I use a 12 inch "bast*rd" file to do this kind of work (that is the real name for it). I even use it on leading edges and trailing edges. Just don't push hard and it works smooth and fast.
When you get it close to what you want, start using sandpaper.
Been doing it that way for years.
If you should cut too deep, fill with spackling compound, then sand.
Ron