I wouldn't recommend using wood filler. Epoxy is a better choice. Wood filler doesn't have much bonding strength, so you'd be relying on the covering or whatever wood was left to hold things together. Depending on how thick the aileron is and how ovaled out the hole is and how you fly, you may or may not have troubles with it later on.