I use my small sanding drum for my dremmel moto tool,it makes short work of aluminum.
first making sure to mark exactly the area I want to remove for reference, on both sides of the spinner