Whats the secret to sanding primer, and not having your sandpaper load up every 10 seconds?

When doing a glass fuse I've always wet sanded, but with a balsa fuse I've been sanding dry, I'm going thru sandpaper like mad. There must be some trick I'm missing, what is it?

Jeff