I think what it is is the magnets from the motor that I'm feeling. I've always felt that with my rc car motors but just got into planes and the motor wasn't broken in yet I guess. I'm pretty sure the prop is spinning straight.

Anyway, thanks for the tips guys, I really appreciate it.