RE: What would you do?
If at a good altitude I would straighten out and do a quick look across the sky. When low to the ground, I would probably react similar to you. I make a habit of keeping track of other planes (as much as possible) so that I at least would know I am in the clear. It is also a good idea to fly with a spotter, who would tell you if you need to move out of the way. If it is a plane coming into the pits, luck or divine intervention can go along way, but having a spotter will decrease the odds of injury.