Their truly isn't anything to worry about when flying FPV as long as you follow the rules of the AMA. I'm pretty confident that the AMA would battle the FAA on a members behalf, if enforcement action was attempted.

Now, the real worry is to get the FAA to change their wording in part 101 so it doesn't seem damning to the hobbyist. This I'm sure Rich Hanson is working hard on resolving.