Please read their definition of "aircraft". As such, irrespective of falling under Part 91 or not, the FAA has authority over that operation.
Yes their definition of aircraft applies to us, but no part 91 does not. Yes they have authority per part 77. That is why they have not regulated us, we fly mostly in non navigable airspace.