I think what dion meant, was that one set of controls will be backwards, depending on your positioning, and that it is more difficult because the weight on top of the thrust always wants to pull the plane out of the hover, whereas in a normal hover, the weight always helps keep it in a hover being below the thrust...
The problem is that the airflow over the controls is a fraction of that of a normal hover/flight, but there is some, making it possible

But I also think the weighted control surfaces might work, but hinder the balance/wingloading of the plane... There's only one way to find out
*gets ready to order the new vpp from HL*