Its doing both.
I have seen Joe fly and I know he can control a plane in a hover as good as anyone out there.
But, even though his shirt isnt moving much (breeze) there isnt enough pitch changing in that TR to make it drift like that.
I think its a combination of his thumbs and whatever small breeze there is.