I agree. Your CG should be at 6.0" back to make it hover better. You'll still need to add some down elevator as the PBF gets vertical, but not as much as with your current CG. And even then, a PBF is difficult to maintain a vertical hover.

If you want a more stable plane for true vertical hovering, try a QHOR, or a PQHOR.