I fly both and enjoy both. My last heli was a Raptor 50 and I flew the snot out of it for 2-3 years.

You can learn a lot about flying helis in FORWARD FLIGHT from flying fixed wing but hovering and transition you need a heli to learn on. Sims are great but the real thing has a little extra edge to it.