Yes, that ^^^ battery will work as long as your RC's battery trays/straps allow correct exiting for the battery's wires. Yes, you would need appropriate charger to charge LiPo batteries.

Also, you will need to make sure your ESCs have sort of LVC (low voltage cutoff) LiPo setting to make sure the cells don't discharge too far. There are LiPo alarms that you could use if your ESCs don't have a LiPo setting.