Yes, I do remove the check valve for refuels. I also disconnect the carb line if there is a long wait between rounds to prevent flooding. Generally, that is being overly cautious.
Much neater and better fuel economy this way. When practicing lots of inverted maneuvers I would land with raw fuel on the wing.