I like whoever said "flight sucks" with brake on the whole time

I just noticed that for the first time this past weekend; I've had brake on since I started flying electric last year, but maybe now I'm getting to know my plane well enough or something.
Other thing to consider is how you use the brake, or how strong the brake is. I've got it set to stop the prop from spinning which now I think is a bad idea. Plane REALLY slows down which is good, sometimes, but doesn't feel right in down lines or when pulling out of them. Going to try a set idle RPM to use as a brake, to keep air moving over surfaces and for less of a "shock" for lack of a better term - when going from measureable RPM to 0 and vice versa.
I am flying intermediate by the way. There aren't any maneuvers with rolls on the down lines, but keeping my down line speed under control I think helps me pace my flight. Very easy for me to use too much throttle and burn up my batteries flying electric.