A model is more sensitive to rudder input the slower it flys.  The center of gravity balance point also tends to make a model more touchy to rudder as the balance is moved back.  However, with your C182, it sounds like it may be rather underpowered, slightly tail heavy and perhaps too much rudder.</p>