I trim at my normal cruising speed.
If I change speed or do a maneuver
I know I will be returning to cruising speed.
Once a plane is set up I try and leave it alone.
Constant trimming takes time and you are apt
to be trimming for some anomaly that may not
re-occur.
Do what ever you are comfortable with.
Good Luck,
KW_Counter