Flying in the pattern refers to circling the field in the same general direction and is common when multiple planes are in the air at the same time. (you will see this at fun fly's and large clubs) It helps eliminate confusion and possible midair collisions.
If you are the only one in the air it really don't matter what direction you fly.