Pool Noodles. Cut off a 6"-10"section, run a dowel through it crosswise, and tie an anchor and line to the dowel. If you keep the string slightly short, they stand up better.

However, use a heavy anchor, or a wave can pick up the bouy and anchor and cause it to move out of place.

[8D]