This might be obvious but I had the same problem once. The right wheel turned freely unloaded, but the hole was slightly elongated so it would bind when under load causing the unwanted ground loop.