I have had several that wiggle around a bit. If it is the whole board, then there is nothing to worry about. I called Bob Wilcox on this years ago. As other have said they usually put a spacer in there to take up the extra room. Bob told me to ignore it (as it wont do any harm) or open it up and put a shim in there. Now if the connector is the only thing moving instead of the whole board, then you have a different issue. I doubt that is the case. Call Bob, he will most likely give you the OK to open it up and see for yourself.
Dom