How deep is the patch? also, I sometimes wet the area to be patched , so the filler will wick into the wood better, and bond a bit better. NOT WET WET BUT DAMP Are you sure the filler is completly dry? It's important for it to be dry before sanding.