yes, just fill in all the space, when you close and tighten the diff case some glue may leak out. that's ok. I use some of my sons silly putty.

If you use glue just let it dry before you put the diff back the car.