I may be doing it incorrectly, but I sand all of the coats down to the cloth except the last one or two. The primer will fill the pits and low spots and not build up making your plane heavy. Ron