I used to launch "match" rockets as well.
Take a match (I used paper matches, but wood ones *should* work), and about a 1.5" x 1" piece of aluminum foil. Place the match-head in about the middle of the foil, with a little bit more foil towards the stick, and wrap the foil around the match tightly, then fold the "tail" around. Basically you want the matchhead wrapped in foil without leaks. Then pierce the foil on the very end with a pin or needle, and slightly wiggle it around to make the hole a little larger, this makes the exhaust vent. Place the "rocket" on a piece of wood or something to guide it, with the head hanging off the edge, then light it with a candle or another match. (very small) Whoosh. Lol.

Might be a little too small and imprecise and dunno if they launch very well at an angle (too much foil makes the too heavy too), but pretty simple to make and try. Could make a nice calliope of rockets too, just need a decent ignition system.

One neat thing about the 5 cent sugar rockets was that the were ignited by filling the hollow core with loose black powder, then capping the end with a dab of power and water. So, you could probably stick them down a barrel with a very hot glow plug or small butane lighter as the ignition source...no wires or electronic igniters. The only issue would be the rocket motors fouling the ignition system.

D.