Here is a link to an article from Red's RC Battery Clinic that discusses using all sorts of wall warts for RC applications.
http://www.hangtimes.com/id36.html

Short answer... It depends on the wall wart. Many put out enough voltage, but, the charge time will be very long because a charger that delivers 50ma to 4 cells will likely deliver 40 or less to 5 cells.