aaaaaaHHH!!! That makes sense! If it stayed attached but the hinges gave...yep...you were doomed...
The reason I brought this up is because I've flown some pretty banged up combat planes that have lost ailerons in mid-airs...and have been shocked to see the plane continue flying just fine!