I had 1 or 2 of the nuts on the door come off when I was used some force getting the bolt out. I replaced the nuts with 1/4-20 cage nuts from the hardware store. So if you get forceful with it and that happens, not to worry.
A nut that survived
A cage nut
