Better way to attach mirrors???

I should probably check to make sure we are allowed to change how the mirrors attach to the FE body but I found that after attaching the side body panel to the car that the roll bar gets in the way of holding onto the two nuts on each side of the mirror mount that hold the bolts in place.

I was thinking of using nutserts inserted into the holes in the fiberglass where the bolts currently go through (after drilling out to the correct size for the nutsert of course) After thinking of this I tried to think of a single open wheeler that I've ever seen at the track that used this method and could not think of a single one. Any reason not to do this?