You don't have to super glue anything, as long as the clasp isn't broken. My car came with the E-brake cover loose, so I had to pop it back on myself.
If you take it off completely, you'll see the clasp part of the cover that I'm talking about. That hooks in to a piece on the e-brake. Basically just slide the cover up a bit and then slam it down onto the e-brake with a bit of force. The clasp will pop back over the edge on the e-brake and secure it. Don't be overzealous and break the thing, but when I did it, I had to give it a pretty good push to get it to click into place.