If you can't unscrew the brass bolt cup (that holds the magnet) from the button, than it's glued.
People have boiled the whole bottom assembly to try to dissolve/soften the glue. People have let it sit in acetone, isopropyl alcohol, and Hoppes #9 solvent gun cleaner, to get rid of the glue...