I actually just wiggled the post out and it looks to be a press fit. Is there any sort of conductive adhesive I could use? Or could I solder it. If that's even safe?
Chances are, you don't need a conductive adhesive (although several exist)... and solder would require a good deal of heat in the base, which would require you remove the positive insulation.
All you need to do is distort (displace metal) the post with a punch (and if you're feeling aggressive, the post hole too), and press it back in, preferably using a vise or a drill press. The 'new' interference fit should be more than adequate. Don't forget to align it correctly. ;-)