I was having problems with pushing it up too. I tried polishing the ends, that worked ok. But what really did it was white lithium grease. I use it for specific applications with my firearms, mainly on slides for 1911's. That is metal on metal sliding, very similar to what the Ultra does. So I polished and then applied the white lithium grease to the ends of the battery sleeve. It's like butter now. I mean, the difference is unreal. You can
buy white lithium grease at any auto parts store. I bought mine at my hometown NAPA. It's very viscous, so it won't run - it stays where you put it. Very cheap. It's great for a lot of things, now that I think about it. I was seriously considering one of the end activation sleeves, but this solved all my problems.
Edit: I have notoriously sweaty hands. (Just ask my girlfriend.) This solved my problem though. It wasn't that my hands were too sweaty...it was that there was simply too much friction between the metal.