DaveP, the trouble you're describing is exactly the same issue both me and my Dad had with the Segelei. I wouldn't get a hit, and I'd look down and I'd be in the menu. It got to the point that in order to get it to work right, I had to squash the button down hard until after a while my index finger started getting sore and I had to switch over to my thumb. That was when I decided to buy a Vamo V3 as a backup so I could see if I could fix the Segelei V3. In a prior post, I describe how I removed the old switch and replaced it with a sealed switch that boasts a 1,000,000 button-press life span. I fixed both mine and my Dad's.
With the old switch removed from my PV, I put a meter across it and verified that the switch was intermittent. Then I took it apart. It's of the type that has a convex metal disk, shaped like a contact lens. When you press the button, the "lens" distorts downward and makes contact in the center of the convex side and also gives you that "clicky" feel (reminds me of those toy "cricket" party favors). Using a magnifying glass, I saw that in the center of the lens there was a bit of wear (almost looked like corrosion) that appeared to be little pock marks in the metal. On a whim, I cleaned that area with alcohol and a cotton swap, and put the switch back together temporarily. Putting the switch back on the meter, it seemed to be working again, but that's probably because the disk was rotated from it's original position and was mating better with the center contact. Not sure how long it would have lasted if I had glued it back together again and tried to re-use it. I had a replacement and didn't want that crappy switch back in there regardless. The original switch started to go bad after only 2 or 3 months and I didn't abuse the switch in any way that I'm aware of (besides squashing it down just to get it to work).
If you go back to my original thread
here, you can see a pic of the original switch and the 4 small back nubs I had to cut off with an exacto knife in order to remove the top of the switch and expose the guts. If you're interested, that post also has the part number for the replacement switch that I used successfully. I've been using my Segelei for almost 2 months since I did that, and the switch is still working like the day I replaced it. I'm hopeful it will last for quite a while yet since it is obvious to me that the new switch is of much better quality.