Yep, I feel that shame when vaping in public. Not all the time, and not to the degree that OP is allowing it to fester.
I think that shame is tied to the shaming of smoking / smokers. I think feeling that shame is the ultimate aim of the anti-vaper. I truly do. I don't think it is the fear, danger, uncertainty stuff that makes for most political discussions we have on ECF. The shame is what YOU will carry in, and proceed accordingly. Once you overcome the lies induced from the fear and uncertainty, you are going to proceed to use eCigs in way that makes most sense to you. But the shame aspect can still be prevalent enough to keep you from feeling comfortable enough to use it around others, with others.
I equate that shame feeling to how I feel about public speaking, or other public phobias that may be entirely personal to me, but of which I am certain I'm not the only person on the planet that feels this. If I am one that feels uncomfortable/shameful about public speaking, would a wise person suggest i never speak in public, or that I practice the activity, and take steps to overcome the shame feeling so that I will be able to speak in public? For the little voice in me, that convinces me public speaking is never necessary, no one wants to hear what I have to say, and that something dreadfully could go wrong if I did do this in public, does have its logic at work for how I shall proceed. And as long as I feel that way, then shaming is doing the exact job that it is called upon to do.
What I find truly, most helpful to vaping in public, is to 'vape like you belong there.' Like vaping is welcomed and that you are natural to be vaping there, regardless of the circumstances, the people, the age of those around you. For once you do regard those, there will be naysayers who will paint it as, "you are inconsiderate, you are rude, etc" for daring to vape in that situation. So, perhaps start in places where there isn't many people around, and vape there like you belong there. Practice vaping in public. Start small and simple, and work your way up.
Hopefully you get to the point where the shame is greatly lessened and you are setting example. You are showing everyone that respectful vaping in public is possible and what that looks like. And you are showing smokers that it is possible to enjoy your habit, without shame, in public. And ideally, you get to the point where you are so comfortable, so respectful, so considerate that even when militant anti-vaper approaches you in public, you aren't defensive, nor shameful, nor willing to stop the activity altogether because one person was vocal enough to claim there is a problem. When reality is, there is no problem vaping indoors. Especially when it is done respectfully, and with consideration for others.
Or it is equal problem to breathing in public. Where germs and cooties can come from your breath. And infect the kids.
You don't want to give kids cooties now, do you?