I don't think you're a jerk!
I always ask the owner/bartender if it's okay to use my E-Cig, before I do, and if they say yes, then I proceed to do so. I have had people come up to me, and ask me if I was smoking, and of course I say no, then I proceed to show them my E-Cig, taking it apart, and...