I don't think non-smokers can ever realize what we've been through to get where we are now. My husband smoked for 40 years and had been harassed relentlessly by co-workers, family, friends, etc. He's still put out that the most he got from those people was a "that's nice" when he switched, and his friends that are still smoking are just waiting for him to start again. His converts think he's a hero, so that makes up for everyone else.
Maybe the smell does bother some people, but to me it's like someone chewing gum or drinking coffee. Without getting all psychological, its possible, when one half of a couple complains about something like this, it's really about the attention given to whatever it is - maybe she's jealous of you wanting time to relax and vape?
I think if it were me, I would announce that I was buying a TV and a recliner for the lanai with the money I was saving from not buying cigarettes (not that I have actually saved any money!).