I'd have to go along with this. My husband is a non-smoker, non-vaper, and he is absolutely THRILLED for me to vape in the house, in the truck, anywhere at all; he says he smells absolutely nothing from the Virginia I vape, though he says he detects the faintest odor from the blueberry muffin I vape, but that it smells slightly like sweet pipe tobacco -- not the *smoke*, just the pipe tobacco itself -- not a bad smell. And he was absolutely choked up if I *smoked* in the truck, even with the windows down, but vaping causes him no problems whatever, even with all windows rolled up.
Also, my mom has COPD and several allergies, and she has ZERO problems with me vaping in her house. At first she joked around about the "smoke" having no smell, but she knows it's really vapor, and now she's accustomed to seeing me using this big honking device and vapor coming out my mouth, and doesn't really react at all.
Unless he has a hitherto-unknown allergy to PG (which seems unlikely since that stuff is in EVERYTHING), then he's just being a fussy-pants and finding a reason to criticize you and complain, or get you to go into another room, and if he's so interested in you being somewhere other than with him, then perhaps it really is time for a husband upgrade.

Try that, sitting a different room from him all the time, and see if he complains about that, and if so, just kindly explain that you don't want to bother him with your vaping, so you'll sit in a different room from him -- and see what he has to say about that.
Andria