To date, no one has found anything in the vapor to be harmful. What you exhale is mostly PG or VG, Water Vapor and a minute amount of nicotine (probably less than they'd get eating an eggplant) PG has been widely used in public settings. It can be irritating to some people, but acts as an anti-microbial. You're actually cleaning the air lol. My daughter has asthma and my vapor never bothers her even sitting next to me on the couch. Some liquids have an odor which may or may not be detected by people in close proximity.
Overall the vapor dissipates so quickly that you'd have to
vape like a chimney to fog the air up enough to even be noticed, so I wouldn't worry about it. Most of the stories of people complaining about the vapor, were people who were so against smoking that they "imagine" the vapor is harmful.
If it bothers your family, you might just need to move to another room while you vape, but from what we know about the vapor, it's not harmful.