Yeah I personally feel that if it really does upset someone enough to actually ask me to vape away from them or complain then I don't mind moving to be honest, anything I could say to put their mind at ease would fall on deaf ears as most wouldn't want to listen to any 'excuses' and that's exactly what they automatically would think I would be giving them.
Perhaps in time people will understand the difference between smoking and vaping and this type of thing would rarely happen...for the time being it's not a problem for me to just vape away from them entirely.