You know, I thought exactly like you when I started out. I was convinced it HAD to look like a stinkie. I had 4 78mm volts and a 1300 X2 for home use only. But I loved the X2 so much, I ordered 2 more in the 650 size. In fact, I loved those so much, the 78's got neglected.
One time I went grocery shopping and to run some other errands with the car. I just grabbed one of the smaller X2s with a clearo attached when I went out the door. I thought, I'll just see what other people's reactions will be. You know what? No one paid any attention. I even took a few minutes to vape around the outside smoking area of the stores, actually hoping to get a reaction. Most people ignored me. The ones who did pay some attention to what I was doing just looked away or nodded with a smile. And this is in Cincinnati, where I have never seen another soul who was vaping.
Since then I have gotten larger APV's, topped with juice tanks, and vaped them at numerous public events like festivals, outdoor concerts, where ever I go. I mean, I vape a freaking huge Silver Bullet out in public. Hardly anyone pays attention, and I no longer even attempt to hide what I am doing when I vape in public. Now, I am discreet. Even though I believe that vaping should not be considered the same as smoking, I abide by whatever non-smoking laws there are for public places.
So my advice is do what is comfortable for you and abide with the laws to avoid issues with the legal system. But should you get a wild hair, you likely don't need to be paranoid that people will consider what you are doing is drugs or something illegal. No one really gives a rat's