It's really one those areas where you just have to do what makes you comfortable with your choice. Like, well, everything.
Personally, I enjoy a sneaky little nic buzz better than going without. Helps my thought processes and my mood. I don't enjoy the bad vibes of people who disapprove and...