I have a magnetic charger on order (from FT) for my (few) setups that need it and also for my cellphone whose USB port is starting to get funky (I've had it 4 years). There are several good reasons not to charge via USB, for me the biggest one is convenience. I hate waiting for things to charge on a USB charger when I can just swap out batteries. The safety reasons have been covered, and they are equally valid and I'm glad I use an external charger for most things. I don't like the idea of killing one of my favorite mods via continual USB charge either.
A decent charger and an extra set of batteries can be purchased fairly easily. Even if you "can" USB charge while you aren't vaping, there is just overall wear and tear on the mod, and yes, if your battery decides to have an unhappy moment, you could damage your gear certainly, in a way that can be a bit irretrievable.
I try to follow safest battery practice and I'm not saying that USB charging is the MOST dangerous practice ever, but there are some significant downsides that just aren't worth it to me when I can avoid it.
Best of luck,
Anna