Safety certainly dictates using an external charger, which I do in most cases. The only time I use USB (on any mod) is when I'm sitting right in front of it, watching it, and checking it regularly for temperature while I'm using the computer or something, and this is a rare occasion that I don't have batteries.
If you're worried about being portable with your batteries, some of the companies like Nitecore, EFEST, Golisi and such make portable two battery chargers. Nitecore actually has one that uses USB to power it but understand that Nitecore builds the protections to make sure your batteries charge properly, this should be a safe method of charging:
UM2. That one is less than $20.
This is maybe boring informational stuff? Read on if you'd like. I get wordy sometimes... I'm also human and make mistakes, I always encourage people to do a little research on their own if it's something they're interested in.
USB is a varying method because each USB port on your computer can only support so many amps and only so much voltage. It's likely that your computer's power save options could reduce voltage and cause a current drop which may not be good for your battery. Understand to, that on a computer sets of USB ports share the same "Bus" or transport mechanism for data and power, and share current, so if you have an external hard drive plugged into one group of USB ports it will pull more current than say a wireless mouse transmitter. That external drive with it's increased current requirement will also restrict the current and voltage available to the other ports because they all share the same bus. These days this it is less likely due to design changes in the computer world. Some may recall a time a few years back that if you plugged in too many USB devices, one was inevitably going to stop working. Or even one device may not work on the front ports of the computer but it does on the back side ports.
Typically there are two USB buses on most OEM PCs (Dell,HP,Lenovo,etc). One bus usually services the front USB ports of the computer and another bus services the rear USB ports. More so on custom PC builds and computers designed for gaming or workstations, which have tons of USB buses for ports all over the place. Because of the current limitations of USB, that is why external drive manufacturers usually give you a wall adapter so it doesn't use the USB bus power. This supplemental power also helps the drives spin faster and write/read data faster. Win-Win I guess...
External USB chargers (wall plugs) are all rated at different current ratings as well, some may try to recharge the battery faster than it's design, and cause battery failure. This was rampant in the cell phone world where Samsung started releasing "quick chargers" which basically use 2+ amps to charger the phones faster, BUT people were using their quick chargers with phones that didn't support quick charging. The batteries in those phones wanted 1amp, so you charge a battery at double the current, failure is going to occur. In today's world most phones support quick charging, but you should always check what the manufacturer of the phone recommends for input current while charging. Especially with the cost of phones these days...