I've tried charging and discharging these bats a couple times and have not had a repeat of the voltages I saw on the first charge, so I'm chalking this up to them being new batteries and this causing issues. I won't be RMAing the charger since it seems to be working fine now. I am using them now after charging and then letting them sit for a few hours for them to settle down to about 3.3-3.4v . This gives a smooth, but stronger vape than the standard 3.7v bat.
Hopefully no one else has problems like this, but I just wanted to let other know, that the batteries settle down after a little while.