Should be okay. The charger will just go to its current limit which it's designed to do. The battery doesn't care one way or the other. It will just pick up the slack for the current demand. Of course, that's assuming you are using something designed to charge a 3.7V Li-Ion battery.