I can kind of understand that line of thinking....
However I do believe that if you battery is operating normally, not overheating or cutting out it should be just fine to place on your V4L recharger. Although just to be safe I would check on it periodically just in case. Or as you would probably like to do, simply set it aside or dispose of it if that would make you feel more comfortable.
The thing about electrical items or batteries in general is that if there is a problem, it's always a problem. So if your battery had a short, it would not operate at all, let alone normally. More than likely there was an issue between the non-V4L charger connector and your battery connector which caused your recharger to heat up. That heat was being conducted through the battery housing and had nothing to do with the actual battery inside the housing itself.
Best of luck in whatever you decide to do.....