spaceballsrules has a good picture explanation. For people who relate better to explanations...
The charger part is the smart or active part. It decides how much current to draw from the power supply, and how much current to put into the battery (how fast to charge it). The battery and power supply are "dumb" devices that don't make decisions. These simple chargers are designed to deliver a fixed amount of current, which is good for a specific size of battery. Use the same charger on a smaller battery and you'll be giving it too much current, charge it too quickly, heat it up, and maybe break or explode it. Going the other way, if you use a charger designed for a small battery on a larger battery, it won't overheat, but it might take a longer time to charge. So you want to use a charger designed for the battery you;re charging, but you can probably use it on a larger battery because a larger battery won't overheat.
Power supplies are rated based on the maximum amount of current they can deliver. Since the charger is the active device, it decides how much current to pull out of the power supply. The power supply needs to be able to deliver at least as much current as the charger wants, or the charger won't work properly. If you use a power supply that can deliver a lot more current, the charger simply won't use it. You also hav to make sure the voltage and polarity are right for the charger.
For a power supply that has a USB fitting that accepts a charger with a USB connector, you should be good because USB has a standard for wiring the voltages--as long as the power supply can deliver at least as much current as the charger wants. (OTOH, it is possible that some company wires them wrong, and these should be called out somewhere on the forum.) There's no such standard for the
batteries, so I wouldn't use a charger for a different battery than it was meant for, even if they fit.
If you have more than one charger, I suggest you label them. I fold a paper label over the wire and cover it in scotch tape.
I threw away a USB power supply that delivers 200mA maximum (meant for a kr808), and only use the ones that can deliver 500mA. All of mine are now 500mA. This way, I'll never get mixed up. The kr808 charger only needs 200mA, but it will work fine with these "larger" power supplies.