On the A/C adapter, there should be a sticker. Output: 5v, XXX mA.
It's the XXX mA you have to pay attention to. That tells you the max draw that it can handle. On the charger, there's an Input: 5v, XXX mA that should be LESS than the amount on the A/C adapter.
So basically, make sure they are both 1) Same voltage, and 2) the charger's input (draw) is LESS than the A/C adapters output.