Anytime anything is smoking, stop using the device immediately! You don't want to risk a catastrophic battery failure. Remove the batteries and let it cool off for a while. Then check for loose wires, short circuits, etc.
I've never heard of that happening, but I'm new here. What regulator...