Its possible. If its the same as most usb chargers it has a little 200 mah charging circuit board in it. Basically take it out, connect up the positive and negative, good to go.
But you need to make sure it doesnt overcharge, some rely on the battery protection circuit, which is a no go, things can go boom.
There are tutorials and questions for usb charging all around the forum, search for em.