That's a hobby charger... you can easily charge your
batteries with it as long as it supports charging 4.2v batteries, which it looks like it does.
Here's a very good writeup/walkthrough..
What is a Hobby Charger
A really nice method, instead of making your own battery cradles, is just get some alligator clips (should've come with some, anyways) and some rare earth magnets... attach one magnet to each clip that's connected to the charger... then simply attach the ends via the magnets to the positive and negative ends of the batteries you want to charge.. then you simply tell the charger you want to charge Lithium batteries, then tell it current and how many etc
If you have an old/cheap charger, you could get it and just use the contacts to charge batteries with it... the old DSD charger was actually really popular for this.. Cool thing about that hobby charger is you can probably charge a TON of batteries at once in a series/parallel and you can supply the current needed to charge them FAST.. and you can have it balance them.... i've been debating on buying one and building fancy battery cradles

haha.. you can score a turnigy accucel-6 at hobbyking for $23