Sorry about your experience vantagebox, I know how frustrating it must be to think you had a good kit and then everything go to crap.
I am not sure how much you know, so if anything I say either goes over your head or seems patronizing, I am sorry - please reply and I'll either shut up, or clarify

This is going to be long, so again, ignore or read, it's up to you but I will try to explain exactly what is going on and what you might want to do to move forward.
So the batteries, there is not a lot wrong with them and they will be fine to use with other stuff - you didn't waste your money.
The 2 CE4's that you mentioned, try soaking them in high proof alcohol for a few hours and give them a good rinse in hot (as hot as you can stand) water. Then, shake all the water out of them and try again. Don't fill them all the way up with juice just in case they don't work, but put about half a tankful in so you get those wicks nice and wet with juice. You might be able to get a few more vapes from them while you get something else.
About that something else, the CE4's are a disposable clearomizer - ego threaded. For reference, anything 510 or ego threaded will work with your battery. That's pretty miuch all you have to remember.
Unfortunately, you will have to buy a new head / topper / clearo / delivery device (all four terms are used interchangeably) as it seems that your CE4's are ready to be disposed. If you want, you can just buy a new CE4 and keep going through that cycle - that's fine, some people hanging around on these forums still use them after a long time vaping and are fine with it.
If not, you'll need to try a different topper - some have already mentioned the EVOD and it is a great clearo(mizer), the only problem is that there are a bunch of different ones to try (EVOD, CE4, CE5, vivi nova, Kanger protank, cartotanks, 510 attys etc. etc.) and all give a different experience. If I had to recommend any, it would be the EVOD, simply because it is a great little clearo - you should be able to get one at your local B&M. And here is the kicker, you will also need to get some replacement heads / coils for it too - get 3 or 4. Rinse your clearo after every 3/4 tanks of juice under hot water and they should last a good few days, maybe even a week or more. If it starts tasting burnt, replace the head / coil and refill and you are off and running again.
OK enough, sorry for the wall of text but there wasn't a three line answer I could give. This is more like an essay...
Stick with it, it will get easier and better, and you are here among people who have gone through what you are going through.