I cleaned it and right now it's reading 3.9 without a load and 3.6 with. So hopefully that was the problem. These batteries will be a year old next month so I'm going to order some new ones soon.
That might be it. I just tested out my AW IMR in the pv I'm using and then on the multi-meter. Reading was almost the same.