RMS relates to AC as in Root mean square. The voltage is DC is it not. I may be wrong but I was and Electronic Tech. I use a Fluke 115 but that is just my best meter.To measure voltage on any device using PWM you need a Digital Multimeter that measures True RMS. These are generally not cheep if you serious i suggest getting a quality meter I suggest Fluke meters as that is what i have used for years as a electrician .
I just tested my ego twist batterys and got a low of 3.23v and a high of 4.94v.