Even with a regulator, you'll have some trouble getting output close to battery voltage (if you want to use those higher voltages). Even low dropout regulators have some dropout which means they can only put out voltage some amount less than input voltage. To obtain those higher voltages, you'd have to add another cell which would probably be an issue for the overall size of the
mod. That's probably why we haven't seen any regulated Pucks (at least I haven't noticed any).
One thing you could do that would work is to add a switch that puts one or two Schottky diodes in-line. That would give you the option to drop voltage in .5V steps.