You need to activate the air flow switch to check for voltage on an auto battery. Some folks claim that if you put the LED end of the battery in your mouth and blow into the battery the LED lights up, meaning the batt is activated. (I havent had an auto batt in a long time)
And yes, connect the meter exactly the way you described.