3.7v Nominal. 4.2ish volts fresh off the charger. After about 80% of the charge is exhausted, the voltage will drop quickly and dramatically below 3.7v until it hits the low-voltage cutoff.
The cell is said to be a "3.7v cell" because that is its nominal voltage.