... I basically find they've lost a lot of their "oomph" by the time they get to about 3.7-3.8v unloaded voltage.
That's probably because at 3.7V, the cell is only at about 20% state of charge
3.5V is basically dead, anything below that is dead, from 3.5V to 4.2V open circuit voltage there is a pretty steady correlation from 0 to 100% state of charge.
But WHY would a cell be "dead" if it's still reading over 80% of the voltage that it starts out at? (rhetorical question, read on!)
Think of it like a water tower up in the air. The water pressure at a valve at the base of the water tower is effected by both the elevation of the tower and how full the tank is. The tank can be empty, but the small amount of water in the pipe leading up to the tank is still full and producing nearly as much water pressure as there would be if the tank were full, however, as soon as you turn on the valve, the pipe drains out and there is nothing left. This is similar to what happens at 3.5V on a typical LiCo cell.