You've hit on the downside - unsoldered contacts might not be good contacts.
In theory the contacts should well with virtually zero resistance, but even a fraction of an ohm will hinder performance. This will not show up by looking at volts off-load; but you will see the voltage drop under load (with atty powered) more than usual if a joint is bad. You could also check the resistance of each join with a meter, set to milli-Ohms.
Perhaps try it with fresh batteries.
Battery connectors are solderless contacts, so they can be good.
Have wondered whether the great performance of my touch-switch based device might be owed to a lower on -resistance; 0.014 ohms (max) is very low.