Yes. Positive lead connects to the center of the PV connector, negative to the outside edge. Make sure the switch is rated at least 2 amps.
I strongly recommend you use this with a dedicated USB power supply, again at least 2 amps, not a PC USB port. That's to avoid possible PC damage, whether from just trying to pull more current than the power supply can provide or in case of a short circuit happening.