Yup, nothing to hurt. I clean all my RBAs with an alcohol bath and/or ultrasonic cleaner w/ distilled water/alcohol mix (not required but that's what I use if I'm leaving the wick in). If you're going to leave the wick in, be sure to let it fully dry if using alcohol.