I'm glad you asked the question, and it's great you are being safe. Perhaps you want to designate an area in the house (if you have one available) that doesn't contain any baby items. Having poison control available is always nice to have on hand, I called them once when my toddler accidentally found an advil that had been dropped by my stepfather and he ate it. I figured he'd be fine, but I still called poison control to check (better safe than sorry).
I am thinking that if your baby were to have any problems, they'd have manifested themselves long before now. I really do, nic poisoning normally happens fairly rapidly, but the likelihood of that happening is fairly low with the scenario you are describing. If you washed it thoroughly, no need to get rid of the pacifier at this point.
As to second hand vape, there really hasn't been a lot of reliable information on that. I'd be not vaping around my kiddo, mainly for modeling rather than the vape itself. With that being said, while I never smoked in the house, I did smoke in the car with my kiddo around, and I still feel guilty about that. He grew up, smoked briefly, then vaped a year or so, then quit, so I'm glad he was able to QUIT before I even started vaping.
Good luck with vaping and with your little one!
Anna