I don't know if it's safe or not, but why chance it? Vaping glue, dye and whatever else comprises the label and how it's stuck on the carto just doesn't sound like the best option if it can be avoided - and it can.
I'd go with removing the labels and glue on the ones you have and going with the stainless steel version on your next purchase, if possible.