Well thats what may have happened....I didn't rinse.I will give it another go...Make sure to rinse the blue foam out real well before using it.
Otherwise some people report a little bit of a funny taste.
But no, it definitely should not take away any flavor.