Ok, well after trying it for a bit it was better after soaking in vinegar but still had a slight funny taste. So I did what was suggested on hoosier's site for their tanks even though it was different
This worked wonderfully, I can now happily say there is no more weird taste when using this...