I will be honest with you first of all, i have never pulled a 510 connector out of it's casing.
I have pulled many 801, 901, 401 and 808's, if this applies to all the same, the connector is both glued and press fit into the casing, so, you need to first heat the casing a bit around the area of...