Definitely noticed the oversized 510 screw head on a buddy's KFL, which even when aligned perfectly straight, made me worry. So I gave him a handful of sandpaper and told him that if the thing ever started shorting out on him to go ahead and shrink that sucker's diameter. Would take a while, but worth it unless you get a spare from some other clone that is smaller. You could also try shoving a tiny o-ring around the 510 screw head -- this was a good temporary fix for the infamous Fogger shorting fiasco.
I would guess however, that you are a victim of an ever-so-slight machine misalignment. It could either be the center pin itself or the positive terminal block. Either way, a decent replacement of one or both of those parts should forever solve your problem.
As for the rough-on-the-inside center hole, you could wrap a small piece of high grit wet sandpaper around a screw driver and ream it out, or scrape every surface in there that you can with the end of a tiny flat head screwdriver.