I have found in the past the problem is not a big enough hammer, not sure what you are using, I would possible have one person holding the drift with vice grips and get a 3 or 4 pound hammer and give it a solid whack. It should move, hopefully it isn't a taper... Login to read more.