No your not missing a thing - the outer joint is next to impossible to remove from the shaft. Generally, you end up damaging the inner cone as you try to drive it off. Disassemble the inner, and go from that direction, as most have said. Login to read more.