Of course this will sound strange, but you probably have a worn distributor drive bushing (pressed into the block, holds the distributor/oil pump drive gear in place).

There is a TSB, you can check for slop by removing the distributor cap and checking for pl... Login to read more.