I agree that excessive offset will cause some pain, but a few mm one way or another will probably not.

Far more bearings fail from getting crashed into the curb repeatedly while attempting to park than all other causes I would think. Login to read more.