Don't overlook the rear, maybe the u-bolts are not tight. Could be a issue with the leaf springs, mounts or shackles.

Will it only pull under load?

If you let it coast with the trailer will it still pull, or not as bad?

I guess I would look for signs of ... Login to read more.