You could have a small leak somewhere in the cac system. Under full throttle and load the turbo is able to overcome such a leak but not so at intermediate speeds.

You're sure the egr valve is not stuck open a little?

Checked the up-pipes and manifold gaske... Login to read more.