Rusty,

disconnect the EGR vacum hose at the EGR valve and see if you can replicate the problem. I've had a few Camrys do just what you're describing and it was caused by an EGR pintle getting stuck open. No command (vacum or other wise) just staying open aft... Login to read more.