"Very apparent when it does it like if someone turned the key off for half a second then right back on."

Maybe you do have an intermittent problem with the ignition switch. Set up a meter with MIN/MAX across the switch and drive it. Login to read more.