You should go to the hardware store and get an outlet tester. It sounds like hot and neutral may be swapped in your outlet. That will put power on the neutral/ground pin. Login to read more.