The RMS = .707 x peak only holds for sine waves.

In this case you are probably not getting a sine wave but just some very sharp spikes. This would explain why your meters are showing .3 to .6v ripple whereas a 10v amplitude sine wave would show up as 7.07v o... Login to read more.