I suspect the plug is pushed out by oil. There must be a drain for that cavity. Check to see if it is restricted. You can also fabricate a holder, similar to the one Honda came up with for I believe the balance shaft seals on older cars. Login to read more.