I too would remove the pan. A new, OE oil filter would be part of this process.

As already suggested, carefully check the belt alignment and the condition of the tensioner and any idler pulleys. Login to read more.