I have always removed the cam as well. It makes it easier to inspect the rockers and lobes while I am in there. I haven't tried any other way but I believe it might be frustrating clearance wise to remove the actuator by itself. Login to read more.