Ive had the same problem with the caps coming off. Nothing you can do as far I know. I believe there plastic, dont think it hurts to leave them in the cylinder? Login to read more.