They are there to prevent the caliper from rattling over bumps. The caliper must move freely on the pins. This could cause it to rattle on the pins. By putting the rubber bushing on one pin it prevents this. Login to read more.