The water pump circulates coolant that removes heat from the engine and releases it into the air despite the name. Yes, your water pump will continue to leak even when the engine is off. That will happen for several reasons like torn hoses, worn-out gaskets, and a leaking radiator or radiator cap.