You should remove the water bottle BEFORE removing the water dish. Otherwise, the leftover water in the bottle may flow out from the center of the fountain base and spill on your floor.