Ensure you have a screen or filter on the incoming water supply to prevent debris from entering the pump.
Was the material in the valve in a discharge valve, and did it look like a piece of plastic/rubber? If so it could be a piece of the packings/seals.
It's probably worth changing all...