Lead contaminated water can cause serious health problems like nerve, liver, and kidney damage especially in small children or fetuses. While it is unlikely that you would need to replace the entire plumbing system, you may need to invest in a water purification system to filter the lead out of your drinking water.