gserve,
The second ground rod MAY help with grounding the system but, the code requires the premises' water system to be bonded also.
It is a matter of safety also.
NEC 2002 250.104 Bonding of Piping Systems and Exposed Structural Steel.
(A) Metal Water Piping. The metal water piping system shall be bonded as required in (1), (2), (3), or (4) of this section. The bonding jumper(s) shall be installed in accordance with 250.64(A), (B), and (E). The points of attachment of the bonding jumper(s) shall be accessible.
(1) General. Metal water piping system(s) installed in or attached to a building or structure shall be bonded to the service equipment enclosure, the grounded conductor at the service, the grounding electrode conductor where of sufficient size, or to the one or more grounding electrodes used. The bonding jumper(s) shall be sized in accordance with Table 250.66 except as permitted in 250.104(A)(2) and (A)(3).
Hope this helps!
Dave
