Table 1.
Ordinary least-squared equations for determining the most probable deviation[Fs, regression estimate of F-pseudosigma; DIS, dissolved; mg/L, milligrams per liter; MPV, Most Probable Value; COL, colorimetric; LIS, low ionic strength; ASF, micro-Kjeldahl digestion, automated segmented flow, colorimetric; USEPA, U.S. Environmental Protection Agency; WWR, whole-water recoverable; TITR, electrometric titration; ICP-AES, inductively coupled plasma-atomic emission spectrometry; mg/L, micrograms per liter; ICP-MS, inductively coupled plasma-mass spectrometry; DCP-AES, direct current plasma-atomic emission spectrometry; HG-AAS, hydride generation-atomic absorption spectrophotometry; F-AAS, flame-atomic absorption spectrophotometry; GF-AAS, graphite furnace-atomic absorption spectrophotometry; IC, ion chromatography; GRAV, gravimetric; ISE, ion-selective electrode; ICP-AES/T, inductively coupled plasma-atomic emission spectrometry, trace; CV-AAS, cold vapor-atomic absorption spectrophotometry; ELEC, electrometric; mS/cm, microsiemens per centimeter at 25o Celsius]
Constituent and method of analysis |
Concentration range |
Units |
Equation to determine F s |
Number of Samples |
p-value |
NUTRIENT CONSTITUENTS |
|||||
Ammonia as nitrogen (DIS) |
0.024 - 3.62 |
mg/L |
F s = 0.077(MPV) + 0.016 |
26 |
0.0001 |
Ammonia as nitrogen (DIS, COL) |
0.024 - 3.62 |
mg/L |
F s = 0.077(MPV) + 0.016 |
26 |
0.0001 |
Ammonia as nitrogen (DIS, COL, LIS) |
0.024 - 3.62 |
mg/L |
F s = 0.077(MPV) + 0.016 |
26 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (DIS) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (DIS, ASF) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (DIS, USEPA) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (WWR) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (WWR, ASF) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Ammonia plus organic nitrogen as nitrogen (WWR, USEPA) |
0.118 - 3.78 |
mg/L |
F s = 0.100(MPV) + 0.083 |
27 |
0.0001 |
Nitrate plus nitrite as nitrogen (DIS) |
0.11 - 1.93 |
mg/L |
F s = 0.039(MPV) + 0.015 |
21 |
0.0001 |
Nitrate plus nitrite as nitrogen (DIS, COL) |
0.11 - 1.93 |
mg/L |
F s = 0.039(MPV) + 0.015 |
21 |
0.0001 |
Nitrate plus nitrite as nitrogen (DIS, COL, LIS) |
0.11 - 1.93 |
mg/L |
F s = 0.039(MPV) + 0.015 |
21 |
0.0001 |
Nitrate plus nitrite as nitrogen (DIS, USEPA) |
0.11 - 1.93 |
mg/L |
F s = 0.039(MPV) + 0.015 |
21 |
0.0001 |
Orthophosphate as phosphorous (DIS) |
0.052 - 1.59 |
mg/L |
F s = 0.059(MPV) + 0.006 |
26 |
0.0001 |
Orthophosphate as phosphorous (DIS, COL) |
0.052 - 1.59 |
mg/L |
F s = 0.059(MPV) + 0.006 |
26 |
0.0001 |
Orthophosphate as phosphorous (DIS, COL, LIS) |
0.052 - 1.59 |
mg/L |
F s = 0.059(MPV) + 0.006 |
26 |
0.0001 |
Phosphorus (DIS) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
Phosphorus (DIS, ASF) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
Phosphorus (DIS, USEPA) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
Phosphorus (WWR) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
Phosphorus (WWR, ASF) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
Phosphorus (WWR, USEPA) |
0.060 - 1.70 |
mg/L |
F s = 0.048(MPV) + 0.007 |
27 |
0.0001 |
INORGANIC CONSTITUENTS |
|||||
Alkalinity (WWR, TITR) |
27.0 - 234 |
mg/L |
F s = 0.019(MPV) + 1.002 |
13 |
0.0001 |
Aluminum (DIS, ICP-AES) |
10.0 - 317 |
m g/L |
F s = 0.091(MPV) + 8.773 |
17 |
0.0006 |
Aluminum (DIS, ICP-MS) |
10.0 - 317 |
m g/L |
F s = 0.091(MPV) + 8.773 |
17 |
0.0006 |
Aluminum (WWR, DCP-AES) |
10.0 - 317 |
m g/L |
F s = 0.091(MPV) + 8.773 |
17 |
0.0006 |
Aluminum (WWR, ICP-AES) |
10.0 - 317 |
m g/L |
F s = 0.091(MPV) + 8.773 |
17 |
0.0006 |
Antimony (DIS, HG-AAS) |
0.55 - 245 |
m g/L |
F s = 0.165(MPV) - 0.251 |
16 |
0.0001 |
Antimony (DIS, ICP-MS) |
0.55 - 245 |
m g/L |
F s = 0.165(MPV) - 0.251 |
16 |
0.0001 |
Arsenic (DIS, HG-AAS) |
0.55 – 81.5 |
m g/L |
F s = 0.077(MPV) + 0.642 |
17 |
0.0001 |
Arsenic (WWR, GF-AAS) |
0.55 – 81.5 |
m g/L |
F s = 0.077(MPV) + 0.642 |
17 |
0.0001 |
Arsenic (WWR, GF-AAS, USEPA) |
0.55 – 81.5 |
m g/L |
F s = 0.077(MPV) + 0.642 |
17 |
0.0001 |
Arsenic (WWR, HG-AAS) |
0.55 - 81.5 |
m g/L |
F s = 0.077(MPV) + 0.642 |
17 |
0.0001 |
Barium (DIS, GF-AAS) |
7.65 - 507 |
m g/L |
F s = 0.040(MPV) + 2.021 |
17 |
0.0001 |
Barium (DIS, ICP-AES) |
7.65 - 507 |
m g/L |
F s = 0.040(MPV) + 2.021 |
17 |
0.0001 |
Barium (DIS, ICP-MS) |
7.65 - 507 |
m g/L |
F s = 0.040(MPV) + 2.021 |
17 |
0.0001 |
Barium (WWR, F-AAS) |
7.65 - 507 |
m g/L |
F s = 0.040(MPV) + 2.021 |
17 |
0.0001 |
Barium (WWR, ICP-AES) |
7.65 - 507 |
m g/L |
F s = 0.040(MPV) + 2.021 |
17 |
0.0001 |
Beryllium (DIS, ICP-AES) |
0.12 - 59.0 |
m g/L |
F s = 0.042(MPV) + 0.581 |
17 |
0.0001 |
Beryllium (DIS, ICP-MS) |
0.12 - 59.0 |
m g/L |
F s = 0.042(MPV) + 0.581 |
17 |
0.0001 |
Beryllium (WWR, F-AAS) |
0.12 – 59.0 |
m g/L |
F s = 0.042(MPV) + 0.581 |
17 |
0.0001 |
Beryllium (WWR, ICP-AES) |
0.12 – 59.0 |
m g/L |
F s = 0.042(MPV) + 0.581 |
17 |
0.0001 |
Boron (DIS, ICP-AES) |
0.18 - 297 |
m g/L |
F s = 0.050(MPV) + 9.293 |
31 |
0.0009 |
Cadmium (DIS, GF-AAS) |
0.34 – 50.5 |
m g/L |
F s = 0.061(MPV) + 0.463 |
17 |
0.0001 |
Cadmium (DIS, ICP-AES) |
0.34 – 50.5 |
m g/L |
F s = 0.061(MPV) + 0.463 |
17 |
0.0001 |
Cadmium (DIS, ICP-MS) |
0.34 – 50.5 |
m g/L |
F s = 0.061(MPV) + 0.463 |
17 |
0.0001 |
Cadmium (WWR, GF-AAS) |
0.34 – 50.5 |
m g/L |
F s = 0.061(MPV) + 0.463 |
17 |
0.0001 |
Calcium (DIS, ICP-AES) |
4.60 - 154 |
mg/L |
F s = 0.054(MPV) - 0.089 |
31 |
0.0001 |
Chloride (DIS, IC) |
7.60 - 208 |
mg/L |
F s = 0.031(MPV) + 0.478 |
14 |
0.0001 |
Chloride (DIS, IC, LIS) |
0.14 - 7.79 |
mg/L |
F s = 0.042(MPV) + 0.156 |
12 |
0.0005 |
Chromium (DIS, GF-AAS) |
0.68 – 79.0 |
m g/L |
F s = 0.064(MPV) + 0.857 |
16 |
0.0001 |
Chromium (DIS, ICP-AES) |
0.68 – 79.0 |
m g/L |
F s = 0.064(MPV) + 0.857 |
16 |
0.0001 |
Chromium (DIS, ICP-MS) |
0.68 – 79.0 |
m g/L |
F s = 0.064(MPV) + 0.857 |
16 |
0.0001 |
Chromium (WWR, GF-AAS) |
0.68 – 79.0 |
m g/L |
F s = 0.064(MPV) + 0.857 |
16 |
0.0001 |
Chromium (WWR, ICP-AES) |
0.68 – 79.0 |
m g/L |
F s = 0.064(MPV) + 0.857 |
16 |
0.0001 |
Cobalt (DIS, GF-AAS) |
0.40 – 40.0 |
m g/L |
F s = 0.052(MPV) + 0.850 |
17 |
0.0005 |
Cobalt (DIS, ICP-AES) |
0.40 – 40.0 |
m g/L |
F s = 0.052(MPV) + 0.850 |
17 |
0.0005 |
Cobalt (DIS, ICP-MS) |
0.40 – 40.0 |
m g/L |
F s = 0.052(MPV) + 0.850 |
17 |
0.0005 |
Cobalt (WWR, GF-AAS) |
0.40 – 40.0 |
m g/L |
F s = 0.052(MPV) + 0.850 |
17 |
0.0005 |
Copper (DIS, GF-AAS) |
1.90 – 85.3 |
m g/L |
F s = 0.047(MPV) + 1.309 |
17 |
0.0001 |
Copper (DIS, ICP-AES) |
1.90 – 85.3 |
m g/L |
F s = 0.047(MPV) + 1.309 |
17 |
0.0001 |
Copper (DIS, ICP-MS) |
1.90 – 85.3 |
m g/L |
F s = 0.047(MPV) + 1.309 |
17 |
0.0001 |
Copper (WWR, GF-AAS) |
1.90 – 85.3 |
m g/L |
F s = 0.047(MPV) + 1.309 |
17 |
0.0001 |
Copper (WWR, ICP-AES) |
1.90 – 85.3 |
m g/L |
F s = 0.047(MPV) + 1.309 |
17 |
0.0001 |
Dissolved Solids (WWR, GRAV) |
88.0 - 1309 |
mg/L |
F s = 0.019(MPV) + 7.031 |
13 |
0.0001 |
Fluoride (DIS, IC, LIS) |
0.03 - 0.17 |
mg/L |
F s = 0.133(MPV) + 0.005 |
9 |
0.0861 |
Fluoride (DIS, ISE) |
0.23 - 1.23 |
mg/L |
F s = 0.062(MPV) + 0.012 |
14 |
0.0002 |
Iron (DIS, ICP-AES) |
4.30 - 1175 |
m g/L |
F s = 0.044(MPV) + 5.512 |
17 |
0.0001 |
Iron (WWR, F-AAS) |
4.30 - 1175 |
m g/L |
F s = 0.044(MPV) + 5.512 |
17 |
0.0001 |
Iron (WWR, ICP-AES) |
4.30 - 1175 |
m g/L |
F s = 0.044(MPV) + 5.512 |
17 |
0.0001 |
Iron (WWR, ICP-AES/T) |
4.30 - 1175 |
m g/L |
F s = 0.044(MPV) + 5.512 |
17 |
0.0001 |
Lead (DIS, GF-AAS) |
1.00 - 103 |
m g/L |
F s = 0.062(MPV) + 1.017 |
16 |
0.0001 |
Lead (DIS, ICP-AES) |
1.00 - 103 |
m g/L |
F s = 0.062(MPV) + 1.017 |
16 |
0.0001 |
Lead (DIS, ICP-MS) |
1.00 - 103 |
m g/L |
F s = 0.062(MPV) + 1.017 |
16 |
0.0001 |
Lead (WWR, GF-AAS) |
1.00 - 103 |
m g/L |
F s = 0.062(MPV) + 1.017 |
16 |
0.0001 |
Lithium (DIS, ICP-AES) |
8.70 - 132 |
m g/L |
F s = 0.078(MPV) + 0.844 |
17 |
0.0001 |
Magnesium (DIS, ICP-AES) |
0.78 – 58.4 |
mg/L |
F s = 0.045(MPV) + 0.008 |
31 |
0.0001 |
Magnesium (DIS, ICP-AES, LIS) |
0.020 - 0.71 |
mg/L |
F s = 0.047(MPV) + 0.005 |
11 |
0.0001 |
Manganese (DIS, ICP-AES) |
2.40 - 619 |
m g/L |
F s = 0.066(MPV) - 0.077 |
17 |
0.0001 |
Manganese (DIS, ICP-MS) |
2.40 - 619 |
m g/L |
F s = 0.066(MPV) - 0.077 |
17 |
0.0001 |
Manganese (WWR, F-AAS) |
2.40 - 619 |
m g/L |
F s = 0.066(MPV) - 0.077 |
17 |
0.0001 |
Manganese (WWR, ICP-AES) |
2.40 - 619 |
m g/L |
F s = 0.066(MPV) - 0.077 |
17 |
0.0001 |
Mercury (DIS, CV-AAS) |
0.32 - 7.43 |
m g/L |
F s = 0.111(MPV) + 0.095 |
17 |
0.0001 |
Mercury (WWR, CV-AAS) |
0.32 - 7.43 |
m g/L |
F s = 0.111(MPV) + 0.095 |
17 |
0.0001 |
Molybdenum (DIS, ICP-AES) |
2.10 - 112 |
m g/L |
F s = 0.076(MPV) + 0.882 |
15 |
0.0001 |
Molybdenum (DIS, ICP-MS) |
2.10 - 112 |
m g/L |
F s = 0.076(MPV) + 0.882 |
15 |
0.0001 |
Nickel (DIS, GF-AAS) |
1.70 – 65.6 |
m g/L |
F s = 0.065(MPV) + 1.168 |
16 |
0.0001 |
Nickel (DIS, ICP-AES) |
1.70 – 65.6 |
m g/L |
F s = 0.065(MPV) + 1.168 |
16 |
0.0001 |
Nickel (DIS, ICP-MS) |
1.70 – 65.6 |
m g/L |
F s = 0.065(MPV) + 1.168 |
16 |
0.0001 |
Nickel (WWR, GF-AAS) |
1.70 – 65.6 |
m g/L |
F s = 0.065(MPV) + 1.168 |
16 |
0.0001 |
Nickel (WWR, ICP-AES) |
1.70 – 65.6 |
m g/L |
F s = 0.065(MPV) + 1.168 |
16 |
0.0001 |
Potassium (DIS, F-AAS) |
0.45 – 13.9 |
mg/L |
F s = 0.067(MPV) + 0.034 |
31 |
0.0001 |
Potassium (DIS, F-AAS, LIS) |
0.057 - 0.65 |
mg/L |
F s = 0.072(MPV) + 0.018 |
13 |
0.0132 |
Selenium (DIS, HG-AAS) |
3.30 – 21.4 |
m g/L |
F s = 0.162(MPV) + 0.231 |
15 |
0.0001 |
Selenium (WWR, GF-AAS) |
3.30 – 21.4 |
m g/L |
F s = 0.162(MPV) + 0.231 |
15 |
0.0001 |
Selenium (WWR, GF-AAS, USEPA) |
3.30 – 21.4 |
m g/L |
F s = 0.162(MPV) + 0.231 |
15 |
0.0001 |
Selenium (WWR, HG-AAS) |
3.30 – 21.4 |
m g/L |
F s = 0.162(MPV) + 0.231 |
15 |
0.0001 |
Silica (DIS, COL) |
2.46 – 19.4 |
mg/L |
F s = 0.050(MPV) + 0.077 |
29 |
0.0001 |
Silica (DIS, ICP-AES) |
2.46 – 19.4 |
mg/L |
F s = 0.050(MPV) + 0.077 |
29 |
0.0001 |
Silver (DIS, GF-AAS) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (DIS, GF-AAS, LIS) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (DIS, ICP-AES) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (DIS, ICP-MS) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (WWR, GF-AAS) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (WWR, ICP-AES) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Silver (WWR, ICP-AES/T) |
0.90 – 14.0 |
m g/L |
F s = 0.160(MPV) + 0.184 |
15 |
0.0001 |
Sodium (DIS, F-AAS) |
7.19 - 166 |
mg/L |
F s = 0.034(MPV) + 0.339 |
31 |
0.0001 |
Sodium (DIS, ICP-AES) |
7.19 - 166 |
mg/L |
F s = 0.034(MPV) + 0.339 |
31 |
0.0001 |
Sodium (DIS, ICP-AES, LIS) |
0.117 - 4.40 |
mg/L |
F s = 0.049(MPV) + 0.024 |
12 |
0.0001 |
Specific Conductance (WWR, ELEC, LIS) |
7.00 – 44.1 |
m S/cm |
F s = 0.058(MPV) + 0.35 |
13 |
0.0026 |
Strontium (DIS, ICP-AES) |
31.9 - 1669 |
m g/L |
F s = 0.055(MPV) - 0.201 |
31 |
0.0001 |
Strontium (DIS, ICP-AES/T) |
31.9 - 1669 |
m g/L |
F s = 0.055(MPV) - 0.201 |
31 |
0.0001 |
Strontium (WWR, ICP-AES) |
31.9 - 1669 |
m g/L |
F s = 0.055(MPV) - 0.201 |
31 |
0.0001 |
Strontium (WWR, ICP-AES/T) |
31.9 - 1669 |
m g/L |
F s = 0.055(MPV) - 0.201 |
31 |
0.0001 |
Sulfate (DIS, IC) |
6.06 - 621 |
mg/L |
F s = 0.036(MPV) + 0.604 |
14 |
0.0001 |
Sulfate (DIS, IC, LIS) |
0.338 - 3.09 |
mg/L |
F s =-0.019(MPV) + 0.325 |
13 |
0.7052 |
Vanadium (DIS, COL) |
1.00 – 52.8 |
m g/L |
F s = 0.059(MPV) + 1.376 |
27 |
0.0006 |
Vanadium (DIS, ICP-AES) |
1.00 – 52.8 |
m g/L |
F s = 0.059(MPV) + 1.376 |
27 |
0.0006 |
Zinc (DIS, ICP-AES) |
5.95 - 381 |
m g/L |
F s = 0.052(MPV) + 2.514 |
17 |
0.0001 |
Zinc (DIS, ICP-MS) |
5.95 - 381 |
m g/L |
F s = 0.052(MPV) + 2.514 |
17 |
0.0001 |
Zinc (WWR, F-AAS) |
5.95 - 381 |
m g/L |
F s = 0.052(MPV) + 2.514 |
17 |
0.0001 |
Zinc (WWR, ICP-AES) |
5.95 - 381 |
m g/L |
F s = 0.052(MPV) + 2.514 |
17 |
0.0001 |