Table 1.Ordinary least-squared equations for determining the most probable deviation

[Fs, regression estimate of F-pseudosigma; DIS, dissolved; mg/L, milligrams per liter; MPV, Most Probable Value; COL, colorimetric; LIS, low ionic strength; ASF, micro-Kjeldahl digestion, automated segmented flow, colorimetric; USEPA, U.S. Environmental Protection Agency; WWR, whole-water recoverable; TITR, electrometric titration; ICP-AES, inductively coupled plasma-atomic emission spectrometry; mg/L, micrograms per liter; ICP-MS, inductively coupled plasma-mass spectrometry; DCP-AES, direct current plasma-atomic emission spectrometry; HG-AAS, hydride generation-atomic absorption spectrophotometry; F-AAS, flame-atomic absorption spectrophotometry; GF-AAS, graphite furnace-atomic absorption spectrophotometry; IC, ion chromatography; GRAV, gravimetric; ISE, ion-selective electrode; ICP-AES/T, inductively coupled plasma-atomic emission spectrometry, trace; CV-AAS, cold vapor-atomic absorption spectrophotometry; ELEC, electrometric; mS/cm, microsiemens per centimeter at 25o Celsius]

 

Constituent and method of analysis

Concentration range

Units

Equation to determine Fs

Number of Samples

p-value

NUTRIENT CONSTITUENTS

Ammonia as nitrogen (DIS)

0.024 - 3.62

mg/L

Fs = 0.077(MPV) + 0.016

26

0.0001

Ammonia as nitrogen (DIS, COL)

0.024 - 3.62

mg/L

Fs = 0.077(MPV) + 0.016

26

0.0001

Ammonia as nitrogen (DIS, COL, LIS)

0.024 - 3.62

mg/L

Fs = 0.077(MPV) + 0.016

26

0.0001

Ammonia plus organic nitrogen as nitrogen (DIS)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Ammonia plus organic nitrogen as nitrogen (DIS, ASF)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Ammonia plus organic nitrogen as nitrogen (DIS, USEPA)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Ammonia plus organic nitrogen as nitrogen (WWR)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Ammonia plus organic nitrogen as nitrogen (WWR, ASF)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Ammonia plus organic nitrogen as nitrogen (WWR, USEPA)

0.118 - 3.78

mg/L

Fs = 0.100(MPV) + 0.083

27

0.0001

Nitrate plus nitrite as nitrogen (DIS)

0.11 - 1.93

mg/L

Fs = 0.039(MPV) + 0.015

21

0.0001

Nitrate plus nitrite as nitrogen (DIS, COL)

0.11 - 1.93

mg/L

Fs = 0.039(MPV) + 0.015

21

0.0001

Nitrate plus nitrite as nitrogen (DIS, COL, LIS)

0.11 - 1.93

mg/L

Fs = 0.039(MPV) + 0.015

21

0.0001

Nitrate plus nitrite as nitrogen (DIS, USEPA)

0.11 - 1.93

mg/L

Fs = 0.039(MPV) + 0.015

21

0.0001

Orthophosphate as phosphorous (DIS)

0.052 - 1.59

mg/L

Fs = 0.059(MPV) + 0.006

26

0.0001

Orthophosphate as phosphorous (DIS, COL)

0.052 - 1.59

mg/L

Fs = 0.059(MPV) + 0.006

26

0.0001

Orthophosphate as phosphorous (DIS, COL, LIS)

0.052 - 1.59

mg/L

Fs = 0.059(MPV) + 0.006

26

0.0001

Phosphorus (DIS)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

Phosphorus (DIS, ASF)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

Phosphorus (DIS, USEPA)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

Phosphorus (WWR)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

Phosphorus (WWR, ASF)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

Phosphorus (WWR, USEPA)

0.060 - 1.70

mg/L

Fs = 0.048(MPV) + 0.007

27

0.0001

INORGANIC CONSTITUENTS

Alkalinity (WWR, TITR)

27.0 - 234

mg/L

Fs = 0.019(MPV) + 1.002

13

0.0001

Aluminum (DIS, ICP-AES)

10.0 - 317

mg/L

Fs = 0.091(MPV) + 8.773

17

0.0006

Aluminum (DIS, ICP-MS)

10.0 - 317

mg/L

Fs = 0.091(MPV) + 8.773

17

0.0006

Aluminum (WWR, DCP-AES)

10.0 - 317

mg/L

Fs = 0.091(MPV) + 8.773

17

0.0006

Aluminum (WWR, ICP-AES)

10.0 - 317

mg/L

Fs = 0.091(MPV) + 8.773

17

0.0006

Antimony (DIS, HG-AAS)

0.55 - 245

mg/L

Fs = 0.165(MPV) - 0.251

16

0.0001

Antimony (DIS, ICP-MS)

0.55 - 245

mg/L

Fs = 0.165(MPV) - 0.251

16

0.0001

Arsenic (DIS, HG-AAS)

0.55 – 81.5

mg/L

Fs = 0.077(MPV) + 0.642

17

0.0001

Arsenic (WWR, GF-AAS)

0.55 – 81.5

mg/L

Fs = 0.077(MPV) + 0.642

17

0.0001

Arsenic (WWR, GF-AAS, USEPA)

0.55 – 81.5

mg/L

Fs = 0.077(MPV) + 0.642

17

0.0001

Arsenic (WWR, HG-AAS)

0.55 - 81.5

mg/L

Fs = 0.077(MPV) + 0.642

17

0.0001

Barium (DIS, GF-AAS)

7.65 - 507

mg/L

Fs = 0.040(MPV) + 2.021

17

0.0001

Barium (DIS, ICP-AES)

7.65 - 507

mg/L

Fs = 0.040(MPV) + 2.021

17

0.0001

Barium (DIS, ICP-MS)

7.65 - 507

mg/L

Fs = 0.040(MPV) + 2.021

17

0.0001

Barium (WWR, F-AAS)

7.65 - 507

mg/L

Fs = 0.040(MPV) + 2.021

17

0.0001

Barium (WWR, ICP-AES)

7.65 - 507

mg/L

Fs = 0.040(MPV) + 2.021

17

0.0001

Beryllium (DIS, ICP-AES)

0.12 - 59.0

mg/L

Fs = 0.042(MPV) + 0.581

17

0.0001

Beryllium (DIS, ICP-MS)

0.12 - 59.0

mg/L

Fs = 0.042(MPV) + 0.581

17

0.0001

Beryllium (WWR, F-AAS)

0.12 – 59.0

mg/L

Fs = 0.042(MPV) + 0.581

17

0.0001

Beryllium (WWR, ICP-AES)

0.12 – 59.0

mg/L

Fs = 0.042(MPV) + 0.581

17

0.0001

Boron (DIS, ICP-AES)

0.18 - 297

mg/L

Fs = 0.050(MPV) + 9.293

31

0.0009

Cadmium (DIS, GF-AAS)

0.34 – 50.5

mg/L

Fs = 0.061(MPV) + 0.463

17

0.0001

Cadmium (DIS, ICP-AES)

0.34 – 50.5

mg/L

Fs = 0.061(MPV) + 0.463

17

0.0001

Cadmium (DIS, ICP-MS)

0.34 – 50.5

mg/L

Fs = 0.061(MPV) + 0.463

17

0.0001

Cadmium (WWR, GF-AAS)

0.34 – 50.5

mg/L

Fs = 0.061(MPV) + 0.463

17

0.0001

Calcium (DIS, ICP-AES)

4.60 - 154

mg/L

Fs = 0.054(MPV) - 0.089

31

0.0001

Chloride (DIS, IC)

7.60 - 208

mg/L

Fs = 0.031(MPV) + 0.478

14

0.0001

Chloride (DIS, IC, LIS)

0.14 - 7.79

mg/L

Fs = 0.042(MPV) + 0.156

12

0.0005

Chromium (DIS, GF-AAS)

0.68 – 79.0

mg/L

Fs = 0.064(MPV) + 0.857

16

0.0001

Chromium (DIS, ICP-AES)

0.68 – 79.0

mg/L

Fs = 0.064(MPV) + 0.857

16

0.0001

Chromium (DIS, ICP-MS)

0.68 – 79.0

mg/L

Fs = 0.064(MPV) + 0.857

16

0.0001

Chromium (WWR, GF-AAS)

0.68 – 79.0

mg/L

Fs = 0.064(MPV) + 0.857

16

0.0001

Chromium (WWR, ICP-AES)

0.68 – 79.0

mg/L

Fs = 0.064(MPV) + 0.857

16

0.0001

Cobalt (DIS, GF-AAS)

0.40 – 40.0

mg/L

Fs = 0.052(MPV) + 0.850

17

0.0005

Cobalt (DIS, ICP-AES)

0.40 – 40.0

mg/L

Fs = 0.052(MPV) + 0.850

17

0.0005

Cobalt (DIS, ICP-MS)

0.40 – 40.0

mg/L

Fs = 0.052(MPV) + 0.850

17

0.0005

Cobalt (WWR, GF-AAS)

0.40 – 40.0

mg/L

Fs = 0.052(MPV) + 0.850

17

0.0005

Copper (DIS, GF-AAS)

1.90 – 85.3

mg/L

Fs = 0.047(MPV) + 1.309

17

0.0001

Copper (DIS, ICP-AES)

1.90 – 85.3

mg/L

Fs = 0.047(MPV) + 1.309

17

0.0001

Copper (DIS, ICP-MS)

1.90 – 85.3

mg/L

Fs = 0.047(MPV) + 1.309

17

0.0001

Copper (WWR, GF-AAS)

1.90 – 85.3

mg/L

Fs = 0.047(MPV) + 1.309

17

0.0001

Copper (WWR, ICP-AES)

1.90 – 85.3

mg/L

Fs = 0.047(MPV) + 1.309

17

0.0001

Dissolved Solids (WWR, GRAV)

88.0 - 1309

mg/L

Fs = 0.019(MPV) + 7.031

13

0.0001

Fluoride (DIS, IC, LIS)

0.03 - 0.17

mg/L

Fs = 0.133(MPV) + 0.005

9

0.0861

Fluoride (DIS, ISE)

0.23 - 1.23

mg/L

Fs = 0.062(MPV) + 0.012

14

0.0002

Iron (DIS, ICP-AES)

4.30 - 1175

mg/L

Fs = 0.044(MPV) + 5.512

17

0.0001

Iron (WWR, F-AAS)

4.30 - 1175

mg/L

Fs = 0.044(MPV) + 5.512

17

0.0001

Iron (WWR, ICP-AES)

4.30 - 1175

mg/L

Fs = 0.044(MPV) + 5.512

17

0.0001

Iron (WWR, ICP-AES/T)

4.30 - 1175

mg/L

Fs = 0.044(MPV) + 5.512

17

0.0001

Lead (DIS, GF-AAS)

1.00 - 103

mg/L

Fs = 0.062(MPV) + 1.017

16

0.0001

Lead (DIS, ICP-AES)

1.00 - 103

mg/L

Fs = 0.062(MPV) + 1.017

16

0.0001

Lead (DIS, ICP-MS)

1.00 - 103

mg/L

Fs = 0.062(MPV) + 1.017

16

0.0001

Lead (WWR, GF-AAS)

1.00 - 103

mg/L

Fs = 0.062(MPV) + 1.017

16

0.0001

Lithium (DIS, ICP-AES)

8.70 - 132

mg/L

Fs = 0.078(MPV) + 0.844

17

0.0001

Magnesium (DIS, ICP-AES)

0.78 – 58.4

mg/L

Fs = 0.045(MPV) + 0.008

31

0.0001

Magnesium (DIS, ICP-AES, LIS)

0.020 - 0.71

mg/L

Fs = 0.047(MPV) + 0.005

11

0.0001

Manganese (DIS, ICP-AES)

2.40 - 619

mg/L

Fs = 0.066(MPV) - 0.077

17

0.0001

Manganese (DIS, ICP-MS)

2.40 - 619

mg/L

Fs = 0.066(MPV) - 0.077

17

0.0001

Manganese (WWR, F-AAS)

2.40 - 619

mg/L

Fs = 0.066(MPV) - 0.077

17

0.0001

Manganese (WWR, ICP-AES)

2.40 - 619

mg/L

Fs = 0.066(MPV) - 0.077

17

0.0001

Mercury (DIS, CV-AAS)

0.32 - 7.43

mg/L

Fs = 0.111(MPV) + 0.095

17

0.0001

Mercury (WWR, CV-AAS)

0.32 - 7.43

mg/L

Fs = 0.111(MPV) + 0.095

17

0.0001

Molybdenum (DIS, ICP-AES)

2.10 - 112

mg/L

Fs = 0.076(MPV) + 0.882

15

0.0001

Molybdenum (DIS, ICP-MS)

2.10 - 112

mg/L

Fs = 0.076(MPV) + 0.882

15

0.0001

Nickel (DIS, GF-AAS)

1.70 – 65.6

mg/L

Fs = 0.065(MPV) + 1.168

16

0.0001

Nickel (DIS, ICP-AES)

1.70 – 65.6

mg/L

Fs = 0.065(MPV) + 1.168

16

0.0001

Nickel (DIS, ICP-MS)

1.70 – 65.6

mg/L

Fs = 0.065(MPV) + 1.168

16

0.0001

Nickel (WWR, GF-AAS)

1.70 – 65.6

mg/L

Fs = 0.065(MPV) + 1.168

16

0.0001

Nickel (WWR, ICP-AES)

1.70 – 65.6

mg/L

Fs = 0.065(MPV) + 1.168

16

0.0001

Potassium (DIS, F-AAS)

0.45 – 13.9

mg/L

Fs = 0.067(MPV) + 0.034

31

0.0001

Potassium (DIS, F-AAS, LIS)

0.057 - 0.65

mg/L

Fs = 0.072(MPV) + 0.018

13

0.0132

Selenium (DIS, HG-AAS)

3.30 – 21.4

mg/L

Fs = 0.162(MPV) + 0.231

15

0.0001

Selenium (WWR, GF-AAS)

3.30 – 21.4

mg/L

Fs = 0.162(MPV) + 0.231

15

0.0001

Selenium (WWR, GF-AAS, USEPA)

3.30 – 21.4

mg/L

Fs = 0.162(MPV) + 0.231

15

0.0001

Selenium (WWR, HG-AAS)

3.30 – 21.4

mg/L

Fs = 0.162(MPV) + 0.231

15

0.0001

Silica (DIS, COL)

2.46 – 19.4

mg/L

Fs = 0.050(MPV) + 0.077

29

0.0001

Silica (DIS, ICP-AES)

2.46 – 19.4

mg/L

Fs = 0.050(MPV) + 0.077

29

0.0001

Silver (DIS, GF-AAS)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (DIS, GF-AAS, LIS)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (DIS, ICP-AES)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (DIS, ICP-MS)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (WWR, GF-AAS)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (WWR, ICP-AES)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Silver (WWR, ICP-AES/T)

0.90 – 14.0

mg/L

Fs = 0.160(MPV) + 0.184

15

0.0001

Sodium (DIS, F-AAS)

7.19 - 166

mg/L

Fs = 0.034(MPV) + 0.339

31

0.0001

Sodium (DIS, ICP-AES)

7.19 - 166

mg/L

Fs = 0.034(MPV) + 0.339

31

0.0001

Sodium (DIS, ICP-AES, LIS)

0.117 - 4.40

mg/L

Fs = 0.049(MPV) + 0.024

12

0.0001

Specific Conductance (WWR, ELEC, LIS)

7.00 – 44.1

mS/cm

Fs = 0.058(MPV) + 0.35

13

0.0026

Strontium (DIS, ICP-AES)

31.9 - 1669

mg/L

Fs = 0.055(MPV) - 0.201

31

0.0001

Strontium (DIS, ICP-AES/T)

31.9 - 1669

mg/L

Fs = 0.055(MPV) - 0.201

31

0.0001

Strontium (WWR, ICP-AES)

31.9 - 1669

mg/L

Fs = 0.055(MPV) - 0.201

31

0.0001

Strontium (WWR, ICP-AES/T)

31.9 - 1669

mg/L

Fs = 0.055(MPV) - 0.201

31

0.0001

Sulfate (DIS, IC)

6.06 - 621

mg/L

Fs = 0.036(MPV) + 0.604

14

0.0001

Sulfate (DIS, IC, LIS)

0.338 - 3.09

mg/L

Fs =-0.019(MPV) + 0.325

13

0.7052

Vanadium (DIS, COL)

1.00 – 52.8

mg/L

Fs = 0.059(MPV) + 1.376

27

0.0006

Vanadium (DIS, ICP-AES)

1.00 – 52.8

mg/L

Fs = 0.059(MPV) + 1.376

27

0.0006

Zinc (DIS, ICP-AES)

5.95 - 381

mg/L

Fs = 0.052(MPV) + 2.514

17

0.0001

Zinc (DIS, ICP-MS)

5.95 - 381

mg/L

Fs = 0.052(MPV) + 2.514

17

0.0001

Zinc (WWR, F-AAS)

5.95 - 381

mg/L

Fs = 0.052(MPV) + 2.514

17

0.0001

Zinc (WWR, ICP-AES)

5.95 - 381

mg/L

Fs = 0.052(MPV) + 2.514

17

0.0001

Go Back to the Report