Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020...

8
Technical Evaluation of Sensor Technology (TEST) Program Clarity Node Sensor 2018 – 3 rd Quarter

Transcript of Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020...

Page 1: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

Technical Evaluation of Sensor Technology (TEST) Program

Clarity Node Sensor

2018 – 3rd Quarter

Page 2: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

2

Introduction and Sensor Profile

This analysis report is focused on assessing the performance of the Clarity Node sensor as a part

of the District’s Technical Evaluation of Sensor Technology (TEST) Program. The Clarity sensor

uses optical laser-based particle counting methodology to estimate the concentration of PM2.5.

The Clarity sensor also measures CO2, NO2, Total VOCs, temperature, and relative humidity

within a solar powered box. A unique feature of the Clarity Node sensor is its ability to self-

correct its PM2.5 estimates based on real-time regulatory monitor readings in the area. This

self-calibration process is aimed to result in more accurate PM2.5 measurements from the

Clarity Node sensors, making them a more viable option for various monitoring projects.

Background and Approach of Evaluation Test

In late 2017, the Clarity Movement Company approached the District regarding the testing of

their Clarity Node sensors in the conditions of the San Joaquin Valley. After coordination on

where the sensors could be placed in the District’s network for testing, on February 28, 2018,

five Clarity sensors were installed and started collecting data to compare the performance of

Clarity sensors to regulatory PM2.5 analyzers. Clarity Node sensors were installed at the

District air monitoring stations of Clovis-Villa, Manteca, Merced-Coffee, Tracy-Airport, and

Tranquillity. The data sets analyzed for this report compare PM2.5 data collected from Clarity

sensors and Federal Equivalent Method (FEM) monitors that are collocated at the District air

monitoring sites listed above. The scatter plots and time series graphs below show how the

datasets compare for both hourly values and the 24-hour average.

Overview of Analysis Findings from Current Period

The analysis for this report covers the time period of July 2018 through September 2018 (2018

– 3rd quarter). The data from the 3rd quarter of 2018 were impacted by firework displays and

several wildfires burning throughout California causing moderate to high PM readings

throughout the Valley. A few troughs of low pressure passed over the region which brought

smoke from the Coast Range and Northern California wildfires into the San Joaquin Valley.

Eleven wildfires located on all sides of the San Joaquin Valley occurred during July and August.

During the majority of this time period, high pressure resided over the Valley which not only

brought smoke from the Sierras, but also kept residual wildfire smoke contained in the region.

Recorded PM2.5 concentrations for both the Clarity Node sensor and regulatory monitors were

relatively high through the period of July to September 2018. This assessment compares the

Clarity Node performance against two different regulatory PM2.5 monitors operating in the

District’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity

Node sensors operating during this period showed a negligible bias (both high and low)

compared to the regulatory monitors, except for the Tranquillity sensor, which showed a more

pronounced high bias. Smoke impacts were detected all monitors throughout the valley as

seen in the graphs below.

Page 3: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

3

Site Specific Analysis of Clarity-Node Sensor Performance

Clovis-Villa

For the 24-hour average, Clarity data had a 0.5 µg/m3 high bias during the July 2018 through

September 2018 period. For the hourly average, Clarity data had a 0.6 µg/m3 high bias over the

same period.

y = 1.0311x + 0.1243

R² = 0.966

0

10

20

30

40

50

60

70

0 10 20 30 40 50 60 70

Cla

rity

Teledyne 602 FEM

Clovis 24-hour Average Comparison

y = 0.8733x + 2.6601

R² = 0.814

0

10

20

30

40

50

60

70

80

90

100

0 10 20 30 40 50 60 70 80 90 100

Cla

rity

Teledyne 602 FEM

Clovis Hourly Average Comparison

0

10

20

30

40

50

60

PM

2.5

g/m

³)

Clovis 24-hour PM2.5 Average FEM vs. Clarity

Clovis PM25 602 Clovis - Clarity

Page 4: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

4

Manteca

For the 24-hour average, Clarity data had a 2.6 µg/m3 high bias during the July 2018 through

September 2018 period. For the hourly average, Clarity data had a 2.6 µg/m3 high bias over the

same period.

y = 1.032x + 2.1849

R² = 0.9462

0

5

10

15

20

25

30

35

40

45

0 5 10 15 20 25 30 35 40 45

Cla

rity

Teledyne 602 FEM

Manteca 24-hour Average Comparison

y = 0.7615x + 5.434

R² = 0.6812

0

10

20

30

40

50

60

70

80

90

100

0 10 20 30 40 50 60 70 80 90 100

Cla

rity

Teledyne 602 FEM

Manteca Hourly Average Comparison

0

5

10

15

20

25

30

35

40

45

01

-Ju

l

04

-Ju

l

07

-Ju

l

10

-Ju

l

13

-Ju

l

16

-Ju

l

19

-Ju

l

22

-Ju

l

25

-Ju

l

28

-Ju

l

31

-Ju

l

03

-Au

g

06

-Au

g

09

-Au

g

12

-Au

g

15

-Au

g

18

-Au

g

21

-Au

g

24

-Au

g

27

-Au

g

30

-Au

g

02

-Se

p

05

-Se

p

08

-Se

p

11

-Se

p

14

-Se

p

17

-Se

p

20

-Se

p

23

-Se

p

26

-Se

p

29

-Se

p

PM

2.5

g/m

3)

Manteca 24-hour PM2.5 Average FEM vs. Clarity

Manteca - Clarity Manteca PM25 602

Page 5: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

5

Merced-Coffee

For the 24-hour average, Clarity data had a 2.3 µg/m3 high bias during the July through

September 2018 period. For the hourly average, Clarity data had a 2.2 µg/m3 high bias over the

same period.

y = 1.3195x - 3.5389

R² = 0.91

0

10

20

30

40

50

60

70

0 10 20 30 40 50 60 70

Cla

rity

MetOne BAM FEM

Merced 24-hour Average Comparison

y = 1.1589x - 0.4297

R² = 0.8195

0

20

40

60

80

100

120

140

0 20 40 60 80 100 120 140

Cla

rity

MetOne BAM FEM

Merced Hourly Average Comparison

0

10

20

30

40

50

60

70

01

-Ju

l

04

-Ju

l

07

-Ju

l

10

-Ju

l

13

-Ju

l

16

-Ju

l

19

-Ju

l

22

-Ju

l

25

-Ju

l

28

-Ju

l

31

-Ju

l

03

-Au

g

06

-Au

g

09

-Au

g

12

-Au

g

15

-Au

g

18

-Au

g

21

-Au

g

24

-Au

g

27

-Au

g

30

-Au

g

02

-Se

p

05

-Se

p

08

-Se

p

11

-Se

p

14

-Se

p

17

-Se

p

20

-Se

p

23

-Se

p

26

-Se

p

29

-Se

p

PM

2.5

g/m

³)

Merced 24-hour PM2.5 Average FEM vs. Clarity

Merced - Clarity Merced-Coffee PM25 BAM

Page 6: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

6

Tracy-Airport

For the 24-hour average, Clarity data had a 0.0 µg/m3 bias during the July through September

2018 period. For the hourly average, Clarity data had a 0.1 µg/m3 low bias over the same

period.

y = 1.1011x - 1.5205

R² = 0.9097

0

5

10

15

20

25

30

35

40

45

50

0 10 20 30 40 50

Cla

rity

MetOne BAM FEM

Tracy 24-hour Average Comparison

y = 0.9355x + 0.8965

R² = 0.7872

0

10

20

30

40

50

60

70

80

90

0 10 20 30 40 50 60 70 80 90

Cla

rity

MetOne BAM FEM

Tracy Hourly Average Comparison

0

5

10

15

20

25

30

35

40

45

50

01

-Ju

l

04

-Ju

l

07

-Ju

l

10

-Ju

l

13

-Ju

l

16

-Ju

l

19

-Ju

l

22

-Ju

l

25

-Ju

l

28

-Ju

l

31

-Ju

l

03

-Au

g

06

-Au

g

09

-Au

g

12

-Au

g

15

-Au

g

18

-Au

g

21

-Au

g

24

-Au

g

27

-Au

g

30

-Au

g

02

-Se

p

05

-Se

p

08

-Se

p

11

-Se

p

14

-Se

p

17

-Se

p

20

-Se

p

23

-Se

p

26

-Se

p

29

-Se

p

PM

2.5

g/m

³)

Tracy 24-hour PM2.5 Average FEM vs. Clarity

Tracy - Clarity Tracy-Airport PM25 BAM

Page 7: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

7

Tranquillity

For the 24-hour average, Clarity data had a 2.7 µg/m3 high bias during the July through

September 2018 period. For the hourly average, Clarity data had a 2.2 µg/m3 high bias over the

same period.

y = 1.5564x - 5.3111

R² = 0.8103

0

10

20

30

40

50

60

70

0 10 20 30 40 50 60 70

Cla

rity

MetOne BAM FEM

Tranquillity 24-hour Average Comparison

y = 1.4533x - 3.2195

R² = 0.79310

20

40

60

80

100

120

140

160

180

0 20 40 60 80 100 120 140 160 180

Cla

rity

MetOne BAM FEM

Tranquillity Hourly Average Comparison

0

10

20

30

40

50

60

70

80

01

-Ju

l

04

-Ju

l

07

-Ju

l

10

-Ju

l

13

-Ju

l

16

-Ju

l

19

-Ju

l

22

-Ju

l

25

-Ju

l

28

-Ju

l

31

-Ju

l

03

-Au

g

06

-Au

g

09

-Au

g

12

-Au

g

15

-Au

g

18

-Au

g

21

-Au

g

24

-Au

g

27

-Au

g

30

-Au

g

02

-Se

p

05

-Se

p

08

-Se

p

11

-Se

p

14

-Se

p

17

-Se

p

20

-Se

p

23

-Se

p

26

-Se

p

29

-Se

p

PM

2.5

g/m

³)

Tranquillity 24-hour PM2.5 Average FEM vs. Clarity

Tranquillity - Clarity Tranquillity PM25 BAM

Page 8: Technical Evaluation of Sensor Technology (TEST) ProgramDistrict’s network – the MetOne BAM-1020 and the Teledyne 602. Overall, most of the Clarity Node sensors operating during

San Joaquin Valley Air Pollution Control District Clarity Node Sensor

Technical Evaluation of Sensor Technology (TEST) Program 2018 – 3rd Quarter

8

Statistical Summary

The following table provides a statistical summary of the data collected during the analysis

period of this report.

Statistic Clovis Manteca Merced Tracy Tranquillity

FEM Avg 17.3 14.6 17.8 14.2 13.4

Sensor Avg 16.3 12.0 19.8 14.4 15.6

FEM 1-hr Max 89.5 86.6 105.0 86.0 112.0

Sensor 1-hr Max 99.5 66.4 122.8 78.6 162.7

FEM 24-hr Max 60.1 39.9 50.3 43.4 51.5

Sensor 24-hr Max 57.1 38.0 62.8 44.4 67.0

1-hr R2 0.8140 0.6812 0.8195 0.7872 0.7931

1-hr Slope 0.8733 0.7615 1.1589 0.9355 1.4533

1-hr Intercept 2.6601 5.4340 -0.4297 0.8965 -3.2195

24-hr R2 0.9660 0.9462 0.9100 0.9097 0.8103

24-hr Slope 1.0311 1.0320 1.3195 1.1011 1.5564

24-hr Intercept 0.1243 2.1849 -3.5389 -1.5205 -5.3111