Judd Patterson Brian Witcher. Overview 1) What we collect water temperature weather station 2)...

19
NPS I&M South Florida/Caribbean Network Miami, FL Judd Patterson Brian Witcher Continuous Data Collection In Florida and the U.S. Virgin Islands

Transcript of Judd Patterson Brian Witcher. Overview 1) What we collect water temperature weather station 2)...

Page 1: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

NPS I&M South Florida/Caribbean NetworkMiami, FL

Judd PattersonBrian Witcher

Continuous DataCollection In

Florida and theU.S. Virgin Islands

Page 2: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

OverviewOverview

1) What we collect water temperature weather station

2) Access database import wizard data validation

3) Workarounds Excel graphing (VB)

4) Problems size of dataset graphing

improvements

Page 3: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Where We WorkWhere We Work

40 reef temperature

1 weather station4 reef

temperature

2 weather stations4 reef

temperature

10 reef temperature

Page 4: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Water TemperatureWater Temperature

HOBO water temperature loggers on coral reefs

located at 47 reef sites in BISC, BUIS, DRTO, and VIIS

several sites have paired sensors

data point every 2 hours

Yawzi Reef 1988-present

• one of the longest water temperature datasets in the Caribbean

Page 5: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Why we do this…Why we do this…

25

25.5

26

26.5

27

27.5

28

28.5

29

29.5

30

30.5

31

1 2 3 4 5 6 7 8 91

01

11

2 1 2 3 4 5 6 7 8 91

01

11

2 1 2 3 4 5 6 7 8 91

01

11

2 1 2 3 4 5 6 7 8 91

01

11

2 1 2 3 4 5 6 7 8 91

01

11

2

2005 2006 2007 2008 2009

Tem

pera

ture

(C

elsi

us)

Historically HOT seawater temps

Source: adapted from Miller et al. 2009

Page 6: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Why we do this…Why we do this…

2005 resulted in massivecoral bleaching and disease…

…and ultimately 60% decline in coral cover in the U.S. Virgin

Islands

Page 7: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Weather StationsWeather Stations

• land-based weather data collection in the USVI and Florida

• full weather station

• storing 9 sensor values

• logging every 10 minutes

• independent rain gauge

• storing 2 sensor values

• logging every 10 minutes

Page 8: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Weather StationsWeather Stations

1.Download data with a HOBO shuttle

Page 9: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Weather StationsWeather Stations

2.Open hobo/dtf and convert to csv

Page 10: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Data Validation WorkflowData Validation Workflow

3.Access database – Import

Page 11: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Weather StationsWeather Stations

3.Access database – Import

Page 12: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Weather StationsWeather Stations

4.Access database – Manual ValidationSpike

• Check suspicious readings with local airport weather

http://www.wunderground.com/history/airport/TISX/2010/4/14/DailyHistory.html

Flatline

Page 13: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Export/GraphingExport/Graphing

Pick a station, pick a date range, select the export location...

• VB creates appropriate query

• VB creates Excel document from template and loads with query data

Page 14: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

WorkaroundsWorkarounds

Page 15: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

WorkaroundsWorkarounds

Page 16: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

WorkaroundsWorkarounds

Page 17: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Data ForEVERData ForEVER

Page 18: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Remaining IssuesRemaining Issues

1) Size of dataset With each new import a performance hit is

noticeable …inevitable switch to SQL Server on the horizon

2) Graphing Excel is also at its limit when dealing with large

datasets; particularly graphing

Page 19: Judd Patterson Brian Witcher. Overview 1) What we collect  water temperature  weather station 2) Access database  import wizard  data validation 3)Workarounds.

Thanks!

Questions?