3SAQS Technical Committee Workshop Status of Technical Work October 2012- May 2013 May 29, 2013

54
3SAQS Technical Committee Workshop Status of Technical Work October 2012- May 2013 May 29, 2013 Shawn McClure (CIRA) Zac Adelman (UNC-IE)

description

3SAQS Technical Committee Workshop Status of Technical Work October 2012- May 2013 May 29, 2013. Shawn McClure (CIRA) Zac Adelman (UNC-IE). 3SAQS and 3SDW Activities. 3SAQS and 3SDW Activities October 2012 – June 2013. Project administration and operations 1 st use case design document - PowerPoint PPT Presentation

Transcript of 3SAQS Technical Committee Workshop Status of Technical Work October 2012- May 2013 May 29, 2013

Page 1: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

3SAQS Technical Committee Workshop

Status of Technical Work October 2012- May 2013

May 29, 2013

Shawn McClure (CIRA)Zac Adelman (UNC-IE)

Page 2: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 2

3SAQS and 3SDW Activities

3SAQS

CO, UT, WY state meetings

Emissions data collection

Emissions data processing and prep

2008 3SAQS Base 2008 version A SMOKE modeling

Merging WestJump Base08a and 3SAQS Base08a emissions

3SAQS SMOKE and CAMx Base08a

January February March April May June

3SDW

Develop design document and use case scenario

Warehouse prototype and tool development

Data warehouse use case and testing

Use case testing and feedback

Populate warehouse with 3SAQS data

Page 3: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 3

3SAQS and 3SDW ActivitiesOctober 2012 – June 2013

• Project administration and operations– 1st use case design document– Operational and modeling protocol outlines

• Emissions and air quality modeling– Find and implement improvements to ancillary data in 2008 WJAQS to

create specific 2008 3SAQS products– Develop and prepare 3SAQS base case 2008 emissions version A

(Base08a)• 3SDW Website and database

– Metadata schema definition and Python generator– WestJump inventory database and web-enabled query tool– Website and database design, development, and launch

Page 4: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 4

3SAQS and 3SDW ActivitiesOctober 2012 – June 2013

• First use case– NPS and EPA participated in a beta test of the 3SDW registration and

data distribution functions– Currently ongoing and nearing completion– Feedback from this process will be used to improve/tweak the 3SDW

interface and operation• Staffing and project team

– CIRA difficulties in hiring a developer– UNC began to provide developer support to the project– ENVIRON being brought on to the project team as a subcontractor on

the UNC cooperative agreement

Page 5: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Identification, Acquisition, Pre- and Post-processing, Extraction

Storage, Backup, Restore, Security, Summarizing, Statistics

Searching, Querying, Filtering, Aggregating, Formatting, Packaging

Charting, Graphing, Mapping, Analyzing

Architecture, Design, Implementation, Management, and Operation

WGANPS CIRA

Acquisition Integration Management Distribution Presentation

Verification, Validation, QA/QC, Mapping, Flagging, Tranformation

Tools

3SDW

Results

Documents

Raw Data

Modelers

Planners

Managers

Guidance, Requirements, Feedback, Funding

Monitored

Modeled

Aerosol

Deposition

Gaseous

Emissions

Met

Air Quality

AQS, VIEWS

WestJump, future modeling, etc

Review of the 3SDW Overall System Ecosystem and Architecture

Page 6: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

• Continued to refine the database, software, and website infrastructure supporting the data warehouse

• Refined various pre-processing components• XML Generator for metadata

• SQL scripts for importing modeled emissions data

• Extended portions of the data import system• SQL scripts for importing modeled emissions data

• Integration layer for the Emissions Management Framework (EMF)

• Refined the logical and physical file system design

• Refined the data verification and validation system

• Refined the system for acquiring and managing emissions data

Summary of Past Quarter Activities

Page 7: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

• Interviewed several applicants for the TSDW software developer position

• Offered the position to the best candidate and received a verbal acceptance

• Candidate reneged on their acceptance the week before starting the appointment

• Designed an alternate plan for continuing the work plan with minimal impacts via an increased involvement by UNC

• Populated the data warehouse with the full complement of WestJump Base08b CAMx Input/Output data for June/July ‘08

• Refined the modeled emissions review tool

• Conducted the First Use Case Beta Test

Summary of Past Quarter Activities (cont’d)

Page 8: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Operational Website Components

• User Login Form

• User Registration/Modification Form

• User Profile/Account Form

• User Feedback Form

• Dataset Request Form

• Database Query Wizard

• Raw Data Download

• Interactive Charts

• Dynamic Contour Maps

• Site Metadata Reports

• Monitoring Site Metadata Browser

• File Explorer

Authentication and Authorization System

Page 9: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Future Website Components

• Modeled Emissions Summary Tool

• Modeled-to-Observed Data Comparison Tool

• Air Quality Summary Reports

o Visibility

o Deposition

o Ozone

o Other

• Model Data Mapping Tool

• Source Apportionment Tool

• Various Unpublished Monitoring Data Tools

• Backend Web Services and Processing Components

Page 10: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

User Login Form

Page 11: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

User Registration/Modification Form

Page 12: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

User Profile/Account Form

Page 13: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

User Feedback Form

Page 14: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Dataset Request Form

Page 15: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013
Page 16: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Raw Data Download (Query Wizard)

Page 17: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Time Series Charts (Query Wizard)

Page 18: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Dynamic Contour Maps (Query Wizard)

Page 19: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Site Metadata Report (Query Wizard)

Page 20: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Monitoring Site Browser

Page 21: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

21

Page 22: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Modeled Emissions Summary Tool

Page 23: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Modeled-to-Obs Comparison Tool

Page 24: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Air Quality Summary Reports

Page 25: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Model Data Mapping Tool

Page 26: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Future Online Visualization Tools

Page 27: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

3SAQS Technical Committee Workshop

3SDW First Use Case Report and Results

May 29, 2013

Shawn McClure (CIRA)Zac Adelman (UNC-IE)

Page 28: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 28

3SDW First Use Case• Use Cases

Conceptualizations of how a software system will be used Aid project managers and developers in compartmentalizing a problem

into workable components/deliverables• 3SDW Use Case

– Launch of the 3SDW website and beta testing of the functionality– Test the 3SDW in registering users, distributing data, and receiving results

back into the system– Subset (2 months) of WestJump AQMS modeling data– Participants: NPS (Mike Barna) and EPA (Gail Tonnessen)

• Feedback from the use case testing will be used to improve the operational and technical components of the 3SDW

Page 29: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

• Testers visited the TSDW website and registered with the system to create an account

• Testers visited the Data Request web page and entered their requests for the WestJump Base08b dataset

• Each request was stored in the database

• The system determined whether or not each request could be automatically filled or had to be manually assembled

• The system sent emails to the appropriate TSDW team members to notify them of the data requests

• TSDW team members assembled the dataset requests (copied the relevant data files onto hard drives)

• The datasets (hard drives) were delivered to the beta testers

• The system updated the dataset requests to reflect their “filled” status

First Use Case - Beta Test Steps

Page 30: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

• Using the delivered datasets, testers ran the models and generated results

• Testers returned the model output results to the 3SDW

• The test results were assessed by TSDW team members

• Testing outcomes were summarized for the May 3SAQS Technical Workshop

• The TSDW team refines the dataset ordering, download, packaging, and delivery system according to lessons learned

• The TSDW team develops the next Use Case testing scenario(s)

First Use Case - Beta Test Steps (cont’d)

Page 31: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 31

WJAQMS Emissions,

meteorology, & AQM data

MetadataAQM post-processed

data

Data request

IC/BC development

Model analysis

IC/BC data

Air quality modeling

Post processing

Evaluation graphics and

statistics

Database

3SAQSEmissions & meteorology

data

WestJumpAQMS

3SDW

USFS & NPS Modelers

3SDW Web Interface

3SAQS First Use Case

Page 32: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 32

WJAQMS Emissions,

meteorology, & AQM data

MetadataAQM post-processed

data

Data request

IC/BC development

Model analysis

IC/BC data

Air quality modeling

Post processing

Evaluation graphics and

statistics

Database

3SAQSEmissions & meteorology

data

WestJumpAQMS

3SDW

USFS & NPS Modelers

3SDW Web Interface

3SAQS First Use Case

Page 33: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

3SAQS Technical Committee Workshop

Status of 3SAQS Base08a Emissions Improvement and Modeling Activities

May 29, 2013

Zac Adelman (UNC-IE)

Page 34: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 34

WestJumpAQMS Emissions Data and 3SDW Improvement Priorities

Meteorology

Spatial AllocationTemporal Allocation Chemical Speciation

Inventory Data

AQM-Ready Emissions

Emissions processing schematic

Page 35: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 35

WestJumpAQMS Emissions Data and 3SDW Improvement Priorities

Meteorology

Spatial AllocationTemporal Allocation Chemical Speciation

Inventory Data

AQM-Ready Emissions

Initial 3SAQS work focused on improving the non-inventory emissions data from WJAQMS

Page 36: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 36

Emissions Improvements Summary

• Made obvious improvements identified during screening of WestJumpAQMS modeling

• Gathered all available data– What data were available at the states/agencies that we can

use for emissions processing?– Stack testing data for VOCs and PM speciation– Shapefiles for oil and gas sources, agricultural sources,

industrial sources– Temporal profiles and chemical speciation data

• Prioritized inventory sources and target potential improvements

Page 37: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 37

High profile/high impact anthropogenic emissions sources in CO, WY, UT 3-state counties

• NOx– Oil and gas sources (drill rigs, compressor engines, heaters)– On-road mobile– Rail (diesel class 1 locomotives)– Industrial and residential natural gas combustion– EGUs

• VOC– Oil and gas sources (venting, fugitives, and dehydrators)– On-road mobile– Recreational vehicles and pleasure craft– Chemical manufacturing

• NH3– Agriculture (livestock)

Page 38: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 38

3SAQS Spatial Allocation Data Updates• New Surrogates

– Replaced NLCD 2001 with NCLD 2006 landuse/landcover surrogates– Replaced 1999 FEMA building square footage surrogates with 2010

FEMA-HAZUSv2.1 building square footage surrogates– Replaced TIGER line rail mileage surrogates with 2012 NTAD rail density

surrogate– New ERTAC rail yard surrogate– Updated CO livestock surrogates with swine CAFOs– New WY livestock surrogate with CAFO point locations– New VMT-weighted roadway surrogates for CO on-road sources

• Updated assignments/cross-referencing– Changed allocation of ATV/ORV/snowmobiles from rural to forest land– Reassigned livestock sources from total ag to pasture land– Reassigned fertilizer sources from total ag to crop land (except animal

waste spreading)

Page 39: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 39

3SAQS Temporal Allocation Data Updates• Calculated 2008 temperature-dependent monthly

and daily profiles for residential wood combustion (RWC) sources

• Updated diurnal profile for RWC sources• Calculated 2008 temperature and wind speed-

dependent daily profiles for livestock NH3 sources• Computed monthly profiles for residential natural gas

combustion• Updated the diurnal profile assignments for off-road

recreational vehicles (to decrease overnight emissions)

Page 40: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 40

3SAQS Other Emissions Data Updates

• Reassigned sources from the non-point inventory as fugitive dust in order to apply transport fractions

• Converted the on-road mobile inventory data to a format that works with standard SMOKE

• Corrections for double counting of some oil and gas sources in the South San Juan and Permian basins and Southern Ute tribal land

Page 41: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 41

CO Roadway Layers

2010 TIGER Line• Urban/Rural + Primary/Secondary• Weighting by urban/rural areas of a county

• Includes only Interstates, arterials, and collectors

2008 CDPHE VMT• VMT by road segment for highways and major roads• Weighting by VMT• Includes an additional layer of major roads (local)

Page 42: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 42

• Current Approach/WestJump:– Onroad inventory SCC codes distinguish between urban and rural sources, which

allows for spatial allocation to urban/rural roads– Local road SCCs are using population as a spatial surrogate

TIGER data don’t have enough information to represent that some sections of the county have higher traffic volume on the primary roads

CDPHE VMT Shapefile distinguishes areas with higher traffic flow. Without the VMT weighting, the emissions will be allocated uniformly across all cells that intersect with roads.

More of the on-road emissions should go here, than here.

VMT

CO Roadway Layers

Page 43: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 43

• Update for 3SAQS:– Ignore urban/rural distinction in the SCC code and instead weight the roadway

surrogates by VMT to take advantage of the better resolution in road segment activity in the CDPHE data

– Allocate local roads using the major road Shapefile from CDPHE, weighted by VMT

TIGER data don’t have enough information to represent that some sections of the county have higher traffic volume on the primary roads

CDPHE VMT Shapefile distinguishes areas with higher traffic flow. Without the VMT weighting, the emissions will be allocated uniformly across all cells that intersect with roads.

More of the on-road emissions should go here, than here.

VMT

CO Roadway Layers

Page 44: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 44

WY CAFO Shapefile

• DWQ permitting database includes mostly CAFOs and a few swine operations

• Locations are provided in the database but not types of animals

Page 45: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 45

WY CAFO Shapefile

Several WY counties only have a single CAFO in this database

If these data are used for spatial allocation, need to limit which SCCs in these counties will be allocated to these single point locations

Page 46: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 46

Case Study: Fremont County, WY CAFO

GIS Shapefile Google Earth Imagery

Largest sources of the Fremont County NEI08 NH3 inventory are cattle.

Other sources are probably not associated with the CAFO

Tier3 SCC Tier 3 SCC Description NH3 (TPY)2805001 Beef cattle - finishing operations on feedlots (drylots) 13.722805002 Beef cattle production composite 221.762805003 Beef cattle - finishing operations on pasture/range 360.362805007 Poultry production - layers with dry manure management systems 0.982805008 Poultry production - layers with wet manure management systems 0.202805009 Poultry production - broilers 0.072805010 Poultry production - turkeys 0.102805018 Dairy cattle composite 0.152805019 Dairy cattle - flush dairy 0.112805021 Dairy cattle - scrape dairy 0.652805022 Dairy cattle - deep pit dairy 0.052805023 Dairy cattle - drylot/pasture dairy 0.152805030 Poultry Waste Emissions 0.462805035 Horses and Ponies Waste Emissions 172.922805039 Swine production - operations with lagoons (unspecified animal age) 0.962805040 Sheep and Lambs Waste Emissions 79.462805045 Goats Waste Emissions 9.21

2805047Swine production - deep-pit house operations (unspecified animal age) 1.63

Page 47: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 47

WY CAFOs Summary• Shapefile can be used to allocate livestock emissions to

modeling grids– Two categories of CAFO identified in the Shapefile: “CAFO” and

“Swine”– CAFO category will be used for cattle (except for finishing operations

on range/pasture SCCs)– Swine category will be used for swine

• Underlying assumption in using these CAFO point data is that they represent all locations of cattle and swine sources in a county

• In the absence of CAFO information, we will use the pasture land surrogate for other animal types (horses, poultry, turkeys, etc)

Page 48: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 48

EIA Monthly Residential Energy Use Database

Page 49: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

3SAQS Technical Committee Workshop

Technical Work PlanJune – October, 2013

May 29, 2013

Shawn McClureZac Adelman (UNC-IE)

Page 50: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 50

3SAQS June-October Workplan• Base 2008 version A – complete SMOKE and CAMx modeling

– Base simulation and performance evaluation (June/July)– Pilot cumulative impacts CAMx simulation with source apportionment

(August/September)• Base 2011 version A

– Collect 2011 NEI data from CO, UT, WY and prepare for SMOKE (June/July)

– Develop 2011 oil and gas inventories from existing data (July-September)

– SMOKE and CAMx modeling (October-December)• Inventory development and analysis

– Future year projection curves (October-November)– Inventory reactivity analysis (July)

Page 51: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

• Implement the collaborative components of the warehouse

• Implement the ongoing news and updates section• 3SDW on-line for NEPA air quality analysis projects by end

of October• Out-bound data delivery and in-bound data ingestion for

NEPA and other air quality studies• Data warehouse operations (hosting, data analysis and

processing, maintenance, et cetera)• Plans for storage/access/visualization for modeling results

and evaluation tools• Store UT BLM ARMS and other studies’ data in 3SDW after

evaluation using protocols

3SDW June-October Workplan

Page 52: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Three State Air Quality Study 52

Upcoming 3SAQS and 3SDW Activities

3SAQS

3SAQS SMOKE and CAMx Base08a

CO, UT, WY 2011 inventory data collection; emissions reactivity analysis

Complete WRF 2011 modeling and MPE; O3 network technical analysis

Year 2011 inventories for base simulation; 2008 pilot cumulative impacts run

3SAQS SMOKE Base2011a; develop future projections inventories off 2011

June July August September October

3SDW

Populate warehouse with 3SAQS data

Implement online analysis, collaboration components, news and updates

Development and testing of online large file transfers

Store UT BLM ARMS and other study data

Warehouse online for NEPA projects

Page 53: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Testing and Refinement Help

• All users, collaborators, and partners can help with testing

• Please report bugs – don’t endure them

• Use the website Feedback form

• Send direct email to team members

• Provide as much information as possible up-front

• Stay abreast of ongoing additions and updates

• Be an active part of the design process - make suggestions for features and refinements

• Don’t assume it can’t be done

• Don’t assume it can be done

Page 54: 3SAQS Technical Committee  Workshop Status of Technical Work  October 2012- May 2013 May 29, 2013

Thanks.