Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.
-
Upload
archibald-summers -
Category
Documents
-
view
217 -
download
0
Transcript of Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.
![Page 1: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/1.jpg)
NWS Operations Proving Ground Overview
Kim J. RunkJune 4, 2014
Satellite Proving Ground User Readiness Meeting
![Page 2: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/2.jpg)
Estab. 2012 GOES-R FLS DSS Boot Camps ERS PDS Team System Design, Installation, Config. First Operational Readiness Evaluation
BackgroundDefined in Weather Ready Nation Services Roadmap
![Page 3: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/3.jpg)
Estab. 2012 GOES-R FLS DSS Boot Camps ERS PDS Team System Design, Installation, Config. First Operational Readiness Evaluation
BackgroundDefined in Weather Ready Nation Services Roadmap
![Page 4: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/4.jpg)
Human Factors Realistic Simulation All Office Types All Service Sectors Partner Involvement
Mission Scope“Last mile” of R2O - BOTH Science AND Services
![Page 5: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/5.jpg)
Dual Focus Services Arm: Effectiveness for DSS
◦ Communication of Hazards, Risk, Vulnerability; Other Social Science Considerations
R2O Arm: Operational Readiness Evaluations◦ Forecaster Endorsement, Validation of Usability,
Usefulness for Decision Making, Workflow Impact
![Page 6: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/6.jpg)
Ongoing OPG projects relate directly to at least 14 recommendations and 3 best practices.
Hurricane Irene
Other Key LinkagesConnection to Recent Service Assessments
![Page 7: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/7.jpg)
DeFacto DSS Testbed
![Page 8: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/8.jpg)
Systems Baseline AWIPS-2 to support OREs
Prototype cloud solutions and virtualization options
Goals: ◦Enhance ops flexibility◦Reduce refresh costs◦Fewer processing centers
![Page 9: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/9.jpg)
The Concept
HT to Lans Rothfusz for Roundabout Metaphor
HWTDevelopmental Testing
OPGOps-Like Simulation
Pilot OfficeLimited Field Testinig
Field OfficesReal World Operations
![Page 10: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/10.jpg)
Early R2O Transition Project
Initial testing conducted at 18 NWS officesAssisted NWS Tampa Bay Pilot Project
GOES-R Fog/Low Stratus Products
Feedback to GOES-R to improve products
Project expanding to 30+ offices this year
Field implementation targeted FY15
![Page 11: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/11.jpg)
software maturityfunctionalitydisplay optionsdifferent versions in simultaneous evals
First Formal ORE – May 2014
Early versions tested at four NWS WFOs◦ Primary focus = total lightning trends
One of several tools featured in Spring Experiments at HWT (2013 & 2014)
NASA SPoRT / MDL Meteogram Tracking Tool
(Image courtesy of NASA SPoRT)
Initial criticisms
![Page 12: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/12.jpg)
Meteogram Tracking ToolOperational Evaluation - Participants
Forecasters from four CONUS Regions SMEs, Developers, Trainers, OPG Staff
![Page 13: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/13.jpg)
Meteogram Tracking ToolOperational Evaluation - Process
Mon : Familiarization Training
Tue-Thu : Weather Scenarios
- V
arying Complexity
- S
everal Locations
- M
ultiple Forecast Challenges
Fri : Final Case, Debrief
- 7 Archived Cases, 1 Live Data Case
- Team Stress Test
- Feedback Sessions
Supplemental eval :
prototype monitor array
![Page 14: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/14.jpg)
VLab Development Community◦Direct ticket entry into dev data base◦Bug fixes, new features coded “on the fly”
Forecasters ID’d several best practices Alternative uses Training plans Drafting report
Meteogram Tracking ToolOperational Evaluation - Outcomes
NWS Leadershipto
![Page 15: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/15.jpg)
Lessons Learned for Future Experiments
Operational Evaluation
VLab Dev Environment
Diversity/Realism of Cases
Emphasis on Unique Valueand Human Factors
Right Combination of Participants
![Page 16: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/16.jpg)
Operational Evaluation Key Forecaster Take-Aways
“The VLab environment really streamlined the process of reporting issues. Developers were very responsive to suggestions for adding new features, and to fixing minor bugs in time for the next case.
VLab Development Site
![Page 17: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/17.jpg)
Key Forecaster Take-AwaysOperational Evaluation
Diversity of Cases
“I was impressed with the diversity of scenarios we worked and the overall setup of the OPG. It simulated a real operational environment fairly well, and allowed us to explore a variety of uses for the tool.”
![Page 18: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/18.jpg)
Operational Evaluation Key Forecaster Take-Aways
Human Factor Emphasis
“Evaluating whether a tool provides some unique value compared to existing tools is really important.
You break trust if you promise something cool, and then forecasters discover it’s just another way to do something they already do, with no clear benefit.”
So is ensuring the tool doesn’t create a workload problem.
![Page 19: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/19.jpg)
Operational Evaluation
“The cross-section of people involved was fantastic. Having forecasters interact with leaders, developers, researchers, and trainers – who together demonstrated genuine collaboration – that was powerful.”
Combination of Participants
Key Forecaster Take-Aways
“Our organization preaches collaborative innovation. This experience nailed it. Every NWS forecaster needs to experience something like this.”
![Page 20: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/20.jpg)
Plans for FY2015 Optimal Balance Experiments
◦Comparative 1-minute vs. 5-minute imagery evaluations for diverse tasks
At Least One Additional Major ORE Clarify NWSEO Role in ORE Process Transition DSS Training Curriculum
![Page 21: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/21.jpg)
Expand Stakeholder Involvement Strengthen Linkage to Other Testbeds and V-Lab Development Environment*
Resolve Staffing and Resource Issues Long-term Organizational Structure
Key Sustainment Issues
Necessitates revising governance model*
![Page 22: Kim J. Runk June 4, 2014 Satellite Proving Ground User Readiness Meeting.](https://reader034.fdocuments.in/reader034/viewer/2022042616/56649eca5503460f94bd9384/html5/thumbnails/22.jpg)