Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance,...
Transcript of Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance,...
![Page 1: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/1.jpg)
1NOAA-20 Beta Calibration/Validation Maturity Review
Beta Maturity Science ReviewFor NOAA-20 (EDR) Imagery
Presented by Don HillgerDate: 2018-01-25
![Page 2: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/2.jpg)
2NOAA-20 Beta Calibration/Validation Maturity Review
Outline
• Imagery Cal/Val Team Members• Product Requirements• Findings/Issues for Beta Imagery• Documentations (Science Maturity Check List)• Conclusions• Path Forward
![Page 3: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/3.jpg)
3NOAA-20 Beta Calibration/Validation Maturity Review
Name Organization Major TaskDon Hillger NESDIS/StAR Imagery Product Lead
Tom Kopp Aerospace Imagery Cal/Val Lead
Curtis Seaman CIRA Imagery/DNB expert
Steven Miller CIRA DNB/Imagery expert
Jorel Torres CIRA JPSS Liaison / trainer
William Straka III CIMSS/SSEC Imagery/DNB expert
Steve Finley CIRA IT/data expert
Rosalie Marley GST Imagery JAM
Imagery Cal/Val Team
Imagery Cal/Val Team Members
![Page 4: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/4.jpg)
4NOAA-20 Beta Calibration/Validation Maturity Review
VIIRS Environmental Data Record (EDR)s
4
VIIRS BandCentral
Wavelength(μm)
Bandwidth (μm) Wavelength Range(μm) Band Explanation Spatial Resolution (m)
@ nadir
M1 0.412 0.02 0.402 - 0.422
Visible
750 m
M2 0.445 0.018 0.436 - 0.454M3 0.488 0.02 0.478 - 0.488M4 0.555 0.02 0.545 - 0.565M5 0.672 0.02 0.662 - 0.682M6 0.746 0.015 0.739 - 0.754 Near IRM7 0.865 0.039 0.846 - 0.885M8 1.240 0.020 1.23 - 1.25
Shortwave IRM9 1.378 0.015 1.371 - 1.386M10 1.61 0.06 1.58 - 1.64M11 2.25 0.05 2.23 - 2.28M12 3.7 0.18 3.61 - 3.79 Medium-wave IRM13 4.05 0.155 3.97 - 4.13M14 8.55 0.3 8.4 - 8.7
Longwave IRM15 10.763 1.0 10.26 - 11.26M16 12.013 0.95 11.54 - 12.49
DNB / NCC 0.7 0.4 0.5 - 0.9 Visible 750 m across full scan
I1 0.64 0.08 0.6 - 0.68 Visible
375 mI2 0.865 0.039 0.85 - 0.88 Near IRI3 1.61 0.06 1.58 - 1.64 Shortwave IRI4 3.74 0.38 3.55 - 3.93 Medium-wave IRI5 11.45 1.9 10.5 - 12.4 Longwave IR
M-bands highlighted in pale yellow are available as EDRs, in addition to SDRs.True-color component bands are highlighted in red, green, and blue.
![Page 5: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/5.jpg)
5NOAA-20 Beta Calibration/Validation Maturity Review
Product Requirements from JPSS L1RDRequirements (1 of 2)
Attribute Threshold Objective1. The Imagery EDR shall be delivered under all weatherconditions, including any rain ratea. Horizontal Spatial Resolution for visible and IRImagery bands
1. Nadir 0.4 km 0.1 km
2. Edge of Swath 0.8 km 0.1 km
3. Night-time visual, Nadir 2.6 km 0.65 km
b. Horizontal Spatial Resolution for moderate resolutionbands
1. Nadir 0.8 km NS
2. Edge of Swath 1.6 km NS
c. Mapping Uncertainty
1. Nadir 1 km NS
2. Edge of Swath 3 km 0.5 km
3. Night-time visual, Nadir TBS 1 km
d. Refresh for Visible and IR bands At least 90% coverage of theglobe every 12 hours
NS
![Page 6: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/6.jpg)
6NOAA-20 Beta Calibration/Validation Maturity Review
The Imagery product consists of:• Visible/IR radiances/reflectances remapped to the Ground Track Mercator
(GTM) grid, eliminating overlapping pixels and bowtie deletions.– I-band and M-band Imagery
• NCC Imagery that is a pseudo-albedo derived from the DNB, creating an image product that removes large contrasts in DNB from day to night across the terminator.
Requirements (2 of 2)
• VIIRS Imagery products as a Key Performance Parameter (KPP) reads as follows:
VIIRS Imagery EDR for (8) bands I1, I3, I4, I5, M14, M15, M16, and DNB for latitudes greater than 60°N in the Alaskan region (I3 and DNB bands added post SNPP launch)
• There are no (quantitative) requirements that address the quality of the Imagery products.
• The user decides if the quality of the Imagery is acceptable, therefore including the users is a key consideration (although end users have not been involved at this Beta level)
![Page 7: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/7.jpg)
7NOAA-20 Beta Calibration/Validation Maturity Review
JPSS Data Products Maturity Definition
JPSS/GOES-R Data Product Validation Maturity Stages –COMMON DEFINITIONS (Nominal Mission)
1. Betao Product is minimally validated, and may still contain significant identified and unidentified errors.o Information/data from validation efforts can be used to make initial qualitative or very limited quantitative assessments
regarding product fitness-for-purpose.o Documentation of product performance and identified product performance anomalies, including recommended
remediation strategies, exists.
2. Provisionalo Product performance has been demonstrated through analysis of a large, but still limited (i.e., not necessarily globally
or seasonally representative) number of independent measurements obtained from selected locations, time periods, or field campaign efforts.
o Product analyses are sufficient for qualitative, and limited quantitative, determination of product fitness-for-purpose.o Documentation of product performance, testing involving product fixes, identified product performance anomalies,
including recommended remediation strategies, exists.o Product is recommended for potential operational use (user decision) and in scientific publications after consulting
product status documents.
3. Validatedo Product performance has been demonstrated over a large and wide range of representative conditions (i.e., global,
seasonal).o Comprehensive documentation of product performance exists that includes all known product anomalies and their
recommended remediation strategies for a full range of retrieval conditions and severity level.o Product analyses are sufficient for full qualitative and quantitative determination of product fitness-for-purpose.o Product is ready for operational use based on documented validation findings and user feedback.o Product validation, quality assurance, and algorithm stewardship continue through the lifetime of the instrument.
![Page 8: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/8.jpg)
8NOAA-20 Beta Calibration/Validation Maturity Review
Findings/Issues at Beta Review• VIIRS M-bands (all good) – vis/IR bands• VIIRS I-bands Issues:
– I3 bad detector• causing striping (CCR3742/ADR8560)• Imagery appears usable in spite of this striping
– I4 and I5 fill values• blank images (CCR3742/ADR8559)• 88% of all granules are not usable (based on a 24 hour evaluation)
• VIIRS DNB/NCC issues:– Extended DNB granule processing by NCC– Geolocation issues (working with Geo Team)– Stray light (VIIRS SDR Team)
• Not unlike striping on SNPP DNB• Expected to be addressed with DNB calibration in Feb 2018
– NOAA-20 vs. SNPP (50 min separation)
![Page 9: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/9.jpg)
9NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 M-bands visible/IR bands
![Page 10: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/10.jpg)
10NOAA-20 Beta Calibration/Validation Maturity Review
VIIRS True ColorEastern US2017-12-20(C. Seaman, CIRA)
![Page 11: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/11.jpg)
11NOAA-20 Beta Calibration/Validation Maturity Review
Natural-color RGB – Frozen North – 2018-01-05(C. Seaman, CIRA)
![Page 12: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/12.jpg)
12NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 I3 bad detector
![Page 13: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/13.jpg)
13NOAA-20 Beta Calibration/Validation Maturity Review
I3 bad detector/striping (granule projection)
blowupfrom
above
![Page 14: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/14.jpg)
14NOAA-20 Beta Calibration/Validation Maturity Review
2018-01-22 – I3 bad detector/striping(remapped over Sahara Desert)
SDR I3
EDR I3
![Page 15: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/15.jpg)
15NOAA-20 Beta Calibration/Validation Maturity Review
I4 and I5 missing/fill values(occasional valid data)
![Page 16: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/16.jpg)
16NOAA-20 Beta Calibration/Validation Maturity Review
2018-01-22 – I4 EDR (when LUT allows valid data)
![Page 17: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/17.jpg)
17NOAA-20 Beta Calibration/Validation Maturity Review
2018-01-22 – I5 EDR (when LUT allows valid data)
![Page 18: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/18.jpg)
18NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 DNB extended granule
![Page 19: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/19.jpg)
19NOAA-20 Beta Calibration/Validation Maturity Review
DNB Extended Granule – SW USA – 2018-01-05(C. Seaman, CIRA)
![Page 20: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/20.jpg)
20NOAA-20 Beta Calibration/Validation Maturity Review
True-color RGB – SW USA – 2018-01-05(C. Seaman, CIRA)
![Page 21: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/21.jpg)
21NOAA-20 Beta Calibration/Validation Maturity Review
2018-01-22 – DNB (extended granule on left)
![Page 22: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/22.jpg)
22NOAA-20 Beta Calibration/Validation Maturity Review
2018-01-22 – NCC (extended granule not included)
![Page 23: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/23.jpg)
23NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 DNB geolocation offset
![Page 24: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/24.jpg)
24NOAA-20 Beta Calibration/Validation Maturity Review
Korea (N/S) and fishing boats2017-12-13(S. Miller, CIRA)
Slight navigation offset
![Page 25: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/25.jpg)
25NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 DNB stray light
![Page 26: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/26.jpg)
26NOAA-20 Beta Calibration/Validation Maturity Review
DNB Stray light near South Pole – raw data
This striping will also appear in the NCC product!
![Page 27: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/27.jpg)
27NOAA-20 Beta Calibration/Validation Maturity Review
Day-Night-Band First Light CONUS – 2017-12-14(S. Miller, CIRA, for NOAA Facebook)
![Page 28: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/28.jpg)
28NOAA-20 Beta Calibration/Validation Maturity Review
SNPP and NOAA-20 DNB comparisons(@ ~50 minutes separation)
![Page 29: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/29.jpg)
29NOAA-20 Beta Calibration/Validation Maturity Review
Animation of VIIRS DNB betweenSNPP and NOAA-20/JPSS-1(J. Torres, CIRA)
![Page 30: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/30.jpg)
30NOAA-20 Beta Calibration/Validation Maturity Review
SNPP DNBEast Cost “bomb” off St. John NB2018-01-05 0558 UTC(W. Straka, CIMSS/SSEC)
![Page 31: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/31.jpg)
31NOAA-20 Beta Calibration/Validation Maturity Review
NOAA-20 DNBEast Cost “bomb” off St. John NB2018-01-05 0648 UTC(W. Straka, CIMSS/SSEC)
![Page 32: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/32.jpg)
32NOAA-20 Beta Calibration/Validation Maturity Review
DNB Great Lakes 2018-01-02 NOAA-20(S. Miller, CIRA)
![Page 33: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/33.jpg)
33NOAA-20 Beta Calibration/Validation Maturity Review
DNB Great Lakes 2018-01-02 SNPP(S. Miller, CIRA)
![Page 34: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/34.jpg)
34NOAA-20 Beta Calibration/Validation Maturity Review
Documents (Check List)
Science Maturity Check List Yes ?
ReadMe for Data Product Users In development
Algorithm Theoretical Basis Document (ATBD) Yes (SNPP)
Algorithm Calibration/Validation Plan Yes (NOAA-20)
(External/Internal) Users Manual Yes (SNPP)
System Maintenance Manual (for ESPC products)
Peer Reviewed Publications(Demonstrates algorithm is independently reviewed)
Yes (SNPP)
Regular Validation Reports (at least annually)(Demonstrates long-term performance of the algorithm)
JPSS Annual Meeting
presentations
![Page 35: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/35.jpg)
35NOAA-20 Beta Calibration/Validation Maturity Review
Conclusions
• Cal/Val results summary:– Team recommends Beta maturity for EDR Imagery
based on:• Limited assessment of I4/I5 Imagery• Expected LUT updates for I3 striping and I4/I5
fill values• Expected DNB stray light corrections in
February 2018
![Page 36: Beta Maturity Science Review For NOAA-20 (EDR) Imagery · o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including](https://reader030.fdocuments.in/reader030/viewer/2022040910/5e83a8f473ecaa6cd864cb23/html5/thumbnails/36.jpg)
36NOAA-20 Beta Calibration/Validation Maturity Review
Path Forward
• Planned improvements:– Planned LUT changes for I3/I4/I5 and DNB stray
light• Future Cal/Val activities / milestones:
– Provisional Maturity – Launch+90d – 16 Feb 2018– Validated Maturity – Launch+9m – August 2018