1

Validated Stage 1 Science Maturity Review for {JPSS Algorithm}

Presented byDate

2

Outline

• Algorithm Cal/Val Team Members• Product Requirements• Evaluation of algorithm performance to specification

requirements– Evaluation of the effect of required algorithm inputs– Quality flag analysis/validation– Error Budget

• Documentation• Identification of Processing Environment• Users & User Feedback• Conclusion• Path Forward

3

Name Organization Major Task

{JPSS Algorithm} Cal/Val Team (1 slide)

Algorithm Cal/Val Team Members

4

Requirements (1 slide)

Product Requirements from JPSS L1RD

Attribute Threshold Objective

Geographic coverage

Vertical Coverage

Vertical Cell Size

Horizontal Cell Size

Mapping Uncertainty

Measurement Range

Measurement Accuracy

Measurement Precision

Measurement Uncertainty

5

Data Product Maturity Definition

Validated Stage 1:Using a limited set of samples, the algorithm output is shown to meet the threshold performance attributes identified in the JPSS Level 1 Requirements Supplement with the exception of the S-NPP Performance Exclusions

6

Evaluation of algorithm performance to specification requirements (3-5 slides)

• Findings/Issues from Provisional Review• Improvements since Provisional– Algorithm Improvements – LUT / PCT updates

• Cal/Val Activities for evaluating algorithm performance:– Test / ground truth data sets– Validation strategy / method– Validation results

7

Evaluation of the effect of required algorithm inputs (2-5 slides)

• Required Algorithm Inputs– Primary Sensor Data– Ancillary Data– Upstream algorithms– LUTs / PCTs

• Evaluation of the effect of required algorithm inputs– Study / test cases– Results

8

Quality flag analysis/validation (2-5 slides)

• Defined Quality Flags– Variable– Description– Value

• Quality flag analysis/validation– Test / example / ground truth data sets– Analysis/validation results– Analysis/validation plan for next validated stages

9

Error Budget (1 slide)

Compare analysis/validation results against requirements, present as a table. Error budget limitations should be explained. Describe prospects for overcoming error budget limitations with future improvement of the algorithm, test data, and error analysis methodology.

Attribute Analyzed

L1RD Threshold

Analysis/Validation Result

Error Summary

10

Documentation (1 slide)

• The following documents will be updated and provided to the EDR Review Board before AERB approval:– Current or updated ATBD– Current or updated OAD– README file for CLASS– Product User’s Guide (Recommended)

11

Identification of Processing Environment (1 slide)

• IDPS or NDE build (version) number and effective date• Algorithm version• Version of LUTs used• Version of PCTs used• Description of environment used to achieve validated

stage 1

12

Users & User Feedback (1-2 slide)

• User list• Feedback from users

• Downstream product list• Reports from downstream product teams on the

dependencies and impacts

13

Conclusion (1 slide)

• Cal/Val results summary:– Team recommends algorithm validated stage 1

maturity • Caveats

14

Path Forward (1-2 slide)

• Planned further improvements• Planned Cal/Val activities / milestones