Key Performance Metrics and End-to-End Testing Tim Jenness.
-
Upload
sandra-dean -
Category
Documents
-
view
225 -
download
0
Transcript of Key Performance Metrics and End-to-End Testing Tim Jenness.
![Page 1: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/1.jpg)
Key Performance Metrics and End-to-End Testing
Tim Jenness
![Page 2: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/2.jpg)
2
Key Performance Metrics
• LSST Science Requirements (LPM-17) and LSST System Requirements (LSE-29) specify the performance of LSST.
• Key Performance Metrics (KPM) are important metrics used to monitor pipeline development.
• They are monitored annually.
![Page 3: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/3.jpg)
3
![Page 4: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/4.jpg)
4
End-to-End Testing
• Raw data on disk to visualization of catalogs and images in a web browser.
• Does not have to be fully automated. Manual intervention is okay.
• What are we missing?• Do we have enough of a system to calculate
S15 KPMs? Which can’t we attempt?
![Page 5: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/5.jpg)
5
End-to-End Testing
• Alert Production end-to-end requires OCS and other infrastructure.– diffim performance only.
• Focus on Data Release Production– Use HSC data– Use NCSA systems– Scale to LSST for performance metrics.
• Five sessions at this meeting.
![Page 6: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/6.jpg)
6
![Page 7: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/7.jpg)
7
![Page 8: Key Performance Metrics and End-to-End Testing Tim Jenness.](https://reader036.fdocuments.in/reader036/viewer/2022062321/56649e365503460f94b25187/html5/thumbnails/8.jpg)
8
Support Documents
• Confluence:https://confluence.lsstcorp.org/display/DM/Data+Processing+End+to+End+Testing