JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial...

10
Nov 26 2012 Nov 26 2012 JWST Data Management Systems Gretchen Greene

Transcript of JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial...

Page 1: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

JWSTDataManagementSystems

GretchenGreene

Page 2: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

JWSTMissionHierarchyforDMS

Page 3: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

DMSEs9matedArchivedDataVolumes–Baseline

Data Per Yr (TB)

5.5 yr Mission (TB)

10 yr Mission (TB)

Recorded engineering

0.3 1.6 3.0

Level-0 20.9 115.0 209.0 Level-1a 20.9 115.0 209.0 Level-1b 20.9 115.0 209.0 Level-2a (compressed 2:1)

1.0 5.6 10.2

Level-2b (compressed 2:1)

1.0 5.6 10.2

Level-3 (compressed 2:1)

1.0 5.6 10.2

WSS Archive package (compressed 2:1)

0.05 0.25 0.5

Total 66.1 363.7 661.1

Page 4: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

JWSTDMSInterfaceContext

Project Level Agreements will be defined ~L-24mo

Dec6‐7.2012

Page 5: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

JWSTvs.HSTDMS…

ManySimilari9es,systemsreuse(DADS,MAST),andlessonslearned,howeverthereare…

•  KeyBasicDifferences:–  Orderofmagnitudeincreaseincomputa9onalandI/ODMS

throughputs–  FlightOpera9onsSysteminterfacestoDMSwillsupportdirect

transferatSTScIofDSNtelemetrydataandrequireprioritydataprocessingforWavefrontSensingandControl

•  Func9onalDecisions:–  AsaresultofTradeStudies,BOTHHSTandJWSTwillbemoving

towardscalabledistributedarchitecture•  DataProcessingWorkflowManagementsystem(OWL‐CONDOR)•  DynamicReprocessingofDataProductswithCRDS

•  OnlineDataProductFileCACHE–  HigherLeveldataproductgenera9onassumedfundamental

–  Servicebasedarchitecturetosupportmul9‐missionDMS

Page 6: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

MAST+JWST

•  STScIArchiveAccesssystemsincludetheintersec9onbetweentheJWSTmissionopera9ons&MAST– Distribu9onServices– ArchiveUserInterface(MASTPortal)– UserAuthen9ca9on– ArchiveCatalog(CAOM)

– OnlineDataProductCache

Page 7: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

Mul9missionFunc9onalArchitectureOverview–SDR1

Page 8: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

JWSTSOCDMSRequirementsandDesignPhases

•  CompletedformalSystemsLevel4Requirements–  ~650requirementsforI&Tverifica9on

•  BeginningDMSI&TforinternalBuild1•  Currentlyinyear2+ofdesignanddevelopment

–  SystemsDesignReview2–Dec6‐7,’12

•  DesigningforLaunchReadinessData(LRD)2018with95%levelofcurrentSTScIDMScapability

Page 9: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

S&OCScienceSystemsEngineering,FlightOpera9ons,andSystemsDevelopmentTimelineforaJWST2018LRD

Page 10: JWST Data Management 2012 Systems Phases • Completed ... DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic ... mug2012_jwstdms_greene.ppt

Nov 26 2012

Nov 26 2012

DMSBuildPlanBuild Name

Build Description Components enabled Supported

Systems Targeted Delivery Status

0 Internal Build Workflow Manager, Minimal Ramp Processing Pipeline, SID

DMS Design & Development Dec-11 Completed

1 DMS Level 1 Internal I&T

DMS Workflow, Baseline Level-2a Pipeline, Baseline Level-2b Imaging Pipeline, CRDS, SID, Baseline SDP-1a

DMS, ISIM CV1RR Sept-12 In Test

2 DMS I&T

ISIM Cryo 2 (OSIM)

DMS SDP WFS&C, Baseline WSS Pipeline, Baseline Level-2b Spectrographic Pipeline, SID , Baseline SDP-1b

DMS, ISIM Cryo 2 Sept-13 In Dev

3 DMS I&T

ISIM Cryo 3 (OSIM)

DMS - All SIs SDP, Baseline Operations Archive, Baseline Level-3 Imaging Pipeline, SID

DMS, ISIM Cryo 3 (?) Sept-14

4 DMS I&T SOC Integration

DMS, CAL, SDP, EDP, CRDS, SID. Partial Baselines for Archive Access, Level 2 Spectrographic

SOC with DMS internal Sept-15

5 DMS I&T JSC/OTIS

DMS, CAL, SDP, EDP, CRDS, Baseline Archive Access, Baseline Level-3 Spectrographic Pipeline, SID

SOC1,DMS, JSC/OTIS

Testing June-16

6 DMS CST2&3 + Flight Release

Fully Functional DMS SOC2,DMS Flight Release

Feb-17 (test cycle +L-12)

6.1 DMS Pre-Flight Updates

Fully Functional DMS Updates SOC Pre-Flight Updates Jan-18