LSSTCommissioningPlanReview•January2017LSSTCommissioningPlanReview•January2017 1
DMServicesandSoftwareStatus(andEvolution)
Kian-TatLim
DMSystemArchitect
LSSTCommissioningPlanReviewJanuary24-26,2017
LSSTCommissioningPlanReview•January2017
Outline
− DMSciencePipelinesforCommissioning
− LSSTSciencePlaEormforCommissioning
− DataProductsandProcessingServices
− ServiceEvoluHon
− ServiceTesHng
− HardwareandNetworkEvoluHon
2
LSSTCommissioningPlanReview•January2017
DMSciencePipelinesforCommissioning
− DMwillprovidesufficientfuncHonalitytosupporthardwarewhenitisdelivered:
– TheAuxiliaryTelescope:
• InstrumentSignatureRemoval(ISR),spectrophotometry,atmosphericfiTng
– ComCam:• ISR,PSFcharacterizaHon,photometry,astrometry
– LSSTCam:
• CalibraHonproducts(includingCollimatedBeamProjectorprocessing)
• ISR,PSFcharacterizaHon,photometry,astrometry
− DMwillprovideafullstack,capableofcarryingoutthesurvey,beforetheScienceVerificaHonphase
− Inreality,DMexpectstoprovideafullstack,sufficienttostartOperaHons,beforetheComCamsustainedoperaHonsphase.
− WewillhavetestedtheselevelsoffuncHonalityusingprecursordata(predominantlyHSCandZTF)beforethestartofCommissioning.
3
DataProductsDefiniHonReview–PrincetonUniversity,Princeton,NJ–June6-7th2013
HSCvs.HST
4
c.500LSSTvisits(credit:HitoshiMurayama)
LSSTCommissioningPlanReview•January2017
TheDMReplan
− Asyoumayknow,
– LSSTDMiscomingtotheendofamajorreplansotheexactstatusofthesystemduringCommissioningisnotyetclear.
− ThisreplanwillbefollowedbyareviewofDM,whichisexpectedbySummer2017.
− InparHcular,wemaydelayimplementaHonofsomecomponents,e.g.:
– "MulHfit"forgalaxyshapemeasurement
– Crowdedfieldphotometry(althoughalertsincrowdedfieldswillbeavailable)
− Wedonotexpectthesedelaystoimpactourabilitytocommissionthehardwaresystems,ortopreventusfromissuingalertsassoonastemplatesareavailable.
5
LSSTCommissioningPlanReview•January2017
LSSTSciencePlaEormforCommissioning
− PortalforviewingautomatedmetricsfromproducHon
− Notebookforhuman-drivenanalysisandinvesHgaHon
− CommissioningClusteratBaseCenterprovidesadhoccompuHng,storage,anddatabase;batchproducHonservicesatNCSAareavailable
− Sogwareforsingle-frameprocessingincludingPSFandWCSesHmaHon,imagedifferencing,wavefrontprocessing;spectrophotometricpipelineforAuxTelescope
6
DataProductsDefiniHonReview–PrincetonUniversity,Princeton,NJ–June6-7th2013
DataProductsProducHonDepartmentServices
7
DataProductsDefiniHonReview–PrincetonUniversity,Princeton,NJ–June6-7th2013
ServiceStart-Upand OperaHons/MaintenancePlan
8
LSSTCommissioningPlanReview•January2017
ServiceList
− Archivingservice(CameraandAuxTelescopeSpectrograph)
− TelemetryGatewayservice
− EngineeringandFaciliHesDatabasetransformaHonservice
− DataBackbone
− OCS-controlledBatchProcessingservice
− Offline(andCatch-Up)Processingservice
− PromptProcessingservice
− DataReleaseProducHonservice
− SciencePlaEormenvironmentonCommissioningCluster
− DataAccessCenteruserservicesandSciencePlaEorm
− LSSTEventMini-BrokerhosHng
9
LSSTCommissioningPlanReview•January2017
ServiceAvailabilityatEarlySystemAI&T
− Archivingservice(CameraandAuxTelescopeSpectrograph)
− TelemetryGatewayservice
− EngineeringandFaciliHesDatabasetransformaHonservice
− DataBackbone
− OCS-controlledBatchProcessingservice
− Offline(andCatch-Up)Processingservice
− PromptProcessingservice
− DataReleaseProducHonservice
− SciencePlaEormenvironmentonCommissioningCluster
− DataAccessCenteruserservicesandSciencePlaEorm
− LSSTEventMini-BrokerhosHng
10
Batch,Notebooks,
Files
Files
5%capacity
LSSTCommissioningPlanReview•January2017
ServiceAvailabilitybeforeComCamSustainedOperaHons(Feb2020)
− Archivingservice(CameraandAuxTelescopeSpectrograph)
− TelemetryGatewayservice
− EngineeringandFaciliHesDatabasetransformaHonservice
− DataBackbone
− OCS-controlledBatchProcessingservice
− Offline(andCatch-Up)Processingservice
− PromptProcessingservice
− DataReleaseProducHonservice
− SciencePlaEormenvironmentonCommissioningCluster
− DataAccessCenteruserservicesandSciencePlaEorm
− LSSTEventMini-BrokerhosHng
11
Fullcapability
Productdatabases
LSSTCommissioningPlanReview•January2017
ServiceAvailabilitybeforeLSSTCamDelivery(May2020)
− Archivingservice(CameraandAuxTelescopeSpectrograph)
− TelemetryGatewayservice
− EngineeringandFaciliHesDatabasetransformaHonservice
− DataBackbone
− OCS-controlledBatchProcessingservice
− Offline(andCatch-Up)Processingservice
− PromptProcessingservice
− DataReleaseProducHonservice
− SciencePlaEormenvironmentonCommissioningCluster
− DataAccessCenteruserservicesandSciencePlaEorm
− LSSTEventMini-BrokerhosHng
12
Archiveonly
LSSTCommissioningPlanReview•January2017
ServiceAvailabilitybeforeScienceVerificaHon(Nov2020)
− Archivingservice(CameraandAuxTelescopeSpectrograph)
− TelemetryGatewayservice
− EngineeringandFaciliHesDatabasetransformaHonservice
− DataBackbone
− OCS-controlledBatchProcessingservice
− Offline(andCatch-Up)Processingservice
− PromptProcessingservice
− DataReleaseProducHonservice
− SciencePlaEormenvironmentonCommissioningCluster
− DataAccessCenteruserservicesandSciencePlaEorm
− LSSTEventMini-BrokerhosHng
13
ArchiveandBase
LSSTCommissioningPlanReview•January2017
− ServiceTesHngbeforeDeliverytoCommissioning
− DMConHnuousIntegraHonincludingtesHngatvaryingcadencesusingL1IntegraHon,VerificaHonCluster,andPrototypeDataAccessCenterenvironmentsonsimulatedandprecursordata;realdatawhenavailable
− DPPoperaHons"dressrehearsals"
− Cross-subsystemearlyintegraHonpathfinderexercises
14
LSSTCommissioningPlanReview•January2017
HardwareandNetworkAvailabilityatEarlySystemAI&T
− AuxiliaryTelescopearchivingandprocessinghardware
− CommissioningClustercomputeandstorage
− L1archivingandpromptprocessinghardwareatBaseandArchive(5%)
− L2DataReleaseprocessing,QA,QChardwareatArchive(5%)
− Tapelibrarysystem
− NetworklinksoperaHonalatproducHonspeed
− PrototypeDataAccessCenterhardware
− IniHalArchiveandBasehardwareinstalledandtestedduringMay2018-Sep2019
15
LSSTCommissioningPlanReview•January2017
HardwareandNetworkEvoluHon
− ExpansionofL1hardwareatBaseandArchiveandL2hardwareatArchiveto100%beforeFullSystemAI&T(May2020)
− ProducHonDataAccessCenterhardwareatArchivebeforeFullSystemAI&T(May2020)
− ProducHonDataAccessCenterhardwareatBasebeforeScienceVerificaHon(Nov2020)
16
DataProductsDefiniHonReview–PrincetonUniversity,Princeton,NJ–June6-7th2013
BackupSlides
17LSSTCommissioningPlanReview•January2017
LSSTCommissioningPlanReview•January2017
EarlyIntegraHonPathfinderExercises
− DMDemonstratesabilitytocompileandlinkagainstthev1DAQsogware
− TestofPopulaHngEFDwithCameraTelemetry
− OCS-DM-TCS-CCSStart/endofnighttest
− TestofEFDtransformaHonunderDMdevicecontrol
− FullOCS-TCS-CCS-DAQ-DMTest:CompleteVisit
− FullOCS-TCS-CCS-DAQ-DMTest:MiniNight
− FullOCS-TCS-CCS-DAQ-DMTest:DailyCycle,IncludingCalibraHon
18
Top Related