The ALMA Online Control Software: An Overview and Ways to … · 2015. 9. 18. · Archive and...
Transcript of The ALMA Online Control Software: An Overview and Ways to … · 2015. 9. 18. · Archive and...
-
The ALMA Online Control Software: An Overview and Ways to Improve Data Quality
R. Rosen
-
Bird’s Eye View
R. HiriartR. Rosen
-
In More Detail
R. HiriartR. Rosen
-
DC, TelCal & QuickLook
R. HiriartR. Rosen
-
DataCapturer
R. Rosen
-
Archive and Relational Database
ARCHIVE: xml store, binary store Relational database: state database, scheduling working database (swdb), asdm database
Users: pipeline, OT, WebAQUA, anyone retrieving an asdm
Users: Scheduling, QuickLook, WebAQUA
Pros: Can hold large amounts of data Pros: Query-able, lots of configuration options, lots of performance tools
Cons: Not query-able Cons: relies on Oracle, possible performance issues with large databases
R. Rosen
-
QuickLook
R. Rosen
-
Scheduling
R. Rosen R. Rosen
SubmissionPhase I
GeneratedSBs
ARPC Meeting
OBSERVED!
Phase IIGenerated
SBs
P2G
Simulation
Simulation
-
Scheduling
R. Rosen
ARCHIVExml store
StateArchive
SchedulingWorking
Database(SWDB)
SchedulingUpdater
SchedulingData
Model(APDM)
DynamicScheduling
Algorithm (DSA)Scheduling
Panel
ReadyRunningSuspended
ScienceCSVCal
-
Scheduling
R. Rosen
-
Software branches
● Trunk: development● Release branch: “staging area” prior to branching● Major releases:
– 2014.6 (Cycle 3)– 2015.8 (Cycle 4)
● Minor releases: (incremental testing)– 2014.4 (subarrays)– 2015.6 (new python version)
R. Rosen
-
Testing Cycle
● Phase A: testing by us– Modular tests– Jenkins– TFINT
● Phase B: “Verification” by Software Operations● Phase C: “Validation” by EOC/Scientists
R. Rosen
-
Jenkins
R. Rosen
-
Release Cycle
Cycle311/04/14: Requirements deadline
12/01/14 – 12/14/14: Implementation Phase
12/15/14 – 01/30/15: Verification Phase
02/17/15: Delivery
Cycle 410/30/15: Requirements deadline
11/30/15 – 12/14/15: Implementation Phase
12/14/15 – 01/22/16: Verification Phase
01/27/16: Deliveryhttps://ictwiki.alma.cl/twiki/bin/view/IRM/ReleasesPlanning
R. Rosen
-
Telescope Meta Data
ObservedPassed
9/18/15R. Rosen
-
Telescope Meta Data
9/18/15
Syscal TimesCSV-2555FixplanetNull StateIDInvalid UIDSyscal Missing AntennaTsys Error
R. Rosen
-
Future Projects
● Short term– QA0 flags– QuickLook
● Middle term– Porting to 64 bit– WebAQUA
● Long term– Migrate to relational database
R. Rosen
-
Control Team● Ralph Marson (Control lead): ObservingModes, Devices,
everything else● Patrick Brandt: Total power processor, hardware● Alexis Tejeda: Scheduling, TMCDB● Rachel Rosen: DataCapturer, QuickLook, Scheduling● Rodrigo Amestica: Correlator● J. Perez: Correlator
● Jorge Avarias: Scheduling (through 01/01/16)● Rafael Hiriart: TMCDB, Pipeline (through 01/01/16)
R. Rosen
-
Paths for Improvement
● Communication directly with software team● Advocate for changes in the policies
– Relational database– Continuous development and deployment
R. Rosen
Slide 1Slide 2Slide 3Slide 4Slide 5Slide 6Slide 7Slide 8Slide 9Slide 10Slide 11Slide 12Slide 13Slide 14Slide 15Slide 16Slide 17Slide 18Slide 19