Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting...

Greg SullivanUniversity of Maryland

Data Filtering and Software

IceCube Collaboration Meeting

Monday, March 21, 2005

March 21, 2005Data Systems Overview

System Overview

DAQ

Dispatch

P&F Server

Recon WorkerX 50-60?

4-15MB/s1500-2000Hz

Tape

Transient Buffer

DAQ Land

Raw Data

Online Analysis

Online Analysis

Online Analysis

Recon Monitor

Data Handling

Rec/FiltData

ALL: RAW+FILT+REC

FILT:RAW+FILT+REC

ALL:FILT+REC

Expt. Control / Logging

Offline Software/IceTray


Data Handling• Accomplishments

– South Pole Test System operational since late last year. – South Pole System installed at the Pole in late December. – SPS operational with 1 string! – SPADE installed at Pole and used to transfer drill,

webcam, and TestDAQ data.

• Coming Year Activities – Data ingestion to Data Warehouse to be implemented.– Web interface to Data Warehouse. – Upgrade data storage facilities. – IceCube Metadata standard and data directory structure to

be defined. – Upgrade SPS and SPTS for upcoming season.


Experiment Control

• Provide system for South Pole operating– Control– Configuration– Monitoring– Logging– JBoss Support

• Based on “JBoss” – Infrastructure in place– Run-Control JMX Console in development


Filtering

• PnF System– V1.0 Tested at SPTS & deployed at Pole– Currently not in data stream

• Lacking some run information and testing

– New Version of Monolith soon (April)• Test & run PnF at Pole in preparation for next year

• Plans for next year– Integrate with Real DAQ,Exp Ctrl, DAQ Disp,

SPADE at SPTS (August/Sept) • PnF is output stream for Real DAQ• Filtering at South Pole required


Offline Software• Several incremental releases this past year

– In use by reconstruction and simulation groups.– Many people developing physics modules– Lots of physics to do yet

• Current release:– OFFLINE-SOFTWARE V01-05-00

• There are tools available for all – Event viewer– Script to make histograms for ROOT

• AMANDA muon reconstruction and merging by summer


Software 1


Software 2


Software 3


Event Viewer


ATWD Calibration & Feature Extraction


Simulation

• Version 0.2 released – Implemented in IceTray

• I3Db• Corsika Reader• MMC Propagator• Hit Constructor (Photonics interface)• Noise Generator• ROMEO, ROMEO-AMANDA• DOM Simulator (atwd,fadc,TWR)• Trigger Sim• ATWD Channel Merger• Feature Extraction• Event Viewer


JULIET

300 PeV


Simulation Plans

• Version 1.0 of IceCube simulation– Ready Mid April– Generate large set of events for validation

against AMASIM with same Ice properties etc…

• New Photonics tables – Ready April-May

• Finalize metadata specs and production scripts

• Large production run using V1.0– Data set in ware house


Summary

• Great Progress in the last year– SPADE operating reliably– PnF/DAQ Dispatch tested and running– Experiment Control system defined and providing Jboss

support– Simulation V0.2 running– Broad range of developers in IceTray

• Decision for C++ and data classes 1 year ago

• For Next Year– Systems on track for physics from 30-32 string detector

• Online system integration and testing in Aug/Sep

• Reconstruction and filtering

Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting...

Documents

Transcript of Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting...