Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by...

17
Report on CHEP ‘06 David Lawrence

Transcript of Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by...

Page 1: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

Report on CHEP ‘06

David Lawrence

Page 2: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

Conference had many participants, but was clearly

dominated by LHC

• LHC has 4 major experiments:ALICE, ATLAS, CMS, and LHCb

• Collaboration sizes:~500, ~1000, ~1000, ~2000

Page 3: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

LHC Event and Data Rates

Event Size

(bytes)

L1 trigger rate

Data rate

Atlas 1.6 x 106 75 kHz 120 GB/s

CMS 1.0 x 106 100 kHz 100 GB/s

Alice 1.0 x 106 20 kHz 20 GB/s

LHCb 3.5 x 104 1 MHz 3.5 GB/s

Page 4: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

PHENIX

• DAQ system used LZO compression to compress raw data after the event builder– Reduced bandwidth requirement– Reduced disk space requirement– Extended time data allowed to linger in

buffer boxes

Page 5: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

PHENIX

Buffer boxes: The longer you can buffer data the better you can take advantage of breaks in data flow.

6 reasonably cheap Linux-based buffer boxes (~20k each) allow 40 hours of data taking without tape access.

L3 trigger can be run on disk data so it only needs to keep up with the average event rate, not the peak rate.

Page 6: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

PHENIX

Analysis Trains: Improve overall use of resources by limiting random access of data files.

About every 3 weeks a new train is started. Jobs register with train ahead of time.

Tapes are read in tape-order and all jobs run on the data at once.

Page 7: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

PHENIX

• 270 TB of data was shipped to computing center in Japan for processing

• This was done by non-experts manning shifts

Page 8: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

ROOT• ROOT is now 11 years old and

represents ~500 man-years of effort

Page 9: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

ROOTThe 2016 laptop: 32 processors, 16GB RAM,

16TB of disk

Multi-core processors are at the doorstep and better multi-threading support is needed.

PROOFI/O (read-ahead)Fitting/Minimization…

Page 10: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

ROOT

• STL and templates take significantly longer to compile.

• Shared libraries become less efficient as the number of packages implemented in them grows

• The new ROOT will be BOOT

Page 11: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

GDML

Witold Pokotski of the GDML development team• Repeated structures are now supported• AGDD guys seem to think they have a better

product and are still a bit bitter• I suggested GDML implement the ability to

apply tweaks in a separate file from the default geometry (they’ll think about it)

Page 12: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

What do you know, people do develop and run physics

analysis software onMS Windows!

Page 13: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

Object Persistence

• Some LHC experiments use POOL which uses Reflex outside of ROOT and then defines TTrees using the Reflex information.

Page 14: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

Object Persistence

• ROOT I/O has many new features making it more viable candidate for general use

• ROOT I/O is based on the Reflex project which uses gccxml

Page 15: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

IEEE Transactions in Nuclear Physics

• Refereed Journal pushing for publications from CHEP type work (software)

• “Hardware guys are very good at publishing. Software guys need to do better then they are.”

Page 16: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,
Page 17: Report on CHEP ‘06 David Lawrence. Conference had many participants, but was clearly dominated by LHC LHC has 4 major experiments: ALICE, ATLAS, CMS,

Conclusions• An abstract really, really should have been

submitted for DANA

• We need to publish (e.g. IEEE TNS)

• ROOT is very strongly supported and will continue to be developed over at least the next 6 years

• CHEP 2007 will be in Victoria, BC. I will be there