Gluex Data Challenge 2

10
Gluex Collaboraton Meeting, Newport News, May 12-14, 2014 Gluex Data Challenge 2 PRODUCTION ON THE OPEN SCIENCE GRID RICHARD JONES 1

description

Gluex Data Challenge 2. Production on the Open Science Grid Richard Jones. Production overview. Wall time daily usage. Usage on Fermilab site. Usage on the Purdue site. Usage on the Northwestern site. Usage on the UConn site. Production site summary. Finding the inefficiencies. - PowerPoint PPT Presentation

Transcript of Gluex Data Challenge 2

Page 1: Gluex  Data Challenge 2

1

Gluex Collaboraton Meeting, Newport News, May 12-14, 2014

Gluex Data Challenge 2PRODUCTION ON THE OPEN SCIENCE GRIDRICHARD JONES

Page 2: Gluex  Data Challenge 2

2Production overviewRun number Beam

intensityevents (M) files cpu hours

9001 1 x 107 3980 398017 2,049,3219002 5 x 107 240 48126 319,4109003 0 945 94494 212,718

Page 3: Gluex  Data Challenge 2

3Wall time daily usage

Page 4: Gluex  Data Challenge 2

4Usage on Fermilab site

Page 5: Gluex  Data Challenge 2

5Usage on the Purdue site

Page 6: Gluex  Data Challenge 2

6Usage on the Northwestern site

Page 7: Gluex  Data Challenge 2

7Usage on the UConn site

Page 8: Gluex  Data Challenge 2

8Production site summary

Page 9: Gluex  Data Challenge 2

9Finding the inefficienciesWall-clock-weighted job success rate

Page 10: Gluex  Data Challenge 2

10Digesting these results

450k files (14TB) now globally available online from UConn via srm

Virtually none of the inefficiency came from srm (non)availability Jlab has started pulling dc2 files from UConn to archive on the

mss Substantial inefficiencies exist at several sites

Under study, one site at a time

Production works, even if there are remaining inefficiencies More Gluex sites are needed to improve production stats