Status of the DESY Grid Centre
Volker Guelzow for the Grid TeamDESY ITHamburg, October 25th, 2011
Volker Guelzow | PRC | 25.10.2011 | Page 2
Outline
> The 2011 DESY Grid centre status
>Requests and Pledges for WLCG
> The NAF@DESY
> PRC relevant IT-Projects @DESY
> The German Tier 2 situation
> Summary
Volker Guelzow | PRC | 25.10.2011 | Page 3
DESY Grid Centre usage by VO
Volker Guelzow | PRC | 25.10.2011 | Page 4
The German T2‘s (Atlas, CMS, LHCb)
Pledges for Germany
CPU 2012 [HS]
CPU 2012 [% Tot]
Disk 2012 [TB]
Disk 2012 [% Tot]
A DESY 12000 5 1500 3C Aachen/DESY 23625 8 1950 8A Goettingen 3853 1 1000 2A Munich 11560 4 1340 3A FR/Wupp 8860 3 1566 3 L DESY 3200 7 2 10Summe CMS 23625 8 1950 8Summe Atlas 36273 13 5406 11
SumDESY 29950 2852 SumNonDESY 33346 4506
Grand Tot Atlas-T2
266000 47000
GrandTot CMS- T2
315000 26000
Volker Guelzow | PRC | 25.10.2011 | Page 5
Atlas delivered vs. pledged CPU resources@DESY
Volker Guelzow | PRC | 25.10.2011 | Page 6
CMS delivered vs pledged computing
Volker Guelzow | PRC | 25.10.2011 | Page 7
DESY T2 availability/reliability from WLCG monitoring
Volker Guelzow | PRC | 25.10.2011 | Page 8
ATLAS: DESY and German Cloud contributions (1)
>DESY (HH+ZN together) competing with ATLAS T1’s
> All jobs since 1.1.2011:
Volker Guelzow | PRC | 25.10.2011 | Page 9
ATLAS: DESY and German Cloud contributions (2)
> Excellent reliability:
> ATLAS GangaRobot hourly tests: Expect 95% reliability
Aug&Sept 2011, all ATLAS T2
Volker Guelzow | PRC | 25.10.2011 | Page 10
CMS Tier-2 Contribution
Volume of subscribed data sets at Tier-2sTB
T2_D
E_D
ESY
T2_C
H_ C
ERN
T2_U
K_ L
ondo
n_IC
T2_U
S_ V
ande
rbilt
T2_U
K_ S
Gr id
_RA
LPP
T2_U
S_ C
alt e
chT2
_US
_ Wis
cons
inT2
_US
_ Pur
d ue
T2_U
S_ F
lor id
aT2
_US
_ Neb
rask
aT2
_US
_ MIT
T2_F
R_ I
PHC
T2_U
S_ U
CS
DT2
_ES
_ CIE
MA
TT2
_BE_
IIHE
T2_F
R_ G
RIF
_IR
F UT2
_IT_
Rom
eT2
_IT_
Bar
iT2
_FR
_ CC
IN2P
3T2
_IT_
P isa
T2_B
E_U
CL
T2_F
R_ G
RIF
_LL R
T2_R
U_ J
INR
T2_I
T_L e
gnar
oT2
_IN
_ TIF
RT2
_UK
_ Lon
don_
Bru
n el
T2_A
T_V
ien n
aT2
_CH
_ CS
CS
T2_E
S_ I
FCA
T2_D
E_R
WT H
T2_C
N_ B
eij in
gT2
_EE_
Esto
nia
T2_T
W_T
aiw
anT2
_FI_
HIP
T2_B
R_ U
ERJ
T2_H
U_ B
udap
est
T2_T
R_ M
ETU
T2_R
U_ S
INP
T2_U
A_K
IPT
T2_P
L_W
arsa
wT2
_UK
_ SG
r id_B
risto
lT2
_PT_
NC
G_L
isbo
nT2
_RU
_ IN
RT2
_PK
_ NC
PT2
_PT_
LIP_
Lisb
o nT2
_RU
_ ITE
PT2
_RU
_ PN
P IT2
_PL_
Cra
c ow
0.00
100.00
200.00
300.00
400.00
500.00
600.00
700.00
800.00“Unregistered” data DESY[TB] RWTH[TB]
/store/user 290* 113
/store/group 14 78
*580TB brutto
FNALLPC=US “interactive” analysis facility
Analysis & MC production jobs since June 2011Still large failure fraction
- Wasting ~20% of resources- Mainly bad user jobs
- Very good performance- DESY is a very important CMS Tier-2
- Very good performance- DESY is a very important CMS Tier-2
Subscribed Phedex data
TB
Volker Guelzow | PRC | 25.10.2011 | Page 11
NAF usage
>NAF well utilized.
>Operation very smooth and reliable since last PRC
>UHH/CMS strong user (own purchases!)
CPU usage 15.4-15.10.2011
Lustre usage 20.10.2011
Volker Guelzow | PRC | 25.10.2011 | Page 12
NAF CPU resources
> Total (with recent purchases) 41.3 kHS06
3000 Slots
Huge contribution UniHH/CMS
>Detail on purchases in 2011 7.8 kHS06/576 cores: 0.5 replacement, 0.5
enlargement beginning 2011 (from DESY budget)
3 kHS06/192 cores: mostly replacement in Zeuthen recently (from DESY budget)
9.2 kHS06/672 cores: upgrade in Hamburg recently (from DESY budget)
9.2 kHS06/672 cores: upgrade in Hamburg recently (from UniHH/CMS group!)
> Plan for 2012 Await technology change end 2011 (AMD
Interlagos) / 2012Q1 (Intel SandyBridge), planning end of 2012Q1
In 2012: Plan for additional 10 kHS06
NAF purchases given to experiments accordingto the key 4 ATLAS / 2 CMS / 1 ILC / 1 LHCB
Volker Guelzow | PRC | 25.10.2011 | Page 13
Datatransfer from Storage Element (1 week sample)
Volker Guelzow | PRC | 25.10.2011 | Page 14
Future plans for the NAF
>Replacement of Lustre file system call for tenders ongoing
> Strengthen NAF reliability, availability and performance reduce impact on the HH-ZN WAN network connection
make two NAF parts more independent
>New features for NAF, requested by users e.g. Fast X-Connection, collaborative tools, …
>Hardware enlargement plans: See slide “NAF CPU resources”
Volker Guelzow | PRC | 25.10.2011 | Page 15
PRC relevant IT-Projects@DESY
>Helmholtz Alliance until end 2012
> Tier 1 for Icecube and Computing for CTA in Zeuthen
> LHCone: Initiative to connect T2‘s and T3‘s, needs more experience and monitoring for further decisions
> European Middleware initiative (dCache) until mid 2013
> Large Scale Datamanagement project starting in 2012
> Active role in HPC- initiative of the HGF (may end in funding)
Volker Guelzow | PRC | 25.10.2011 | Page 16
The German Tier 2 Situation
> Funding of the NAF@ DESY secured through base investment
> Funding of Tier 2‘s@DESY secured trough base&capital investment
> Funding of ½ Tier 2 @MPI secured
> Funding of Universities‘ Tier 2: Invest only secured until mid 2012
Different ideas are under debate, DESY may be asked to act as a coordinator
Volker Guelzow | PRC | 25.10.2011 | Page 17
Summary
> The DESY-Grid-Centre again was very reliable
> The DESY T2 Centre is larger than some T1‘s centres
> The DESY T2 is very attractive because of the available data
> The NAF was used intensively and nationwide
> The NAF is in the process of further development, major upgrades took place and are planned
> dCache is still the major working horse for LHC datamanagement and DESY has the lead
>DESY is very active in attracting 3rd party money
> There is still an open financing issue for the Universities‘ Tier 2 after end 2012
Top Related