Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev...
-
Upload
collin-mclaughlin -
Category
Documents
-
view
219 -
download
0
Transcript of Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev...
![Page 1: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/1.jpg)
Experience of xrootd monitoring for ALICE at RDIG sites
G.S. Shabratova JINRA.K. Zarochentsev SPbSU
![Page 2: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/2.jpg)
Xrootd Monitoring
• Static monitoring - Bdii • Dynamic monitoring – Monalisa and “xRootd
federation monitoring”
![Page 3: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/3.jpg)
2 xrootd BDII versions(from Claudiu Schiaua ( [email protected]))
• Xrootd information service (xis) 2009• glite-info-provider-SE_xrootd (gip) 2010
![Page 4: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/4.jpg)
xis
• http://niham.nipne.ro/xis/xis.install.html• 2-d xrootd serivce on xis server :
root://xishost: 2194• Xrootd clients on xrootd servers.• Xrootd client on information provider (bdii
server)
![Page 5: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/5.jpg)
gip
• http://indico.cern.ch/getFile.py/access?contribId=0&resId=0&materialId=slides&confId=77435
• http://niham.nipne.ro/NIHAM-repo/instr.html Xrootd client on gip and bdii server Scheme:GlueSALocalID=xroot:SA
>ClueVOinfoLocalID=xroot:VOID:alice
![Page 6: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/6.jpg)
xrootd in ldap
![Page 7: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/7.jpg)
DPM and xrootd in BDII
http://gstat2.grid.sinica.edu.tw/gstat/site/RU-SPbSU/treeview/bdii_site/alice23.spbu.ru/
http://gstat2.grid.sinica.edu.tw/gstat/ldap
DPM
XROOTD
![Page 9: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/9.jpg)
Requirements to dynamic monitoring
• Transfers details:– Host out (ip)– Host in (ip)– Size of file– Number of files
• Statistic details:– Size of packages for host out (in) by time– Errors
![Page 10: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/10.jpg)
Proposed Architecture to Monitoring & Control the Xrootd in ALICE
Long HistoryDB
MonALISA
Network Monitoring
ApMon
XROOTDSERVER
SystemMonitoring
MonaLisaXrootd Repository
Aggregated Data
Alerts
Actions
Xroootd Monitoring and Control, Harish Arora, Cern
ControlModule
Control / Update
MonALISA
Network Monitoring
ApMon
XROOTDSERVER
SystemMonitoring
ControlModule
MonALISA
Network Monitoring
ApMon
XROOTDSERVER
SystemMonitoring
ControlModule
![Page 14: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/14.jpg)
MonALISA from gui client
• GUI client from alimonitor.cern.ch:
• Or form http://monalisa.caltech.edu/monalisa.htm :
![Page 15: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/15.jpg)
MonALISA from gui client
![Page 16: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/16.jpg)
MonALISA from console
• Need:– Monalisa Repository from
http://monalisa.caltech.edu/:
– And monalisaWSClients :
![Page 17: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/17.jpg)
MonALISA from console
• Result:
![Page 18: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/18.jpg)
xRootd federation monitoring
• 17 July 201215.45-16.00ATLAS Off-Grid Sites (Tier-3) Monitoring A.S. Petrosyan, D.A. Oleynik, S.D. Belov, J. Andreeva, I.S. Kadochnikov (on behalf of the ATLAS collaboration)
![Page 19: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/19.jpg)
Data flow for XRootD• Both summary and detailed events
gatherer implemented as Linux daemon• Summary data goes directly to Ganglia• File transfer data can be stored in local
PostgreSQL and then presented via Ganglia
• Detailed data can be delivered to ActiveMQ directly
• Data being sent to global level:• Domain from, host and ip address• Domain to, host and ip address• User• File, size• Bytes read, written• Time transfer started and finished
1917.07.2012 GRID'2012, JINR, Dubna
![Page 20: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/20.jpg)
Conclusions:• Bdii monitoring works, but not supported and
rarely used• Monalisa monitoring works, but can not
monitor separate transfer• “xRootd federation monitoring” – we wait it in
the near future.
![Page 21: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/21.jpg)
Many thanks:
• Sergey Belov• Daniil Oleynik• Artem Petrosyan• Andrey Kiryanov• And etc
![Page 22: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649e4d5503460f94b43a14/html5/thumbnails/22.jpg)
Questions?