LcgCAF:CDF submission portal to LcgCAF:CDF submission portal to LCGLCG

Federica Fanzago Federica Fanzago for for

CDF-Italian Computing GroupCDF-Italian Computing GroupGabriele Compostella, Francesco Delli Paoli, Gabriele Compostella, Francesco Delli Paoli,

Donatella Lucchesi, Daniel Jeans, Subir Sarkar Donatella Lucchesi, Daniel Jeans, Subir Sarkar and Igor Sfiligoiand Igor Sfiligoi

CDF Italian Computing Group 2

CAF

CDF Data Handling ModelCDF Data Handling Model

Fermilab: host data and a farm used mainly to analyze data, the CAF Central Analysis Facility Remote sites: have a decentralized CAF (dCAF) where Monte Carlo are produced and later copied to FNAL, some sites (ex. CNAF) has data CAF and dCAF are CDF dedicated farms structured:

Head Node

Monitor

Mailer

Submitter

User DesktopWorkernodes

CafExe

MyJob.sh

MyJob.exe

Developed by: H. Shih-Chieh, E. Lipeles, M. Neubauer, I. Sfiligoi,F. Wuerthwein

CDF Italian Computing Group 3

Moving to a GRID Computing ModelMoving to a GRID Computing Model

Reasons to move to a GRID computing model

Need to expand resources, luminosity expect to increase by factor 8 until CDF ends Resource were in dedicated pools, limited expansion and need to be maintained by CDF persons GRID resources can be fully exploited before LHC experiments will start analyze data CDF currently access in Europe more than 5000 KSpecInt2000! No hope of having so many resources without GRID

CDF Italian Computing Group 4

LcgCAF: General ArchitectureLcgCAF: General Architecture

CDF-SE

CDF-UI

…

Robotic tape Storage

GRID site CE and worker nodes

User Desktopjobjob

CDF user musthave access toCAF clients andKerberos V ticket

ou

tpu

t

output

CDF Italian Computing Group 5

Job Submission and ExecutionJob Submission and Execution

CDF-UIMonitor

Submitter Mailer

Job …

WMS

WN

WN

Monitor: provide job information to user Submitter: create JDL. Retrieve user tarball and make it available to WN Mailer: send mail to user when job is over

CDF Italian Computing Group 6

Job MonitorJob Monitor

CDF-UI

Information System

Job information

WN information

Interactive Job Monitor:

CafMon kill CafMon tail CafMon dir CafMon log CafMon top CafMon ps

WN: job wrapper collects information like load, dir, ps, topWMS : keeps track of job information

WMS

WN

CDF Italian Computing Group 7

CDF Code DistributionLcg site: CNAF

Lcg site: Lyon

… …

Proxy Cache

Proxy Cache

/home/cdfsoft

/home/cdfsoft

No CDF code or Run Condition Database need to be available on WN On demand Parrot translates local warning in HTT requests towards Fermilab code server and DB To be scalable when a site has many equal requests the information are cached near WN using squid

CDF Italian Computing Group 8

CDF Output storage

From CDF-SE or CDF storage output copied using gridftp to FNAL fileservers. An automatic procedure copies files from fileservers to tape and declare them to the catalogue

…CDF-SE

Job outputWorker Nodes

…CDF-Storage

gridftp

KRB5 rcp

CDF Italian Computing Group 9

Performances

Samples Events on tape

with 1 Recovery

Bs->Ds Ds-> 1969964 ~92% ~100%

Bs->Ds Ds->K*K

2471751 ~98% ~100%

Bs->Ds Ds->KsK

1774336 ~92% ~100%

CDF B Monte Carlo production

#segments succeeded# segments submitted

GRID failures: site miss-configuration, temporary authentication problems, WMS overloadLcgCAF failures: Parrot/Squid cache stackedRetry mechanism: necessary to achieve ~100% efficiencyWMS retry for GRID failures and LcgCAF “home-made” retry based on logs parsing

CDF Italian Computing Group 10

Future developments

An interface between SAM (CDF catalogue) and GRIDservices is under development. This will allow:

File declaration into the catalogue directly from LcgCAF

Automatic transfer of files from LCG sites to FNAL tape Possibility of data analysis on LCG sites by single user

CDF Italian Computing Group 11

Conclusions

Site Country KSpecInt2K

CNAF-T1 Italy 1500

INFN-Padova Italy 60

INFN-Catania Italy 248

INFN-Bari Italy 87

INFN-Legnaro Italy 230

IN2P3-CC France 500

FZK-LCG2 Germany

2000

IFAE Spain 20

PIC Spain 150

UKI-LT2-UCL-HE UK 300

Liverpool UK 100

CDF has developed a portal to access the LCG resources Currently CDF access the following sites:

CDF has produced and is producing Monte Carlo data exploiting these resources demonstrating that GRID can serve also a running experiment