INFSO-RI-508833 Enabling Grids for E-sciencE Irish ROC - Report John Walsh Stephen Childs Eamonn...

INFSO-RI-508833

Enabling Grids for E-sciencE

www.eu-egee.org

Irish ROC - Report

John Walsh <john.walsh at cs.tcd.ie>

Stephen Childs <stephen.childs at cs.tcd.ie>

Eamonn Kenny <eamonn.kenny at cs.tcd.ie>

Kathryn Cassidy <kathryn.cassidy at cs.tcd.ie>

Brian Coghlan <coghlan at cs.tcd.ie>

UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 2


INFSO-RI-508833

TCD (partner 15): Overview

• TCD hosts Grid-Ireland OpsCentre (Irish ROC)• TCD also runs a grid site (csTCDie)• Grid-Ireland OpsCentre Management

– Brian Coghlan– John Walsh– Stephen Childs

• Other OpsCentre Staff [ not in PPT]

– Eamonn Kenny– Kathryn Cassidy– David O’Callaghan – Geoff Quigley – John Ryan – Stuart Kenny

• Website: http://www.grid.ie/• Successes

– 30 TCD papers thus far since 2006 – OpsCentre developing adaptive e-Learning (XeL)– Integrated architecture, centrally managed virtualised CE/SE/UI, transactional rollout– Fully virtualised certification, experimental, porting & eLearning Testbeds– Grid-Ireland monitoring (Irish SFTs/I4C/GIDS/trust-eval) plus central Irish AccessGrid service– OpsCentre supports grid MPI (Chair TCG WG, app support, courses, workshop with int.eu.grid, etc)– White Paper and subsequent proposal for a sustainable Irish eInfrastructure (e-INIS)– Grid-Ireland has been confirmed as the defacto Irish NGI– K.Cassidy is Secretary OGF Ed.Training WG, ICEAGE member & ISGCC07 programme committee– JRA1: Stuart Kenny is writing the R-GMA Authorisation code

additional regional effort



INFSO-RI-508833

TCD (partner 15): Overview

• OpsCentre – Irish ROC Management– Local Support for Ireland– Middleware certification– Grid-Ireland central services

– EGEE plus additional services– Deploy/Manage 18 grid gateways – Irish Service Monitoring (I4C)

– Accounting: EGEE and Irish

– Authentication: policy + Irish CA– Authorisation: policy + Irish VOs

– Security: monitoring, vulnerability – All Grid-Ireland operations

• TCD– csTCDie site: 64 CPUs– strongly supports BIOMED VO

• DIAS – cpDIASie site: 32 CPUs

• UCD – mpUCDie site: 256 CPUs– OpsCentre had to develop

remotePBS jobmanager– no non-national VO enabled yet

• ICHEC– giHECie site: 952 CPUs– head-node-only model requires

OpsCentre to develop proxy software– WNs not able to talk to RB/LFC yet

• UCC,NUIG,DCU,NUIM,UL,RCSI,QUB, ARM,DIT,AIT,WIT,ITC,ITTA,ITTR

– no shared resources (yet)– nonetheless, all ready for WNs

96 384 11,500




INFSO-RI-508833

TCD (partner 15): Activity

unfunded unfunded unfunded unfundedFTEs B.Coghlan J.Walsh S.Childs E.Kenny K.Cassidy

SA1.1.1 0.1SA1.2.1 0.1SA1.2.2 0.2SA1.3.2 0.1SA1.3.3 0.2SA1.4.1 0.1SA1.4.2 0.1SA1.4.3 0.1SA1.5.2 0.2SA1.5.3 0.1SA1.5.4 0.1SA1.5.5 0.1SA1.6.2 0.1SA1.7.1 0.1 0.1SA1.8.1 0.1SA1.9.1 0.1

0.3 0.5 1 0 0.2

unfunded unfunded unfunded unfundedFTEs B.Coghlan J.Walsh S.Childs E.Kenny K.Cassidy

SA3.1 0.29SA3.2.1 0.125SA3.2.2 0.125SA3.2.3 0.25

0 0.5 0 0.29 0

matching matching matchingFTEs B.Coghlan J.Walsh S.Childs K.Cassidy

SA1.1.1 0.1SA1.2.1 0.1SA1.2.2 0.2SA1.3.2 0.1SA1.3.3 0.2SA1.4.1 0.1SA1.4.2 0.1SA1.4.3 0.1SA1.5.2 0.2SA1.5.3 0.1SA1.5.4 0.1SA1.5.5 0.1SA1.6.2 0.1SA1.7.1 0.1 0.1SA1.8.1 0.1SA1.9.1 0.1

0.3 0.5 1 0.2voluntary

matching contributionFTEs J.Walsh E.Kenny E.Kenny

SA3.1 0.29 0.7SA3.2.1 0.125SA3.2.2 0.125SA3.2.3 0.25

0.5 0.29 0.7

= being done

• Activity



INFSO-RI-508833


• Activity– TSA1.1.1: ROC Management

Grid-Ireland Production Service, 4 Irish sites EGEE-registered. 18 Irish sites Total Excellent TCD/RAL working relationship

– TSA1.2.1: Coordination and support for m/w deployment Grid-Ireland coordination task simplified to LRMS & WN by integrated deployment architecture

centrally managed with CE/SE/UI/MON virtualised transactional rollout of RPMs & profiles from central repository to site Quattor instances support to deploy on heterogeneous site WNs deployment of remotePBS and customised site information providers

– TSA1.2.2: Regional certification of middleware releases OpsCentre does regional certification of software releases

Certification Testbed (SA1/SA3) - virtualised replica of Grid-Ireland OpsCentre manages Porting Testbed (SA3) OpsCentre manages Experimental TestGrid (research) OpsCentre manages eLgrid (eLearning) infrastructure

– TSA1.3.1: 1st line support for ops problems in region [email protected] RT system

Appropriate Grid-Ireland tickets go through RAL’s footprints to GGUS Bugs go to Savannah

– TSA1.3.2: Oversight and management of ops problems Grid-Ireland Grid Manager (John Walsh) and Deputy Grid Manager (Stephen Childs)

– TSA1.3.3: Run essential regional grid services OpsCentre provides EGEE services plus Grid-Ireland central services (RB/BDII/etc)




INFSO-RI-508833


– TSA1.3.4: Weekly operator on duty support OpsCentre op-on-duty rota

– TSA1.3.5: Grid services for infrastructure or VOs Grid-Ireland monitoring (Irish SFTs/I4C/GIDS) plus central Irish AccessGrid services

– TSA1.4.1: Grid incident response coord in region OpsCentre (TCD’s John Walsh, David O’Callaghan, Stuart Kenny)

• [email protected] and [email protected]– TSA1.4.2: Security vulnerability and risk analysis

Security vulnerability (TCD’s John Walsh, SA1/SA3) Grid-wide Intrusion Detection System (GIDS) developed by TCD Prototype trust evaluation service developed by TCD

– TSA1.4.3: CA management Grid-Ireland CA (TCD) plus RAs (UCD, NUIG)

– TSA1.5.2: helpdesk for ROC Via [email protected] RT system

– TSA1.5.3: VO support, integration support EGEE VOs supported: alice,atlas,cms,lhcb,fusion(int.eu.grid),biomed,egode,planck,dteam,ops Grid-Ireland VOs supported: cosmo,eirevo,gene,webcom,solovo,gitest Central VO Admin support: [email protected] OpsCentre must develop s/w to suit non-EGEE site model for VOs like LHCb OpsCentre specifically supports MPI users

– TSA1.5.4: User training in region Hands-on Irish courses, e.g. Grid MPI Course (with NeSC) OpsCentre developing adaptive e-Learning (XeL) additional regional effort



INFSO-RI-508833


– TSA1.5.5: Site admin training in region Specific Irish Grid admin and VO admin courses

– TSA1.6.2: Accounting coordination in region Irish accounting records published to Grid-Ireland R-GMA

• Irish records for EGEE-registered sites republished to EGEE R-GMA• Irish national VO records very infrequently republished

– TSA1.7.1: National and regional grid projects Existing Irish WebCom-G, CosmoGrid, MarineGrid projects In Jul-06, a White Paper proposed a sustainable Irish eInfrastructure, e-INIS

A proposal was submitted in Mar-07 for funding e-INIS A proposed e-PSI Physical Sciences Initiative coupled to e-INIS

– TSA1.7.2: International grid projects TCD’s Stephen Childs is Chair TCG Working Group on MPI

• Ran the joint EGEE/int.eu.grid MPI Workshop in Dec-06 TCD has been instrumental in establishing strong working relations between EGEE

and int.eu.grid to enhance MPI submission• MPI is very important to Irish computational scientists

Grid-Ireland has been confirmed as the defacto Irish NGI TCD’s Brian Coghlan represents Ireland regarding EGI

– TSA1.8.1: ROC management of resources/SLAs Slow evolution, will be a focus of e-INIS organisation

– TSA1.9.1: ROC representation in coordination All Irish coordination issues involve OpsCentre

• Task simplified by integrated deployment architecture




INFSO-RI-508833


– TSA1.A.3: EGEE conferences (preparation & attendance) TCD delegates at all EGEE conferences, and have made presentations as well

– TSA1.A.5: Participation to Standardisation bodies (GGF) Kathryn Cassidy is Secretary of OGF Ed.Training WG

– TSA1.A.7: Dissemination 30 TCD papers thus far since 2006

See also: http://people.tcd.ie/coghlan#CV_PUBS_D_PREF

– TSA1.A.8: EGEE training (as a trainee) Kathryn Cassidy attended EGEE Summer School

– TSA1.A.9: EGEE training (as a trainer) Kathryn Cassidy is informal NA3 member

• And is ICEAGE member and on ISGCC07 programme committee– TSA1.A.10: Partner related tasks (administration, …)

TCD does cost claims, ICC, PPT, etc.– Non-SA1 activities

Stephen Childs is an active member of LCG Quattor Working Group• Ran the Quattor Workshop in Mar-07

GridPP Deployment Board: John Walsh EUGridPMA: Brian Coghlan & David O’Callaghan JRA1: Stuart Kenny is writing the R-GMA Authorisation code SA3: Eamonn Kenny – coordinator for porting, heterogeneity, works intensively with ETICS SA3: John Walsh - vulnerability, certification (R-GMA)




INFSO-RI-508833


– Grid-Ireland has also developed useful additional middleware Service monitoring

I4C service monitoring, see: http://i4c.sourceforge.net/ GIDS grid-wide intrusion detection system, see:

https://www.cs.tcd.ie/coghlan/pubs/egc05-snort-santag.pdf Prototype trust evaluation service

Jobmanagers RemotePBS jobmanager that allows loosely connected batch systems to be connected

to the EGEE & Grid-Ireland infrastructures (these batch systems are typically in separate administrative domains)

GIP dynamic scheduler plugin for Condor LRMS Virtual Machine support

pypxeboot PXE boot loader for Xen GridBuilder, see: http://gridbuilder.sourceforge.net/

Grid Filesystem gridFS, see: https://www.cs.tcd.ie/coghlan/pubs/FGCS-gridfs-article.pdf

• Notable Successes– Grid-Ireland deploys 5 complete Grids using Quattor

Production, certification, porting, experimental and eLearning

All five Grids are heavily reliant on Virtual Machines

• Irish ROC Future– Will increase number of sites and number sharing resources– Will be a partner in EGEE-III and the Irish NGI member of EGI – Will move towards sustainability




INFSO-RI-508833

Grid-Ireland Accounting



INFSO-RI-508833


INFSO-RI-508833 Enabling Grids for E-sciencE Irish ROC - Report John Walsh Stephen Childs Eamonn...

Documents

Transcript of INFSO-RI-508833 Enabling Grids for E-sciencE Irish ROC - Report John Walsh Stephen Childs Eamonn...