S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary...

S.L.Lloyd Grid Steering Committee 8 March 2002

Slide 1

Status of GridPP

• Overview• Financial Summary• Recruitment Status• EU DataGrid• UK Grid Status• GridPP and the e-Science Centres


Slide 2

GridPP Overview

Provide architecture and middleware

Use the Grid with simulation data

Use the Grid with real data

Future LHC Experiments

Running US Experiments

Build prototype Tier-1 and Tier-2s in the UK and implement middleware in experiments


Slide 3

Allocation of GridPP Funds

CERN Hardware7%

CERN Staff26%

UK Managers 5%

UK DataGrid Posts15%

Misc1%UK Hardware

14%

UK GridPP Posts15%

UK Transferred Posts12%

Travel5% Tier-0

Applications

Tier-1/A

Middleware

Applications/System


Slide 4

Recruitment

• EU Funded Posts (Middleware/Testbed)– All 5 in post + 1 additional from 1/2/02

• EDG Unfunded Posts (Middleware/Testbed)– 13.5 out of 15 in post– (1 under offer, 0.5 starts 1/4/02 + 0.5 from CeSC)

• GridPP Posts (Applications + Tier1/A) – Allocated Dec 2001– ~7 out of 15 ~in post

• CERN Posts– First Round > 100 Applicants– 12 Offers, 1 Refusal, 1 Postponed– 3 Fellows, 5 Staff members, 2 UK University Staff– 4 in Applications, 2 Data Management, 3 Systems, 1

Management


Slide 5

Recruitment

Overall: • Initially problems with EU Funded posts at RAL.• Since then no real problems recruiting - mixture of

academic and software industry backgrounds.• Delays mainly caused by (University) bureaucracy.


Slide 6

EU DataGrid

• First EU Review of DataGrid completed last week.– Verbal feedback very positive.– Reviewers commended overall good performance.– Several areas above expectations.– All deliverables accepted as they are.– Earlier UK concerns successfully overcome.

• UK Contributions– Architectures– Testbed-1– Network Monitoring– Storage Element– Certificates & Security– R-GMA– LCFG– MDS deployment– Spitfire– …


Slide 7

LCFG

The LCFG Architecture

LCFG Source Files

mkxprof

Web Server

XML Profi le

ldxprofldxprof

GenericComponent

GenericComponent

rdxprofrdxprof

LCFG Components

DBM File

Server

Client


Slide 8

R-GMA

Consumer Servlet

RegistryAPI

Consumer Servlet

RegistryAPI

Consumer Servlet

RegistryAPI

Consumer Servlet

RegistryAPI

Sensor Code

ProducerAPI

Application Code

ConsumerAPI

ProducerServlet

RegistryAPI

Registry Servlet

SchemaAPI

Schema Servlet

“Event Dictionary”

Application Code

ArchiverAPI

DBProducer

DBProducerServlet

Archiver Servlet

ConsumerAPIConsumer

APIConsumerAPIConsumer

API

User code monitors output here.

User code here.Builds on R-GMA

Database Structures. Relational Grid Monitoring Architecture


Slide 9

EDG Testbed Status

• For EU Review of DataGrid on 1st March a Testbed 1.1 grid of 5 sites was constructed:– CERN, RAL, IN2P3-Lyon, CNAF-Bologna, NIKHEF.– The demos included jobs running at all sites and moving

data.– This had the required functionality working but proved

unreliable.• An attempt will be made to make it stable in Release 1.1.2

– Then it will be released to more sites • In UK we have a rollout plan that will start then.

– Most sites plan to be involved in the GridPP Grid in some way.

– Core UK sites at first will be RAL, Bristol, Manchester, IC where we have funded WP6 effort.


Slide 10


Slide 11


Slide 12

UK Tier1/A Status

Hardware Purchase for delivery in March156 Dual 1.4GHz 1GB RAM, 30GB disks 26 Disk servers (Dual 1.266GHz) each

with 1.9TB diskExpand the capacity of the tape robot by

about 35TB

Current setup14 Dual 1GHz PIII, 500MB

RAM 40GB disksCompute Element (CE)Storage Element (SE)User Interface (UI)Information Node (IN)

Central Facilities (Non Grid)

250 CPUs10TB Disk35TB Tape (Capacity

330 TB)


Slide 13

Tier-2 - ScotGrid

ScotGrid Processing nodes at Glasgow 59 IBM X Series 330 dual 1 GHz Pentium III with 2GB memory • 2 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory and dual ethernet • 3 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory and 100 + 1000 Mbit/s ethernet • 1TB disk • LTO/Ultrium Tape Library • Cisco ethernet switches

ScotGrid Storage at Edinburgh• IBM X Series 370 PIII Xeon with 512 MB memory 32 x 512 MB RAM • 70 x 73.4 GB IBM FC Hot-Swap HDD

BaBar UltraGrid System at Edinburgh• 4 UltraSparc 80 machines in a rack 450 MHz CPUs in each 4Mb cache, 1 GB memory • Fast Ethernet and MirrorNet switching

CDF equipment at Glasgow• 8 x 700 MHz Xeon IBM xSeries 370 4 GB memory 1 TB disk

Griddev testrig at Glasgow• 4 x 233 MHz Pentium II


Slide 14


Slide 15


Slide 16

GridPP & Core e-Science Centres

• NeSc– Close ties, hosted 2nd GridPP Collaboration

Meeting, Collaboration on EDIKT Project? Training...

• Belfast– Replied but not yet up and running.

• Cambridge– Close ties, hosted 3rd GridPP Collaboration

Meeting. Share one post with GridPP. Will collaborate on ATLAS Data Challenges.

• Cardiff– Replied - contacts through QM (Vista) and Brunel

GridPP Group.

Written formally to all e-Science centres inviting contact and collaboration with GridPP.


Slide 17

GridPP & Core e-Science Centres

• London– No formal reply but close contacts through IC

HEP Group. IC will host 5th GridPP Collaboration Meeting.

• Manchester– No reply. Manchester HEP Group will host 4th

GridPP Collaboration Meeting.

• Newcastle– In contact - Database projects?

• Oxford– Close ties, collaboration between Oxford HEP

Group and GridPP on establishment of central Tier-2 centre? CS/Core-GridPP-EDG links? Probably host 6th GridPP Collaboration Meeting.

• Southampton– Replied but no collaboration as yet.


Slide 18

Summary

OGSA

• GridPP Project up and running• EDG Middleware development well

underway– Recruitment ~ complete – 1st EU Review successful

• EDG Testbed 1 being rolled out– UK in 1st rollout– Now extend to several UK sites

• Application Development– Just starting– Recruitment underway– 1st US tests successful

• UK Grid– 1st Procurement for RAL Tier-1/A

underway– Tier-2s developing

• Core e-Science Centres– Good relationships evolving

S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary...

Documents

Transcript of S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary...