European Network Policy

Group

Malcolm AtkinsonDirector

www.nesc.ac.uk

28th October 2004

Outline

The UK e-Science ProgrammeFunding and organisationThe UK Grid

Example Projects and MiddlewareOGSA-DAIBiomedical applications

Building e-Infrastructure: People, sociological, economic & technical challenges

One e-Infrastructure: for all disciplines – they all need it.

Balance application pull and organised delivery + Engage industry.

International collaboration on building e-Infrastructure essential.

All disciplines and commercial sectors will join in.

What is e-Science?Goal: to enable better research in all applicationsMethod: Invention and exploitation of advanced computational methods

to generate, curate and analyse research data From experiments, observations and simulations Quality management, preservation and reliable evidence

to develop and explore models and simulations Computation and data at extreme scales Trustworthy, economic, timely and relevant results

to enable dynamic distributed virtual organisations

Facilitating collaboration with information and resource sharing Security, reliability, accountability, manageability and agilityDoes e-Science imply new European requirements?

The Primary Requirement …

Enabling People to Work Together on Challenging Projects: Science, Engineering & Medicine

NERC (£15M)7%

CLRC (£10M)5%

ESRC (£13.6M)6%

PPARC (£57.6M)27%

BBSRC (£18M)8%

MRC (£21.1M)10%

EPSRC (£77.7M)37%

Staff costs -Grid Resources

Computers & Networkfunded separately

Applied (£35M)45%

HPC (£11.5M)15%

Core (£31.2M)40%

EPSRC Breakdown

UK e-Science Budget (2001-2006)

Source: Science Budget 2003/4 – 2005/6, DTI(OST)

Total: £213M

+ Industrial Contributions £25M

+ £100M via JISC

Globus Alliance

CeSC (Cambridge)

DigitalCurationCentre

e-Science Institute

Open Middleware

Infrastructure Institute

The e-Science Centres

EGEE

Grid Operations

SupportCentre

NationalCentre fore-SocialScience

National Institute

forEnvironmental

e-Science

CeSC (Cambridge)

The e-ScienceGrid

Engineering Task Force

(Contributions from e-Science Centres)

Grid Support Centre / Grid

Operations Centre

OGSA Test Grid projects

Architecture Task Force

Security Task Force

Usability Task Force

HPC(x)

1600 x CPUAIX

64 x CPU4TB Disk

Linux

20 x CPU18TB Disk

Linux

512 x CPUIrix

The European dimension

EGEE: Enabling Grids for E-Science in Europe

… and beyond32M Euro, 10 regions, 70 partnersAdditional funding from NSF (USA)50% production, 30% development, and 20% dissemination and training

“The Grid Infrastructure in Europe”Deploy a production Grid across EuropeInitially based on LHC Computing Grid

UK NGS will converge and run same e-Infrastructure

Importance of collaboration: VDT

A highly successful collaborative effort

VDT Working GroupVDS (Chimera/Pegasus) team

Provides the “V” in VDT

Condor TeamGlobus AllianceNMI Build and Test team EDG/LCG/EGEE

Middleware, testing, patches, feedback …

PPDG Hardening and testing

Pacman Provides easy installation

capability Currently Pacman 2, moving to

Pacman 3 soon

Used by many projectsSystematic testingRich integration of

componentsEurope should be part of

this – exploit test bedcontribute components

Productise our M/W with this testing & packaging

Thanks to Miron Livny

Where Next for e-Infrastructure

Put people and teams firstInvest in building a communityThe creative forceThe repository of Experience, Skills and Knowledge

Focus on Major PrioritiesDeveloping well-defined Flexible Agreements

Embraced as standards

High-level Software Investment Applications & Requirements led

Explore & Evolve Common & Shared Infrastructure

Recognise and respond to differencesCelebrate and support commonalities

International Collaboration EssentialGlobal ResearchStandards and interoperation

Outline

The UK e-Science ProgrammeFunding and organisationThe UK Grid

Example Projects and MiddlewareOGSA-DAIBiomedical applications

Building e-Infrastructure: People, sociological, economic & technical challenges

One e-Infrastructure: for all disciplines – they all need it.

Balance application pull and organised delivery + Engage industry.

International collaboration on building e-Infrastructure essential.

All disciplines and commercial sectors will join in.

OGSA

Infrastructure Architecture

Grid or Web Service Infrastructure

Data Intensive Applications for Science X

Compute, Data & Storage Resources

Distributed

Simulation, Analysis & Integration Technology for Science X

Data Intensive X Scientists

Virtual Integration Architecture

Generic Virtual Data Access and Integration Layer

Structured DataIntegration

Structured Data Access

Structured Data Relational XML Semi-structured-

Transformation

Registry

Job Submission

Data Transport Resource Usage

Banking

Brokering Workflow

AuthorisationOGSA-DAI

OGSA-DAI Downloads R4

690 downloads since May 04-Actual user downloads not search engine crawlers-Does not include downloads as part of GT3.2 releases

Total of 838 registered users

R1.0 (Jan 03) 104R1.5 (Feb 03) 108R2.0 (Apr 03) 250R2.5 (Jun 03) 291R3.0 (Jul 03) 792R3.1 (Feb 04) 630

Total 2865

United Kingdom21%

China26%

United States

13%

Japan

5%

Unknown7%

Germany5%

Italy5%

Austria2%

Australia2%

France3%

Taiwan2%

Downloads by Country – OGSA-DAI R4.0

Database GrowthPDB Content Growth

Wellcome Trust: Cardiovascular Functional Genomics

Glasgow Edinburgh

Leicester

Oxford

LondonNetherlands

Shared dataPublic curated

data

BRIDGESIBM

Biochemical Pathway Simulator

Closing the inf ormation loop – between lab and computational model.

(Computing Science, Bioinformatics, Beatson Cancer Research Labs)

DTI Bioscience Beacon Project Harnessing Genomics Programme

Slide from Muffy Calder, Glasgow

Now largest EU project in the Life Sciences – see http://www.cancerresearchuk.org/news/pressreleases/scottishscientists_22july04

Walter Kolch

eDiaMoND – Compute

Mammograms have different appearances, depending on image settings and acquisition systems

StandardMammoFormat

StandardMammoFormat

Temporal mammography

ComputerAidedDetection

3D View

Provided by eDiamond project: Prof. sir Mike Brady et al.

Automatic registration technology

Rigid registration of MR and CT imagesof the head

Inter-subject image warpingProvided by IXI project: Prof. Derek Hill et al.

e-Science Institute Figures for 3 Years

We have run just under 7 per month (up from just over 6 at last Review)

19,456 delegate days248 events8,329 delegates (many ‘repeats’)421 event days (in 750 working days)

Further statistics exclude GGF5, as we did not handle registration so cannot do a detailed analysis.

Events held in the 3rd Year(from 1 Aug 2003 to 31 Jul 2004)

We had 114 (86,48) events: (Year 2 & 1 figures in brackets)

7 project meetings ( 11, 4)8 research meetings ( 11, 7)34 workshops (25, 18) 2 schools (2, 0)18 training sessions (15, 8)26 outreach events (12, 3)6 international meetings (5,1)4 conferences (0,1)9 e-Science management meetings (5, 7)

Attendance from different countries

0

100

200

300

400

500

600

700

800

900

Year

1/Q

2

Year

1/Q

3

Year

1/Q

4

Year

2/Q

1

Year

2/Q

2

Year

2/Q

3

Year

2/Q

4

Year

3/Q

1

Year

3/Q

2

Year

3/Q

3

Year

3/Q

4

Other

Australasia

North America

Europe (non UK)

UK (Other)

AC.UK

Involvement in EGEE reflected in increase in EU participation

Take home messages

E-Science is for everybody & every disciplineEnvironment, health, safety, design, science, humanities

To enable itBuild “people grids”And “institution e-Infrastructures”

The TechnologyWill support useful work nowBut still too hard to use & hard to sustain

Work on the TechnologyMiddleware, Portals, Security, Networks collaboratively