The Grid Prof Steve Lloyd Queen Mary, University of London.

15
The Grid Prof Steve Lloyd Queen Mary, University of London

Transcript of The Grid Prof Steve Lloyd Queen Mary, University of London.

Page 1: The Grid Prof Steve Lloyd Queen Mary, University of London.

The Grid

Prof Steve Lloyd Queen Mary, University of

London

Page 2: The Grid Prof Steve Lloyd Queen Mary, University of London.

The Grid

The Physics Challenge

Steve Lloyd Slide 2

10 o

rders

of

mag

nit

ud

e All interactions

The Higgs

Standard Model: Jets, W, Z

Relative number of events

Page 3: The Grid Prof Steve Lloyd Queen Mary, University of London.

The Grid

Event Complexity

Steve Lloyd Slide 3

25 Separate Interactions

8 Jet Event

Page 4: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 4

The Data Deluge

Collisions 40 Million times a second (40MHz)

150 Million electronic channels

Petabytes of data per year

1 Petabyte = 1000 Terabytes1 Terabyte = 1000 Gigabytes1 Gigabyte = 1000 Megabytes

Total ATLAS Disk Used

100 PB

2008 2012

Page 5: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 5

E = mc2

Grid Middleware

Solution is a massive distributed computer system – The Grid

From Web to Grid

• Relatively inexpensive

• Scalable• Simple (?) to use• Accessible 24/7• Easily upgraded• Robust

Page 7: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 7

Computing and Data Centres

Fibre Optics of the Internet

Computing Grid

Page 8: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 8

The Grid – A Distributed PC

MIDDLEWARE

CPUDisks, CPU etc

PROGRAMS

OPERATING SYSTEM

Word/Excel

Email/Web

Your Progra

mGames

CPUCluste

r

UserInterfac

eMachine

CPUCluste

r

CPUCluste

r

Workload Manageme

nt

Information Service

Single PC

Grid

DiskServer

Your Progra

m

Middleware is the Operating System of a distributed computing

system

Replica CatalogueBookkeepin

g Service

Page 9: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid

Brunel

Tier-0

Tier-1National centres

Tier-2Regional groups

Institutes

Servers

Offline farm

Online system

CERN computer centre

RAL,UK

ScotGrid NorthGridSouthGrid London

FranceItalyGermanyUSA

Imperial QMUL RHULUseful model for Particle Physics but not necessary for others

UCL

Slide 9

Tier Structure

Page 10: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 10

Tier-1 v Tier-2

Tier-1s – International role Tier-2s – Leverage University funding, Local

publicity

RAL Tier-1: 7,400 PC Equivalents, 2.3PB Disk, 5PB

TapeQMUL Tier-2: 3,500 PC Equivalents, 1.7PB Disk

Page 11: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid

Problems that are highly parallelizable

Problem

Grid

Solution

Input data is independent e.g. Images:

A=2B=3 A=3

B=3 A=2B=4

Simulation using different parameters:

Not so good for closely coupled problems

These pieces may be independent

These pieces will have to interact

What is a Grid good for?

Slide 11

Page 12: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid

• Astronomy

• Healthcare

• Bioinformatics

• Gaming

• Engineering

• Commerce

Other Applications

Slide 12

Page 13: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 13

Other Applications

Allow use by other scientific disciplines such as Bioinformatics

Page 14: The Grid Prof Steve Lloyd Queen Mary, University of London.

The Grid

CERN@school

Steve Lloyd Slide 14

Take data from Medipix Detector Chips and make available via the Grid (Simon Langton Grammar School for Boys,

Canterbury)

Available for use in schools – cosmic

rays, radioactivity etc

LUCID flying on TechDemoSat-1

in Autumn 2012

Schools

Schools

Schools

Coordinator School

Local University

Grid

Schools

Schools without Chips will be able to contribute to

analysis

Page 15: The Grid Prof Steve Lloyd Queen Mary, University of London.

Steve Lloyd The Grid Slide 15

The Real Time Monitor

Try it yourself (Java App): http://rtm.hep.ph.ic.ac.uk/