Open Science Grid Consortium of many organizations (multiple disciplines) Production grid...

30

Transcript of Open Science Grid Consortium of many organizations (multiple disciplines) Production grid...

Page 1: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 2: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

Open Science GridConsortium of many organizations (multiple

disciplines)Production grid cyberinfrastructure80+ sites, 25,000+ CPU

Page 3: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

The Evolution of the OSG

1999 2000 2001 2002 20052003 2004 2006 2007 2008 2009

PPDG

GriPhyN

iVDGL

Trillium Grid3 OSG(DOE)

(DOE+NSF)(NSF)

(NSF)

Campus, regional grids

LHC OpsLHC construction, preparation

LIGO operation LIGO preparation

European Grid + Worldwide LHC Computing Grid

DOE Science Grid (DOE)

Page 4: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Britta DaudertCalifornia Institute of Technology

Britta is an OSG user with the Laser Interferometer Gravitational Wave Observatory (LIGO) experiment; gravity wave research is one of OSG’s principle science drivers.

Page 5: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Brian BockelmanUniversity of Nebraska at Lincoln

Brian is the site administrator for the computing resources at U of Nebraska for the CMS experiment. These machines contribute cycles to OSG.

Page 6: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Rob QuickIndiana University

Rob manages the Grid Operations Center, the OSG operations control center that monitors grid health 24hrs/day, 7 days/week.

Page 7: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Page 8: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 9: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

Open Science Grid Basics Who

Comp. scientists, IT specialists, physicists, biologists, etc.

WhatShared computing and storage resourcesHigh-speed production and research networksMeeting place for research groups, software experts, IT

providers

VisionMaintain and operate a premier distributed computing facilityProvide education and training opportunities in its useExpand reach & capacity to meet needs of stakeholdersDynamically integrate new resources and applications

Members and partnersMembers: HPC facilities, campus, laboratory & regional

gridsPartners: Interoperation with TeraGrid, EGEE, NorduGrid,

etc.

Page 10: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Doug OlsonLawrence Berkeley National Laboratory

Doug serves as the OSG deputy of operations and security. With a computing grid the size of OSG, security is an important consideration.

Page 11: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Alain RoyUniversity of Wisconsin-Madison

Alain is the software coordinator for OSG, in charge of the integration and configuration of the OSG distributed computing middleware.

Page 12: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Jim ShankBoston University

Jim works on high energy physics: "Using OSG we've achieved a 97% efficiency in simulation production, exceeding our expectations.”

Page 13: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Page 14: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 15: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 16: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

OSG Principal Science Drivers High energy and nuclear physics LIGO (gravity wave search) Digital astronomy Other sciences coming forward

BioinformaticsNanoscienceEnvironmentalChemistryApplied mathematicsMaterials Science

Page 17: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Abhishek Singh RanaUniversity of California San Diego

Abhishek is an organizer and active participant in the OSG User Group.

Page 18: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Mine AltunayFermilab

Mine serves as the OSG Security Officer. "OSG is … where scientists focus on science and team work rather than getting the [compute] tools to work.”

Page 19: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Paul AveryUniversity of Florida

Paul’s research is in high energy physics. As a founding member, he serves as a co-PI of the OSG. U of Florida contributes many compute resources to the OSG.

Page 20: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Page 21: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 22: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

Partners: Federating with OSG Campus and regional

Grid Laboratory of Wisconsin (GLOW) Grid Operations Center at Indiana University (GOC) Grid Research and Education Group at Iowa (GROW) Northwest Indiana Computational Grid (NWICG) New York State Grid (NYSGrid) (in progress) Texas Internet Grid for Research and Education (TIGRE) nanoHUB (Purdue) LONI (Louisiana)

National Data Intensive Science University Network (DISUN) TeraGrid

International Worldwide LHC Computing Grid Collaboration (WLCG) Enabling Grids for E-SciencE (EGEE) TWGrid (from Academica Sinica Grid Computing) Nordic Data Grid Facility (NorduGrid) Australian Partnerships for Advanced Computing (APAC)

Page 23: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Chander SehgalFermilab

As OSG Project Manager, Chander says: "OSG is a team effort that leverages a powerful and diverse set of experts.”

Page 24: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Arvind GopuIndiana University

Arvind works in the OSG Grid Operations Center, which serves as a centralized control center.

Page 25: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

BU

UNM

UTA

OU

FNALANL

UCHICAGO

WISC BNL

VANDERBILT

PSU

UVA

IOWA STATE

PURDUE

IU

BUFFALO

TTU

CORNELL

ALBANY

UMICH

INDIANAIUPUI

UWM

UNL

UFL

KU

UNI

WSU

MSU

LTU

LSU

CLEMSON

MCGILL

UMISS

UIUC

UCLASDSC

CALTECH

NERSC

STANFORD

UCR

LEHIGH

Page 26: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 27: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.

U.S. gridprojects LHC experiments

Laboratorycenters

Educationcommunities

Science projects & communities

Technologists(Network, HPC, …)

ComputerScience

Universityfacilities

Multi-disciplinaryfacilities

Regional andcampus grids

Page 28: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 29: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.
Page 30: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  80+ sites, 25,000+ CPU.