Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 [email protected].

12
sc2003 S.Wallach 1 Super Networking Evolution of the Grid SC2003 [email protected]

Transcript of Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 [email protected].

Page 1: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 1

Super Networking Evolution of the Grid

SC2003

[email protected]

Page 2: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 2

Speakers

• Dan Blumenthal

• Larry Smarr

• Andrew Chien

• Jason Leigh

• Rick Stevens

Page 3: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 3

Grid Day 0 – Circa 1975

Users

Central Processor Unit

Main Memory

RS- 232

DISK

Device DriversTimesharing

Page 4: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 4

Grid Day 1 – Circa 1982

Central Processor Unit

Main Memory

DISK

Workstations

Ethernet – Layer 2 (TCP/IP)

Network Stack

Page 5: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 5

Grid Day 2 - Circa 1987 (client/server)

Workstations

LANSwitch .Ethernet - Layer 2(TCP/IP)

.Heterogeneous Environments

.Software – FTP, RLOGIN

LAN

Disk

LANCentral Processor Unit

Main Memory

LANCentral Processor Unit

Main Memory

Page 6: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 6

Node Topology Change

Client/Server

LAN Switch WAN Switch

Client/Server

LAN Switch

AKA Router

.Separate Addressing Domains for LAN and WAN References.

.Separate Switches – Layer 2 & Layer 3

.Dynamic Routing Protocols (BGP, OSPF, etc)

.Optical Transmission for Wide Area Network (Bandwidth the same for local or wide-area)

Storage Storage

Page 7: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 7

AMPLIFIER TECHNOLOGY

fc *

(WDM)

Page 8: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 8

Grid Day 3 – Networked (Early 90’s)

WAN Switch

LAN Switch

Storage

WAN Switch

LAN Switch

StorageStorage

Long HaulT1/OC3-12

WAN Switch

LAN Switch

Storage

Page 9: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 9

Grid Day 4 (today) – Grid Enabled - TeraGrid

Storage StorageStorage

.Optics is the Enabler

.Homogeneous Development Environments

.Multiple Lambda’s (4)

Long HaulOC48/192 (Sonet)

WAN Switch

LAN Switch

Storage

WAN Switch

LAN Switch

Storage

A Cluster is a LOCAL GRID

WAN Switch

LAN Switch

Storage

Page 10: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 10

Grid Day 5 (Future) – Layer 3 IPv4/6

WAN Switch

LAN SwitchIntegrated

LAN/WAN Switch

.Layer 3 Switching and Addressing is inherently Global in Nature.

.New Transport Protocols (Reliable UDP, XCP, SABLE, etc)

.Global view of the Grid to support (design @1, execute @2, store @3)

.DWDW – Multiple Optical Channels - Terabits/sec (Multiple Lambda’s)

.Cluster/SMP has integrated Grid Support

Storage Storage

Page 11: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 11

The OptIPuter 2003

Experimental NetworkWide Array of Vendors

Page 12: Sc2003 S.Wallach1 Super Networking Evolution of the Grid SC2003 swallach@chiaro.com.

sc2003 S.Wallach 12

Global Architecture of a 2009 COTS PetaFLOPS System

I/O

ALL-OPTICAL SWITCH

Multi-DieMulti-Processor

1

23

64

63

49

48

4 516

17

18

32

3347 46

128 Die/Box4 CPU/Die

10 meters= 50 nanosec Delay

...

...

...

...

LAN/WAN

Source: Steve Wallach, Supercomputing 2000 Keynote

Systems Become GRID Enabled