GLORIAD/KREONet2 Updates

22nd APAN Meeting @ Singapore2006 Jul. 20

Minsun LeeSupercomputing Center, KISTI

GLORIAD-KR Overview• Leading edge for BIG GLORIAD

– Funded by MOST since 2005– Two 10Gs : KR to US (Transpacific), KR to

CN(HK)– Multiple 10Gs or 40Gs in the future

• Hybrid optical and packet switching facility– SONET/SDH transmission– Single/multiple GEs and single 10GE– Native IPv4, IPv6 and lightpath provisioning

• Routed path and lightpath over a single link

14 Regional Centers, GLORIAD, 5 Major IX, APII Test-bed (JP, EU)

KREONET Network Topology

55

Etc

16510104050

TotalIndustrial LabsGovernment OrgsUniversitiesResearch Labs

※ Every Regional

Center is Based

on MSPP 15454/15600¡ New Regional

Centers: Jeju

and O-Chang ¡ Link Upgrade:

Gwangju and Daegu (5Gbps ->

10Gbps)¡ Equipment

Upgrade:

Daejeon (ONS15454 ->

ONS 15600)

Network Update

10G

Hongneung

5G10G5G

5G

5G

5G

10GWDM 10G10G

Suwon

Incheon

Seoul

Cheonan

Gwangju

Jeonju

Busan

Changwon

Phohang

5G

2.5G

GLORIADGLORIADGLORIAD

USChina

MSPP15454

MSPP15600

5G

5G

10G

10G10G

O-Chang

Daegu

Jeju

Daejeon

10G

UCLPv2 Development and Test

• UCLP Testbed Between Gwangju and Jeju

Next step will be expanded to the ONS 15600 version

STS-24C (1.25Gbps)1GE

Users Users

Gwangju Jeju

STS-24C (1.25Gbps)1GE

1GE

1GE

ONS15454C7609 C7609ONS15454

UCLPv2 Test Link

GLORIAD-KR 10G Networks

KISTI, Korea KISTI, Korea (Daejeon)(Daejeon)

CNIC, ChinaHong Kong

China (Beijing)

Russia (Novosibirsk)

Amsterdam

MoscowUS Seattle

CANARIE, Canada

ChicagoEU

NYC

10G

(KR-US)

10G(KR-HK)

Calgary Toronto

HKLight

CSTNET

KoreaOC192

OC192OC192

GOLE(KRLight)

Hong Kong, CN 2*10GE

KREONET

Seattle, US

GLIF node(CANARIE,

PW)

GLO-KR/CANARIE

nodes(L1, L2)

PacificWave

OC192

10GE

OC192Korea

StarLight

GLORIAD-KR 10G Networks (cont’d)

KISTI, KOREA KISTI, KOREA (Daejeon)(Daejeon)

CNIC, CN

China (Beijing)

Russia (Novosibirsk)

Amsterdam

MoscowUS Seattle

CANARIE, CA

ChicagoEU

NYC

KR-US (10G)

KR-HK (10G)

Calgary Toronto

10GE WAN

OC192

KR

10GE LAN

8*1GE

OC192 HK OC192 US

KREONET

10GPOS

10GE LAN

GLIF node

(OC192)

10GE LAN

PacWave

8*1GE

StarLight

N*OC192

N*OC48

N*1GE

ONS15454

Westin Building, Seattle, US

Force10 E600 OSR7606

GLORIAD-KR 10G Networks (cont’d)

For hybrid networking Layer 1~3

GLORIAD Architecture

CN

KR

USCA

RU

NL

10G (LP)

10G (LP)

155M->

2.5Gbps (LP)(2006.02)

~10G (LP)(2006.03)

~10G (LP)(2006.03)

622M -> ~2.5Gbps (LP)

(2006.03)10G(2007.03)622M

10G(2007.03)

US

~10G (LP)(2006.03)

• Lambda integrated facility for entire nodes

• Multiple 10Gs (or 40Gs)– Hybrid optical & packet

switched path– Separate single routed path– Permanent multiple

lightpaths

10 Gbit/s

SURFnet10 Gbit/s

SURFnet10 Gbit/s

IEEAF10 Gbit/s

PragueCzechLight

PragueCzechLight

2.5 Gbit/s

NSF10 Gbit/s

StockholmNorthernLight

StockholmNorthernLight

CA*net4

2.5 Gbit/s

New YorkMANLANNew YorkMANLAN

KoreaKREONet2

KoreaKREONet2

10 Gbit/s

10 Gbit/s10 Gbit/s

10 Gbit/s

GLORIAD10 Gbit/s

10 Gbit/s

10 Gbit/s

10 Gbit/s

10 Gbit/sTokyoAPANTokyoAPAN

AmsterdamNetherLightAmsterdamNetherLight

GenevaCERN

GenevaCERN

LondonUKLightLondonUKLight

ChicagoStarLightChicagoStarLight

Source: Kees Neggers, SURFnetWhere does GLIF infrastructure connect ?

WIDEWIDEIEEAF

Source: Kees Neggers

GLORIAD & GLIF Participation

GLORIAD-KREONet2/10Gb

Visualization courtesy : Bob Patterson

Applications in Korea

• Astronomy: Virtual Observatory, SDSS• High Energy Physics• Fusion Research: ITER, KSTAR• Earth Science: GEOSS, THORPEX• Grid Computing: K*Grid• Medical Science: e-Health• OptIPuter

? International Virtual Observatory Alliance (IVOA)à Need a distributed

archive serverà Data Transfer

à Data Processing(interoperability)

Astronomy: Virtual Observatory

• ¼ of the sky to ~½ ”resolution • about 200M objects in 5 bands & spectra of 106 objects• Within 1~2 weeks of the observation, the reduced data is

available to the SDSS astronomers• 5 year survey starting in 2000: Each year 5TB more data• SDSS data sizes (in 2006) : ~7 TB online, ~10 TB in

archive (for reprocessing if needed)• Over 450 Scientific papers based on analyses of, or

presentations of, the SDSS

Astronomy: SDSS

SDSS Demo @ iGrid2005

• From Federal Express to Lambdas: Transporting SDSS Data Using UDT(US, Korea, Japan)

• Show how optical paths and new transport protocols are enabling these data sets to be transported using networks over long distances

• Disk-Disk UDT transport from San Diego to KISTI : 1206Mbp/s

First Beams: Summer 2007Physics Runs: from Fall 2007

TOTEM

LHCb: B-physics

ALICE : HI

­ pp √s =14 TeV L=1034 cm-2 s-1

­ 27 km Tunnel in Switzerland & France

CMS

Atlas

5000+ Physicists250+ Institutes

60+ Countries

H. Newman

High Energy Physics

Experiment

Tier 1

Tier2 Center

Online System

CERN Center PBs of Disk; Tape Robot

FNAL CenterIN2P3 Center INFN CenterRAL Center

InstituteInstituteInstituteInstitute

Workstations

~100-1500 MBytes/sec

~10 Gbps

1 to 10 GbpsTens of Petabytes by 2007-8.An Exabyte ~5-7 Years later.Physics data

cache

~PByte/sec

10 - 40 Gbps

Tier2 CenterTier2 CenterTier2 Center

~1-10 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center Tier 2

CERN/Outside Resource Ratio ~1:2Tier0/(Σ Tier1)/(Σ Tier2) ~1:1:1

H. Newman

HEP Demo @ SC|05(also at iGrid2005)

GLORIAD Access Link Support

Daejeon Daegu(KNU)

SiSi SiSi

ONS15600 ONS15454

10Gbps

GLORIAD-KR

Force10Force10

10Gbps

※ We are Supporting about 50 Orgs requires High bandwidth network (Grid computing, HD, Earth Science, HEP etc)

US

HK

※ KNU/CHEP(High Energy Physics): dircect 10G Access Link

GSR12406

International Thermonuclear Experimental Reactor: To enable all international parties to participate as “Virtual ITER”sites

ITER Grid

KSTAR: ~1/10th of ITER (will be operational from 2008)

Fusion VO on EGEE

• Current partners– CIEMAT, BIFI, UCM, INTA (Spain)– Kurchatov Institute (Russia)– Culham Laboratory- UKAEA (UK) – KISTI, NFRC (South Korea) – ENEA (Italy)– CEA-Cadarache (France)– Open to new partners and regions– Connection with EELA (Some fusion partners: Brazil, Mexico,

Argentina)

• Experience in using and developing Fusion Applications• Experience in porting applications and developing Grid

Technologies

GEOSS

Lead by Korea Meteorological Administration (PI: Dr. Dongil Lee)

0

500

1000

1500

2000

2500

3000

3500

4000

2001

2002

2003

2004

2005

2006

2007

GB

/Day

NWP Messages NEXRAD Prod NEXRAD Base

• Mission– Exploitation of very large, remote data objects

in a novel interactive and collaborative fashion

ComputationComputationComputation

VisualizationVisualizationVisualization

StorageStorageStorage

Parallel, optical networkParallel, optical networkParallel, optical network

Network mgmtNetwork mgmtNetwork mgmtMiddlewareMiddlewareMiddleware

CampusCampusCampus

MetroMetroMetro

NationalNationalNational

InternationalInternationalInternational

OptIPuter

NCMIRNCMIR

SIO

UICUIC

USGS EDCUSGS EDC

TAMUTAMU UCIUCI

SARASARA

NCSA & TRECCNCSA & TRECC

CALCAL--(IT)(IT)22

AISTAIST RINCON & NortelRINCON & NortelKISTIKISTI

SIOSIO

GLVF: Participants

ll Visible Korean Human Visible Korean Human àà 3D 3D volume(CTvolume(CT) with wavelet compression) with wavelet compressionll Katrina Katrina àà Aerial photography of Hurricane Katrina (USGS/UAF)Aerial photography of Hurricane Katrina (USGS/UAF)ll Blue Marble Blue Marble àà True color global imagery at 1km resolution (NASA)True color global imagery at 1km resolution (NASA)

GLORIADSURFNet

CAVEWave

UIC-EVLKatrina

SARABlue Marble

iGrid2005KISTIVisible Korean Human

Pacific Gigapop

StarLight

GLVF: Demo at iGrid2005

PCI-X(133MHz) 4CPU

“Application Proxy Center”for High Performance Application

• Goal : to support high performance

applications systematically

• Plans for 2006: Analyzing requirements of

various scientific applications requiring high performance network bandwidth

: Constructing High Performance Application required Networked Application Test Proxy Center

: Supporting various scientific applications as well as HEP, SDSS, Optiputer

Application Test Proxy Center:

High Performance Test-bed

SATA2 Disk Controller 10G NIC(Xframe)

Monthly bandwidth challenge Day!!

KRLight & GOLE Collaborations I

OptIPuter Demonstration on Feb 22, 2006

Korea, the Netherlands, the US, and Canada

participated over 10G Lightpath on GLORIAD

KRLight & GOLE Collaborations IIPacific Wave, Seattle StarLight, Chicago

EVL, Chicago

Force10Force10

NetherLight

SARA, Amsterdam

KRLight

KISTI, Daejeon

CAnet4

SARA-cat6SARA-cat6

Existing 10G path, A new VLAN for KISTI project

GLIFHDXcGLIFHDXc

ONS15600ONS

15600

ONS 15454ONS 15454

AMSGLIFHDXc

AMSGLIFHDXc

Force10Force10

PassportPassport

GLIFHDXcGLIFHDXc

Force10Force10

OC192OC192

16 x 1 Gbps10 Gbps

HD Cam Server Tiled Display

IRNC OC192

OC192

GIST, Gwangju

KREONet2,Daejeon

C4506C4506OSR7609OSR7609

HD Cam Server

1 Gbps

GLORIADOC192

Thank you!

For more information,Visit www.gloriad-kr.org