13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 11

OutlineOutlineI -IntroductionI -IntroductionII -T2-HEPGRID BrasilII -T2-HEPGRID BrasilIII -RNP and Brasil NewsIII -RNP and Brasil NewsIV –L.A. NewsIV –L.A. NewsV -Conclusion V -Conclusion

Computing in High Energy and Nuclear PhysicsComputing in High Energy and Nuclear Physics13-17 February 2006, T.I.F.R. Mumbai, India 13-17 February 2006, T.I.F.R. Mumbai, India

Alberto SantoroAlberto SantoroUERJ/Brazil UERJ/Brazil

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 22

• Network in Brazil has been one of the main concerns of the Brazilian governement.

• The recent support to the National Network by the Minister of Science and Technology demonstrate the way that we are solving the problems.

• RNP initiatives, GIGA, “RECOMED” –Metropolitan Network, and IPÊ –Innovation-Recherch-Education are main current projects. • Perhaps, our Naive Formula to respond for what can we do? like in HEP: Collaborate and Cooperate! It was extended to the RECOMED project.

• Let us see a bit from a High Energy Physicist point of view.I WILL BE NOT EXAUSTIVE ON BRAZILIAN INITIATIVES

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 33

Concorde(15 Km)

Balloon(30 Km)

CD stack with1 year LHC data!(~ 20 Km)

Mt. Blanc(4.8 Km)

1015 Bytes103 Terabytes =1 Petabyte = 106 Gigabytes =

109 Megabytes=1012 Kilobytes=

These four Detectors at LHC willThese four Detectors at LHC willProduce in one year:Produce in one year:

(~ 2

0 P

eta

byte

)

How to Storage,How to Analyse,

How to organize these data

GRIDGRID

Motivation to build HEPGRID in Brazil

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 44

HEPGRID-BRAZIL is a project to build a Grid that at-Regional Level will include CBPF,UFRJ,UFRGS,UFBA,UERJ & UNESP -International Level will be integrated with CMS Grid based at CERN;

CERN

IndividualMachinesT4

T0 +T1

GIGAUFRGS

UFRJ

CBPFUNESP/USPSPRACE

UFBA

UERJ-Tier2

T2 T1

T3 T2

2.5 - 10 Gbps

Now is a RealityMoving to

BRAZILFrance Italy USAGermany622 MbpsT1

EU622 Mbps

.......

.

SPRACE – S. PAULO

Sergio NovaesEduardo Gregores

Rogerio IopePedro Mercadante

Sergio Lietti

T2 – HEPGRID BRAZIL

Dan Nae

Michael

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 55

CMS Experiment

DISUN: DISUN: Data Intensive Science University NetworkData Intensive Science University NetworkDISUN: DISUN: Data Intensive Science University NetworkData Intensive Science University Network

Online System

CERN Computer Center

FNALKorea RussiaUK

UCSB

0.2 - 1.5 GB/s

~10 Gb/s

10 Gb/s

~10 Gb/s

Tier 0

Tier 1

Tier 3

Tier 2

Physics caches PCs

UCR

UFlUCSDCaltech

10s of Petabytes/yr by ~2008 1000 Petabytes in < 10 yrs? > 50% of CPU in Tier2s

UCLA

Tier 4

DISUN

10+ Gb/s

UERJ

USP

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 66

Evolution of academic networks in Evolution of academic networks in BrazilBrazil

(Link capacity)

Phase 0BITNET

Phase 1Internet

Phase 2commercial

Internet

Phase 3RNP2

Phase 4RNP2+

Phase 5Ipê

1

10

100

1.000

10.000

100.000

1.000.000

10.000.000

19881989

19901991

19921993

19941995

1996 19971998

19992000

20012002

20032004

2005Ano

kbp

s

Project GIGA – an optical networking testbedIPÊ – RNP’s Phase 5 national network (Innovation-Recherch-Education)Redecomep – Community-based Optical Metropolitan Networks

CHEP95

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 77

Phase 4 RNP backbone networkPhase 4 RNP backbone network

Fase 4 April/2005(2 Gbps)

Introduced in 2004/5

IP/SDH(replacing IP/ATM)

first multi-provider network until late 1990s

telcos were state monopolies

6x the aggregate capacity of the previous (ATM) network at 2/3cost

(SDH=Synchronous Digital Hierarchy)

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 88

GIGA testbed network - GIGA testbed network - locationlocation

UniversitiesIMEPUC-RioPUC-CampinasUERJUFFUFRJMackenzieUNICAMPUSP

R&D Centers CBPF CPqDCPTECINCORCTA FIOCRUZ IMPA INPE LNCC LNLS

FUNTTELFUNTTEL

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 99

IPÊ: RNP’s Phase 5 network IPÊ: RNP’s Phase 5 network (2005)(2005)

IPÊ – Nov 2005(60 Gbps)

Fortaleza

Recife

Salvador

Rio de Janeiro

Belo Horizonte

Brasília

São PauloCuritiba

Florianópolis

Porto Alegre

2.5 Gbps10 Gbps

Multiple Gbps for Multiple Gbps for interstate linksinitially interstate linksinitially between 10 citiesbetween 10 cities

unprotected 2.5 and 10G unprotected 2.5 and 10G waves from 2 telcoswaves from 2 telcos

only 3x cost of the only 3x cost of the previous SDH network for previous SDH network for around 40x the aggregate around 40x the aggregate capacitycapacity

routers from Juniper routers from Juniper Networks (M320, M40)Networks (M320, M40)

(Michael Stanton)

IPE = Innovation, Research, EducationSDH = Synchronous Digital Hierarchy

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1010

http://www.redecomep.rnp.br

REDECOMEP is an iniciative of Ministery of Science and Tecnology (MCT) coordinate by RNP creating MetropolitanHigh Speed Networks based on its own Optical Fibers, to serve the research institutions and Universities via Consortia among the participant Institutions to assure the auto-support.

• Cities that already signed the MoU...................16• Participant Institutions................................228• Investiment in own fiber until now.....R$13M ~ 6M$US• coverage estimate..................................650 Km• Investiment in equipment until now...R$10M ~ 4.5M$US

Optical Metropolitan Networks forOptical Metropolitan Networks for the R&E communitythe R&E community

Total > US$15 millions to be spent by December, 2006Manaus, Belém, Fortaleza, Natal, Recife, Salvador, Vitória, Brasília, Curitiba, Florianópolis, Porto Alegre

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1111

An alternative approach :An alternative approach :– DIY (do-it-yourself) community networking– DIY (do-it-yourself) community networking

1. 1. Form a consortium for joint network provision2. Build your own optical fiber network to reach ALL

the campi of ALL consortium members3. Light it up and go!Costs involved:

Building out the fiber: using utility poles of electric company US$ 8,000 per km Monthly rental of US$1 (about 40 poles per km)

Equipment costs: mostly use cheap 2 port GigE switches Operation and maintenance

Case study in 2004: Belém/Pará (eastern Amazonia): 12 institutions using all GigE connections: Capital costs around US$500,000 Running costs around US$80,000 p.y.This will be the cost

p.y. Compare with current US$240,000 p.y. for traditional telco This is 3 TIMES MORE FOR 1000 LESS BANDWITHD

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1212

Belém: a possible topology (30 km Belém: a possible topology (30 km ring)ring)

MAP of the Institution Network in MetroBel

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1313

MANAUS-STATE NETWORK FOR RESEARCH & EDUCATION OF AMAZONAS

*By December 2006 more than 200 institutions with 1 Gbps *By December 2006 more than 200 institutions with 1 Gbps *connections Go to IPÊ backbone network (10Gbps)*connections Go to IPÊ backbone network (10Gbps)*Last Mile connection will be pushed for DIY solution *Last Mile connection will be pushed for DIY solution Connected to Connected to the Metropolitan Networksthe Metropolitan Networks

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1414

France Italy USAGermany

10Gbps

HEPGRIDLatin America

T2 For Countries

HEPGRID Colombia

HEPGRIDChile HEPGRID-MexicoT3 For Institutes

T4 For GroupsIndividualMachines or

Small Clusters

HEPGRIDHEPGRID Venezuela

CERN

HEPGRID.Brasil

One T1 for Latina America

HEPGRID-Peru

HEPGRID Argentina

An extended Model for Latin America

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1515

Association of NRENs in LA open to all LA Association of NRENs in LA open to all LA CountriesCountries similar to TERENA (Europe) and APANsimilar to TERENA (Europe) and APAN constituted in Uruguay (like LACNIC) in 2003constituted in Uruguay (like LACNIC) in 2003 18 member countries:18 member countries: Argentina, Brasil, Bolivia, Argentina, Brasil, Bolivia,

Chile, Colombia, Costa Rica, Cuba (*), Ecuador, El Chile, Colombia, Costa Rica, Cuba (*), Ecuador, El Salvador, Guatemala, Honduras (*), Mexico, Salvador, Guatemala, Honduras (*), Mexico, Nicaragua, Panama, Paraguay, Peru, Uruguay, Nicaragua, Panama, Paraguay, Peru, Uruguay, Venezuela.Venezuela.(*) = expected future member(*) = expected future member

Will connect LA to Europe and to other regionsWill connect LA to Europe and to other regions

Cooperação Latino Americana de Redes Avançadas

TopologTopologyy

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1616

We made some progress in the last 3 yearsWe made some progress in the last 3 years In my view, not enough to get the In my view, not enough to get the

opportunities in science in general.opportunities in science in general.

Magic Equation = C2I2

Cooperation + Collaboration + Internal Initiatives

Cooperation + Collaboration + Internal Initiatives

Cooperation + Collaboration + Internal Initiatives

13-17 February 200613-17 February 2006 Alberto Santoro Alberto Santoro 1717

Thank You!