Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA...

16
Ron Lambert (Computer Infrastructure Services South) & Chris Smith (AURA-O) 1 AURA Users Mtg: Networks

Transcript of Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA...

Page 1: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

Ron Lambert (Computer Infrastructure Services South) & Chris Smith (AURA-O)

1 AURA Users Mtg: Networks

Page 2: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

 Mission to provide base to summits and international network connectivity for all tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las Campanas.

  Prior to 2011/2012, the network services were of limited bandwidth, funded solely by NOAO and Gemini.

2 AURA Users Mtg: Networks

Page 3: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

  International links ◦  ~1985-1995: NASA satellite link from Tololo to

Ames, FL providing 56Kbps ◦  1995-2000: Entel ISP providing 256Kbps,

increasing to 4Mbps ◦  2005-present: REUNA+Ampath providing

50Mbps, then 155Mbps, and now 622Mbps  Mountain Links ◦  1985-2000: Collins Microwave 64Mbps ◦  2000-present: Harris Microwave w/ dual

155Mbps, expandable to 624Mbps

3 AURA Users Mtg: Networks

Page 4: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

 Transition to robust high-speed network ◦  ~1Gbps total, shared ◦ Multiple paths to U.S. mainland

  Supporting growing number of users ◦ Two fundamental classes:   “low volume/basic connectivity”   “high volume/mission critical”

 Requires shared cost model to fund operations, maintenance, and upgrades

4 AURA Users Mtg: Networks

Page 5: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

 National Link: ~$150K/yr ◦ REUNA (Chilean equivalent of Internet2) ◦ Membership + 1Gbps

  International Link: $200K/yr ◦  LAUREN+AmLight (NSF supported link) ◦ Currently 622Mbps, planned 1Gbps

 O&M: $140K/yr ◦  including only 0.5FTE + hardware + training

5 AURA Users Mtg: Networks

Page 6: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

  “Basic Connectivity” ◦ Access to infrastructure (includes base of

operations & maintenance cost + 10Mbps) ◦  $10K/year

  “High Volume / Mission Critical” ◦ Needing 10 – 100 Mbps for larger volume

data transfer, burstable to almost 1Gbps ◦  $75K/year

 Not metered, but Monitored

6 AURA Users Mtg: Networks

Page 7: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

1.  Research traffic (.edu) 592Mbps

2.  International Commodity traffic 30Mbps

3.  National Commodity traffic 10Mbps

4.  REUNA National Backbone 30Mbps

5.  SOAR direct vlan to Brazil 10Mbps

6.  Entel emergency link (pending) 20Mbps

7 AURA Users Mtg: Networks

Page 8: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

2x 155Mbs

2x 155Mbs

SOAR ALO GEMINI

CTIO SMARTS WHAM PROMPT Yale/ESO KASI SARA LCOGT

GEMINI SOAR/NOAO/AURA

Pachon

Tololo

La Serena La Serena

EXTERIOR 8 AURA Users Mtg: Networks

Page 9: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

Cerro Pachon

Cerro Tololo

Cerro Tololo

La Serena

10Mbs Private

20Mbs Entel

9 AURA Users Mtg: Networks

Page 10: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

La Serena POP

AURA DWDM

DWDM

SDHd

SDHd

Santiago POP

REUNA

NRAO

1 Gbit/sec

2.5Gbit/sec

hjGlobal Xing POP

20 Mbs

ENTEL

10 AURA Users Mtg: Networks

Page 11: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

CURRENT PATH

AURA Users Mtg: Networks 11

Page 12: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

AURA Users Mtg: Networks 12

Page 13: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

Cut over to 622Mbs

Graph showing latency and uptime between La Serena and Miami.

Note latency decreased when we switched to the west coast with 622Mbs

AURA Users Mtg: Networks 13

Page 14: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

Graph demonstrating latency and uptime on the AURA Campus backbone

AURA Users Mtg: Networks 14

Page 15: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

  International Link upgrade to 1Gbps  Ring Protection in Santiago  Emergency Backup link off Recinto (Entel)   Improved Backup links on AURA Campus

Backbone  Move Mountain Backbone Equipment to

stand-alone building on C. Pachón  Tenants isolated to autonomous subnets

15 AURA Users Mtg: Networks

Page 16: Ron Lambert (Computer Infrastructure Services South) Chris ... · tenants operating under the AURA umbrella, including other Institutions with specific MOUs, e.g. NRAO/ALMA, Carnegie/Las

 LSST: massive data transfer requirements ◦  100-200Gbps from mountain to base ◦ >15TB/night to U.S., possibly in real time!

 LSST construction plans ◦  Fiber bundle connecting summits to base,

allowing 1Gbps to 100Gbps ◦  40Gbps to 80Gbps international link

16 AURA Users Mtg: Networks