APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

53
bgg W{yyzuomu{zB cWb bm{wu amtuw{ zDymtuw{TzDo{y Wtuwm l{tuy~m otuwmD{tuy~mTzDo{y Ude]Wcg HFGH uz bq Xqxtu `uuzs ut tq qq~Cs~{uzs V[d mnxq P mz cWb {~
  • Upload

    -
  • Category

    Internet

  • view

    159
  • download

    0

Transcript of APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

Page 1: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

bgg9W{yy�zuom�u{z�B9cWb�bm{wu9am�tuw{9zDym�tuw{Tz��Do{y�

Wtuwm9l{�tuy�~m9otuwmD�{�tuy�~mTz��Do{y�9Ude]Wcg9HFGH9uz9bq�9Xqxtu�

`u�uzs9�u�t9�tq9q�q~Cs~{�uzs9�V[d9�mnxq9P9mz9cWb9��{~��

Page 2: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© H Copyright © 2012 NTT Communications Corporation All Rights Reserved.

Un{��9hfØbgg9W{yy�zuom�u{z�B9�

�������cWb?UfJMGI@�

Page 3: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© I Copyright © 2012 NTT Communications Corporation All Rights Reserved.

g{pm�’��Z{o��:�

c�~9]d9Vmown{zq9C9{�q~�uq��

!  jq9tm�q9H9Ufq��C z��Dzq�E[]b9?[x{nmx9]d9bq��{~w@99UfHOGJ�t��|PEE���Dz��Dzq�E�C cWb9?c|qz9W{y|��q~9bq��{~w@999UfJMGI�t��|PEE���D{ozDzqDv|E�

Dix-ie/NSPIXP PAIX EQUI6IX AMS-IX LINX UK6X JPNAP

EQUI6IX

_{~qm�bgg9_{~qm�

\{zs9_{zs�bgg9W{y9U�um�

amxm��um�bgg9afW�

U���~mxum�bgg9U���~mxum�

hDfD�iq~u{�

AS2914 AS 4713

gmu�mz�bgg9gmu�mz�

DE-CIX

z��Dzq��

PARIX

ESPANIX

Y�~{|q�bgg9Y�~{|q�

: Global IP Network POP

Singapore NTT Singapore

Page 4: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© J Copyright © 2012 NTT Communications Corporation All Rights Reserved.

c�~9]d9Vmown{zq9C9b{�9‘GG�

b{�9uzox�pqp9|~u�m�q9|qq~�9mzp9o���{yq~9zq��{~w���

US Backbone

dUe]k�

Global Backbone

OCN Aichi

OCN Kyoto

OCN Osaka

OCN Hyogo

OCN Hiroshima

OCN Fukuoka

OCN Hokkaido

OCN Kanagawa

OCN Miyagi

OCN Chiba

OCN Tokyo

OCN g{w�{9�q���

180 Gbps

20 Gbps

20 Gbps

480 Gbps

20 Gbps

80 Gbps

120 Gbps

80 Gbps

1Gbps NSPIXP-3

40Gbps JPNAP Osaka

90Gbps JPNAP

10Gbps dix-ie

Domestic Peer

Osaka GW

1Gbps Internet Multifeed

ICP

20 Gbps

100 Gbps

440 Gbps

20 Gbps

JAPAN BackBone� 480 Gbps

Osaka Core 200 Gbps

Aichi Core 200 Gbps

Gunma Core

Tokyo Core

200 Gbps

200 Gbps

Tokyo GW

560 Gbps

YfdUb]k� EUROPE Backbone

Uaf]k�

XYCW]k�

ASIA Backbone

Y}�uzu�9Xmxxm��

Y}�uzu�9Wtuoms{�

dU]k�

Y}�uzu�9�fmz9^{�q�

Y}�uzu�9U�tn�~z�

Houston

Australia

New York

Chicago

Warsaw

Seattle

Korea

Miami

Atlanta

Geneva Frankfurt

Dusseldorf

Madrid

Taiwan

Osaka

Hong Kong

Dallas

Amsterdam

Singapore

London

Paris

Tokyo

Malaysia

Washington D.C. San Jose

Brussels

Budapest

Sofia Bucharest

310 Gbps

240 Gbps

Los Angeles c�q~9GFFF[n|�9o{zzqo�u�u��9nq��qqz�

9bggDzq�9UfHOGJ?[x{nmx@C9cWb9UfJMGI?X{yq��uo@�

z��Dzq�?UfHOGJ@�

cWb?UfJMGI@�

Page 5: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© K Copyright © 2012 NTT Communications Corporation All Rights Reserved.

cWb9Vmown{zq9Vmzp�up�t9\u��{~��

�  dt��uomx9Vmzp�up�t9�t~{�st9co�9’OM9�{9am�9‘GG�

)

6 6 3G

39A

3G

39A

3G

39A

3G

39A

3G

39A

3G

39A

(

3G

(

39A

)

3G

)

/)

-G

/ 3GA

5B

49I

5B

49I

5B

49I

5B

1E

9 BA 09E DA 7 E DA 39 9A

2A DA9 BA9

28

Mar 2003�installed 10G-IF in the backbone��

Feb 2007�100G between

Japan to the U.S. (ntt.net)

Nov 2001 Started

FTTH service Dec 1996

Started OCN

Aug 2011 500G between

Japan to the U.S. (ntt.net)

�2200

�5800

�20000

Page 6: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© L Copyright © 2012 NTT Communications Corporation All Rights Reserved.

g{pm�’��Z{o��:�

c�~9o{zoq~z9�tqz9pq�uszuzs9�tq9nmown{zq�

GD9g~mrruo9s~{��t�

�9q�|qoumxx�9r~{y9{�q~�qm�9�{9^m|mz�

HD9V[d9�mnxq9s~{��t9�

999?uzox�puzs9]fd��9uz�q~zmx9~{��q�@�

��

Page 7: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© M Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9[~{��t9{r9V[d9gmnxq9�

Page 8: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© N Copyright © 2012 NTT Communications Corporation All Rights Reserved.

]d�J9r�xx9~{��q��

eqr~qzoqp9pm�mØV[d9[~{��t9eq�u�u�qp9b{�qynq~9HFGG9[q{rr9\���{z�t��|PEE���D|{�m~{{Dzq�Eu�|o{xEHFGGCGGEns|HFGGDt�yx�

!  [~{�uzs9m�9m9o{z��mz�9�|qqp9mr�q~9]d�J9mpp~q��9q�tm���u{zD�

!  c�q~9JFFFFF9~{��q�9�uzoq9qzp9{r9Xqo9HFGGD�

Page 9: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© O Copyright © 2012 NTT Communications Corporation All Rights Reserved.

]d�J9r�xx9~{��q��

!  ]zo~qm�q9GJDJ<9~{��q�9nq��qqz9HFGGCHFGHD�

!  V��9]zo~qm�q9~m�u{9u�9��mnxq9�uzoq9HFFKD�

%

%

%

%

%% %%

-%--%---%%

------ %

%

--

%

--

%%

-%-

%

--

%

-%-

%

-%-

%

-%-

%

--

%

-%-

%

%--

%

--

%

--

%%

--

./623 3170/4 63 70/44250

eqr~qzoqp9pm�mØV[d9[~{��t9eq�u�u�qp9b{�qynq~9HFGG9[q{rr9\���{z�t��|PEE���D|{�m~{{Dzq�Eu�|o{xEHFGGCGGEns|HFGGDt�yx�

Page 10: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GF Copyright © 2012 NTT Communications Corporation All Rights Reserved.

]d�J9r�xx9~{��q��

!  c�q~9KF<?HFFFFF9~{��q�@9{r9r�xx9~{��q�9m~q9EHJ�

eqr~qzoqp9pm�mØV[d9[~{��t9eq�u�u�qp9b{�qynq~9HFGG9[q{rr9\���{z�t��|PEE���D|{�m~{{Dzq�Eu�|o{xEHFGGCGGEns|HFGGDt�yx�

Page 11: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GG Copyright © 2012 NTT Communications Corporation All Rights Reserved.

]d�J9r�xx9~{��q��

!  czq9y{z�t9?^mz@9]zo~qm�q9~m�u{9{r9qmot9|~qru�9xqzs�t9o{y|m~uzs9�u�t9^mz9HFGGD�

!  ft{~�9xqzs�t9mzp9EHF9{~9x{zsq~9|~qru�q�9m~q9uzo~qm�uzsD�

eqr~qzoqp9pm�mØV[d9[~{��t9eq�u�u�qp9b{�qynq~9HFGG9[q{rr9\���{z�t��|PEE���D|{�m~{{Dzq�Eu�|o{xEHFGGCGGEns|HFGGDt�yx�

% %

Page 12: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GH Copyright © 2012 NTT Communications Corporation All Rights Reserved.

!  [~{�uzs9~m|upx�9uz9�tq9~qoqz�9�qm~��

99?q�|qoumxx�9r~{y9‘FN@�

]d�L9r�xx9~{��q��

eqr~qzoqp9pm�mØUfLJJM9]d�L9V[d9gmnxq9Xm�mB9[q{rr9\���{z�t��|PEEns|D|{�m~{{Dzq�E�LEm�LJJME�

2008

Page 13: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GI Copyright © 2012 NTT Communications Corporation All Rights Reserved.

! U�9xq�qx�9uz9q�oq��9{r9a{{~q>�9`m�9�

]d�L9r�xx9~{��q��

eqr~qzoqp9pm�mØUfLJJM9]d�L9V[d9gmnxq9Xm�mB9[q{rr9\���{z�t��|PEEns|D|{�m~{{Dzq�E�LEm�LJJME�

Page 14: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GJ Copyright © 2012 NTT Communications Corporation All Rights Reserved.

!  a{��9xqzs�t9{r9|~qru�9m~q9EIH9mzp9EJND�

]d�L9r�xx9~{��q��

eqr~qzoqp9pm�mØUfLJJM9]d�L9V[d9gmnxq9Xm�mB9[q{rr9\���{z�t��|PEEns|D|{�m~{{Dzq�E�LEm�LJJME�

/32

/48

Page 15: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GK Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9~qm�{z�9{r9�tq9s~{��t9{r9V[d9�mnxq�

GDXqmss~qsm�u{z�

CZ{~9g~mrruo9qzsuzqq~uzsS�

Ccz9�tq9t{~u�{zB9n��uzs9mzp9�qxxuzs9]d�J9mpp~q��9n�9|uqoqS9�

HD`qmw�9{r9uz�q~zmx9~{��q�S�

IDgtq9yuzuy�y9mpp~q��9mxx{om�u{z9�u�q9tm�9nqqz9otmzsqp9mr�q~9�tq9]UbU9mpp~q��9q�tm���u{zD�

Page 16: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GL Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9~qm�{z�9�t�9�tq9V[d9�mnxq9s~{��tuzs�

!  g{|9HF9Ufq�9mp�q~�u�uzs9y{~q9�|qouruo9|~qru�q��

eqr~qzoqp9pm�mØV[d9[~{��t9eq�u�u�qp9b{�qynq~9HFGG9[q{rr9\���{z�t��|PEE���D|{�m~{{Dzq�Eu�|o{xEHFGGCGGEns|HFGGDt�yx�

Page 17: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GM Copyright © 2012 NTT Communications Corporation All Rights Reserved.

]zo~qm�q9{r9V[d9�mnxq�?uz�q~zmx9rmo�{~@�

!  ]z�q~zmx9~{��q��C gtq9my{�z�9{r9uz�q~zmx9~{��q�9u�9z{�9zqsxusunxq::�

!  �g{�mx9z�ynq~9{r9{�~9o�~~qz�9uz�q~zmx9~{��q9u�9uz9ru�q9pusu���C jq9omz��9mss~qsm�q9uz�q~zmx9~{��q�9mz�9y{~qD9�C Vqom��q9�q9tmp9nqqz9mxx{om�qp9|~qru��9uz9��msq�D�999]9�tuzw9�tm�9{�tq~9]fd9tmp9�tq9�myq9|~{nxqyD�

C Uppu�u{zmxx�9�q9tm�q9ymz�9|{|�9uz9^m|mzD�

Page 18: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GN Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9~qm�{z�9�t�9�tq9V[d9�mnxq9s~{�uzs�

Gunma Core

Miyaagi POP

Hokkaido POP

Kanawaga POP

Chiba POP

Aichi POP

Kyoto POP

Hyogo POP

Hiroshima POP

Fukuoka POP

West Tokyo POP

Tokyo Core

80G

100G

20G

20G

20G

120G

80G

180G

400G

20G 20G

Aichi Core

440G

Osaka POP

パケット 携帯網 (Dopa)

高速ディジタル/FR 携帯網

高速ディジタル FR

IPルーティング網 接続専用サービス

LAN

PHS網

NTT-COM ハウジングビル LAN LAN

SDSL

UWWU�(�

ADSL 9FTTH��BÆÏÀÁ� ADSL

LAN LAN

PSTN/ISDN Ether/FE/GE ATM/STM

FWA

LAN

ADSL 9FTTH

Zxq���9zq��{~w�

専用線

帯域 確保

専用線

Ether/FE/GE ATM/STM

µÄк�)�

ISDN�)�ÚÙÛ� ��7/�

ISDN �ÆÏÀÁISDN�

LAN

Osaka Core

The internet The Internet

VERIO IX (Tokyo)

Private Peers (Osaka)

IX (Osaka)

Private Peers (Tokyo)

AS4713 - Backbone                

AS4713 - Edge

40G X0G

Tokyo POP

ntt.net       

XX0G 90G

Tokyo

560G

Osaka

480G

480G

BGP4(+) BGP4(+) BGP4(+)�

Core routes

To flet’s/business customers

BGP4(+) / OSPF(3)

Consumer custmers(IPv4/v6)� Business customers(IPv4/v6)

gtq~q9m~q9m9x{�

9{r9uz�q~zmx9

~{��q�9uz9�tq9d

cd��

Page 19: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© GO Copyright © 2012 NTT Communications Corporation All Rights Reserved.

b{�B9�mxw9mn{��9�tu�:�g�{9|{uz��9{r9|~{nxqy��

���GD9W{z��y|�u{z9Z]V9yqy{~���

���HD9]zo~qm�q9o{z�q~sqzoq9�uyqÓe]VEZ]VÔ�

jtm���9|~{nxqy9�u�t9]zo~qm�q9~{��q��

Page 20: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HF Copyright © 2012 NTT Communications Corporation All Rights Reserved.

GD9Z]V9yqy{~�9o{z��y|�u{z�

!  ]r9~qmot9m9Z]V9xuyu�uzs9�mx�qP9�C  zq�9~{��q�9omz’�9nq9uz��mxxqp9uz�{9Z]V�C  m9rmux�~q9{r9|mowq��9pqxu�q~�::9�

!  ]d�L9|~qru�q�9��q9y{~q9yqy{~�9�tmz9]d�J9{zq��

Page 21: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HG Copyright © 2012 NTT Communications Corporation All Rights Reserved.

\{�9y�ot9yqy{~�9~{��q~�9��qS�

!  Z]V9yqy{~�9��msq9{r9�{yq9~{��q~�9�tm�9tm�q9r�xx99~{��q�9uz9cWb�C ]�9pq|qzp�9{z9m9~{��q~’�9y{pqx�

core

edge1, 2

core

edge 3

BGP customers customers

Core Router

Peering Router1

Peering Router2

Housing service Router

Page 22: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HH Copyright © 2012 NTT Communications Corporation All Rights Reserved.

b{�B9�mxw9mn{��9�tu�:�

g�{9|{uz��9{r9|~{nxqy���

���GD9W{z��y|�u{z9Z]V9yqy{~���

���HD9]zo~qm�q9o{z�q~sqzoq9�uyqÓe]VEZ]VÔ�

jtm���9|~{nxqy9�u�t9]zo~qm�q9~{��q��

Page 23: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HI Copyright © 2012 NTT Communications Corporation All Rights Reserved.

HD9]zo~qm�q9o{z�q~sqzoq9�uyqÓe]VEZ]VÔ�

gmwuzs9m9x{zs9�uyq9�{9o{z�q~sq9e]V�C  gmwuzs9x{zs9�uyq9�{9�qxqo�9m9nq��9|m�t�C  \ust9Wdh9��uxu�m�u{z9{r9~{��uzs9|~{oq��{~��C  d{��unuxu��9{r9m9rmux�~q9{r9|mowq��9pqxu�q~�9�

UfCU�

c�~9Uf�

UfCV��

jtqz9V[d9nq��9|m�t9u�9otmzsqp9r~{y9UfCU9�{

9UfCVB9�

t{�9y�ot9�uyq9�uxx9nq9�mwqzS9jq’xx9�tm~q9�tq9pm�m

9�tuot9�q9

�q��qp9uz9{�~9`mnD�

Page 24: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HJ Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9o{z�q~sqzoq9�uyq�

!  gtq9o{z�q~sqzoq9�uyq9{r9m9nmown{zq9~{��q~9�tm�9tm�q9r�xx9~{��q��C ]�9u�9|~{|{~�u{zm�q9�{9�tq9z�ynq~9{r9~{��q��

CR9Uo�u�q�V[d9~{��q�?�J@�aYXHFF�

V[d9~{��q�?�J@�aYXGFF�

CR9|qq~9p{�z�

~{��q~9U� ~{��q~9V�

�q��9~{��q~�

gtq9]z�q~zq�� �qo�

z�ynq~9{r9V[d9]d�J9|~qru�?yuxxu{z@�

Page 25: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HK Copyright © 2012 NTT Communications Corporation All Rights Reserved.

gtq9~qm�{z9{r9tm�uzs9r�xx9~{��q��

!  jt�9�t{�xp9~{��q~�9tm�q9r�xx9~{��q�S9jt�9z{�9pqrm�x�C~{��qS�

!  c�~9|{xuo�9u�9P�Uxx9~{��q~�9uz9�tq9nmown{zq9�t{�xp9tm�q9r�xx9~{��q��

•  r{~9m9x{�9{r9V[d9o���{yq~�9?gtq�9zqqp9r�xx9~{��q�:@�

•  ox{�q��9q�u�9{r9�tq9nmown{zq9�~mrruo�

•  m�{upuzs9m9~{��uzs9x{{|�

��9CR\{�q�q~B9�tq9~qmxu��9u�9m9xu��xq9purrq~qz�D�

� �jtm�9�{x��u{z�9p{9�q9tm�qS�

Page 26: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HL Copyright © 2012 NTT Communications Corporation All Rights Reserved.

b{�B9�mxw9mn{��9�tu�:�f{x��u{z��

���GD9W{z��y|�u{z9Z]V9yqy{~���

���HD9]zo~qm�q9o{z�q~sqzoq9�uyqÓe]VEZ]VÔ�

jtm���9|~{nxqy9�u�t9]zo~qm�q9~{��q��

Page 27: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HM Copyright © 2012 NTT Communications Corporation All Rights Reserved.

f{x��u{z9�{9pqmx9�u�t9Z]V9xuyu��

!  ~qp�ouzs9�{yq9~{��q�9�CR9u�9y{��9x{�9o{��9�{~wm~{�zpB9nqom��q9u�9p{q�z��9zqqp9zq�9~{��q~�D9�

CR9jtuot9~{��q�9�t{�xp9nq9~qp�oqpS�GD  gtq9uz�q~zq�9r�xx9~{��q�9P9�tq9~{��q�9r~{y9�tq9]z�q~zq��HD  gtq9uz�q~zmx9~{��q�9P9�tq9~{��q�9�u�tuz9cWb9?z{�9mp�q~�u�qp9�{9�tq9]z�q~zq�@ ��

!  ~q|xmouzs9�{9tust9�|qo9~{��q~�9999CR9u�9tust9o{����

9999CR9mzp9~q|xmouzs9ymuz�qzmzoq9u�9tqm��9{|q~m�u{zD9�

�U�9ru~��9sxmzoqB9~qp�ouzs9�{yq9~{��q�9�qqy�9nq��9�m�D9V����

Page 28: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HN Copyright © 2012 NTT Communications Corporation All Rights Reserved.

g~{�nxq�9�tqz9~qp�ouzs9~{��q��

!  eqp�ouzs9~{��q�9u�9�~{�nxq�{yq�C gtu�9tm||qzqp9mo��mxx�9m�9cWb9yus~m�u{z9{|q~m�u{zD�

aggregate

core

aggregate

core

aggregate aggregate

OSPF Area 0

V[d9~{��q~�

b{z9V[d9~{��q~�

edge�

ACTedge

②looks up BGP routes and forwards

edgeα’s loopback because aggregate router

know BGP routes. SBYedge

①look up the default-route when packet comes from

downlink. because edge router is non

BGP router.

Internal routersPeering/Transitrouters

OSPF Area 1

Destnation address

192.168.1.1/24

Page 29: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© HO Copyright © 2012 NTT Communications Corporation All Rights Reserved.

OSPF Area 0

OSPF Area 1

g~{�nxq�9�tqz9~qp�ouzs9~{��q��

aggregate

core

aggregate

core

aggregate aggregate

Internal routersPeering/Transitrouters

edge�

ACTedge

SBYedge

④Replacing Standby edge router to another aggregation router

which located in same OSPF area

③Replacing this aggregation router when become EOL(End Of life)

V[d9~{��q~�

b{z9V[d9~{��q~�

Page 30: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IF Copyright © 2012 NTT Communications Corporation All Rights Reserved.

OSPF Area 0

OSPF Area 1

g~{�nxq�9�tqz9~qp�ouzs9~{��q��

aggregate

core

aggregate

core

aggregate aggregate

edge�

ACTedge

SBYedge ⑤Despite the migration to

new aggregation router,Act edge router keep forwarding packets to upstream links. Because It don’t know the

BGP routes.

⑥Aggregation router finds new ospf shotest path to

edgeα’s loop back at downlink. Because OSPF

prefer same area path to less metric path.

Internal routersPeering/Transitrouters

!  au�ym�otuzs9x{suomx9�{|{x{s�9nq��qqz9Uss~qsm�u{z9mzp9UWg9qpsq9~{��q~�

eq��x�9uz9�tq9sqzq~m�u{z9{r9~{��uzs9x{{|:�

V[d9~{��q~�

b{z9V[d9~{��q~�

Page 31: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IG Copyright © 2012 NTT Communications Corporation All Rights Reserved.

g~{�nxq�9�tqz9~qp�ouzs9~{��q��

V[d9~{��q~�

b{z9V[d9~{��q~�OSPF Area 0

OSPF Area 1

aggregate

core

aggregate

core

aggregate aggregate

edge�

Internal routersPeering/Transitrouters

SBYedge

ACTedge

]r9mxx9~{��q~9tm�q9r�xxC~{��qB9�~{�nxq9xuwq9�tu�9�{z��9tm||qzD�

If edge router has BGP routes. Routing loop will not happen. Because edge router

looks up BGP routes and find edge α loopback. As

a result packets are forwarded to new

aggregation router, not to old aggregation router

Page 32: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IH Copyright © 2012 NTT Communications Corporation All Rights Reserved.

f{x��u{z9�{9pqmx9�u�t9Z]V9xuyu��

eqp�ouzs9�tq9z�ynq~9{r9~{��q��

eqp�ouzs9�tq9�u�q9{r9yqy{~��

{|q~mnuxu���?|~{�upuzs9�~mz�u�Eg~mrruo9Yzsuzqq~uzs@�

g~{�nxq�?d{��unuxu��9{r9~{��uzsCx{{|@�

Y��qzmx?�tq9~{��q�9r~{y9{�q~�qm�@� ÕÕÕ� ÕÕÕ� ÖÖÖ� Ö�

]z�q~zmx?�tq9~{��q�9{r9{�tq~9dcd�9uz9cWb@�

Õ� Õ� Ö� Ö�

!  9jtuot9~{��q�9�t{�xp9nq9~qp�oqpS��

gm~sq�9|~qru�9�{�~qp�oqp9�{x�yq�

Yrrqo��

]r9V[d9~{��q�9uzo~qm�qB9�tq~q9u�9z{9�m�9{��B9�n��9�{9~q|xmoq9Ypsq9~{��q~9�u�t9tust9f|qo9~{��q~B9��u�t{��9o{y|~{yu�uzs9�tq9{|q~m�u{z9}�mxu���

�D�

Page 33: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© II Copyright © 2012 NTT Communications Corporation All Rights Reserved.

c�~9�u��m�u{z9–9nqr{~q9~q|xmouzs�

mss~qsm�q�

o{~q�

qpsq�

mss~qsm�q�

o{~q�

qpsq�

tust�

yqpu�z�

x{��

aqy{~�9��msq�

dqq~��oxuqz���

uz�q~zmx9�~{��q~��

Page 34: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IJ Copyright © 2012 NTT Communications Corporation All Rights Reserved.

qpsq� qpsq�

mss~qsm�q�

o{~q�

mss~qsm�q�

o{~q�

c�~9�u��m�u{z9–9�tqz9uzo~qm�uzs9~{��q��

tust�

yqpu�z�

x{��

aqy{~�9��msq�

dqq~��oxuqz���

uz�q~zmx9�~{��q~��

W~u�u�9{r9yqy{~�9��msq:�

Page 35: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IK Copyright © 2012 NTT Communications Corporation All Rights Reserved.

qpsq� qpsq�

mss~qsm�q�

o{~q�

mss~qsm�q�

o{~q�

�eqp�ouzs9~{��q�9n��9o��p{�z9]z�q~zq��9r�xxC~{��q:�

tust�

yqpu�z�

x{��

aqy{~�9��msq�

c�~9�u��m�u{z9–9mr�q~9~qp�ouzs9~{��q��

Wmz’�9nq9~qp�oqpD�Vqom��q9V[d9oxuqz���zqqp9r�xxC~{��q�

W���{yq~��t{9zqqp9�r�xxC~{��q�

uz�q~zmx9�~{��q~��

Page 36: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IL Copyright © 2012 NTT Communications Corporation All Rights Reserved.

mss~qsm�q� mss~qsm�q�

c�~9�u��m�u{z9C9eq|xmouzs:�

o{~q�

qpsq�

o{~q�

qpsq�

o{~q� o{~q�

mss~qsm�q� mss~qsm�q�

GD  9V��9zq�9nus9~{��q~�99mzp9~q|xmouzs�

zq��~{��q~�

zq��~{��q~�

tust�

yqpu�z�

x{��

aqy{~�9��msq�

HD9~q|xmouzs�

ID9~q|xmouzs�

dqq~��oxuqz���

uz�q~zmx9�~{��q~��

Page 37: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IM Copyright © 2012 NTT Communications Corporation All Rights Reserved.

!  eqp�ouzs9~{��q�9ym�9om��q9�~{�nxq��

!  c�~9upqmx9u�9�{9tm�q9r�xx9~{��q�B9n��9�tq~q9m~q9yq~u��9mzp9pqyq~u���

f�yym~��

~{��q~��o{���

��

��

o{z�q~sqzoq��uyq�

��

��

{|q~m�u{z�o{���

��

��r�xx9~{��q��

~qp�ouzs9�{yq9~{��q��

pqrm�x�9~{��q�

\{�9mn{��9�{�~9zq��{~w�S�

Page 38: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© IN Copyright © 2012 NTT Communications Corporation All Rights Reserved.

b{�B9�mxw9mn{��9�tu�:�

f{x��u{z���

���GD9W{z��y|�u{z9Z]V9yqy{~���

���HD9]zo~qm�q9o{z�q~sqzoq9�uyqÓe]VEZ]VÔ�

jtm���9|~{nxqy9�u�t9]zo~qm�q9~{��q��

Page 39: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 39

c�~9�u��m�u{z�99�

! e]V9o{z�q~sqzoq�C 9b{9�~{�nxq�9�{9rm~9"�C 9g~�uzs9�{9uy|~{�q9�tq9o{z�q~sqzoq9�uyq�

!  Z]V9o{z�q~sqzoq�C 9U9�~{�nxq9~qxm�qp9�{9x{zs9Z]V9o{z�q~sqzoq9�uyq�

Page 40: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 40

gtq9e]V9W{z�q~sqzoq9�

Page 41: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 41

c�~9o{z�q~sqzoq9�uyq9�

!  e]V9o{z�q~sqzoq9?;9{r9|~qru�q�9P9�J9KFFFFFB9�L9KFFFF@�

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

* i MED 10 * e MED 20

gtq9]z�q~zq��

* i MED 10�

* e MED 10 MED 30

* i MED 20 �

* i MED 20�

2mins at R1 �

ASBR-1 (MED10)

Page 42: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 42

gqotzuomx9f{x��u{z�9�{9pqmx9�u�t9�tq9o{z�q~sqzoq�

!  g{9tm�q9nmow�|9|m�t��

Solution add-path BGP Best External

+Full mesh diverse-path

Internet-draft draft-ietf-idr-add-paths

draft-ietf-idr-best-external

draft-ietf-grow-diverse-bgp-path-

dist Current I-D

version 06 05 06

Author Cisco,Juniper,HP Cisco, Juniper Cisco,Verisign,KDDI, NTT MCL

jq9�q��qp9�tu�9:�

Page 43: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 43

* i MED 10 e MED 20 e MED 20�

Vqr{~q9V[d9nq��Cq��q~zmx�

!  eGEH9tm�q9{zx�9nq��9|m�t��

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

gtq9]z�q~zq��

* i MED 10�

not advertise to any peers�

only best paths�

* i MED 10�

* e MED 10 �

Page 44: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 44

�e MED 20

Vqr{~q9V[d9nq��Cq��q~zmx�

!  jtqz9�tq9aYX9�mx�q9u�9otmzsqp9m�9eG�

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

gtq9]z�q~zq��

* i MED 10 � long time to

change the paths�

* e MED 10 MED 30

* i MED 20 �

updates updates

* i MED 20� i MED 30�

updates i MED 30�* �* i MED 10

updates updates

Page 45: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 45

* i MED 10 e MED 20 e MED 20�

Ur�q~9V[d9nq��Cq��q~zmx�

!  eGEH9tm�q9nmow�|9|m�t��

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

gtq9]z�q~zq��

* i MED 10�

* e MED 10 �

Backup paths�

i MED 20�

best-external�

MED20 MED20

best-external�

Page 46: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 46

�e MED 20

Ur�q~9V[d9nq��Cq��q~zmx�

!  jtqz9�tq9aYX9�mx�q9u�9otmzsqp9m�9eG�

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

gtq9]z�q~zq��

* i MED 10 �

More quickly

* e MED 10 MED 30

* i MED 20 �

updates updates

i MED 30�

updates i MED 30�* �* i MED 10 best-external�best-external�

i MED 20� * i MED 20�

Page 47: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 47

0.0%$

10.0%$

20.0%$

30.0%$

40.0%$

50.0%$

60.0%$

70.0%$

80.0%$

90.0%$

100.0%$

sec$ 0$$ 5$$ 10$$ 15$$ 20$$ 25$$ 30$$ 35$$ 40$$ 45$$ 50$$ 55$$ 60$$ 65$$ 70$$ 75$$ 80$$ 85$$ 90$$ 95$$100$$105$$110$$115$$120$$125$$130$$135$$140$$

disable$best7external$1st$

disable$best7external$2nd$

enable$best7external$1st$

enable$best7external$2nd$

gtq9e]V9o{z�q~sqzoq9�uyq�9m�9eG�

!  gtq9o{z�q~sqzoq9�uyq�9�q~q9uy|~{�qp�C jtqz9otmzsuzs9�tq9aYX9�mx�q9m�9UfVeCG�C ;9{r9|~qru�q�9]d�J9JHFBFFF99]d�L9IIBFFF�

��m~�qp9�|pm�uzs9�tq9e]V�

130sec�

95sec 27% improved�

ruzu�tqp9�|pm�uzs9�tq9e]V�

Page 48: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 48

gtq9Z]V9W{z�q~sqzoq9�

Page 49: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 49

c�~9Z]V9o{z�q~sqzoq9�uyq9�

!  Z]V9o{z�q~sqzoq9?;9{r9|~qru�q�9P9�J9KFFFFFB9�L9KFFFF@�

R1 R2

ASBR1 (MED10)

ASBR-2 (MED20)

iBGP eBGP

|~qru�q��

gtq9]z�q~zq��

gtq9Z]V9�mnxq9uz9eG�

d~qru�?q�@�d~{�{o{x9�

bq��Ct{|?�@�{��|��9uz�q~rmoq?�@�

kDkDkDkEN�

D�

D�

D�

UfVeG�

`{suC]Z9mq;F�

dt�C]Z9sqC;GB9HB9IB9JB9KB9L�

a logical IF a physical IF 210sec

at R1 �

Page 50: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 50

•  jq9�q~q9rmouzs9m9|~{nxqyP�C  cfdZ9zqustn{~9�qz�9p{�z9p�q9�{9Z]V9�mnxq9o{z�q~sqzoq�

•  Vq��qqz9eG9mzp9UfVeCG�C9`uzw9Uss~qsm�u{z9?`U[@9tmp9nqqz9qzmnxqp9?yuzuy�yCxuzw�9Q9G@9�C9cfdZ9zqustn{~9tmp9nqqz9o{zzqo�qp9�t~{�st9�tq9`U[9uz�q~rmoq�

•  jtqz9mxx9yqynq~Cxuzw�9n��9{zq9tmp9nqqz9�{9ymwq9pu�mnxqp�� �C9jq9tmp9q�|qo�qp9�tq9cfdZ9zqustn{~9�{9~qymuz9�|99��

50

e�G�

UfVe�G�

yqynq~Cxuzw9G�

`uzw9Uss~qsm�u{z�

yqynq~Cxuzw9H?p{�z@�

yqynq~Cxuzw9I?p{�z@�

yqynq~Cxuzw9J9?p{�z@�

yqynq~Cxuzw9K9?p{�z@�

yqynq~Cxuzw9L9?p{�z@�

cfdZ9tqxx{9|mowq��9�t{�xp9nq9q�otmzsqp�{�q~9�tu�9]Z9�

fomxmnuxu��9{r9e{��q~9Z{~�m~puzs9gmnxq�9�

OSPF hello

Page 51: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 51

51

•  jtm�9tm||qzqpS�

eG�UfVe�G�

yqynq~Cxuzw9G�

`uzw9Uss~qsm�u{z9]z�q~rmoq�

yqynq~Cxuzw9H�

yqynq~Cxuzw9I�

yqynq~Cxuzw9J�

yqynq~Cxuzw9K�

yqynq~Cxuzw9L�× pu�mnxq�

?G@9eG9pq�qo�qp9�tq9uz�q~rmoq�9�q~q9p{�z�

?H@9eG9��m~�qp9�|pm�uzs9Z]V�

?I@9eG9ruzu�tqp9�|pm�uzs9Z]V�

?J@9eG9ot{�q9mz{�tq~9uz�q~rmoq9�{9�qzp9cfdZ9tqxx{�

cfdZ9tqxx{�

y{~q9�tmz9cfdZ9pqmpC�uyq~�

e×9�m�z��9mnxq9�{9�qzp9mz�9cfdZ9tqxx{9|mowq��9p�~uzs9?G@9–9?I@B9�tqz9�tq9zqustn{~9�qz�9p{�z�

cfdZ9tqxx{�

fomxmnuxu��9{r9e{��q~9Z{~�m~puzs9gmnxq�9�

Page 52: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 52

•  \uq~m~otuomx9Z]V9�C9Wu�o{P9V[d9d~qru�9]zpq|qzpqz�9W{z�q~sqzoq?d]W@�C  ^�zu|q~P9uzpu~qo�Czq��t{|��

Z{~9y{~q9uzr{~ym�u{zP99V[d9W{z�q~sqzoq9uz9y�ot9xq��9�tmz9m9�qo{zp�t��|PEE���Dzmz{sD{~sEyqq�uzs�Ezmz{sJFE|~q�qz�m�u{z�EWxm~qzoqZux�rux�CV[dD|pr��

•  Zq�q~9~{��q�9�{9nq9�|pm�qp�

•  ]y|~{�uzs9�tq9Z]V9o{z�q~sqzoq9�uyq�

52

oq~�muz9~{��q~�

Z]V9�mnxq?]d�J@� W{z�q~sqzoq9�uyq�

?rxm��qzqp9Z]V@�

W{z�q~sqzoq9�uyq�

?tuq~m~otuomx9Z]V@�

KFFBFFF� y{~q9�tmz9HGF�qo� m~{�zp9HK�qo�

gqotzuomx9f{x��u{z�9�{9pqmx9�u�t9�tq9o{z�q~sqzoq�

Page 53: APRICOT 2012 - Living with the ever-growing BGP table: an OCN story

© Copyright © 2012 NTT Communications Corporation All Rights Reserved. 53

j~m|9�|�

!  gtq9�u�q9{r9�tq9V[d9�mnxq9tm�9nqqz9o{z�uz�mxx�9uzo~qm�uzs�

!  gtq~q9m~q9H9u���q�9�{9o{|q9�u�t9�tq9uzo~qm�q�

GD  Z]V9yqy{~�9xuyu�99��9CR9~qy{�uzs9~{��q�E~q|xmouzs9~{��q~��

HD9W{z�q~sqzoq9�uyq99?e]VEZ]V@�

9CR9�q��uzs9=9uz��mxxuzs9zq�9r�zo�u{z��

!  \{�9u�9�{�~9zq��{~wS9dxqm�q9�qxx9��9�{�~9q�|q~uqzoq�9�{9o{|q9�u�t9�tq9q�|qo�qp9s~{��t9{r9�tq9V[d9�mnxq9:�