Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting...
Transcript of Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting...
![Page 1: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/1.jpg)
Route Server at IXP~ JPIX stats, present and getting ahead ~
Japan Internet Exchange Co., Ltd.
Masataka MAWATARI <mawatari[at]jpix.ad.jp>
![Page 2: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/2.jpg)
2Copyright © 2010 Japan Internet Exchange Co. Ltd.,
What we will talk here
• I talk about present conditions in Route Server and discuss way to improve service.
• All IXPs want to make service level and quality better.
– I hope this session will help to bring improvement.
• For all engineers getting involved Route Server service
– ISPs, Router hardware vender, absolutely IXPs
![Page 3: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/3.jpg)
3Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Agenda
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 4: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/4.jpg)
4Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 5: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/5.jpg)
5Copyright © 2010 Japan Internet Exchange Co. Ltd.,
What’s Route Server at IXP?
• “Route Server” from RFC1863– A process that collects routing information from border
routers and distributes this information to “client routers”.
• Service’s purpose (it’s simple)– Route reflector from various global ASs– Multi-lateral Peering at IX segment
• one bgp peer config for many ASs’ prefixes
• Service’s optional functions– Route filter
• AS-Path filter, Prefix filter (ex. based IRRd)
– Policy filter• Using bgp community attribute
– Route confirm• Comparison with IRRd database • Looking glass
![Page 6: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/6.jpg)
6Copyright © 2010 Japan Internet Exchange Co. Ltd.,
What’s Route Server at IXP?
Route-ServerASN : A
ParticipantASN : X
ParticipantASN : Y
ParticipantASN : Z
BGP peer sessionwith only RS (ASN:A)
Traffic exchangewith all the other participant ASs
• BGP peer session with all RS participants (ASN:X,Y,Z)• Advertising all RS participants’ prefix
Traffic
Peer
![Page 7: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/7.jpg)
7Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Route Server Implementation
• OSS daemon– IXP is generally using now.
• Quagga• OpenBGPd• BIRD
– Topic issue• More stable. More reliable.• Quagga development team isn’t doing very well in past days.• But, development activity is going well worldwide.• Euro-IX RS Working Group is working on improvement project.• Recently, NANOG 48 meeting had route servers session.
• Commercial implementation– Fewer IXP using than OSS now.
• Vyatta• ZebOS• Network hardware vender’s implementation• ...etc
– Topic issue• Actual case reports are very few.• But, hardware venders are interested in implementing.
![Page 8: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/8.jpg)
8Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 9: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/9.jpg)
9Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Introduction: JPIX
• Ethernet-based Layer 2 IX (Commercial)
– Our main service
– IX Switch installation site (2 segmentalized sites)
• Tokyo Metropolitan Site
– Otemachi, Bayarea, Otemachi 2nd, Toyosu, Nihonbashi,Nagoya, Tennozu.
• Osaka Site
• Optional Service (Free of Charge)
– Route Server < This presentation theme!!
– NTP Server
– NNTP Server
– etc..
• Members
– 125AS over
![Page 10: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/10.jpg)
10Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Introduction: JPIX
peak traffic : 120Gbps over
![Page 11: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/11.jpg)
11Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Introduction: JPIX (extras)
Traffic dimple on 13:00-15:00 26th Feb 2010
• This traffic dimple is cased by figure skating final performance at Olympic Winter Games Vancouver
• Most Japanese Net-Surfers was watching TV in this time.
![Page 12: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/12.jpg)
12Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Introduction: JPIX (extras)
Excuse me,Let’s get back to
the subject.
![Page 13: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/13.jpg)
13Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route Servers Implementation
• Based on Quagga
– Protect BGP session with TCP/MD5 support
– Dual Stack (IPv4/IPv6) bgp peering support
– 4Byte ASN support
• Route Filtering
– Inbound AS-PATH filter on Route-Server
– Prefix Limit (10,000prefix/peer)
• Redundancy
– Participants are peering with both active RS and backup RS
• Management from Participant operator
– Managed by Web-based GUI (Customer’s Portal Web)
![Page 14: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/14.jpg)
14Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route Servers Implementation
Route-Server
Route Filtering (AS-PATH Filter)
ParticipantASN:64500
AS-PATH=64500AS-PATH=64510
InboundPrefix Limit Filterpermit ^(64500_)+$
![Page 15: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/15.jpg)
15Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route Servers Implementation
Route-Server
Route Filtering (Prefix Limit)
ParticipantASN:64500
advertised preix #: 10,000advertised prefix #: >10,001
InboundPrefix LimitMaximum: 10,000
![Page 16: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/16.jpg)
16Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route Servers Implementation
Route-Server-1192.0.2.1
2001:db8:abab::7527:1
Route-Server-2192.0.2.2
2001:db8:abab::7527:2
Route-Server Redundancy
ParticipantParticipant Participant
![Page 17: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/17.jpg)
17Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route Servers Implementation
Controlling route filter (IPv4/IPv6) menu
Looking glass and Comparison with IRR database menu
JPIX Route-Server Customer’s Portal Web
![Page 18: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/18.jpg)
18Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route-Server IPv4 statistics
• Number of Peers and Prefixes grow steadily
• Average number of prefixes per peer = 20.7 (just now)
• 30% of the total IPv4 IX participants is using IPv4 RS
Total peers and total prefixes on IPv4 RS
![Page 19: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/19.jpg)
19Copyright © 2010 Japan Internet Exchange Co. Ltd.,
JPIX Route-Server IPv6 statistics
• JPIX has launched IPv6 RS service in 2008.
• Number of IPv6 Peers != Number of IPv6 Prefixes
• 60% of the total IPv6 IX participants is using IPv6 RS
Total peers and total prefixes on IPv6 RS
![Page 20: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/20.jpg)
20Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 21: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/21.jpg)
21Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Route Server issues facing JPIX
• ISP inadvertently overwriting next-hop address of received prefix from Route Server.– ISP operator change next-hop address into BGP
neighbor address (=Route Server’s address).
– As a result, Route Server will get into blackhole.
– JPIX have a plan to implement blackhole detecting function.
• “bgp enforce-first-as” default enable/disable behavior depends on IOS version.– http://www.ciscosystems.com/en/US/docs/ios/iproute_bgp/comma
nd/reference/irg_bgp1.html#wp1061416
– When participant router upgrading IOS version, router can not peer with Route Server
– ISP operator need to explicitly configure “no bgp enforce-first-as”.
![Page 22: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/22.jpg)
22Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 23: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/23.jpg)
23Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Requirement for service from RS participants
• More various route filtering
– Route filtering is important service function for RS
– Prefix filter, AS-PATH filter, other policy filter.
• Not want to disable “bgp enforce-first-as”
– Route Server don’t add ASN of RS’s own to AS-PATH.
– Security concern about received bgp routes.
• ex) IOS: “no bgp enforce-first-as” is global configuration.
• Selective peering over the Route-Server Service
– Ambivalent between Multi-lateral peering and Bi-lateral peering
![Page 24: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/24.jpg)
24Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 25: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/25.jpg)
25Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Requirement for implementation from IXP
• Improvement OSS bgp daemon
– Every IXPs have already been spending money to use oss and local patch for Route-Server.
• More selectable platform.
– In fact, We have only some software base implementation now.
– Router Hardware vender should develop route server implementation.
– There are features that BGP daemon can’t do.
• BFD (with BGP), Graceful switchover, ISSU, and more...
• At all, we are looking for good solution.
![Page 26: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/26.jpg)
26Copyright © 2010 Japan Internet Exchange Co. Ltd.,
1. Introduction
• What’s Route Server at IXP?
• Route Server Implementation
2. JPIX Route Servers
• Introduction: JPIX
• System Implementation
• Stats
3. Route Server issues facing JPIX
4. Requirement for service from RS participants
5. Requirement for implementation from IXP
6. Request for Comments
![Page 27: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/27.jpg)
27Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Request for Comments
• I want comments from ISP.
– What do you want features about Route Server service?
– Are you using route reflector in your own AS?
• I want comments from Router vender.
– Are you interested in implementing Route-Server?
• I want comments about JPIX Route Server
– Route Server Implementation, Service, etc...
• Any comments.
![Page 28: Route Server at IXP - conference.apnic.netRoute Server at IXP ~ JPIX stats, present and getting ahead ~ Japan Internet Exchange Co., Ltd. Masataka MAWATARI](https://reader030.fdocuments.in/reader030/viewer/2022040603/5e9fc85517356573f57ef95f/html5/thumbnails/28.jpg)
28Copyright © 2010 Japan Internet Exchange Co. Ltd.,
Thank you !