Surge 2014 - Kris Beevers - Data Driven DNS

DATA DRIVEN DNSTraffic Management for Distributed Applications

Kris Beevers@beevek

TRAFFIC MANAGEMENT

DATA DRIVEN DNS @nsoneinc

MULTIPLE OPTIONS FOR SERVICING A USER:2 or more servers... datacenters... CDNs

TRAFFIC MANAGEMENT



GOAL: SEND USER TO THE “BEST” OPTION

TRAFFIC MANAGEMENT




“BEST”:Fastest / most responsiveUpCheapest… any biz objective, really

TRAFFIC MANAGEMENT




“BEST”:Fastest / most responsiveUpCheapest… any biz objective, really

(of course, there’s more to “traffic management”)TRAFFIC MANAGEMENT


DNS IS BORING.


DNS IS BORING.

BUT

DISTRIBUTED APPLICATIONS ARE EASIER THAN EVER.(traffic management is more important than ever)


DNS IS BORING.

BUT

DISTRIBUTED APPLICATIONS ARE EASIER THAN EVER.(traffic management is more important than ever)

SO

DNS IS KIND OF EXCITING AGAIN. YAY.(because dns lookup is a decent time to make traffic management decisions)


WHY IS DNS LOOKUP A GOOD TIME TODO TRAFFIC MANAGEMENT?




1. APP ENTRYPOINT


1. APP ENTRYPOINT2. REALTIME STATE

Your systems The network Etc.



1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY

Get to make “decisions” often

Can have impact faster than TTL in some key scenarios (load shedding)



1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY4. GRANULAR

Per resolver Or per /24 (edns-client-subnet)



1. APP ENTRYPOINT2. REALTIME STATE3. HIGH FREQUENCY4. GRANULAR5. LOW LATENCY

Anycasting: decisions at the edge Caching: reuse decisions


TRADITIONALDNS STATE



WHAT DOES IT MEAN TO DODATA DRIVEN TRAFFIC MANAGEMENT?


UNDERSTAND WHAT WE’RETRYING TO OPTIMIZE



response timesthroughputinfrastructure loadcost…




MAKE ROUTING DECISIONS USINGFIRST ORDER INFORMATION




MAKE ROUTING DECISIONS USINGFIRST ORDER INFORMATION

eyeball metricsapplication load metrics$/usage metricsaccurate geo/network/resolver data...

DATA DRIVENDNS STATE

CONFIGURATIONSTATIC & DYNAMIC

LIVE METRICSDATA FEEDS



WHAT DOES THIS LOOK LIKE IN PRACTICE?


APP

DATASOURCES

application metricsperfload...


APP

MONITORING

DATASOURCES

server, system, networkupnessperf/QoS...


APP

MONITORING

TOOLS

DATASOURCES

portals/manualbiz logic/automation...


APP

MONITORING

TOOLS

GATHERERS

DATASOURCES

routing/network metricsgeoip intelligenceresolver modeling & intelligenceeyeball metrics / RUM...


APP

MONITORING

TOOLS

GATHERERS

INGEST

DATASOURCES


APP

MONITORING

TOOLS

GATHERERS

INGEST

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DATASOURCES


APP

MONITORING

TOOLS

GATHERERS

INGEST PUBLISH

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DNSEDGES

DATASOURCES


APP

MONITORING

TOOLS

GATHERERS

INGEST PUBLISH

COMPILECLASSIFY

NORMALIZEAGGREGATE

...

DNSEDGES

QUERIES

DATASOURCES

TRAFFIC MANAGEMENT PATTERNS




GEO



GEO

TARGETING + FENCING



GEO +WEIGHTING



GEO +WEIGHTING +STICKINESS



GEO +WEIGHTING +STICKINESS +FAILOVER



GEO +WEIGHTING +STICKINESS +FAILOVER

CAN’T LOSE A SINGLE REQUEST?

ANYCAST.



GEO +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING




COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION...




COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION…

STATIC CONFIG +INFRASTRUCTURE INTELLIGENCE



METRICS ROUTING +WEIGHTING +STICKINESS +FAILOVER +LOAD SHEDDING

COMMIT MANAGEMENTIP PREFIX FENCINGASN FENCINGPRIORITIZATIONRANDOMIZATION…

STATIC CONFIG +INFRASTRUCTURE INTELLIGENCE +EYEBALL INTELLIGENCE

WHAT MATTERS MORE IN DYNAMIC DNS?HOW FAST YOU SPIT OUT AN ANSWER?

OR THAT IT’S THE RIGHT ANSWER?




90-98% OF DNS QUERIES AREANSWERED FROM CACHE

(for high volume records)




90-98% OF DNS QUERIES AREANSWERED FROM CACHE

(for high volume records)

YOU’D BETTER MAKE SURE THE

RIGHT ANSWER IS CACHED



ANYCASTING: More POPs is better, right?

40+

50+

?

<1010+15+

30+15+20+


EDNS-CLIENT-SUBNET


EDNS-CLIENT-SUBNETA.B.C.D: (xyz.com?) -> 8.8.8.8: (xyz.com? + A.B.C.0/24) -> dns3.p07.nsone.net

THANK YOU!

Kris Beevers

[email protected]@nsoneinc


WHERE ARE THE RESOLVERS?24h, sample ~0.5% NSONE queries CC /32s >10Q

US 95k 12k

BR 9k 1.3k

GB 7k 900

RU 6k 1.4k

JP 6k 800

CA 6k 800

DE 5k 600

CN 3k 700

AU 3k 400

Surge 2014 - Kris Beevers - Data Driven DNS

Technology

Transcript of Surge 2014 - Kris Beevers - Data Driven DNS