Preparing for DNS DisasterAugust 28, 2013

Cory von WallensteinCTO

@cvwdyn

Preparing for DNS Disaster @cvwdyn @dyninc

Cory von Wallenstein

Chief Technology

Officer

Dyn Inc.

cvw@dyn.com

@cvwdyn

Preparing for DNS Disaster @cvwdyn @dyninc

What do we mean by DNS disaster?$ dig company.com

; <<>> DiG 9.8.3-P1 <<>> company.com

;; global options: +cmd

;; Got answer:

;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 1876

;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:

;company.com. IN A

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

October 2012

Hurricane

Sandy

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

“A frying squirrel took out half of our Santa Clara data center two years back,”- Mike Christian, Yahoo

Preparing for DNS Disaster @cvwdyn @dyninc

“Squirrel chews account for a whopping 17% of our damages so far this year! But let me add that it is down from 28% just last year and it continues to decrease since we added cable guards to our plant.”, Fred Lawler, Level(3)

Preparing for DNS Disaster @cvwdyn @dyninc

Disasters can happen anywhere.Disasters can happen anytime.Disasters can happen to anyone.

Preparing for DNS Disaster @cvwdyn @dyninc

Users expect reliable & fast services.

No excuses.

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

What should you know about your data center before you

commit?

Preparing for DNS Disaster @cvwdyn @dyninc

“Wired people should know something about wires”- Neal Stephenson, quoted in Andrew Blum’s TED Talk What is the Internet, Really?

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Who carries your bits?Where are they carried?

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Speed of light299,792.458 km/second(in a vacuum)

Theoretical RTT~40ms

Real RTT~90ms

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Where will you deploy your second datacenter?

Preparing for DNS Disaster @cvwdyn @dyninc

Where will you deploy your second datacenter?

Preparing for DNS Disaster @cvwdyn @dyninc

What do you drill? How often?Can I watch?

Preparing for DNS Disaster @cvwdyn @dyninc

When disaster approaches, how can you use advanced services to

help avoid downtime?

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Preparing for DNS Disaster @cvwdyn @dyninc

Failover to a Status Page;; QUESTION SECTION:

;twitter.com. IN A

;; ANSWER SECTION:

twitter.com. 30 IN A 199.16.156.230

twitter.com. 30 IN A 199.16.156.198

twitter.com. 30 IN A 199.16.156.38

Preparing for DNS Disaster @cvwdyn @dyninc

Active Failover to a Status Page;; QUESTION SECTION:

;twitter.com. IN A

;; ANSWER SECTION:

twitter.com. 30 IN A 199.16.156.230

twitter.com. 30 IN A 199.16.156.198

twitter.com. 30 IN A 199.16.156.38

Monitor… actively change when down

Preparing for DNS Disaster @cvwdyn @dyninc

Active Failover to a Status PagePros:• Preserve the trust in brand, maintain communication

Cons:• Longer time to recovery• You’re still “down”

Preparing for DNS Disaster @cvwdyn @dyninc

Active/Passive…Primary/Backup…

Pros:• Shorter time to recovery

Cons:• Cross your fingers that it works when you need it• Drill, drill, drill. Test, test, test.

Preparing for DNS Disaster @cvwdyn @dyninc

Active/Active (Iovation)

Pros:• Highly available• Shift traffic as needed (maintenance)

Cons:• Architect for it• Two sites each operating at >50% capacity risks outage

Preparing for DNS Disaster @cvwdyn @dyninc

Ever Too Late?

Never!

Constant evaluation of the right tool in the toolbox

Will evolve as your business evolves

Accept responsibility and ownership, and make it better

Preparing for DNS Disaster @cvwdyn @dyninc

Cory von Wallenstein

Chief Technology

Officer

Dyn Inc.

cvw@dyn.com

@cvwdyn

Preparing for DNS Disaster @cvwdyn @dyninc

Thank You!

Next Webinar: Holiday Planning For DNS & EmailWednesday, September 25

For More Disaster Planning Content:Dyn.com/Content-Hub