Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

21
Using Data to Determine Where to Build a New Data Center Eugene Yaacobi, Shutterstock

Transcript of Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Page 1: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Using Data to Determine Where to Build a New

Data CenterEugene Yaacobi, Shutterstock

Page 2: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Who Am I?• Nerd

• Manager, Infrastructure @ Shutterstock

• I also like cars

Page 3: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

A Little About Shutterstock• We are a stock photo,

footage, and music company

• 12 years old - founded in 2003

• Made in NY• Offices in Amsterdam,

Berlin, Chicago, Dallas, Denver, London, Los Angeles, Montreal, Paris, San Francisco, and Silicon Valley

• Over 600 employees• 4 images sold every

second• Focus on volume, unbiased

search experience.• Translated into 20

languages• Accepting 9 currencies • Customers in 150+

countries

Page 4: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

A Little About Shutterstock (cont.)• Two-sided marketplace

• Over 1.3 million active customers from 150 countries

• 80,000 contributors in 100 countries

• 60 mm images; over 50,000 images added every day (look at the counter on the site and round down to the nearest million)

• 3mm+ video clips; over 90% HD, 160,000 4K clips, and 3,000 videos added every day

• 500 mm paid downloads to date, selling 4 images per second

• $350 mm paid to contributors since 2003

Page 5: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Infrastructure at Shutterstock• The service that every other

service is built on:

• 3 Datacenters

• 4,000 servers running CentOS

• Servers are mostly virtualized

• ~500 network devices

• Brocade load balancers

• Juniper routers and switches, running JunOS

Page 6: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

The Infrastructure Group at Shutterstock• First responders to site issues

• 1OC for immediate alerts

• Made up of five teams:

• SRE - training

• Tools - internal tooling

• Storage - Purchasable asset storage

• Assets - Hardware acquisition

• Traffic - Network engineering

Page 7: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Hey Infrastructure Where do we put our next deployment?

Page 8: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Great question! Our assets are downloaded all over the world

Page 9: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Every second counts!

40% of people abandon a website that takes more than 3 seconds to load.

Page 10: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

If an e-commerce site is making $100,000 per day, a 1 second

page delay could potentially cost you $2.5 million in lost sales every

year

This makes executives sad pandas

Page 11: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Step 1 Decide what regions are important to you

Page 12: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Step 2 Create some Tests

Page 13: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Step 3 Let Simmer

Page 14: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Step 4 Review and Analyze

Page 15: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Look at response times Pay attention to where the client is spending

more time

Page 16: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Look at your page loads Good starting spot is your worst

performer

Page 17: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Drill down into your data You can learn some cool

things

Page 18: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Waterfalls are super useful Use them

Page 19: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

What else can the data be used for? Things

Page 20: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Like what?• Ad-Hoc Troubleshooting

• Monitor and Alert on Overall Site Performance

• Does the site function properly and efficiently in all locations?

• If not:

• Which locations are performing under expectations?

• Why are these locations seeing degraded performance?

Page 21: Using Data to Determine Where to Build a New Data Center at Shutterstock from ThousandEyes Connect

Bananas are YummySo are Grapes

Now you know where to deploy your next site