PowerPoint Presentation · @GlebBudman Backblaze, Inc. Proprietary and Confidential . Title:...
41
@GlebBudman What When Who SNIA Presentation Sep 2015 Gleb Budman, CEO Learnings From Nearly A Decade Of Building Low-Cost Cloud Storage `
Transcript of PowerPoint Presentation · @GlebBudman Backblaze, Inc. Proprietary and Confidential . Title:...
Backblaze, Inc. Proprietary and Confidential @GlebBudman
What
When
Who
SNIA Presentation
Sep 2015
Gleb Budman, CEO
Learnings From Nearly A Decade Of Building Low-Cost Cloud Storage
`
Backblaze, Inc. Proprietary and Confidential @GlebBudman
150+ PETABYTES
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
• Backblaze B2 is still 40% - 250% lower cost
• Doesn’t make you wait for your data
• Doesn’t penalize for deletes
• Doesn’t penalize for access
Backblaze, Inc. Proprietary and Confidential @GlebBudman
The Cloud Storage Stack
Culture
Business Process
Software
Hardware
Datacenter
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Goal: • Convert kilowatts-to-bits
Considerations: • Local cost of power and real estate
• Don’t ignore taxes, economic zones
• Climate
• Building and system efficiency
• Proximity to ops team & good people
• Connectivity
Resource: Backblaze Datacenter RFP https://www.backblaze.com/blog/backblaze-datacenter-grows-1000x-datacenter-2-0-needed-apply-within/
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Hardware Connect Hard Drives to the Internet
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze Storage Pod
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Don’t Make Hardware Redundant
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Server Power Supply Desktop Power Supply VS
Use Commodity Parts
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Use Consumer Hard Drives
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Insource & Do the Math for Drive Purchases
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Goal: • Connect hard drives to
the Internet
Considerations:
• Don’t make hardware redundant
• Use commodity parts
• Use consumer hard drives
• Insource & use math for drive
purchases
Resource: Backblaze Storage Pod https://www.backblaze.com/storage-pod.html/
Backblaze, Inc. Proprietary and Confidential @GlebBudman
http://www.pbs.org/wgbh/nova/body/brain-transplants.htm
Software Put All Intelligence Here
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze Vault
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Avoid Choke Points
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Algorithmically Monitor SMART Stats
Backblaze, Inc. Proprietary and Confidential @GlebBudman
VS
Plan for Silent Corruption
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Put Replication Above the File System
http://infosthetics.com/archives/2009/06/a_visual_expedition_inside_the_linux_file_systems.html
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Run Out of Resources Simultaneously
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Model & Monitor Storage Burn
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Goal: • Put all intelligence here
Considerations: • Avoid choke points
• Algorithmically monitor SMART stats
• Plan for Silent Corruption
• Put replication above the file system
• Run out of resources simultaneously
• Model & monitor storage burn
Resource: Backblaze Vault https://www.backblaze.com/blog/vault-cloud-storage-architecture/
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Business Processes Optimize for TCO
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Design for Failure…
Backblaze, Inc. Proprietary and Confidential @GlebBudman
…But Fix Failures Quickly
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Goal: • Optimize for TCO
Resource: Backblaze Drive Process https://www.backblaze.com/blog/alas-poor-stephen-is-dead/
Considerations: • Design for failure, but fix failures quickly
• Create repeatable repairs (drive swap,
chassis swap)
• Standardize pod chassis
• ROI drives automation
• Workflow for storage buffer
(different buffer types; e.g. 11 PB in a day)
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Image by Michael Cara https://www.flickr.com/photos/michael_cala/
Backblaze, Inc. Proprietary and Confidential @GlebBudman
No Hardware Worshippers
Backblaze, Inc. Proprietary and Confidential @GlebBudman
http://365datacenters.com/blog/local-cloud-storage-beats-public-cloud/
Agile Extends to Hardware
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Relentless Focus on Cost
• Is this required?
• Is there a comparable lower cost option?
• Can business processes work around this?
• Can software work around this?
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Culture
Goal: • Question “conventional wisdom”
Considerations: • No hardware worshippers
• Agile extends to hardware
• Relentless focus on cost
Resource: Backblaze Agile Hardware Process https://www.backblaze.com/blog/designing-the-next-storage-pod/
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Backblaze, Inc. Proprietary and Confidential @GlebBudman
Learnings from nearly a decade of building low-cost cloud storage.
Backblaze.com/B2 => Lowest cost cloud storage Backblaze.com/blog => Cloud storage resources
Gleb Budman @glebbudman
