The Distributed & Decentralized Cloud
-
Upload
seattledawson -
Category
Technology
-
view
2.679 -
download
0
description
Transcript of The Distributed & Decentralized Cloud
Praerit Garg, Co-founder & PresidentMargaret Dawson, Vice President
Distributed & Decentralized Cloud
www.symform.com
How much digital data are we creating every
second?
It’s all about the data
➡58 Gigabytes of data created every second
➡35 Zettabytes of digitally stored data by 2020
➡ That’s enough data to fill a stack of DVDs reaching from the Earth to the moon and back — about 240,000 miles each way.
33
But…
4
The ‘Cloud’ Will Save Us!
4
Only one problem
Cloud is powered by massive centralized infrastructure
5
Cloud driving massive data center build out
6
Over 500,000 data centers worldwide covering 290m sqft or 6,000 football fields
6
www.symform.com
What percentage of North American energy consumption do those data centers account
for?
8
➡ Have to build for peak usage; excess capacity lying idle
➡ Power consumption issues
• 2% of North American energy consumption goes to servers and data centers
• 2% of global carbon footprint is data centers used to power cloud computing
• Google uses 260 million watts continuously across the globe -- equivalent to the power used by all the homes and businesses in a city of 200,000 people.
➡ Energy grid management
➡ Potential security and physical vulnerabilities (e.g. fire)
➡ Costs - data centers are expensive to build and maintain
➡ Bandwidth bottlenecks
Issues with over centralization
8
9 ZB 4502015
2020 35 ZB
0.8 ZB 1602009
And we can’t keep pace with data growth . . .
99
Good news . . .
10
The Internet is already highly distributedInternet Users by Country
Billions of devices sitting on the edge
Data distributed across devices, networks, data centers, and geos
➡ Multi-tenant architecture
➡ Distributed database
➡ Virtualization
➡ Multi-threading
➡ Multi-core CPUs
➡ Parallel processing
➡ Distributed file systems
➡ Distributed Load Balancing
➡ RAID algorithms
Cloud Computing is driving distributed models:
You are already using distributed systems
11
➡ System or process optimization
➡ Improved performance - faster
➡ Increased reliability & fault tolerance
➡ Lower costs
➡ Increased efficiencies
➡ Easier scalability or expansion
➡ Continuous or near continuous operations
And we’re realizing benefits
1212
www.symform.com
What’s the largest distributed & decentralized
system in the world?
Distributed alone is not enough . . .
Distributed only will not keep up with our data growth
Still heavily based on centralized models with distributed components
14
Need to go beyond distributed to decentralized
15
Unused instances
Over provisioning
Under use of reserved instances
Orphaned services
Millions of dollars invested and wasted
Contributing source: Mat Ellis
Why?
16
➡ No central hub or owner
➡ Power of large numbers
➡ Organic, demand driven growth in capacity
➡ Leverages existing infrastructure and devices on edge
➡ Shared information
➡ Concept of “Contribution” to the community
➡ Assume everyone / every node is “untrusted”
➡ Geographic spread of:• Ownership & participation
• Costs
• Management overhead
• Risks
How to think about Decentralization
16
17
There are good examples of
decentralization today
Good news . . .
17
www.symform.com
Do you have an example of a decentralized
system?
19
➡ Linux – a Unix-Based operating system
➡ Apache — a leading server software and scripting language on the web
➡ MySQL — a database management system
➡ PHP — a widely used open source general-purpose scripting language
➡ Blender — a 3D graphics and animation software
➡ OpenOffice.org – an office suite software with word processor, spreadsheet, and presentation capabilities
➡ Mozilla — a web browser and e-mail client
➡ Perl — a programming/scripting language
➡ Wikipedia — Online encyclopedia open for anyone to update and revise content
Open Source Movement
Decentralized Development
Programmers who support the open source movement philosophy contribute to the open source community by voluntarily writing and exchanging programming code for software development.
19
Skype is the largest telephone company in the world but has almost no centralized infrastructure
Decentralized Communications
20
Search for extraterrestrial intelligence (SETI)
Decentralized Processing
World Community Grid
21
Decentralized Cloud StorageWhat if we aggregated all the unused capacity across servers, desktops and storage devices on the edge of the Internet to build a global storage network?
22
23
➡ CMOs often have as much IT purchasing power as CIOs
➡ Employees are buying rogue platforms, applications and devices
Alas . . . Also already here
Decentralized IT budgets
23
24
Whoa! . . . “This is chaos for enterprise IT”
24
25
➡ IT Policy and governance
➡ Security and compliance mandates
➡ Definition of “trust”
➡ API management
➡ Shared services (SOA)
➡ Vendor evaluation guidelines
➡ Data analysis aggregation (search, e-discovery & reporting)
What Stays Centralized?
Doesn’t mean loss of centralized control or IT power
25
26
➡ Desire for Control
➡ Geo-political differences
➡ Random expertise
➡ Data security and encryption
➡ Integration
➡ Need more open API’s
➡ Consistent Quality of Service
Issues with decentralization
We are still in early stages
26
www.symform.com
How much digitally stored data will there be
by 2020?
28
We still need data centers
Data centers are ideal for:
➡ High volume, low latency transactions
➡ Data warehousing
➡ Search
28
➡ Assumption of “untrusted” should be your security principle today
➡ Worry less about where the data is and on how to control access
➡ Be the source of centralized policy and governance
To Leverage Distributed & Decentralized Models
But we can look for opportunities
29
Today’s Cloud: Centralized Data Centers
Apple
Amazon
30
31
Tomorrow’s Cloud: Decentralized Grids
31
www.symform.com
Q&A