The Distributed & Decentralized Cloud

33
Praerit Garg, Co-founder & President Margaret Dawson, Vice President Distributed & Decentralized Cloud

description

Presentation given by Margaret Dawson & Praerit Garg of Symform Inc (www.symform.com) at Cloud Expo East 2012 on June 11, 2012

Transcript of The Distributed & Decentralized Cloud

Page 1: The Distributed & Decentralized Cloud

Praerit Garg, Co-founder & PresidentMargaret Dawson, Vice President

Distributed & Decentralized Cloud

Page 2: The Distributed & Decentralized Cloud

www.symform.com

How much digital data are we creating every

second?

Page 3: The Distributed & Decentralized Cloud

It’s all about the data

➡58 Gigabytes of data created every second

➡35 Zettabytes of digitally stored data by 2020

➡ That’s enough data to fill a stack of DVDs reaching from the Earth to the moon and back — about 240,000 miles each way.

33

Page 4: The Distributed & Decentralized Cloud

But…

4

The ‘Cloud’ Will Save Us!

4

Page 5: The Distributed & Decentralized Cloud

Only one problem

Cloud is powered by massive centralized infrastructure

5

Page 6: The Distributed & Decentralized Cloud

Cloud driving massive data center build out

6

Over 500,000 data centers worldwide covering 290m sqft or 6,000 football fields

6

Page 7: The Distributed & Decentralized Cloud

www.symform.com

What percentage of North American energy consumption do those data centers account

for?

Page 8: The Distributed & Decentralized Cloud

8

➡ Have to build for peak usage; excess capacity lying idle

➡ Power consumption issues

• 2% of North American energy consumption goes to servers and data centers

• 2% of global carbon footprint is data centers used to power cloud computing

• Google uses 260 million watts continuously across the globe -- equivalent to the power used by all the homes and businesses in a city of 200,000 people.

➡ Energy grid management

➡ Potential security and physical vulnerabilities (e.g. fire)

➡ Costs - data centers are expensive to build and maintain

➡ Bandwidth bottlenecks

Issues with over centralization

8

Page 9: The Distributed & Decentralized Cloud

9 ZB 4502015

2020 35 ZB

0.8 ZB 1602009

And we can’t keep pace with data growth . . .

99

Page 10: The Distributed & Decentralized Cloud

Good news . . .

10

The Internet is already highly distributedInternet Users by Country

Billions of devices sitting on the edge

Data distributed across devices, networks, data centers, and geos

Page 11: The Distributed & Decentralized Cloud

➡ Multi-tenant architecture

➡ Distributed database

➡ Virtualization

➡ Multi-threading

➡ Multi-core CPUs

➡ Parallel processing

➡ Distributed file systems

➡ Distributed Load Balancing

➡ RAID algorithms

Cloud Computing is driving distributed models:

You are already using distributed systems

11

Page 12: The Distributed & Decentralized Cloud

➡ System or process optimization

➡ Improved performance - faster

➡ Increased reliability & fault tolerance

➡ Lower costs

➡ Increased efficiencies

➡ Easier scalability or expansion

➡ Continuous or near continuous operations

And we’re realizing benefits

1212

Page 13: The Distributed & Decentralized Cloud

www.symform.com

What’s the largest distributed & decentralized

system in the world?

Page 14: The Distributed & Decentralized Cloud

Distributed alone is not enough . . .

Distributed only will not keep up with our data growth

Still heavily based on centralized models with distributed components

14

Page 15: The Distributed & Decentralized Cloud

Need to go beyond distributed to decentralized

15

Unused instances

Over provisioning

Under use of reserved instances

Orphaned services

Millions of dollars invested and wasted

Contributing source: Mat Ellis

Why?

Page 16: The Distributed & Decentralized Cloud

16

➡ No central hub or owner

➡ Power of large numbers

➡ Organic, demand driven growth in capacity

➡ Leverages existing infrastructure and devices on edge

➡ Shared information

➡ Concept of “Contribution” to the community

➡ Assume everyone / every node is “untrusted”

➡ Geographic spread of:• Ownership & participation

• Costs

• Management overhead

• Risks

How to think about Decentralization

16

Page 17: The Distributed & Decentralized Cloud

17

There are good examples of

decentralization today

Good news . . .

17

Page 18: The Distributed & Decentralized Cloud

www.symform.com

Do you have an example of a decentralized

system?

Page 19: The Distributed & Decentralized Cloud

19

➡ Linux – a Unix-Based operating system

➡ Apache — a leading server software and scripting language on the web

➡ MySQL — a database management system

➡ PHP — a widely used open source general-purpose scripting language

➡ Blender — a 3D graphics and animation software

➡ OpenOffice.org – an office suite software with word processor, spreadsheet, and presentation capabilities

➡ Mozilla — a web browser and e-mail client

➡ Perl — a programming/scripting language

➡ Wikipedia — Online encyclopedia open for anyone to update and revise content

Open Source Movement

Decentralized Development

Programmers who support the open source movement philosophy contribute to the open source community by voluntarily writing and exchanging programming code for software development.

19

Page 20: The Distributed & Decentralized Cloud

Skype is the largest telephone company in the world but has almost no centralized infrastructure

Decentralized Communications

20

Page 21: The Distributed & Decentralized Cloud

Search for extraterrestrial intelligence (SETI)

Decentralized Processing

World Community Grid

21

Page 22: The Distributed & Decentralized Cloud

Decentralized Cloud StorageWhat if we aggregated all the unused capacity across servers, desktops and storage devices on the edge of the Internet to build a global storage network?

22

Page 23: The Distributed & Decentralized Cloud

23

➡ CMOs often have as much IT purchasing power as CIOs

➡ Employees are buying rogue platforms, applications and devices

Alas . . . Also already here

Decentralized IT budgets

23

Page 24: The Distributed & Decentralized Cloud

24

Whoa! . . . “This is chaos for enterprise IT”

24

Page 25: The Distributed & Decentralized Cloud

25

➡ IT Policy and governance

➡ Security and compliance mandates

➡ Definition of “trust”

➡ API management

➡ Shared services (SOA)

➡ Vendor evaluation guidelines

➡ Data analysis aggregation (search, e-discovery & reporting)

What Stays Centralized?

Doesn’t mean loss of centralized control or IT power

25

Page 26: The Distributed & Decentralized Cloud

26

➡ Desire for Control

➡ Geo-political differences

➡ Random expertise

➡ Data security and encryption

➡ Integration

➡ Need more open API’s

➡ Consistent Quality of Service

Issues with decentralization

We are still in early stages

26

Page 27: The Distributed & Decentralized Cloud

www.symform.com

How much digitally stored data will there be

by 2020?

Page 28: The Distributed & Decentralized Cloud

28

We still need data centers

Data centers are ideal for:

➡ High volume, low latency transactions

➡ Data warehousing

➡ Search

28

Page 29: The Distributed & Decentralized Cloud

➡ Assumption of “untrusted” should be your security principle today

➡ Worry less about where the data is and on how to control access

➡ Be the source of centralized policy and governance

To Leverage Distributed & Decentralized Models

But we can look for opportunities

29

Page 30: The Distributed & Decentralized Cloud

Today’s Cloud: Centralized Data Centers

Apple

Google

Amazon

30

Page 31: The Distributed & Decentralized Cloud

31

Tomorrow’s Cloud: Decentralized Grids

31

Page 32: The Distributed & Decentralized Cloud

www.symform.com

Q&A

Page 33: The Distributed & Decentralized Cloud

www.symform.com

Thank [email protected]

[email protected]

Cloud Connect Advisory Council

CloudNOWAdvisory Council