2010 03 31 Marco Parenzan An Extract From Above The Clouds By Pat Helland
-
Upload
marco-parenzan -
Category
Technology
-
view
1.338 -
download
0
description
Transcript of 2010 03 31 Marco Parenzan An Extract From Above The Clouds By Pat Helland
1
Some slides from"Above the Clouds:a Berkeley View of Cloud Computing"
Presented by:Pat HellandMarco ParenzanPartner Architect (SQL SIA)
Clarification:• I did NOT write this paper – I am reporting on some excellent work.
• Much of this paper’s content is well known to the folks working
in the cloud computing space.
• Hats off to the folks from Berkeley for such a crisp and thoughtful paper!
•I’m a programmer and I think that this kind of documents are written better by other people
•Original Slide Deck•http://cid-84f3c5ef51d06e8b.skydrive.live.com/self.aspx/.Public/2009/Above-the-Clouds-090401k.pptx
Created by:Pat HellandPartner Architect (SQL SIA)
2
Dilbert on Cloud Computing
Novembre 18th, 2009http://www.dilbert.com/strips/comic/2009-11-18/
Novembre 19th, 2009http://www.dilbert.com/strips/comic/2009-11-19/
3
Over 25 Years Working in Distributed Computing
Tandem Computers(1982-1990)
Message Based Multiprocessor
WAN Distributed DB
Chief Architect: Fault-Tolerant TX Platform
MyPat Helland’s Experiences with “Cloud Computing”
HaL Computers(1991-1994)
Chief Architect:Cache-Coherent
Non-Uniform Memory Arch
Multi-Processor
Microsoft(1994-2005 and 2007-Present)
Microsoft Transaction Server (MTS):Transactional RPC and N-Tier Apps
Distributed Transaction Coordinator
SQL Service Broker
Service Oriented Architectures (SOA)
2 Years at Amazon (2005-2007)Worked to Make
Software Accept Low Availability Datacenters
Worked On Product Catalog: 10s of Millions of Product Descriptions
Saw “Cloud Computing” Firsthand
Extensive Monitoring
Drive to Commonality
Drive to Commodity
Internals of AWS
Multiple Datacenters
Pressure on Availability
Creation of Dynamo
Cost Pressure on Services…
4
Cloud Computing: ConfusionThe interesting thing about cloud computing is that we’ve redefined
Cloud Computing to include everything that we already do… I don’t understand what we would do differently in the light of Cloud Computing than change
some of the words in our ads.
Larry Ellison (Oracle CEO) , quoted in the Wall Street Journal, Sept 26, 2008
A lot of people are jumping on the [cloud] bandwagon, but I have not heard two people say the same thing about it. There are multiple definitions
out there of “the cloud”
Andy Isherwood (HP VP of European Software Sales), in ZDNews, Dec 11, 2008
It’s stupidity. It’s worse than stupidity: it’s a marketing hype campaign. Somebody is saying this is inevitable – and whenever you hear somebody saying
that, it’s very likely to be a set of businesses campaigning to make it true.
Richard Stallman (“free software” advocate), in The Guardian, Sept 29, 2008
5
What Is Cloud Computing?Cloud Computing: App and Infrastructure over Internet
Software as a Service: Applications over the Internet
Utility Computing:“Pay-as-You-Go” Datacenter Hardware and Software
Three New Aspects to Cloud Computing
The Illusion of Infinite Computing Resources Available on Demand
The Elimination of an Upfront Commitment by Cloud Users
The Ability to Pay for Use of Computing Resources on a Short-Term Basis as Needed
6
New Application OpportunitiesGray’s Observation: Jim Gray Looked at Trends in 2003 Wide-Area Networking
Falling Slower than Other IT CostsCosts Require Putting the Data Near the Application!
Some Interesting New Types of Applications Enable By the Cloud:
Mobile Interactive Apps: Applications that respond in real time but work with lots of data. Cloud computing offers highly-available large datasets.
Parallel Batch Processing: “Cost Associativity” – Many systems for a short time. Washington Post used 200EC2 instances to process 17,481 pages of Hillary Clinton’s travel documents within 9 hours of their release.
Rise of Analytics: Again, “Cost Associativity” – Many systems for a short time. Compute intensive data analysis which may be parallelized.
Compute Intensive Desktop Apps: For example, symbolic mathematics requires lots of computing per unit of data. Cost efficient to push the data to the cloud for computation
7
A Spectrum of Application Models
Microsoft Azure.NET CLR/Windows Only
Choice of LanguageSome Auto Failover/
Scale (but needs declarative application
properties)
Google App EngineTraditional Web Apps
Auto Scaling/Provisioning
Force.ComSalesForce Biz Apps
Auto Scaling/Provisioning
Amazon AWSVMs Look Like HardwareNo Limit on App ModelUser Must Implement Scalability and Failover
Constraints in the App Model More
ConstrainedLess
Constrained
Automated Management ServicesMore
AutomationLess
Automation
Which Model Will Dominate??Analogy: Programming Languages and Frameworks• Low-Level Languages (C/C++) Allow Fine-Grained Control• Building a Web App in C++ Is a Lot of Cumbersome Work• Ruby-on-Rails Hides the Mechanics but Only If You Follow
Request/Response and Ruby’s Abstractions
High-Level Languages and Frameworks Can Be
Built on Lower-Level
More-Constrained Clouds May Be Built on Less-Constrained Ones
8
Conclusions and Questions about the Cloud of Tomorrow
Utility Computing: It’s Happening!
Grow and Shrink on Demand
Pay-As-You-Go
Cloud Provider’s View
Huge Datacenters Opened Economies and Possibilities
Cloud User’s View
Startups Don’t Need Datacenters
Established Organizations Leverage Elasticity
UC Berkeley Has Extensively Leveraged Elasticity to Meet Deadlines
Cloud Computing: High-Margin or Low-Margin Business?
Potential Cost Factor of 5-7X
Today’s Cloud Providers Had Big Datacenter Infrastructure Anyway
Implications of Cloud:Application Software: Scale-Up and Down Rapidly; Client and Cloud
Infrastructure Software: Runs on VMs; Has Built-in Billing
Hardware Systems: Huge Scale; Container-Based; Energy Proportional
9
Top 10 Obstacles and Opportunities
Obstacle Opportunity1 Availability of Service Use Multiple Cloud Providers;
Use Elasticity to Prevent DDOS
2 Data Lock-In Standardized APIs; Compatible Software to Enable Surge Computing
3 Data Confidentiality and Auditability
Deploy Encryption, VLANs, Firewalls;Geographical Data Storage
4 Data Transfer Bottlenecks FedExing Disks; Data Backup/Archival; Higher Bandwidth Switches
5 Performance Unpredictability Improved VM Support; Flash Memory; Gang Scheduling VMs
6 Scalable Storage Invent Scalable Store
7 Bugs in Large Distributed Systems Invent Debugger that Relies on Dist VMs
8 Scaling quickly Auto-Scaler; Snaphots for Conservation
9 Reputation Fate Sharing Reputation Guarding Services
10 Software Licensing Pay-for-Use Licenses; Bulk Use Sales
10
#3 Obstacle: Data Confidentiality and Auditability
“My sensitive corporate data will never be in the cloud!”
Current Clouds Are Essentially Public
Networks They Are Exposed to More Attacks
Auditability Is Required
Sarbanes-Oxley
HIPAA
Berkeley Believes There Are No Fundamental Obstacles to Making Cloud Computing as Secure as Most In-House IT
Encrypted Storage Network Middleboxes (Firewalls, Packet Filters)Virtual LANs
Encrypted Data in the Cloud Is Likely More Secure than Unencrypted Data on Premises
Maybe: Cloud Provided Auditability
Maybe More Tamper Resistant
Auditing Below VMs
More Focus on Virtual
Capabilities…
Concerns over National Boundaries
Blind Subpoenas
Foreign Subpoenas
USA PATRIOT Act Gives Some Europeans
Worries over SaaS in the USA
11
#4 Obstacle: Data Transfer Bottlenecks
Opportunity-1: Sneaker-Net
Jim Gray Found Cheapest Transfer Was FedEx-ing Disks
1 Data Failure in 400 Attempts
Opportunity-2: Keep Data in Cloud
If the Data Is in the Cloud, Transfer Doesn’t Cost
Amazon Hosting Large Data
E.g. US Census
Free on S3; Free on EC2
Entice EC2 Business
Opportunity-3: Cheaper WAN
High-End Routers Are a Big Part of the Cost of Data Transfer
Research into Routing using Cheap Commodity Computers
Problem: At $100 to $150 per Terabyte Transferred, Data Placement and Movement Is an Issue
Example: Ship 10TB from UC Berkeley to Amazon
-- WAN: S3 < 20Mbits/sec:10TB 4Mil Seconds > 45 Days$1000 in AMZN Net Fees
-- FedEx: Ten 1TB Disks via Overnight Shipping< 1 Day to Write 10TB to Disks LocallyCost ≈ $400 Effective BW of 1500Mbits/Sec
“NetFlix for Cloud Computing”
12
To better undestand, read the originals...
Above the Clouds: a Berkeley View of Cloud Computing
http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-28.pdfCloud Computing
Book Report” on the UC Berkeley Paper “Above the Clouds: a Berkeley View of Cloud Computing”
http://blogs.msdn.com/pathelland/archive/2009/04/10/book-report-on-the-uc-berkeley-paper-above-the-clouds-a-berkeley-view-of-cloud-computing.aspx
http://cid-84f3c5ef51d06e8b.skydrive.live.com/self.aspx/.Public/2009/Above-the-Clouds-090401k.pptx
Demystifying the Cloud (Simon Guest)
http://simonguest.com/blogs/smguest/archive/2009/05/14/Slides-from-TechEd-2009.aspx
An introduction to Cloud Computing
http://s3.amazonaws.com/ppt-download/ima-cloud-computing-mar2010-v8-100320181538-phpapp02.pdf?Signature=GhK3ogCr2Z%2FzhWFa%2F%2BJUr1cT1eg%3D&Expires=1269958049&AWSAccessKeyId=AKIAJLJT267DEGKZDHEQ
…and many others