New Roles In The Cloud
-
Upload
steve-loughran -
Category
Technology
-
view
2.962 -
download
1
description
Transcript of New Roles In The Cloud
![Page 1: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/1.jpg)
©2010 HP
NEW ROLES IN THE CLOUD
Steve Loughran
HP Laboratories
March 2010
![Page 2: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/2.jpg)
©2010 HP 2
Cloud computing will change• how applications are delivered• how applications are designed• how teams work
![Page 3: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/3.jpg)
©2010 HP 3
CLASSIC SERVER-SIDE APPLICATIONS
– Architect designs the application
– Developers code and test on local machines
– Operations buy and configure production machines
– Developers get blame for things not working
– Operations get blame for security & availability problems
– Getting predictions of demand wrong can kill your project
![Page 4: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/4.jpg)
©2010 HP 4
CLOUD COMPUTING ELIMINATES
– Buying hardware based on predicted load
– 2+ week lead time on new hardware, storage
– High Availability
– Homogeneity
– Static machine names, addresses and capabilities
– Stable machines
– A fast private network
– Someone in the datacentre who cares about you
![Page 5: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/5.jpg)
©2010 HP 5
IMPLICATIONS FOR HARDWARE VENDORS
(servers, routers, storage, ... )
– No. of major accounts drops to? 5? 10? Less?
– Power consumption becomes a key concern
– Network: power, agile routing, bandwidth, throttling
– Servers: power, VM-hosting, uniformity, no-extra features
![Page 6: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/6.jpg)
©2010 HP6
AGILE APPLICATIONS
![Page 7: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/7.jpg)
©2010 HP 7
WHAT HAS GONE?
– High Availability through hardware
– Static hostnames, network addresses,
– rDNS, multicast IP
– Maybe: SQL databases
![Page 8: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/8.jpg)
©2010 HP 8
APPLICATIONS MUST BE AGILE
– Directory, database or CM service to configure
– Applications to rebind on loss of server connectivity
– Use dynamic DNS services; don’t cache IPAddrs
– Don’t expect HDD content to last on a single disk
– Restart VMs on any app failure
Nothing is static. Nothing lasts.
![Page 9: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/9.jpg)
©2010 HP 9
HADOOP’S ASSUMPTIONS
– Master nodes don’t move
– Workers can spin for them
– Failed workers get blacklisted
– Single, static hostnames
– Cache all DNS entries
– Disks don't move between hosts
Different strategies are needed
![Page 10: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/10.jpg)
©2010 HP 10
AGILE TEAMS
![Page 11: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/11.jpg)
©2010 HP11
CLASSIC TEAM ROLES
Business Development
Architecture
OperationsDevelopment
![Page 12: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/12.jpg)
©2010 HP 12
Business Development
Architecture
Operations
Development
THE OLD PROCESS
Design
Code TestStaging Live
![Page 13: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/13.jpg)
©2010 HP 13
Architecture
DevelopmentBusiness
Development
Operations
CLOUD-HOSTING BLURS THE ROLES
Design
Code Test
LiveStaging
![Page 14: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/14.jpg)
©2010 HP 14
CLOUD ARCHITECT
1. Agile Application
2. Scale up under load
3. Scale down when quiet
4. No known SPOF
5. Deploys with VMs
Design an agile, HA application from cloud services and VMs
![Page 15: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/15.jpg)
©2010 HP 15
CLOUD OPERATIONS
– Instrumentation
– Reconfiguration
– Monitoring
– Reporting
– Datamining
Create the VMs, manage and monitor staging and production
![Page 16: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/16.jpg)
©2010 HP16
ROLES IN CLOUD APIS
Different team roles need different rights and different service interfaces
![Page 17: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/17.jpg)
©2010 HP17
ROLES IN THE CLOUD
Role Task Tooling
Cloud Architect Design App structure Text editor (?))Powerpoint (?
Cloud Operations Build VMs, set parametersManage production
Text under SCMWeb & Command line
Developers Request test VMs Web, IDE, build tools
Biz Dev Worry about costs and revenue
Web & Spreadsheet
![Page 18: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/18.jpg)
©2010 HP18
CLOUDFARMER
![Page 19: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/19.jpg)
©2010 HP19
Role Specification
machineRole extends HadoopVMRole { description "A basic machine with SmartFrog installed"; vmPrefix "vm"; bootAutoVol "vol-0-1-47"; min 0; recommendedMin 0; links extends Compound { "HTTP port 80" ["http", 80, "/"]; "HTTP port 8080" ["http", 8080, "/"]; }}
![Page 20: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/20.jpg)
©2010 HP20
WEBAPP LISTS AVAILABLE ROLES
![Page 21: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/21.jpg)
©2010 HP21
HADOOP CLUSTER: MASTER + WORKER
![Page 22: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/22.jpg)
©2010 HP22
REQUEST COMPLETED
![Page 23: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/23.jpg)
©2010 HP23
LIST HOSTS IN A ROLE
Actions: Add a worker, delete all in role “worker”
![Page 24: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/24.jpg)
©2010 HP24
LIST ALL HOSTS
![Page 25: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/25.jpg)
©2010 HP25
VIEW A HOST
![Page 26: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/26.jpg)
©2010 HP26
Benefits over (VM type, disks+)
• Infrastructure can do some late binding install/deploy
• Feeds into the UI
• Web, IDE, build tools, ...
• “Role” CPU/network history can aid placement
• Other templates: network, aggregate clusters
![Page 27: New Roles In The Cloud](https://reader033.fdocuments.in/reader033/viewer/2022061115/54639237af795969338b458d/html5/thumbnails/27.jpg)
©2010 HP 27
Q&A