Web Scale Computing Mike Culver Amazon Web Services.
-
Upload
ashton-watts -
Category
Documents
-
view
214 -
download
0
Transcript of Web Scale Computing Mike Culver Amazon Web Services.
![Page 1: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/1.jpg)
Web Scale Computing
Mike Culver
Amazon Web Services
![Page 2: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/2.jpg)
Agenda
Web Scale Computing Overview
Code
![Page 3: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/3.jpg)
The Obligatory Timeline Slide
COBOL, Edsel
1959 19691982
1996
Amazon.com
20042006
Darkness Web as a Platform
Web Services, Resources Eliminated
Web Awareness
InternetARPANET
Dot-Com Bubble Web 2.0 Web ScaleComputing
20011997
![Page 4: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/4.jpg)
![Page 5: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/5.jpg)
Being Relevant Counts
![Page 6: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/6.jpg)
![Page 7: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/7.jpg)
It’s All About Ideas
![Page 8: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/8.jpg)
Ideas Cost Money
a + bc
![Page 9: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/9.jpg)
a + bc
But How Much Money?
Our favorite numbers: 0.10, 0.15, and 0.20
x
![Page 10: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/10.jpg)
10
Amazon Web Services Are...
A set of APIs and business models which give developers access to Amazon technology and content
Data As a ServiceAmazon E-Commerce Service
Amazon Historical Pricing
Infrastructure As a ServiceAmazon Simple Queue Service
Amazon Simple Storage Service
Amazon Elastic Compute Cloud
Search As a ServiceAlexa Web Information Service
Alexa Top Sites
Alexa Site Thumbnail
Alexa Web Search Platform
People As a ServiceAmazon Mechanical Turk
![Page 11: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/11.jpg)
Amazon Web Scale Infrastructure:We Do the Muck
Leverage Amazon’s Core Expertise
Scales to the Enterprise
Priced for People
Reliable
Simple to Use
Highly Available
Using Industry Standards
HTTP, XML, REST, SOAP, XSLT
With World-Class Developer Support
![Page 12: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/12.jpg)
What do these companies have in common?
![Page 13: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/13.jpg)
Amazon E-Commerce Service
![Page 14: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/14.jpg)
Amazon E-Commerce Service
Exposes Amazon's product data plus a shopping cart
In 4th major release
Millions of products
Rich data schema
Product images
Reviews
Wishlists
Commissions via Amazon Associates program
![Page 15: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/15.jpg)
Amazon.com With Your Look
![Page 16: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/16.jpg)
Amazon ECS Cost
$0.00
![Page 17: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/17.jpg)
Amazon Simple Storage Service
![Page 18: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/18.jpg)
Amazon S3 is… Simple
Data Storage in Amazon Data Center
Web Service interface
No set-up fee, No monthly minimum
Storage: $0.15 per GB/Month
Data Transfer: $0.20/GB to transfer data
Private and public storage
Each object up to 5GB in size
![Page 19: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/19.jpg)
Many ISV Implementations
S3 Explorer filicio.us Jungle Disk
S3 Firefox Organizer MyOwnDB
![Page 20: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/20.jpg)
Amazon Elastic Compute Cloud
![Page 21: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/21.jpg)
Amazon EC2 Is…
A Web service that provides resizable compute capacity in the cloud.
Designed to make Web-scale computing easier for developers.
A simple Web service interface that provides complete control of your computing resources
![Page 22: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/22.jpg)
Amazon EC2 Benefits You Because It
Reduces the time required to obtain and boot new server instances to minutes
Quickly scales capacity, both up and down, as your computing requirements change
Changes the economics of computing:
Pay only for capacity that you actually use
a + bc becomes just bc
![Page 23: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/23.jpg)
Amazon EC2 Changes Computing Economics
No start-up, monthly, or fixed costs
$0.10 per CPU hour
$0.20 per GB transferred across Net
No cost to transfer data between Amazon S3 and Amazon EC2
![Page 24: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/24.jpg)
Amazon EC2 Profile
1.7 Ghz x86 processor
1.7 GB of RAM
160 GB disk
250 Mb/second network
![Page 25: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/25.jpg)
Web-Scale for Mobile
Services Used•Amazon S3•Amazon EC2
Estimated Savings$650,000
Gumiyo.com
![Page 26: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/26.jpg)
Amazon Mechanical Turk
![Page 27: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/27.jpg)
Amazon Mechanical Turk Is…
A web service that exposes an on-demand global workforce ready to complete small tasks in exchange for micro-payments
Frictionless. Outsourcing per-se is irrelevant.
A web services API
![Page 28: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/28.jpg)
Identify Road Markings
![Page 29: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/29.jpg)
Are These the Same MP3 Players?
![Page 30: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/30.jpg)
30
How It Works
www.mturk.com
Workers
Artificial, Artificially
Intelligent Software
Requester(Developer)
Human Intelligence Tasks (HITs)
Completed HITs
Worker Qualifications
![Page 31: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/31.jpg)
32
Man Versus Machine
![Page 32: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/32.jpg)
33
But Not Really
![Page 33: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/33.jpg)
Podcast transcription service provider
Transcribes audio into high-quality text
Amazon Mechanical Turk: Workers transcribe podcasts and index text within search engine
Amazon Simple Storage: Stores the podcasts and related files
![Page 34: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/34.jpg)
Amazon Simple Queue
![Page 35: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/35.jpg)
Amazon Simple Queue Is
A reliable, highly scalable hosted distributed queue for storing messages as they travel between computers.
Amazon's web-scale messaging infrastructure as a web service
Platform-agnostic, allowing any computer on the Internet to add or read messages without any installed software or special firewall configurations
![Page 36: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/36.jpg)
Amazon SQS Highlights
Reliable
Runs within Amazon's high-availability data centers.
Messages are stored redundantly across multiple servers and data centers.
Simple: Only Six Methods
Scalable
Secure: Strong access controls
![Page 37: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/37.jpg)
Amazon SQS Pricing
Pay only for what you use
No minimum fee
No start-up cost
$0.10 per 1,000 messages sent ($0.0001 per message sent)
$0.20 per GB of data transferred
![Page 38: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/38.jpg)
Alexa Web Services
![Page 39: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/39.jpg)
Four Alexa Web Services:One Vast Web Database
Alexa Web Information Service: Web search engine, traffic information for web sites, a web site directory, and more.
Alexa Top Sites: Programmatic access top sites data is available for the web as a whole, or for individual countries
![Page 40: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/40.jpg)
Four Alexa Web Services:One Vast Web Database
Alexa Site Thumbnail:Programmatic access to thumbnail images for the home pages of web sites.
Alexa Web Search Platform:Directly analyze Alexa's Web archive to create and publish new search services
![Page 41: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/41.jpg)
Amazon Historical Pricing
![Page 42: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/42.jpg)
Amazon Historical Pricing
Highlights
Access to 3 years of actual sales history from books, music, videos, and DVDs sold on Amazon.com
Returns the average, minimum, maximum, and median price for items
Up to ten items per request
Pricing:$249/mo. for up to 60,000 requests/mo.
![Page 43: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/43.jpg)
Learn More About AWS
Explore http://aws.amazon.com
Read Our Blog at http://aws.typepad.com
Amazon’s hiring www.amazon.com/jobs
![Page 44: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/44.jpg)
![Page 45: Web Scale Computing Mike Culver Amazon Web Services.](https://reader036.fdocuments.in/reader036/viewer/2022081518/551a0de2550346a4248b4934/html5/thumbnails/45.jpg)
Code!!!