AWS Innovation in the Datacenter · AWS Innovation in the Datacenter Werner Vogels VP & CTO,...
37
AWS Innovation in the Datacenter Werner Vogels VP & CTO, amazon.com @werner
Transcript of AWS Innovation in the Datacenter · AWS Innovation in the Datacenter Werner Vogels VP & CTO,...
AWS Innovation in the Datacenter
Werner Vogels
VP & CTO, amazon.com
@werner
What sets AWS apart from other providers?
Breadth and Depth of Services
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
StorageSecurity
& Access
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops
Templates
Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute StorageNetworking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops
Templates
Mobile & Devices
Identity
Sync
Analytics
Notifications
Amazon WorkSpaces
Delivering on the promise
of desktop virtualization
Most successful preview, ever
Infrastructure & admin tools
End user desktop and mobile apps
Fully managed, secure document storage
and sharing service for the Enterprise
Amazon WorkDocs
Secure
Easy sharingSimple document
feedback
Access from
any device
Integrate your
corporate directoryLow cost
Is secure email and calendaring made easy
Amazon WorkMail
Managed email and
calendaring solution
Always available,
anytime, anywhere.
Integrates with
Amazon WorkDocs
Infrastructure
Foundation
Services
Regions Availability Zones CDN Points of Presence
Storage(Object, Block and Archive)
NetworkingSecurity &
Access Control
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real-time
Data warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Search
Deployment & Management
Containers
Dev/ops Tools
Resource
Templates
Mobile & Devices
Identity
Sync
Mobile
Analytics
Notifications
Applications Virtual Desktops Collaboration and Sharing
Data Workflows
Usage
Tracking
Monitoring
and Logs
Compute(VMs, Auto-scaling and Load Balancing)
What sets AWS apart from other providers?
Breadth and Depth of Services
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
The AWS Price Reduction Philosophy49 Price Reductions Since 2006
Infrastructure
innovation
Ecosystem
Global Footprint
New Features
New Services
AWS Trusted AdvisorFour reports available to all
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Small, autonomous teams
Roadmap ownership
Decoupled launch schedules
Small, “Two Pizza”
Teams
Get Core Functionality in the
Hands of Customers, Quickly
Operational stability
High scale
Limited initial feature set
Iterate Based on Customer Feedback
Amazon
Redshift
Amazon
Glacier
Amazon
Workspaces
EPICCOLLABORATION
+
=
Rapid pace of Innovation
2008 2009 2010 2011 2012 2013 2014
280
159
8261
4824
516
What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at every level of the stack
Every day, AWS adds enough new server capacity to
support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise
Get Networks Out of the Way
Relative cost of networking increasing quickly
• Server & storage prices falling fast
• Network costs trending to dominate
Networking frozen in time
• Vertically integrated ecosystem
• Indefensible profit margins
AWS solution:
• Custom net H/W & protocol stack
• Private long haul links
57%
8%
18%
13%
4%Servers
Networking Equipment
Power Distribution & Cooling
Power
Other Infrastructure
Monthly Costs
3yr server & 10 yr infrastructure amortization
Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
82, 864 fiber strands in region
AZs <2ms apart & usually <1ms
25Tbps peak inter-AZs traffic
Why Does AWS Offer AZs?Asynchronous replication between distant data centers• Committing to an SSD order 1 to 2ms
• But, LA to New York is 74ms round trip
• You can’t wait 74ms to commit a transaction
On failure, difficult & high skill decision:• Fail-over & lose transactions, or
• Or don’t fail-over & lose availability
• Difficult choice
• Use AZs for no-admin failover
• Sync works when <2ms
• Can be combined with regional replication for very high availability
74ms
1 of 28 availability zones world-wide
All regions have 2 or more AZs
Each AZ is 1 or more DC
- No data center is in two AZs
- Some AZs have as many as 6 DCs
DCs in AZ less than ¼ ms apart
Data centers & Availability zones
Single DC typically over 50,000
servers & often over 80,000 • Larger DCs undesirable (blast
radius)
• Diminishing returns on scale
Up to 102Tbps provisioned in to
a single DC
AWS custom network equipment:• Multi-ODM sourced
• Amazon custom network protocol
stack
Remove the “virtualization tax”
NIC supports Supports Single
Root I/O VirtualizationMuch lower latency & less latency jitter
Lo
ga
rith
mic
Sc
ale
tp0 tp50 tp99 tp99.9 tp00
>2x average
latency
reduction
>10x latency
variability
improvement
Previous
generation
Current
generation
OEM servers
• Very general designs able to run wide variety of workloads
• Vast, expensive, world-wide distribution network (30% of cost)
AWS custom servers & storage
• Specialized servers optimized for a specific workload
• Move hot software kernels to hardware implementations
• Custom Intel processors beyond commercially available clock rates
• DCs, servers, networking, storage designed to integrated specs
Example Storage Rack
864 disks, 2,350lb
Power Infrastructure
Some DCs with custom power sub-stations
• Lower power cost & build more quickly
• Negotiated power purchasing agreements
Custom switchgear firmware
3 100% carbon neutral regions:
• US West (Oregon)
• AWS GovCloud (US)
• EU (Frankfurt)
