Openstack and eBay
-
Upload
open-stack -
Category
Technology
-
view
4.873 -
download
0
Transcript of Openstack and eBay
Neal SampleVP Architecture, Platform Products, Developers Program
eBay’s global commerce platform
eBay marketplace = economy of scale
200200M live listings9494M active users
99 Petabytes of data storage22B page views/day
7575B database calls/day6,0006,000 application servers
$62$62B 2010 gross merchandise volume2323M lines of code
Commercial data warehouse 100x larger than Library of Congress
Excess Capacity
Cloud bursting: ↓ costs by ↑ efficiency
Current Traffic
Datacenter efficiency
Energy-proportional computing
Timeline
text text text text text text text text
Fixed Cost
Req
uest
for
Dat
a
2000
1800
1600
1400
1200
1000
800
600
400
200
0
IdealRemove the peaks
Cloud Burst
TIER IV TIER II2(N+1) N+1
Datacenter efficiency
• Blend of Tier IV & Tier II– Minimum 30% reduction in OpEx cost per MW enables cost effective operations/expansion.– 50% reduction in CapEx for new lower-tier datacenters (Tier IV vs. Tier II)
• Burst Capacity (DC and Cloud)
Datacenter tier = level of redundancy
Energy-proportional computing
Meta Scheduler
Traffic
SLAModels
BMS metrics
Utilization (headroom)Availability
SLC PHX (Tier 4) PHX (Tier2)
Cloud Bursting
Direct traffic to the most economical location / optimize placement within DC
KWh cost / incentives / forecasts
Evaluate tradeoffs by varying size of internal cloud, and costs
Sum cost over period
HW/SW lease, networking, space, power, laborPredict future costs trends
Negotiated price with public cloud vendor
Hourly cost of CUin external cloud
Hourly total costHourly cost of CU in internal cloud
Financial model structure
Hourly CUs neededin external cloud
Based on server inventoryand growth forecast
Number of CU in internal cloud
Hourly computing units (CU) required
Define a standard CU
Max TPS per CU
Historical (from ODW) or predicted
Hourly demand(in average TPS)
Evaluate tradeoffs by varying size of internal cloud, and costs
Sum cost over period
HW/SW lease, networking, space, power, laborPredict future costs trends
Negotiated price with public cloud vendor
Hourly cost of CUin external cloud
Hourly total costHourly cost of CU in internal cloud
Hourly CUs neededin external cloud
Based on server inventoryand growth forecast
Number of CU in internal cloud
Hourly computing units (CU) required
Define a standard CU
Max TPS per CU
Historical (from ODW) or predicted
Hourly demand(in average TPS)
Cost components
Fixed, $0.88
Power, $0.03
Leases, $0.08
Networking, $0.04 Licenses, $0.04Datacenter
People
Total cost per CU/h : $1.07
TSP ↑ = more attractive options for cloud bursts
All self operated CUs
Load served by external cloud
CU decreasing byLease expiration
Historical TPS hourly data from ODW
TPS and FE Compute Units (CU) 24-Month Projects
Load served by self operated CU
Cost-benefit analysis
Cloud cost ($/hour)
0.5
0.81
1.11.21.5
234
DC CUs Impact on Project Annual Cost 9/2010 – 8/2011DC CU Hr Cost = 1.07, 30 TPS per CU
DC CUs
To
tal
Co
st (
$)
0 2000 4000 6000 8000
20,0
00,0
0040
,000
,000
60,0
00,0
00
0 DCs$20M
0 DCs$30M
3K DCs$40M
3.5K DCs$45M
4K DCs$47M
4.8K DCs$52M
5K DCs$55M
Business Intelligence
Focus for the future
LowerCost
• Commerce expertise
• Customer experience
• Reliability
• Security
• Etc.
Business Intelligence
Increased Focus
Infrastructureas CommodityInfrastructureas Commodity
Financial Cost Model for the Hybrid Cloud