Cut AWS Costs: Using Spot Instances for More Than Batch
-
Upload
rightscale -
Category
Technology
-
view
81 -
download
1
Transcript of Cut AWS Costs: Using Spot Instances for More Than Batch
The fundamentals of EC2 Spot
On-Demand
Pay for compute capacity by the hour with no long-term commitments For spiky workloads, or to define needs
AWS EC2 Consumption Models
Reserved
Make a low, one-time payment and receive a significant discount on the hourly charge For committed utilization
Spot
Bid for unused capacity, charged at a Spot Price which fluctuates based on supply and demand For time-insensitive or transient workloads
EC2 Best prac-ces
Fault tolerance
for Spot
Stateless Mul/-‐AZ Loosely coupled Instance Flexibility
¢
Spare capacity at scale
AWS has mil l ions of active customers in 190 countries. On average, every week, AWS customers are using more compute capacity on Amazon EC2 Spot than customers in 2012 were running across all of Amazon EC2.
With Spot the rules are simple
Markets where the price of compute changes based on
supply and demand
You’ll never pay more than your bid. When the market exceeds your bid you get 2 minutes to
wrap up your work
Capacity pools
AZ1
AZ2
Frankfurt Region
C3 C4 M4 I3 R4 D2
Shared
Dedicated
Shared
Dedicated
$0.27 $0.29 $0.50
1b 1c 1a
8XL
$0.30 $0.16 $0.21 4XL
$0.07 $0.08 $0.08 2XL
$0.05 $0.04 $0.04 XL
$0.01 $0.04 $0.01 L
C3
$1.76
On Demand
$0.88
$0.44
$.22
$0.11
Show me the markets!
Each instance family
Each instance size
Each Availability Zone
In every region
Is a separate Spot Market
50% Bid
75% Bid
You pay the market price
Bid Price Vs Market Price
25% Bid
¢
Amazon EC2 Spot – in the wild
1) We make this easy using the Spot bid advisor
2) With deliberate pool selection and bidding, you will keep your Spot instance as long as you need to.
3) And with new features like Spot fleet diversified we do the heavy lifting for you...
¢
Spot Bid Advisor – aws-spot-labs ¢
Spot fleet helps you
Launch Thousands of Spot Instances with one RequestSpotFleet call.
Get Best Price Find the lowest priced horsepower that works for you. or Get Diversified Resources Diversify your fleet. Grow your availability. And Apply Custom Weighting Create your own capacity unit based on your application needs
¢
Using a single additional Parameter
Run continuously for up to 6 hours
Save up to 50% off On-Demand pricing
EC2 Spot block
$1 ¢
Example customer cases
Customer examples – Yelp
• Seagull is Yelp’s distributed system for concurrent task execution
• Seagull’s infrastructure costs were reduced by 85% by moving to Spot instances
Sea
gull
Infra
stru
ctur
e C
ost
Timeline (May 2015-April 2016)
55% reduction in costs after initial transition to spot instances
Additional 60% savings after transition to spot+autoscaling complete
Why use Spot – customer examples
Scaling up as many as 1000 Spot instances a day to handle real time ad delivery Petabyte-Scale Data Pipelines with Docker, Luigi and Elastic Spot Instances