S3 + Snowball
-
Upload
amazon-web-services -
Category
Technology
-
view
799 -
download
0
Transcript of S3 + Snowball
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Guy Farber, AWS Business Development
11/18/2015
S3 and Data Ingest Update
Increased 120% YoY(Q2 2014 vs Q2 2015)
Amazon S3 Momentum - Data Transfer Growth
2014 Q2 2014 Q3 2014 Q4 2015 Q12014 Q2 2015 Q2
Introducing S3 Standard-Infrequent Access
Standard Standard-IA Glacier
The newest storage class in Amazon S3
Standard-Infrequent Access (SIA) Definition
What’s the same?
Access: Almost identical to S3 Standard with same buckets and URLs
Durability: 11 9’s, same as S3 Standard
Performance: Same characteristics as S3 Standard; low latency, high
throughput
What’s different?
Availability: Designed for 99.9%, SLA of 99%
Cost: Lower capacity fees, retrieval fees, minimum object size and
retention
Selecting the right Storage class for your needs
S3
S3-IA
Glacier
L
i
f
e
c
y
c
l
e
AvailableS3: 99.99%
S3-IA: 99.9%
PerformantLow Latency
High Throughput
SecureSSE, client
encryption, IAM
integration
Event
NotificationsSQS, SNS, and
Lambda
VersioningKeep multiple
copies
automatically
Cross Region
Replication
Common
NamespaceDefine storage
class per object
Durable99.999999999%
ScalableElastic capacity
No preset limits
“Hot” DataActive and/or
Temporary Data
“Warm” DataInfrequently
Accessed Data
“Cold” DataArchive and
Compliance Data
Selecting the right Storage class for your needs
S3
S3-IA
Glacier
L
i
f
e
c
y
c
l
e
AvailableS3: 99.99%
S3-IA: 99.9%
PerformantLow Latency
High Throughput≥ 30 Days≥ 128K
≥ 90 Days
Durable99.999999999%
ScalableElastic capacity
No preset limits
> 0K$0.007/GB per month
$0.0125/GB per month
“Hot” DataActive and/or
Temporary Data
“Warm” DataInfrequently
Accessed Data
“Cold” DataArchive and
Compliance Data
≥ 0 Days> 0K$0.0275 - $0.03/GB per
month
3 – 5 Hrs
$0.01/GB retrieval
$0.01/GB retrieval < 5%
Object Storage Use Cases
S3
S3-IA
Glacier
Cloud
Applications
Big Data
Analytics
Content
DistributionPrimary Data
File Sync &
Share
Active
Archive
Enterprise
BackupMedia
Transcoding
Disaster Recovery /
Geo Redundancy
Deep /
Offline
Archives
Tape Vaulting
Replacement
WORM
Compliant
Data
Temporary &
Small
Objects
New S3 Features
S3 Storage Metrics
Monitor and set alarms on
Amazon S3 storage usage
through CloudWatch
Supported metrics include:Total bytes for Standard Storage
Total bytes for Reduced-Redundancy Storage
(RRS)
Total bytes for Reduced-Redundancy Storage
(S3-IA)
Total number of objects for a given S3 bucket.
Migrating Large
Volumes of Data
Never underestimate
the bandwidth of a
FedEx truck
Shipping Physical Media Today
Manage Data and
Physical Media
Manage Data and
Physical Media
Need to Manage Multiple
Drives for Large Imports
Shipping Physical Media Today
Apply Some
‘Inside The Box’ Thinking…
Amazon Snowball
Highly secure, storage appliance
Shipping now, starting at 50TB
Simplified, Secure Data Transfer in Large Scale
Secure
EnclosureStrong Encryption,
End-to-End
50TB, Shipped
in Parallel
Simplified
Logistics
Complex Customer Requirements
Snowball – Petabyte Scale Data Transport
Service
50 TB
E Ink Shipping Label
Ruggedized Case “8.5G Impact”
Rain & Dust Resistant
Tamper Resistant Case & Electronics
All Data Encrypted End-to-end
Encryption Keys Managed Off-Device
How it works
What does it cost?
• $200 / job plus shipping
• Includes 10 days to fill the device at your site
• $15/day after the tenth day on site
• Standard Amazon S3 charges apply
• $0.03/GB to transfer data out
• $0.00/GB to transfer data in
How fast is that truck full of drives?
• Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping
• Number of days to transfer 250TB via the Internet at typical
utilizations
InternetConnectionSpeed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 632
50% 47 95 158 316
75% 32 63 105 211
Thank you!