S3 + Snowball

22
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Guy Farber, AWS Business Development 11/18/2015 S3 and Data Ingest Update

Transcript of S3 + Snowball

Page 1: S3 + Snowball

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Guy Farber, AWS Business Development

11/18/2015

S3 and Data Ingest Update

Page 2: S3 + Snowball

Increased 120% YoY(Q2 2014 vs Q2 2015)

Amazon S3 Momentum - Data Transfer Growth

2014 Q2 2014 Q3 2014 Q4 2015 Q12014 Q2 2015 Q2

Page 3: S3 + Snowball

Introducing S3 Standard-Infrequent Access

Standard Standard-IA Glacier

The newest storage class in Amazon S3

Page 4: S3 + Snowball

Standard-Infrequent Access (SIA) Definition

What’s the same?

Access: Almost identical to S3 Standard with same buckets and URLs

Durability: 11 9’s, same as S3 Standard

Performance: Same characteristics as S3 Standard; low latency, high

throughput

What’s different?

Availability: Designed for 99.9%, SLA of 99%

Cost: Lower capacity fees, retrieval fees, minimum object size and

retention

Page 5: S3 + Snowball

Selecting the right Storage class for your needs

S3

S3-IA

Glacier

L

i

f

e

c

y

c

l

e

AvailableS3: 99.99%

S3-IA: 99.9%

PerformantLow Latency

High Throughput

SecureSSE, client

encryption, IAM

integration

Event

NotificationsSQS, SNS, and

Lambda

VersioningKeep multiple

copies

automatically

Cross Region

Replication

Common

NamespaceDefine storage

class per object

Durable99.999999999%

ScalableElastic capacity

No preset limits

“Hot” DataActive and/or

Temporary Data

“Warm” DataInfrequently

Accessed Data

“Cold” DataArchive and

Compliance Data

Page 6: S3 + Snowball

Selecting the right Storage class for your needs

S3

S3-IA

Glacier

L

i

f

e

c

y

c

l

e

AvailableS3: 99.99%

S3-IA: 99.9%

PerformantLow Latency

High Throughput≥ 30 Days≥ 128K

≥ 90 Days

Durable99.999999999%

ScalableElastic capacity

No preset limits

> 0K$0.007/GB per month

$0.0125/GB per month

“Hot” DataActive and/or

Temporary Data

“Warm” DataInfrequently

Accessed Data

“Cold” DataArchive and

Compliance Data

≥ 0 Days> 0K$0.0275 - $0.03/GB per

month

3 – 5 Hrs

$0.01/GB retrieval

$0.01/GB retrieval < 5%

Page 7: S3 + Snowball

Object Storage Use Cases

S3

S3-IA

Glacier

Cloud

Applications

Big Data

Analytics

Content

DistributionPrimary Data

File Sync &

Share

Active

Archive

Enterprise

BackupMedia

Transcoding

Disaster Recovery /

Geo Redundancy

Deep /

Offline

Archives

Tape Vaulting

Replacement

WORM

Compliant

Data

Temporary &

Small

Objects

Page 8: S3 + Snowball

New S3 Features

Page 9: S3 + Snowball

S3 Storage Metrics

Monitor and set alarms on

Amazon S3 storage usage

through CloudWatch

Supported metrics include:Total bytes for Standard Storage

Total bytes for Reduced-Redundancy Storage

(RRS)

Total bytes for Reduced-Redundancy Storage

(S3-IA)

Total number of objects for a given S3 bucket.

Page 10: S3 + Snowball

Migrating Large

Volumes of Data

Page 11: S3 + Snowball

Never underestimate

the bandwidth of a

FedEx truck

Page 12: S3 + Snowball

Shipping Physical Media Today

Manage Data and

Physical Media

Page 13: S3 + Snowball

Manage Data and

Physical Media

Need to Manage Multiple

Drives for Large Imports

Shipping Physical Media Today

Page 14: S3 + Snowball

Apply Some

‘Inside The Box’ Thinking…

Page 15: S3 + Snowball

Amazon Snowball

Highly secure, storage appliance

Shipping now, starting at 50TB

Page 16: S3 + Snowball

Simplified, Secure Data Transfer in Large Scale

Secure

EnclosureStrong Encryption,

End-to-End

50TB, Shipped

in Parallel

Simplified

Logistics

Page 17: S3 + Snowball

Complex Customer Requirements

Page 18: S3 + Snowball

Snowball – Petabyte Scale Data Transport

Service

50 TB

E Ink Shipping Label

Ruggedized Case “8.5G Impact”

Rain & Dust Resistant

Tamper Resistant Case & Electronics

All Data Encrypted End-to-end

Encryption Keys Managed Off-Device

Page 19: S3 + Snowball

How it works

Page 20: S3 + Snowball

What does it cost?

• $200 / job plus shipping

• Includes 10 days to fill the device at your site

• $15/day after the tenth day on site

• Standard Amazon S3 charges apply

• $0.03/GB to transfer data out

• $0.00/GB to transfer data in

Page 21: S3 + Snowball

How fast is that truck full of drives?

• Less than 1 day to transfer 250TB via 5x10G connections with 5

Snowballs, less than 1 week including shipping

• Number of days to transfer 250TB via the Internet at typical

utilizations

InternetConnectionSpeed

Utilization 1Gbps 500Mbps 300Mbps 150Mbps

25% 95 190 316 632

50% 47 95 158 316

75% 32 63 105 211

Page 22: S3 + Snowball

Thank you!