AWS Partner Summit_UmeshSampat

1º AWS LATAM Partners Summit

São Paulo, 9 de Maio de 2012

AWS Executive Briefing: Storage

AWS CONFIDENTIAL

Umesh Sampat | Solutions Architect

Agenda

What is AWS?Common Storage ChallengesStorage Overview S3 High Level S3 Deep Dive

Next Generation Enterprise StorageWhy AWS + S3?

AWS CONFIDENTIAL

What is AWS?: AWS Platform

Your Applications

Foundation Services

Building Block Services

Compute Storage Database Networking

Application Platform Services

Management & Administration

AWS Global InfrastructureRegions

Availability ZonesEdge Locations

Content Distribution

MessagingParallel

ProcessingLibraries &

SDKs

Administration Console

Identity & Access

Deployment Monitoring

AWS CONFIDENTIAL

Common Data Storage Challenges

Data growth spiraling out of controlTraditional technologies and processes don’t scaleTry to accurately predict storage needsOffsite / Secondary data centers are expensiveSAN systems are very expensiveNAS systems are expensiveArchive HW + SW is expensiveBackup HW + SW is expensiveTape is unreliable and cumbersomeMulti-site collaboration is often challengingIT response times can hinder the pace of innovation

AWS CONFIDENTIAL

What if you could……..Go global with a few key strokes?Go active in a few clicks?Eliminate capacity planning?Eliminate provisioning for peak demand?Eliminate the need for secondary sites?Consolidate Gold Copy, Backup, DR, and Archive?Slash your DR budget by 50%?Eliminate the need for tech refresh?Eliminate 30%+ of your storage footprint?Eliminate tape?

AWS CONFIDENTIAL

Amazon S3 offers a way to……

Confidently rethink storage strategy: Architecture Capacity Planning Provisioning Operations Consumption Run rate ROI Risk

US West Region (N. CA)

US West Region (Portland)

South America Region (Sao Paulo)

US GovCloud Region (Portland)

EU West Region (IRE)

US East Region (N. VA)

Japan Region (Tokyo)

APAC Region (Singapore)

AWS CONFIDENTIAL

No Up-Front Capital Expense

Pay Only for What You Use

Self-Service Infrastructure

Easily Scale Up and Down

Improve Agility & Time-to-Market

Low Cost

Amazon S3 Benefits

Deploy

AWS CONFIDENTIAL

What is Amazon S3?

Scalable

Reliable

Fast

Inexpensive

Simple

Simple Storage Service: Storage for the Internet

AWS CONFIDENTIAL

What is Amazon S3?

No SPOFAvailability: 99.99%Durability: 99.999999999%

Simple Storage Service: Storage for the Internet

Store 10,000 objects in S3 and expect to lose one object every 10,000,000 years.

AWS CONFIDENTIAL

Global: Global Infrastructure for Global Enterprises

US West(Northern California)

US East(Northern Virginia)

EU(Ireland)

Asia Pacific

(Singapore)

Asia Pacific(Tokyo)

AWS Regions

AWS Edge Locations

GovCloud(US ITAR Region)

US West(Oregon)

South America(Sao Paulo)

AWS CONFIDENTIAL

Durable: AWS Regions and Availability Zones

Customer Decides Where Applications and Data Reside

AWS CONFIDENTIAL

Scalable - Fast – Proven – Accepted

AWS CONFIDENTIAL

Peak Requests: 650,000+ per second192% Growth in 2011

Total Number of Objects Stored in Amazon S3

2.9 Billion 14 Billion 40 Billion102 Billion

762 Billion

262 Billion

905 Billion

Q4 2006 Q4 2007 Q4 2008 Q4 2009 Q4 2010 Q4 2011 Q1 2012

Secure

Identity and Access Management (IAM) Create and manage multiple users under a single AWS account Grant IAM users fine-grained control to your Amazon S3 bucket or

objects

Access Control Lists (ACLs) Use ACLs to selectively add (grant) certain permissions on

individual objects

Bucket Policies Add or deny permissions at the bucket level across some or all of

the objects within a single bucket

Query String Authentication Share Amazon S3 objects through URLs that are valid for a

predefined expiration time

AWS CONFIDENTIAL

Secure

Encryption Amazon S3 Encryption Client

• Encrypt your data before uploading to Amazon S3• Customer manages encryption keys

SSL Server Side Encryption

• AWS manages the keys with SSE

Logging Capture all requests made against a bucket or the objects

within the bucket These logs can be used for auditing purposes

AWS CONFIDENTIAL

Secure

AWS CONFIDENTIAL

Simple

No managementNo backupEliminate Rack & StackNo snapshotsNo provisioningFOCUS ON THE BUSINESS NOT THE TECHNOLOGY Speed business innovation

AWS CONFIDENTIAL

Inexpensive

Pricing Options: Standard Storage RRS

16 price reductions to dateAmazon S3 passes on AWS savings to the customer

AWS CONFIDENTIAL

Next Generation Enterprise Storage - S3

AWS CONFIDENTIAL

First, let’s visit some storage basics

AWS CONFIDENTIAL

Storage Basics - Block vs. File vs. Object Storage

• Block Storage:– Data organized as an array of unrelated blocks– Host File System places data on disk: Microsoft NTFS or Unix ZFS– Structured data is predicted to grow at 18.7% CAGR until 2018

• File Storage: – Unrelated data blocks managed by a file (serving) system– Native file system places data on disk: EMC UxFS or NTAP WAFL– Unstructured data is predicted to grow at 47.3% CAGR until 2018

• What is Object Storage?: – A new data access, data storage, and data management model

• API access to data vs. traditional block or file system access• Metadata Driven, Policy-based, Self Managing storage • No host overhead for storage functions

– A system that stores virtual containers that encapsulate the data, data attributes, metadata, and Object IDs

AWS CONFIDENTIAL

Storage Basics - SAN vs. NAS vs. Cloud Storage

SERVERS

Cloud Storage

NASNAS

SANSANDatacenter Proximity

Ethernet / Optical

Datacenter Proximity

Ethernet

Cloud Proximity

API / HTTP(S)

FILESYSTEMS

APPLICATIONShttps://

nfs / cifs

FC / iSCSI / FCoE

• SAN and NAS are integrated with clients via the operating system• Cloud Storage is an application level integration

AWS CONFIDENTIAL

Archiving is the process of moving data that is no longer actively used to a separate data storage device for long-term retention. Data archives are indexed and have search capabilities so that files and parts of files can be easily located and retrieved.

Backup or the process of backing up is making copies of data which may be used to restore the original after a data loss event. The primary purpose is to recover data after its loss, be it by data deletion or corruption. The secondary purpose of backups is to recover data from an earlier time.

Disaster recovery is the process, policies and procedures related to preparing for recovery or continuation of technology infrastructure critical to an organization after a natural or human-induced disaster.

S3 blurs the lines and collapses budgets

AWS CONFIDENTIAL

Storage Basics - Cloud Storage: SDK or Plug & Play?

SDK: Application Developers can

leverage the S3 SDK for custom application

integration

Plug & Play: IT can bridge on-premises environments

with familiar storage interfaces and

methodologies via Cloud Storage Gateways

AWS CONFIDENTIAL

Web Services API HTTP(S)

Cloud Storage Use-Cases for the Enterprise

AWS CONFIDENTIAL

Next Generation Enterprise Storage - Overview

AWS CONFIDENTIAL

Cus

tom

er D

ata

Cen

ter

HTTP(S)








Block File Archive Backup DR

Direct Connect or InternetWeb Services API

HTTP(S)


Cloud Storage Gateway Benefits

Eliminate Arch. HW / SW

Eliminate Tape

Recover in Cloud or in any Data Center

Reduce SAN Footprint

Next Generation:Gateway + Cloud Storage

Primary Block Storage

Disk Based Backup Storage

Tape Infrastructure & Management

Archival Storage

Replicated Storage for Disaster Recovery

Offsite Locations Geo-Resilience

Traditional: On-Premise Solutions

$$$$$ $

Eliminate Secondary Data Centers

Primary File Storage

Reduce NAS Footprint

AWS CONFIDENTIAL

Eliminate B.U. HW / SW

AWS CONFIDENTIAL

Next Generation Enterprise Storage Use Case: Backup & DR with the AWS Storage Gateway

Benefits ELIMINATE TAPE! Recover Seamlessly in EC2 Reduce DR cost by 50%

Eliminate Backup Software Backup with 11-9s of durability Low cost file server storage

Next Generation Enterprise Storage Use Case: Thin SAN Storage with S3

SAN GW

Benefits Massive SAN footprint reduction Simplify SAN storage Lower costs with data reduction

- Dedplication - Compression

Enterprise grade security Reduce DR cost by 50% Never migrate again!

Fast, online restores + tape elimination Integrated disaster recovery Low cost file server storage

Enterprise Class Dual Controller for High Availability No Single Point of Failure Non-Disruptive Software Upgrades Certified by Microsoft & VMware

iSCSI storage integrates transparently Self-protecting primary storage Secondary and data protection storage

Features that reduce cost, simplify storage

Thin provisioning Primary storage deduplication

Performance with cloud elasticity and cost

WSL and integrated tiering, SSD, and SAS Multiple cloud providers

Enterprise-grade security for the cloud Local keys and encryption of all cloud data Protecting both data-in-motion AND data-at-rest

Simplified, optimized data protection Fast online restores and elimination of tape Integrated disaster recovery at lowest cost,

complexityAWS CONFIDENTIAL

Next Generation Enterprise Storage Example: Thin SAN Storage with S3

NAS GW

Next Generation Enterprise Storage Use Case: Thin NAS Storage with S3

Benefits Massively Scalable NAS Storage Eliminate 30% of NAS storage

footprint Combine Production + Archive +

Backup + DR Global File Namespace Centralize Capacity Never run out of capacity Never under provision capacity!

Eliminate Backup Software for files Eliminate Archive Software for files

NAS GW

NAS GW

Next Generation Enterprise Storage Use Case: Thin NAS Storage (cont.)

HTTP(S)









AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: Thin NAS Storage with S3

AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: Fast File Transfer into AWS

Multi-part Upload Up to 700 Mb/s direct to Amazon S3

Internet

1Gb and 10Gb Connections

Next Generation Enterprise Storage Example: Fast File Transfer into AWS

Next Generation Enterprise Storage Use Case: File Archive with S3

NAS

NAS

NAS

Archive GW

Benefits Significant capital savings Eliminate NAS upgrades Reduce NAS capacity up to 80% Significantly scale existing systems Never under provision = reduced risk Never run out of capacity

Reduce backup times by 80% Reduced replication = bandwidth

savings

VNX

VNX

NTAP Celerra NS

File servers

Location 1 Location 2 Location 3 Location 4

HTTPS HTTPS HTTPS HTTPS









AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: File Archive with S3

Local Storage Amazon

Local file system interface to the SOAP / REST API used by the Amazon storage cloud platform

Virtual namespace to seamlessly integrate local and Amazon cloud storage cloud for users

1

SOAP / REST

CIFS / NFS

2

Automatically identify inactive and other appropriate files to store in the Amazon storage cloud

3 4

Migrate files to Amazon storage cloud platform without disrupting user access or causing downtime

5

Encrypt every file stored in the Amazon storage cloud for data security

AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: File Archive with S3

Next Generation Enterprise Storage Use Case: Email Archive with S3

Email

Email

Archive GW

Benefits Significant capital savings Eliminate email quotas Reduce Storage upgrades Increase mail store capacity by 80% Never run out of email capacity Keep all email online

Reduce backup times by 80% E-Discovery / Compliance Features Search

Email

Integrates with major email systems100% Email capture Internal and internet Email

Unlimited storage Lifecycle and storage allocation

Full text indexing Header, body and attachments

Advanced searching based on indexing Advanced E-Discovery features Legal hold Add comments Mark as reviewed, saved, needs

attention Add tags

Multiple export options .pst, pdf, text, mime, .eml, HTML, etc.

100% Web-based access

AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: Email Archive with S3

Next Generation Enterprise Storage Use Case: Tapeless Cloud Backup

Backup GW

Benefits Eliminate tape Eliminate tape hardware Eliminate VTLs (Data Domain) Never run out of backup capacity Maintain existing BU Software +

paradigms

Secure cloud backup Eliminate off-site tape storage

Random Access to ALL backup/archive files at all timesData integrityNO TAPES OR TAPE LIBRARIES!No human handlingInfinite Scalability

• Deduplication 90 day backup:Unstructured Data - 20:1Structured Data - 5:1Imaging Data – 3:1

• Throughput rates:Up to 800 Mbs sustained

• Ingest/Restore rates:8 TB/day raw16 TB/day deduplicated (first pass)

AWS CONFIDENTIAL

Next Generation Enterprise Storage Example: Tapeless Cloud Backup

AWS CONFIDENTIAL

Next Generation Enterprise Storage Use Case: Tapeless Cloud Backup

Next Generation Enterprise Storage Example: Backup Oracle Database with S3

Corporate Data center

Oracle RMAN

Oracle Secure Backup Module

S3

Region

Amazon S3 + AWS Ecosystem = Business Value









CloudFront

Cloud Search

EC2Direct Connect

Import / Export

Elastic Map Reduce (EMR)

DynamoDB

AWS CONFIDENTIAL

Benefits:Financial: Significant reduction in capital investments Pay for only what you use: Metered Utility Eliminate the need to over purchase AWS prices continue to fall over time

Operational: Streamline and simplify data management operations Reduction of systems and data centers Focus employees on proactive and innovative tasks

Business: Never stop the business as capacity is endless Never slow the pace of innovation Turn IT into an innovation enabler

AWS CONFIDENTIAL

For more information about S3, visit….

http://aws.amazon.com/S3/

AWS CONFIDENTIAL

Thank You

AWS CONFIDENTIAL

AWS Partner Summit_UmeshSampat

Business

Transcript of AWS Partner Summit_UmeshSampat