AWS Overview - SMU

39
Amazon Web Services Overview Julian Lau Solutions Architect - Education, Research & Not-For-Profit Global Public Sector - APAC

description

Amazon Web Services

Transcript of AWS Overview - SMU

Page 1: AWS Overview - SMU

Amazon Web Services Overview

Julian LauSolutions Architect - Education, Research & Not-For-ProfitGlobal Public Sector - APAC

Page 2: AWS Overview - SMU

AWS IntroductionAWS services walkthroughUse case scenarios on CloudTutorials

Agenda

Page 3: AWS Overview - SMU

AWS IntroductionAWS services walkthroughUse case scenarios on CloudTutorials

Agenda

Page 4: AWS Overview - SMU

What is Cloud Computing?

The on-demand delivery of IT resources via the Internet with pay-as-you-go pricing.

Page 5: AWS Overview - SMU

v

Amazon S3

Amazon SQS

Amazon EC2

Amazon Simple DB

Amazon EBS

Amazon

CloudFront

Elastic Load Balancing

Auto Scaling

Amazon VPC

Amazon RDS

Amazon SNS

Amazon IAM

Amazon Route 53

Amazon SES

AWS Elastic Beanstalk

AWS CloudFormation

Amazon Elasticache

AWS Direct Connect

AWS GovCloud

AWS Storage Gateway

Amazon DynamoDB

Amazon CloudSearch

Amazon SWF

Amazon Glacier

Amazon Redshift

AWS Data Pipeline

Amazon Elastic Transcoder

AWS OpsWorks

Amazon CloudHSM

Amazon AppStream

Amazon CloudTrail

Amazon WorkSpaces

Amazon Kinesis

Amazon ECS

Amazon Lambda

Amazon Config

AWS CodeDeploy

Amazon RDS for Aurora

AWS KMS

Amazon Cognito

Amazon WorkDocs

AWS Directory Service

Amazon Mobile Analytics

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Amazon WorkMail

AWS has been continually expanding its services to support virtually any cloud workload, and it now has more than 40 services.

July 9, 2015

Amazon EFS

Amazon Machine Learning

AWS Device Farm

Amazon API Gateway

AWS CodePipeline

AWS CodeCommit

AWS’ History of Innovation

Page 6: AWS Overview - SMU

11 Regions

28 Availability Zones

53 Edge locations

AWS Global Infrastructure

Page 7: AWS Overview - SMU

Availability Zone (AZ)

• Each region has multiple,

isolated locations known as

Availability Zones

• Low-latency links between

AZs in a region

• When launching an EC2

instance, a customer chooses

an AZ

AVAILABILITY ZONE 3

EC2

AVAILABILITY ZONE 2

AVAILABILITY ZONE 1

EC2EC2

EC2

REGION

Page 8: AWS Overview - SMU

Increased agility has become the #1 reason organizations use the AWS cloud

Page 9: AWS Overview - SMU

Organizations Can’t Afford to be Slow

Add New Dev Environment

Add New Prod Environment

Add New Environment in Japan

Add 1,000 Servers

Remove 1,000 Servers

Deploy 1 PB Data Warehouse

Shut down 1 PB Data Warehouse

AWS:

Infrastructure in MinutesOld World:

Infrastructure in Weeks

Everything changes with this kind of agility

Page 10: AWS Overview - SMU

Education Use Cases on AWS

Development and TestEnterprise Applications

Big Data and High Performance Computing (HPC)Storage, Backup, and Archival

Disaster RecoveryWeb, Mobile, and Social Apps

Virtual DesktopsData Center Migrations

Page 11: AWS Overview - SMU

AWS IntroductionAWS services walkthroughUse case scenarios on CloudTutorials

Agenda

Page 12: AWS Overview - SMU

Service Breadth & Depth

Infrastructure Regions Points of PresenceAvailability Zones

Core ServicesStorage(Object, Block and Archival)

Compute(VMs, Auto-scaling and Load Balancing)

Databases(Relational, NoSQL, Caching)

Networking(VPC, DX, DNS)

CDN

Access ControlUsage Auditing

Monitoring and Logs

Administration & Security

Key StorageIdentityManagement

Platform Services

Deployment & Management

One-click web app deployment

Dev/ops resourcemanagement

Resource Templates Push Notifications

Mobile Services

Mobile Analytics

Identity

Sync

App Services

Workflow

Transcoding

Email

Search

Queuing &Notifications

App streaming

Analytics

Hadoop

Data Pipelines

Data Warehouse

Real-timeStreaming Data

EnterpriseApplications

Virtual Desktops Collaboration and Sharing

Page 13: AWS Overview - SMU

Compute Services

Amazon EC2 Auto ScalingElastic Load

Balancing

Actual

EC2

Elastic Virtual servers

in the cloud

Dynamic traffic

distribution

Automated scaling

of EC2 capacity

Page 14: AWS Overview - SMU

Networking Services

Amazon VPC: AWS DirectConnect Amazon Route 53

Availability

Zone BAvailability

Zone A

Private, isolated

section of the AWS

Cloud

Private connectivity

between AWS and your

datacenter

Domain Name System

(DNS) web service.

Page 15: AWS Overview - SMU

Storage Services

Amazon EBS

EBS

Block storage for use

with Amazon EC2

Amazon S3

Images

Videos

Files

Binaries

Snapshots

Internet scale

storage via API

AWS Storage Gateway

S3,

Glacier

Integrates on-premises

IT and AWS storage

Amazon Glacier

Images

Videos

Files

Binaries

Snapshots

Storage for archiving

and backup

Page 16: AWS Overview - SMU

Application Services

Amazon CloudFront

Distribute content

globally

Amazon

CloudSearch

Managed search

service

Amazon Elastic

Transcoder

Video transcoding

in the cloud

Page 17: AWS Overview - SMU

Database Services

Amazon RDSAmazon

DynamoDB

Managed relational

database serviceManaged NoSQL

database service

DBA

Amazon

ElastiCache

In-Memory Caching

Service

Page 18: AWS Overview - SMU

Big Data Services

Amazon EMR

(Elastic Map Reduce)

AWS Data Pipeline

Hosted Hadoop

frameworkMove data among AWS

services and on-

premises data sources

Amazon Redshift

Petabyte-scale data

warehouse service

Page 19: AWS Overview - SMU

Deployment & Administration

Amazon CloudWatch

AWS IAM (Identity

& Access Mgmt)

AWS OpsWorks

AWS CloudFormation

AWS Elastic Beanstalk

Web App

Enterprise

App

Database

Monitor resources Manage users,

groups &

permissions

Dev-Ops framework

for application

lifecycle management

Templates to deploy

& manageAutomate resource

management

Page 20: AWS Overview - SMU

AWS IntroductionAWS services walkthroughUse case scenarios on CloudTutorials

Agenda

Page 21: AWS Overview - SMU

Big Data

Import Export

Glacier

S3 EC2

RedshiftDynamoDB

EMR

Data Pipeline

S3Direct Connect

COLLECT STORE ANALYZE SHAREA

WS

BIG

DA

TA

PO

RTF

OLI

O

Amazon Kinesis - Fully-managed service for real time

processing of streaming data, at any scale

Page 22: AWS Overview - SMU

AWS Cloud

Amazon Glacier

Gateway Appliance/ AWS Storage Gateway

Amazon S3

Block File

On-premises Data Center

Archive Backup Disaster

Recovery

Storage, Backup, and Archival

Amazon Glacier

Low-cost Archive Storage in the Cloud

Amazon Elastic Block Store

Persistent Block Storage for EC2

AWS Storage Gateway

File Sharing & seamless backup of

enterprise data to Amazon S3

Amazon EBS

Amazon S3

Redundant, High-Scale Object Store

Page 23: AWS Overview - SMU

Disaster Recovery

AWS DR Scenarios Backup and Restore Pilot Light for Simple Recovery into AWS

Warm Standby Solution Multi-site Solution

Amazon RDS – Cross Region Read ReplicasImproved disaster recovery operations.

Readable copies for cross-region applications.Easy migration between regions

Page 24: AWS Overview - SMU

Web, Mobile, and Social Apps

Amazon AppStream - Flexible, interactive application streaming service for any device

Captures user input to send back to the cloud Responsive and consistent experience across devices

Web and Mobile Apps

on AWS

Page 25: AWS Overview - SMU

Demo

Page 26: AWS Overview - SMU

AWS IntroductionAWS services walkthroughUse case scenarios on CloudTutorials

Agenda

Page 27: AWS Overview - SMU

Tutorials

• Tutorial 1 – Creating a Billing Alarm

• Tutorial 2 – EC2 with iPython

• Tutorial 3 – Docker with iPython

• Tutorial 4 – Adding Terminate Actions to

Amazon CloudWatch Alarms

Page 28: AWS Overview - SMU

Tutorial 1 – Creating a Billing Alarm

Page 29: AWS Overview - SMU

Tutorial 1 – Creating a Billing Alarm

• http://docs.aws.amazon.com/awsaccountbilling/l

atest/aboutv2/free-tier-alarms.html

Page 30: AWS Overview - SMU

Tutorial 2 – EC2 with iPython

• Step 1: Setup your AWS Account– Sign Up for AWS

– Create an IAM User

– Create a Key Pair• Save it to local Hard drive first and move it to a secure location

• Remember to clean up after the Lab!

– Create a Virtual Private Cloud (VPC)

– Create a Security Group

• http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/get-set-up-for-amazon-ec2.html

Page 31: AWS Overview - SMU

Tutorial 2 – EC2 with iPython

• Step 2: Launch a Linux Instance– Launch an Amazon EC2 Instance

• Create a new security group: iPython Notebook– SSH

– HTTP

– Custom TCP Rule: 8000

– Custom TCP Rule: 8888

• Choose an existing key pair – Your key pair created in Step 1

– Connect to Your Instance• Option 2: Connect from Windows Using PuTTY

• http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/EC2_GetStarted.html

Page 32: AWS Overview - SMU

Tutorial 2 – EC2 with iPython

• Step 3: Deploy iPython

– sudo yum groupinstall "Development Tools“ -y

– sudo pip install jupyter

– jupyter notebook --ip=*

– http://<your ip address>:8888

• http://jupyter.readthedocs.org/en/latest/install.ht

ml

Page 33: AWS Overview - SMU

Tutorial 3 – Docker with iPython

Page 34: AWS Overview - SMU

VM-based approach

Page 35: AWS Overview - SMU

VM-based approach

Benefits

• Secure

• Isolation

• Tooling

• Portability (vdisks)

Challenges

• Portability (v-resources)

• Speed

• Composition

• Flexibility

Page 36: AWS Overview - SMU

Container-based approach

• Shared OS speeds

deployment

• File system simplifies

updates & migration

Page 37: AWS Overview - SMU

Tutorial 3 – Docker with iPython

• Step 1: Docker Basic

– Reuse the Linux Instance from previous tutorial

– Installing Docker

– Sign up for a Docker Hub Account

– Create a Docker Image and Upload it to Docker Hub

• http://docs.aws.amazon.com/AmazonECS/latest/

developerguide/docker-basics.html

Page 38: AWS Overview - SMU

Tutorial 3 – Docker with iPython

• Step 2: Docker with iPython (tmpNB)– docker pull jupyter/minimal

– export TOKEN=$( head -c 30 /dev/urandom | xxd -p )

– docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN --name=proxy jupyter/configurable-http-proxy --default-target http://127.0.0.1:9999

– docker run --net=host -d -e CONFIGPROXY_AUTH_TOKEN=$TOKEN --name=tmpnb -v /var/run/docker.sock:/docker.sock jupyter/tmpnb

• https://github.com/jupyter/tmpnb

Page 39: AWS Overview - SMU

Tutorial 4 – Adding Terminate Actions to Amazon CloudWatch Alarms

• http://docs.aws.amazon.com/AmazonCloudWatc

h/latest/DeveloperGuide/UsingAlarmActions.html

#AddingTerminateActions