Post on 21-Jan-2018
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CTO Club - Jerusalem
November 2017
AI Services on AWSBoaz Ziniman – Technical Evangelist, AWS
@ziniman
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The difficulty comes in writing software that will make sense
of the data
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Artificial Intelligence
A system or service which can perform tasks that usually require human intelligence
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
25,000 skills
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
And a few more examples…
Fraud detection Detecting fraudulent transactions, filtering spam emails, flagging suspicious reviews, …
Personalization Recommending content, predictive content loading, improving user experience, …
Targeted marketing Matching customers and offers, choosing marketing campaigns, cross-selling and up-selling, …
Content classification Categorizing documents, matching hiring managers and resumes, …
Churn prediction Finding customers who are likely to stop using the service, free-tier upgrade targeting, …
Customer support Predictive routing of customer emails, social media listening, …
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine Learning On AWS Today
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General-purpose GPU compute applications.Features:• High Frequency Intel Xeon E5-2686v4 (Broadwell)• High-performance NVIDIA K80 GPUs, each with
2,496 parallel processing cores and 12GiB of GPU memory
• Supports GPUDirect™• Enhanced Networking• EBS-optimized by default at no additional cost
Amazon EC2 P2 Instances
Instance Size GPUs GPU Peer to Peer
vCPUs Memory (GiB)
Network Bandwidth*
p2.xlarge 1 - 4 61 1.25Gbpsp2.8xlarge 8 Y 32 488 10Gbpsp2.16xlarge 16 Y 64 732 20Gbps
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General-purpose GPU compute applications.Features:• High Frequency Intel Xeon E5-2686v4 (Broadwell)• High-performance NVIDIA V100 GPUs, each with
5,120 GPU cores + 640 Tensor cores and 16GiB of GPU memory
• Supports GPUDirect™• Enhanced Networking• EBS-optimized by default at no additional cost
Amazon EC2 P3 Instances
Instance Size GPUs GPU Peer to Peer
vCPUs Memory (GiB)
Network Bandwidth*
p3.2xlarge 1 - 8 61 Up to 10Gbpsp3.8xlarge 4 Y 32 244 10Gbpsp3.16xlarge 8 Y 64 488 25Gbps
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Expedia - Ranking Hotel Images
Leading online travel companyHow to improve hotels listing images?
• Use GPUs and deep learning to rank hotel images• Build a model based on 100K images
How to rank 10M images?• Use data parallelization across multiple GPUs on AWS• Improve ranking time from more than a week to 1 day
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One-ClickDeep Learning
AWS Deep Learning AMIsAmazon Linux & Ubuntu
Up to~40k CUDA cores
Apache MXNet
TensorFlow
Theano
Keras
Caffe
CNTK
Torch
Pre-configured CUDA drivers
Anaconda, Python3
Out-of-the-box Tutorials
+ CloudFormation template
+ Container Image
Available in the AWS Marketplace
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Can We Help CustomersPut Intelligence At The Heart Of Every Application & Business?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PollyText-to-Speech
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RekognitionImage Analysis
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
LexConversation Bots
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PollyText-to-Speech
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
“Today in Seattle, WA it’s 11°F”
“Today in Seattle Washington it’s 11 degrees Fahrenheit”
Text In, Life-like Speech Out
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing• “Today in Seattle, WA, it’s 11°F”• ‘"We live for the music" live from the Madison Square Garden.’
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://www.w3.org/TR/speech-synthesis/
<speak>The spelling of my name is
<prosody rate='x-slow'><say-as interpret-as="characters">Boaz</say-as>
</prosody></speak>
A Focus On Voice Quality & Pronunciation
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“<say-as interpret-as="telephone">
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags• dynamic range compression (drc)
<speak><prosody volume="loud">This text needs to be understandable and loud.<amazon:effect name="drc">This text also needs to be more understandable in a moving car.</amazon:effect></prosody></speak>
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing2. Intelligible and Easy to Understand3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“ • “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags• dynamic range compression (drc)• whispered
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where users help translate the web and rate translations.
With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.
Severin HackerCTO, Duolingo
”“ • Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High quality,through
best-in-classdeep learning
Deep functionality
Easy to use& thoughtfully
integrated
Built forproduction
Lowcost
Polly: Life-like Speech Service
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RekognitionImage Analysis
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition
Object and scene detectionFacial analysisFace comparisonCelebrity recognitionImage moderation
Amazon Rekognition: Images In, Rich Metadata Out
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object & Scene Detection
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Analysis
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smiling?
Facial Analysis
(Deep) Learning from a Masterpiecehttp://bit.ly/MonaLisaAI
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Celebrity Recognition
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Search
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Explicit NudityNudityGraphic Male NudityGraphic Female NuditySexual ActivityPartial Nudity
SuggestiveFemale Swimwear or UnderwearMale Swimwear or UnderwearRevealing Clothes
Image moderation
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Customers
Digital Asset ManagementMedia and EntertainmentTravel and HospitalityInfluencer MarketingSystems IntegrationDigital AdvertisingConsumer StorageLaw EnforcementPublic SafetyeCommerceEducation
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.https://aws.amazon.com/solutions/case-studies/cspan/
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DEMO
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High quality,through
best-in-classdeep learning
Deep functionality
Easy to use& thoughtfully
integrated
Built forproduction
Lowcost
Rekognition: Search & Understand Visual Content
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
LexConversation Bots
Artificial Intelligence Services on AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon LexAutomatic Speech RecognitionNatural Language Understanding
“What’s the weather forecast?”
WeatherForecast
Speech Recognition & Natural Language Understanding
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon LexAutomatic Speech RecognitionNatural Language Understanding
“What’s the weather forecast?”
“It will be sunny and 25°C”
WeatherForecast
Speech Recognition & Natural Language Understanding
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin
Destination
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin
Destination
Departure Date
✈ Flight Booking
“Book a flight toLondon”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin
Destination
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural LanguageUnderstanding
Flight booking
London Heathrow
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin
Destination
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural LanguageUnderstanding
Flight booking
London Heathrow
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin
Destination London Heathrow
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural LanguageUnderstanding
Flight booking
London Heathrow
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural LanguageUnderstanding
Flight booking
London Heathrow
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
Prompt
“When would you like to fly?”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“When would you like to fly?”
PollyPrompt
“When would you like to fly?”
Natural LanguageUnderstanding
Flight booking
London Heathrow
“Book a flight toLondon”
AutomaticSpeech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“When would you like to fly?”
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
AutomaticSpeech Recognition
Next Friday
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
Natural LanguageUnderstanding
Flight booking
10/11/2017
AutomaticSpeech Recognition
Next Friday
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Natural LanguageUnderstanding
Flight booking
10/11/2017
AutomaticSpeech Recognition
Next Friday
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Confirmation
“Your flight is booked for next Friday”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Confirmation
“Your flight is booked for next Friday”
“Your flight is booked fornext Friday”
Polly
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lex: Build Natural, Conversational Interactions In Voice & Text
High quality,through
best-in-classdeep learning
Deep functionality
Easy to use& thoughtfully
integrated
Built forproduction
Lowcost
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Wrap up
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smile!@ziniman
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!@ziniman