Enhancing Your Cloud Applications with Artificial Intelligence
-
Upload
alchemyapi -
Category
Technology
-
view
568 -
download
0
description
Transcript of Enhancing Your Cloud Applications with Artificial Intelligence
- Elliot Turner
CEO & Founder, AlchemyAPI
Enhancing your Cloud Applications with Artificial Intelligence
A.I.? What exactly are we talking about?
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
HAL? Killer Robots? IBM Watson?
A.I. = Smarter Applications (not Killer Robots)
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
A.I.: Increasingly Embedded Everywhere
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Monitoring your credit card transac2ons for fraud… Recommending products on Amazon.com... Understanding your voice in Google Now... Analyzing your tax returns… Reading your handwri2ng on personal checks… Correc2ng spelling mistakes in your TPS report…
Using A.I. Cloud APIs - No PhD Required
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Speech Recognition Machine Translation
Computer Vision Natural Language Processing
Question Answering Machine Learning
Building an A.I.-enabled Sample Application
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
"Est-ce que toxique?" "Is this poisonous?"
Example app: "Voice + visual assistant for hikers in any country"
Intended use case: Answer verbal and visual questions about plants and animals encountered on a hike
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide speech recognition capability to any network-enabled device, across 19+ different
spoken languages.
What you can do: respond to spoken commands, transcribe audio and video files, search audio
streams for specific key phrases ...
Moving beyond the keyboard: Speech Recognition
Integrating Speech Recognition into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs support uploading audio files or streaming audio data in real-time ● Providers include Nuance and AT&T:
○ https://developer.att.com/apis/speech ○ http://dragonmobile.nuancemobiledeveloper.com/public/index.php
Speech recognition 1-liner: curl --data-binary @speech.wav -H "Content-Type: audio/wav" -H "Authorization: $AUTH_TOKEN" -H "Accept: application/xml" http://api.att.com/speech/v3/speechToText Hint: use X-SpeechContext to set different transcription modes (web search, local search, dictation)
Integrating Speech Recognition into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
curl --data-binary @speech.wav -H "Content-Type: audio/wav" -H "Authorization: $AUTH_TOKEN" -H "Accept: application/xml" http://api.att.com/speech/v3/speechToText
{ "Recognition": { "Status": "Ok", "ResponseId": "3125ae74122628f44d265c231f8fc926", "NBest": [ { "Hypothesis": "this is some transcribed speech", "LanguageId": "en-us", "Confidence": 0.9, "Grade": "accept", "ResultText": "This is some transcribed speech",
Moving beyond the keyboard: Computer Vision
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide the ability to recognize objects (buildings, cars, ...), logos, and faces contained
within photographs.
What you can do: drive search in your application with camera-phone images, automatically organize
photo libraries, "visually" index video files, filter inappropriate content ...
Integrating Computer Vision into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs automatically tag photos with what they contain ● Providers include Moodstocks, AlchemyAPI, and Koaaba:
○ https://moodstocks.com/ (logos & barcodes) ○ http://alchemyapi.com/ (3d objects: cats, dogs, buildings, …) ○ http://www.koaaba.com/ (logos + wine bottles)
Computer Vision 1-liner: curl --data-binary @photo.jpg ”http://access.alchemyapi.com/image/ ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_KEY
Integrating Computer Vision into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
curl --data-binary @photo.jpg "http://access.alchemyapi.com/calls/image/ ImageGetRankedImageKeywords?imagePostMode=raw&apikey="$API_KEY
"imageKeywords": [ { "text": "boxing", "score": "0.970688" }, { "text": "sport", "score": "0.930862" }, { "text": "person", "score": "0.710949" },
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide automatic translation of text across dozens of different languages.
What you can do: automatically translate foreign-language content for your users, real-time
translation of forum posts or chat sessions, search within foreign language documents ...
Breaking down language barriers: Machine Translation
Integrating Machine Translation into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs automatically translate between dozens of languages. ● Providers include Google and Microsoft:
○ https://developers.google.com/translate/ ○ http://datamarket.azure.com/dataset/bing/microsofttranslator
Language Translation 1-liner:
curl "https://www.googleapis.com/language/translate/v2?key=$INSERT-YOUR-KEY&source=en&target=de&q=Hello
%20world"
Integrating Machine Translation into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
"translations": [ { "translatedText": "¿Dónde está mi hotel?" } ]
"Where is my hotel?"
curl "https://www.googleapis.com/language/translate/v2?key=$INSERT-YOUR-KEY&source=en&target=es&q=Where+is+my
+hotel?"
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide the ability for computers to derive "meaning" from text (documents, web pages,
tweets, …)
What you can do: tag documents by topic, drive content recommendation engines, contextually
target advertisements ...
Reading like a Human: Natural Language Processing
Integrating Natural Language Processing into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs automatically tag documents, extract facts and events, ... ● Providers include AlchemyAPI and OpenAmplify:
○ http://www.alchemyapi.com/ ○ http://www.openamplify.com/
Named entity tagging + sentiment analysis 1-liner: curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=I+am+coming+to+Denver!"
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
"language": "english", "entities": [ { "type": "City", "relevance": "0.33", "sentiment": { "type": "positive", "score": "0.325672" }, "count": "1", "text": "Denver", "disambiguated": { "name": "Denver", "website": "http://www.denvergov.org", "dbpedia": "http://dbpedia.org/resource/Denver", "freebase": "http://rdf.freebase.com/ns/m.02cl1"
"I am coming to Denver!"
Integrating Natural Language Processing into your App
curl "http://access.alchemyapi.com/calls/text/ TextGetRankedNamedEntities?apikey=$API_KEY&sentiment=1&text=I+am+coming+to+Denver!"
Expert in a box: Question Answering
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide the ability to answer natural language questions, such as "Who invented the
Segway?"
What you can do: leverage questions like "was this company acquired?" to trigger processes in data pipelines or GUI displays, automatically answer
questions from your own corpus of data ...
Integrating Question Answering into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs automatically answer questions posed in plain English ● Providers include IBM Watson and Wolfram Alpha:
○ https://www.ibmdw.net/watson/docs/ (QA from text) ○ http://products.wolframalpha.com/api/ (QA from data)
IBM Watson Example API Call JSON: { "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." } }
Integrating Question Answering into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
"answers": [ { "id": 0, "text": "Michael Jackson", "confidence": 0.42276 },
{ "question":{ "questionText":"His 1983 hit \"Beat it\" featured Eddie Van Halen on guitar." } }
Automated reasoning: Machine Learning
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Cloud APIs provide the ability to automate many types of tasks such as labeling data or predicting
things.
What you can do: predict a prospect's likelihood of conversion based on historical data, identify fraud and other anomalous activities, analyze customer
churn ...
Integrating Machine Learning into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
● APIs enable black-box training of prediction models based on submitted training data
● Providers include Google Prediction API and BigML:
○ https://developers.google.com/prediction/ (API only) ○ https://bigml.com/ (API + Web GUI)
Integrating Machine Learning into your App
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Step 1: Collect some data
Step 2: Train a model
Step 3: Make some predictions
Putting it all together: Sample A.I. App Workflow
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Use AT&T Speech API to accept speech input
Use Google Translate to convert from French to English
"Est-ce que toxique?"
"Is this poisonous?"
Take a picture of the item the question is about
Use AlchemyAPI to interpret the photograph "fly agaric"
Use IBM Watson to answer the question Is this poisonous + fly agaric
Example app: "Voice + visual assistant for french hikers"
Thanks for listening! Questions ?
Enhancing your Cloud Applica2ons with Ar2ficial Intelligence Gluecon 2014
Elliot Turner CEO & Founder, AlchemyAPI
[email protected] Twitter: eturner303