Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that...

43
1 Bringing IBM Watson to Life © International Business Machines Corporation, 2014

Transcript of Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that...

Page 1: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

11

Bringing

IBM Watson

to Life

© International Business Machines Corporation, 2014

Page 2: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

2

1.Why the world needs Watson

2.What does Watson do?

3.Why is this hard for a computer?

4.Taking Watson to the marketplace

5.I want to be a Watson developer...

© International Business Machines Corporation, 2014© International Business Machines Corporation, 2014

Agenda

Page 3: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

3

1/

Why the world

needs Watson

© International Business Machines Corporation, 2014© International Business Machines Corporation, 2014

3

Page 4: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

4

$20B

Transforming how we connect with the world

in revenue last quarter

50M

Transforming how we consume media

subscribers© International Business Machines Corporation, 2014

4

Page 5: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

5

The volume,

variety, velocity

and veracity of

data is creating

an unprecedented

opportunity.

2.5Bgigabytes of new data are generated every day, 4/5ths of which is unstructured.

© International Business Machines Corporation, 2014

5

Page 6: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

6

This proliferation of

data is driving

demand for real-time

insights and

evidence-based

decision making.

1 in 2CEOs report not having the information they need when making critical decisions

© International Business Machines Corporation, 2014

6

Page 7: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

7

Advances in

natural language

processing and

machine learning

are enabling us to

transform expertise

and professionals.

12%Most firms estimate that they only analyze 12% of the data they already have, leaving 88% on the cutting room floor.

© International Business Machines Corporation, 2014

7

Page 8: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

8

2/

What does Watson do?

© International Business Machines Corporation, 2014

8

Page 9: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

9

Watson is ushering in a

new era of computing

Tabulating Systems

1900 Programmable Era

1950Cognitive Era

2011

© International Business Machines Corporation, 2014

Page 10: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

10

Watson is creating a new partnership between people

and computers that enhances,scales and accelerates human

expertise.

© International Business Machines Corporation, 2014

10

Page 11: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

11

Every day, our brains process

incredible amounts of

information without us even

realizing we’re doing it.

Watson aids the human

cognitive process by reading

and storing all public and

proprietary knowledge across

professions, and making

insights contained within

instantly available.

Observe

InterpretDecide

Evaluate

Observe

© International Business Machines Corporation, 2014

Page 12: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

12

We interpret the data

available to us to make

connections and frame our

choices

Watson supports this

process by interpreting

explicit and implicit

relationships and visualizing

unexpected patterns within

data

Observe

InterpretDecide

Evaluate

Interpret

© International Business Machines Corporation, 2014

Page 13: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

13

We evaluate

connections across

knowledge and data to

draw conclusions and

develop our opinions

Watson supports this

process by testing options

against all available

evidence, without

assumption or bias

Observe

InterpretDecide

Evaluate

Evaluate

© International Business Machines Corporation, 2014

Page 14: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

14

We make decisions based

on experience, new

evidence, and the integrity

of evaluation that we’ve

done.

Watson puts content into

context, pairing confidence-

weighted responses with

supporting evidence and

allowing professionals to

make informed decisions at

the point of impact.

Observ

e

InterpretDecide

Evaluate

Decide

Observe

InterpretDecide

Evaluate

© International Business Machines Corporation, 2014

Page 15: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

15

3/

Why is this hard for a computer?

© International Business Machines Corporation, 2014

15

Page 16: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

16

It is Hard For Computers to Understand

Humans

Person Organization

L. Gerstner IBM

J. Welch GE

W. Gates Microsoft

“If leadership is an art

then surely Jack Welch

has proved himself a

master painter during

his tenure at GE.”

Welch ran

this?

© International Business Machines Corporation, 2014

Page 17: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

17

It is Hard For Computers to Understand

Humans

Noses that run and feet that smell?

How can a house can burn up as it burns down?

Does CPD represent a complex comorbidity of lung cancer?

What mix of zero-coupon, non-callable, A+ munis fit my risk

portfolio?

Person Organization

L. Gerstner IBM

J. Welch GE

W. Gates Microsoft

“If leadership is an art

then surely Jack Welch

has proved himself a

master painter during

his tenure at GE.”

Welch ran

this?

© International Business Machines Corporation, 2014

Page 18: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

18

What is the Difference Between Watson and a Search Engine

Ask Watson How Smart He Is?Ask Google How Smart it is?

© International Business Machines Corporation, 2014

Page 19: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

19

How Watson works: DeepQA architecture

Answer

Scoring

Models

Responses with

Confidence

Inquiry

Evidence Sources

Models

Models

Models

Models

ModelsPrimary

Search

Candidate

Answer

Generation

Hypothesis

Generation

Hypothesis and Evidence

Scoring

Final Confidence

Merging & RankingSynthesis

Answer Sources

Inquiry/Topic

Analysis

Evidence

Retrieval

Deep

Evidence

Scoring

Learned Models

help combine and

weigh the Evidence

Hypothesis

Generation

Hypothesis and Evidence

Scoring

Inquiry

Decomposition

© International Business Machines Corporation, 2014

Page 20: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

20

How Watson works: DeepQA architecture

Answer

Scoring

Models

Responses with

Confidence

Inquiry

Evidence Sources

Models

Models

Models

Models

ModelsPrimary

Search

Candidate

Answer

Generation

Hypothesis

Generation

Hypothesis and Evidence

Scoring

Final Confidence

Merging & RankingSynthesis

Answer Sources

Inquiry/Topic

Analysis

Evidence

Retrieval

Deep

Evidence

Scoring

Learned Models

help combine and

weigh the Evidence

Hypothesis

Generation

Hypothesis and Evidence

Scoring

Inquiry

Decomposition

© International Business Machines Corporation, 2014

1000’s of

pieces of

evidence

Multiple

interpretations

of a question

100,000’s of scores

from many deep

analysis algorithms100’s of

sources

100’s of

possible

answers

Balance &

combine

Page 21: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

21

arrival

in

explorer

India

21

400th anniversary

Portugal

May 1898

celebrated

In May 1898 Portugal celebrated the

400th anniversary of this explorer’s

arrival in India.

Source: IBM Research

Question

Watson leverages multiple algorithms to gather deeper evidence

© International Business Machines Corporation, 2014

Page 22: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

22

explorer

India

In May

1898

India

In May

celebrated

anniversary

in Portugal

In May, Gary arrived in India

after he celebrated his

anniversary in Portugal

Portugal

400th

anniversary

celebrated

THIS IS NOT HOW WATSON WORKS:Keyword Matching

Gary

In May 1898 Portugal celebrated the

400th anniversary of this explorer’s

arrival in India.

This evidence

suggests “Gary” is

the answer BUT the

system must learn

that keyword

matching may be

weak relative to

other types of

evidence

arrived in

arrival in

Legend

Keyword “Hit”

Reference Text

Answer

Question Possible evidence

© International Business Machines Corporation, 2014

Page 23: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

23

27th May 1498

Vasco da

Gama

landed in

arrival

in

explorer

India

Para-

phrases

Geo-

mapping

Date

Match

23

Stronger evidence can

be much harder to find

and score…

…and the evidence is

still not 100% certain

Search far and wide

Explore many hypotheses

Judge evidence

Many inference algorithms

On the 27th of May 1498, Vasco da

Gama landed in Kappad Beach

400th anniversary

Portugal

May 1898

celebrated

In May 1898 Portugal celebrated the

400th anniversary of this explorer’s

arrival in India.

Kappad Beach

Legend

Temporal Reasoning

Reference Text

Answer

Statistical Paraphrasing

GeoSpatial Reasoning

Source: IBM Research

Question Possible evidence

Watson leverages multiple algorithms to gather deeper evidence

© International Business Machines Corporation, 2014

Page 24: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

24

Understands

natural language

and human style

communication

Adapts and learns from

training, interaction, and

outcomes

Generates and

evaluates

evidence-based

hypothesis

1 2

3

Cognitive computing is changing

the game

© International Business Machines Corporation, 2014

Page 25: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

25

4/

Taking Watson to the marketplace

© International Business Machines Corporation, 2014

25

Page 26: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

26

Transforming industries and

professions with services-led

engagements.

Advancing cognitive computing

across the enterprise with

repeatable solutions.

Bringing the cognitive

experience to market through an

ecosystem of partners.

Bringing Watson to market

Transforming industries

and professions with

services-led

engagements.

Advancing cognitive

computing across the

enterprise with

repeatable solutions.

Bringing the cognitive

experience to market

through an ecosystem

of partners.

© International Business Machines Corporation, 2014

Page 27: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

27

Watson’s Evolution

Jeopardy

Single user system

2 - 3 sentence

questions

2 - 3 word answers

5+ days to retrain

Wikipedia, general

corpus

1000s of users

20 page questions

< 1 day to retrain

Medical corpus

Millions of users

Conversational dialog

Few hours to retrain

Broad industry corpus

8 cognitive services

Watson cloud service

Taught at 10

universities

Thousands of business

partners

50+ cognitive services

Multi-lingual

Scalable cloud platform

Taught at 100+

universities

2011 2013 2014 2015

Cognitive

Products

Cognitive

Ecosystem

Open

Cognitive

Platform

Jeopardy

© International Business Machines Corporation, 2014

Page 28: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

28

Customers

Transform Customer

Experiences

Watson Engagement Advisor

For brands and their

consumers

Simple to use

Support answers with

evidence

Dialog with person

builds context IBM Customers have been Enterprises

– B2B2C, B2B2E

Personalization of Interaction

Call Center Assist, Self Help, eCommerce

© International Business Machines Corporation, 2014

Page 29: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

29

Experts

Accelerate Research

and Insights

Watson Discovery Advisor

Test hypotheses

Find Evidence

Discover New Facts

At Scale

Law Enforcement, Pharma

Law, Education, Material Discovery

© International Business Machines Corporation, 2014

Page 30: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

30

Practioners

Improve Decisions and

outcomes

Watson Decision Advisor

Let practitioners consult

with an expert

Support a differential

diagnosis

Reason through

possible actions

Evidence-based

decisions Primary Focus has been chronic disease

Oncology

Treatment support, not pure diagnosis

MSK expertise codified via case studies

© International Business Machines Corporation, 2014

Page 31: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

31

Providers, Payers

& Regulators

Validate adherence to policy guidelines

Watson Policy Advisor

Determine if:

- Policy adhered to

- Policy violated

- More data needed

Provide supporting

evidence

Clinical Trial Matching

170,000 active clinical trials world wide

Does a patient qualify for one?

Should an Insurance Company pay out?

Is there a potential issue with a medication?

© International Business Machines Corporation, 2014

Page 32: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

32

5/

I want to be a

Watson

developer....© International Business Machines Corporation, 2014

32

Page 33: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

33

Award-Winning Examples of Watson Applications

3 of 50+ Watson Ecosystem Partners

Built Applications Using Watson Services Platform

Children talk to their toys.

This one talks back,

teaching and observing

Train and support

sellers in real time by

understanding products

and customers

Deliver personalized

healthcare

recommendations to me

http://www-03.ibm.com/innovation/us/watson/getting_started.shtml

© International Business Machines Corporation, 2014© International Business Machines Corporation, 2014

Page 34: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

34

Watson Services Platform

Data Curation

Requirements Inventory Prioritization

IBM Watson Platform (built on BlueMix ~ IBM Cloud Foundry)

IBM Watson SolutionsHealthcare Financial Services Public Sector Other…

Cognitive

Services

Preparation

Domain

Specialization

Content

Annotators

Models

Tooling

Deploy

Train

Assemble

Admin

Learning

improving insight with experience

Perceiving

Gaining

insight into

our world

Reasoning

Inferring new

conclusions

Relating

Personalizing

individual

nteractions

Ingest

IBM Watson ProductsEngagement Discovery Policy Other…

Data Lake

© International Business Machines Corporation, 2014

Page 35: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

35

Watson Services Platform:

Delivered Via the Cloud....

http://watson.stage1.ng.bluemix.net/

© International Business Machines Corporation, 2014

Page 36: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

36

A Watson Application:

Polylingual Question and Answer for IT

Questions can be asked in either English or Spanish English questions are answered in English Spanish questions are answered bilingually Better or worse answers to a question can be browsed

© International Business Machines Corporation, 2014

Page 37: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

37Application Fragment:

Polylingual Question and Answer for IT

(Written in Ruby Sinatra)

#

# EXTRACT THE ANSWERS FROM A WATSON QUERY

#

watsonQuery = JSON.parse(...)["question"]

answers = watsonQuery["evidencelist"]

answer = answers[@answerIndex]

@answerConfidence = answer[“value”]

@answerText = answer[“text”]

@answerValue = answer[“value”]

© International Business Machines Corporation, 2014

Page 38: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

38

Application Statistics:

Polylingual Question and Answer For IT

AnswerPage.haml: 36 lines

QueryPage.haml: 20 lines

AskWatsonQuestionsInLotsaLanguages.rb 180 lines

© International Business Machines Corporation, 2014

Page 39: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

39

Tool set for Watson Question and Answer Service

Ingest Train Build App Deploy

© International Business Machines Corporation, 2014

Page 40: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

40

Watson Services Platform:

Question and Answer Service

© International Business Machines Corporation, 2014

Page 41: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

41

Watson ServicesPlatform:

Question and Answer Service Documentation

© International Business Machines Corporation, 2014

Page 42: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

42

Watson Goes to University

(Teaching Watson)

10 Universities in 2014, 100+ in 2015

Analogous to a familar senior undergraduate course

“build an O/S, Compiler, or Data Management System

Content, Training, Testing, Mobile Application Development, Business plan

Inter-collegiate competition at conclusion:

The top 3 individuals/teams from each school compete

Grand prize of $100,000 in startup seed money

Access to Watson, and support form IBM in getting to market

http://www.ibm.com/smarterplanet/us/en/ibmwatson/academic.html© International Business Machines Corporation, 2014

Page 43: Bringing IBM Watson to Life - Sogeti · It is Hard For Computers to Understand 17 Humans Noses that run and feet that smell? How can a house can burn up as it burns down? Does CPD

43

© International Business Machines Corporation, 2014

43