Emotion recognition - a new design paradigm

Post on 14-Aug-2015

35 views 0 download

Tags:

Transcript of Emotion recognition - a new design paradigm

GRAPHING CUSTOMER EMOTION IN TURBOTAX IN REAL TIME

1

Agenda1. background

2. technology

3. experiments, insights and customer benefits

4. opportunities, risks and next steps

2

Part 1. Background

3

4

43 muscles and 23 action units (AUs) – combinations of facial muscle activity that correspond to seven core emotions – are studied on a

second-by-second basis.

Pursuant to US Patent #7,113,916

5

6

Why now?

7

SxSW 2015 + CONVERGENCE

8

9

Gathering emotion response data will allow us to see our customers in a completely new way. It will unlock the unique individual behind the faceless demographic.

This would allow us to…

10

Serve up different versions our tax-prep experience according to emotional responses

Capture a completely new dimension of data in analytics

Change marketing offers based on emotion response

Better facilitate customer care (especially agent interaction)

Baseline requirements

11

real time fast accurate seamless integration

Part 2. Technology

12

13

14

Technology Highlights

Valence, Engagement, and other emotions

SDK runs native/local on mobile + desktop platforms

Real-time, reads every 250 ms

Transient — no images are stored

15

Hands-on demo!

16

Part 3. Experiments, insights and customer benefits

17

Experiment A positive reaction (valence >0)

negative reaction (valence <0)

AFFECTIVA measure

page 1

page 2A

page 2B

19

WHAT THE CUSTOMER SEES

WHAT THE CAMERA SEES

Experiment A

positive reaction negative reaction

Experiment Apositive reaction

(valence >0)

negative reaction (valence <0)

measure

22

negative valence

positive valence

we needed data from real people

23

Experiment B

24

Experiment B

-48

+35

25

Experiment B

we needed a controlled test on a specific event at a specific time

26

We measured emotions between 3 points for a 3 second interval

Experiment C

number starts rolling number stops rolling 2 seconds after number stops rolling

THE EVENT THE TIME INTERVAL

0 1 3

When the EIC credit appears

Stt

28

Experiment C

noisy data - wide range of deviation on a single URL giving low

confidence on what the customer is experiencing

event driven data

With data tied to intervals around events we get an accurate reflection of emotion response.

29

Experiment C

Stt

30

Experiment C

31

Experiment B

Customer benefitswe can understand our customers on a deeper level

we can respond to a negative or positive outcome in a way that builds confidence

we can provide customers with support when they need it most

we can and help in ways we never did before

we can identify areas of concern that are otherwise invisible

32

Conclusions / insights

We can gather a completely new understanding of the end-to-end customer journey AND key moments in the customer experience

We can gather valuable, actionable analytics giving us a radically new data dimension, creating a strategic advantage that we have never had before.

33

Part 4. Opportunities, risks and next steps

34

35

There is no art/ to find the man's

construction in the face William Shakespeare, Macbeth

36

37

-12

38

Thanks for your time!!

Damien Amir

Sharon Clarence