Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus...

43
Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee Alex Rudnicky (Chair) Roni Rosenfeld Jeff Schneider Eric Horvitz (Microsoft Research)
  • date post

    19-Dec-2015
  • Category

    Documents

  • view

    215
  • download

    0

Transcript of Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus...

Page 1: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems

Thesis Proposal

Dan BohusCarnegie Mellon University, January 2004

Thesis CommitteeAlex Rudnicky (Chair)Roni RosenfeldJeff SchneiderEric Horvitz (Microsoft Research)

Page 2: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

2

Problem

Spans most domains and interaction types Has a significant impact on performance

Lack of robustness when faced with understanding errors

Page 3: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

3

An exampleS: Are you a registered user ?U: No I'm not. No [NO I'M NOT NO]S: What is your full name ?U: Adam Schumacher [ATHENS IN AKRON]S: There is an Athens in Georgia and in Greece. Which destination did you want ?U: Neither [NEITHER]S: I'm sorry, I didn't catch that. There is an Athens in Georgia and in Greece. Which

destination did you want ?U: Georgia [GEORGIA]S: A flight from Athens... Where do you want to go ?U: Start over [START OVER]S: Do you really want to start over ?U: Yes [YES]S: What city are you leaving from ?U: Hamilton, Ontario [HILTON ONTARIO]S: Sorry, I'm not sure I understood what you said. Where are you leaving from ?U: Hamilton [HILTON]S: I'm still having trouble understanding you. To go on, I need you to answer the

following question. What city are you leaving from ?U: Toronto [TORONTO]

Page 4: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

4

Some Statistics …

Corrections [Krahmer, Swerts, Litman, Levow]

30% of utterances correct system mistakes 2-3 times more likely to be misrecognized

Semantic error rates

CMU Communicator [CMU] 32%

CU Communicator [CU] 27%

How May I Help You? [AT&T] 36%

Jupiter [MIT] 28%

SpeechActs [SRI] 25%

Page 5: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

5

Significant Impact on Interaction

CMU Communicator

40% 26%

Contain understanding errors

Failed

Multi-site Communicator Corpus [Shin et al]

37%

Failed

sessions

sessions

33%

63%

Page 6: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

6

Outline

ProblemApproach Infrastructure Research Program Timeline & Summary

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 7: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

7

Increasing Robustness …

Increase the accuracy of speech recognition

Assume recognition is unreliable, and create the mechanisms for acting robustly at the dialogue management level

ASR performance increases / demands increase More general

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 8: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

8

Snapshot of Existing Work: Slide 1

Theoretical models of grounding Contribution Model [Clark], Grounding Acts [Traum]

Practice: heuristic rules Misunderstandings

Threshold(s) on confidence scores

Non-understandings

problem : approach : infrastructure : indicators : strategies : decision process : summary

Analytical/Descriptive, not decision oriented

Ad-hoc, lack generality, not easy to extend

Page 9: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

9

Snapshot of Existing Work: Slide 2

Conversation as Action under Uncertainty [Paek and Horvitz]

Belief networks to model uncertainties Decisions based on expected utility, VOI-analysis

Reinforcement learning for dialogue control policies [Singh, Kearns, Litman, Walker, Levin, Pieraccini, Young, Scheffler, etc]

Formulate dialogue control as an MDP Learn optimal control policy from data

Do not scale up to complex, real-world domains

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 10: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

10

A task-independent, adaptive and scalable framework for error recovery in task-oriented spoken dialogue systems

A task-independent, adaptive and scalable framework for error recovery in task-oriented spoken dialogue systems

Research Program: Goals & Approach

Decision making under uncertainty

Approach:

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 11: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

11

1. Error awareness

2. Error recovery strategies

3. Error handling decision process

Three Components

Develop indicators that … Assess reliability of information Assess how well the dialogue is advancing

Develop and investigate an extended set of conversational error handling strategies

Develop a scalable reinforcement-learning based approach for error recovery in spoken dialogue systems

problem : approach : infrastructure : indicators : strategies : decision process : summary

0. Infrastructure

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 12: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

12

Infrastructure

RavenClaw Modern dialog management framework for

complex, task-oriented domains

RavenClaw spoken dialogue systems Test-bed for evaluation

problem : approach : infrastructure : indicators : strategies : decision process : summary

Completed

Completed

Page 13: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

13

RavenClaw

Dialogue Task (Specification)

Domain-Independent Dialogue Engine

RoomLine

Login

Welcome

AskRegistered AskName

GreetUser

GetQuery

DateTime Location Properties

Network Projector Whiteboard

GetResults DiscussResults

user_nameregistered

query

results

RoomLine

Login

AskRegistered

Dialogue Stack

registered: [No]-> false, [Yes] -> true

registered: [No]-> false, [Yes] -> trueregistered: [No]-> false, [Yes] -> trueuser_name: [UserName]

registered: [No]-> false, [Yes] -> trueregistered: [No]-> false, [Yes] -> trueuser_name: [UserName]user_name: [UserName]query.date_time: [DateTime]query.location: [Location]query.network: [Network]

Expectation Agenda

Error HandlingDecision Process

Strategies

Indicators

ExplicitConfirm

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 14: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

14

RavenClaw-based Systems

RoomLine CMU Let’s Go!! Bus Information

System LARRI [Symphony]

TeamTalk [11-741]

Eureka [11-743]

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 15: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

15

0. Infrastructure

1. Error awareness

2. Error recovery strategies

3. Error handling decision process

Three Components

Develop indicators that … Assess reliability of information Assess how well the dialogue is advancing

Develop and investigate an extended set of conversational error handling strategies

Develop a scalable reinforcement-learning based approach for error recovery in spoken dialogue systems

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 16: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

16

Existing Work

Confidence Annotation Traditionally focused on speech recognizer

[Bansal, Chase, Cox, and others]

Recently, multiple sources of knowledge[San-Segundo, Walker, Bosch, Bohus, and others]

Recognition, parsing, dialogue management

Detect misunderstandings: ~ 80-90% accuracy

Correction and Aware Site Detection[Swerts, Litman, Levow and others]

Multiple sources of knowledge Detect corrections: ~ 80-90% accuracy

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 17: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

17

S: Where are you flying from?

U: [CityName={Aspen/0.6; Austin/0.2}]

S: Did you say you wanted to fly out of Aspen?

U: [No] [CityName={Boston/0.8}]

Proposed: Belief Updating

Continuously assess beliefs in light of initial confidence and subsequent events

[CityName={Aspen/?; Austin/?; Boston/?}]

An example:

problem : approach : infrastructure : indicators : strategies : decision process : summary

initial belief+

system action+

user response

updated belief

Page 18: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

18

contents

Belief Updating: Approach

Model the update in a dynamic belief network

C C

systemaction

User response features

t t + 1

problem : approach : infrastructure : indicators : strategies : decision process : summary

C C

systemaction

initial belief updated belief

confidence

correction

contents

confidence

correction

CurrentTop Current2ndCurrent3

rd

Confidence

Yes No

PositiveMarkers

NegativeMarkers

UtteranceLength

Page 19: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

19

0. Infrastructure

1. Error awareness

2. Error recovery strategies

3. Error handling decision process

Three Components

Develop indicators that … Assess reliability of information Assess how well the dialogue is advancing

Develop and investigate an extended set of conversational error handling strategies

Develop a scalable reinforcement-learning based approach for error recovery in spoken dialogue systems

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 20: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

20

Is the Dialogue Advancing Normally?

Locally, turn-level: Non-understanding indicators

Non-understanding flag directly available Develop additional indicators

Recognition, Understanding, Interpretation

Globally, discourse-level: Dialogue-on-track indicators

Summary statistics of non-understanding indicators

Rate of dialogue advance

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 21: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

21

0. Infrastructure

1. Error awareness

2. Error recovery strategies

3. Error handling decision process

Three Components

Develop indicators that … Assess reliability of information Assess how well the dialogue is advancing

Develop and investigate an extended set of conversational error handling strategies

Develop a scalable reinforcement-learning based approach for error recovery in spoken dialogue systems

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 22: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

22

Error Recovery Strategies

Identify Identify and define an extended set of error

handling strategies

Implement Construct task-decoupled implementations of a

large number of strategies

Evaluate Evaluate performance and bring further

refinements

Page 23: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

23

List of Error Recovery Strategies

HelpWhere are we?Start overScratch concept valueGo backChannel establishmentSuspend/ResumeRepeatSummarizeQuit Restart subtask plan

Select alternative planStart overTerminate session / Direct to operator

Local problems(non-understandings)

Global problems(compounded, discourse-level problems)Switch input modality

SNR repairAsk repeat turn

Notify non-understandingExplicit confirm turnTargeted helpWH-reformulationKeep-a-word reformulationGeneric helpYou can say

Ask rephrase turn

problem : approach : infrastructure : indicators : strategies : decision process : summary

User Initiated System Initiated

Explicit confirmationImplicit confirmationDisambiguationAsk repeat conceptReject concept

Ensure that the system has reliable information(misunderstandings)

Ensure that the dialogueon track

Page 24: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

24

List of Error Recovery Strategies

HelpWhere are we?Start overScratch concept valueGo backChannel establishmentSuspend/ResumeRepeatSummarizeQuit Restart subtask plan

Select alternative planStart overTerminate session / Direct to operator

Local problems(non-understandings)

Global problems(compounded, discourse-level problems)Switch input modality

SNR repairAsk repeat turn

Notify non-understandingExplicit confirm turnTargeted helpWH-reformulationKeep-a-word reformulationGeneric helpYou can say

Ask rephrase turn

problem : approach : infrastructure : indicators : strategies : decision process : summary

User Initiated System Initiated

Explicit confirmationImplicit confirmationDisambiguationAsk repeat conceptReject concept

Ensure that the system has reliable information(misunderstandings)

Ensure that the dialogueon track

Page 25: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

25

Error Recovery Strategies: Evaluation

Reusability Deploy in different spoken dialogue systems

Efficiency of non-understanding strategies Simple metric: Is the next utterance understood? Efficiency depends on decision process Construct upper and lower bounds for efficiency

Lower bound: decision process which chooses uniformly Upper bound: human performs decision process (WOZ)

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 26: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

26

0. Infrastructure

1. Error awareness

2. Error recovery strategies

3. Error handling decision process

Three Components

Develop indicators that … Assess reliability of information Assess how well the dialogue is advancing

Develop and investigate an extended set of conversational error handling strategies

Develop a scalable reinforcement-learning based approach for error recovery in spoken dialogue systems

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 27: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

27

Dialogue control ~ Markov Decision Process States Actions Rewards

Previous work: successes in small domains NJFun [Singh, Kearns, Litman, Walker et al]

Problems Lack of scalability Once learned, policies are not reusable

Previous Reinforcement Learning Work

problem : approach : infrastructure : indicators : strategies : decision process : summary

S1

S2

S3A

Page 28: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

28

Proposed Approach

Overcome previous shortcomings:

1. Focus learning only on error handling Reduces the size of the learning problem Favors reusability of learned policies Lessens the system development effort

2. Use a “divide-and-conquer” approach Leverage independences in dialogue

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 29: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

29

Gated Markov Decision Processes

RoomLine

Login

Welcome

AskRegistered AskName

GreetUser

user_nameregistered

GatingMechanism

Concept-MDP Concept-MDP

Topic-MDP

Topic-MDP

Topic-MDP

Small-size models Parameters can be tied across

models Easy to design initial policies

Decoupling favors reusability of policies

Accommodate dynamic task generation

Independence assumption

problem : approach : infrastructure : indicators : strategies : decision process : summary

No Action

Explicit Confirm

No Action

No Action

No Action

ExplicitConfirmation

Page 30: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

30

Reward structure & learning

Gating Mechanism

MDP MDP MDP

Action

Global, post-gate rewardsReward

Gating Mechanism

MDP MDP MDP

Action

Local rewards

Reward Reward Reward

Rewards based on any dialogue performance metric

Atypical, multi-agent reinforcement learning setting

Multiple, standard RL problems

Model-based approaches

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 31: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

31

Evaluation

Performance Compare learned policies with initial heuristic

policies Metrics

Task completion Efficiency Number and lengths of error segments User satisfaction

Scalability Deploy in a system operating with a sizable task Theoretical analysis

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 32: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

32

Outline

Problem Approach Infrastructure Research Program Summary & Timeline

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 33: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

33

Overall Goal: develop a task-independent, adaptive and scalable framework for error recovery in task-oriented spoken dialogue systems

Modern dialogue management framework Belief updating framework Investigation of an extended set of error handling

strategies Scalable data-driven approach for learning error

handling policies

Summary of Contributions

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 34: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

34

Timelineproposal

milestone 1

milestone 2

milestone 3

defense

end ofyear 4

end ofyear 5

now

5.5 years

Data collection forbelief updating and

WOZ study

Develop andevaluate the

belief updatingmodels

Implementdialogue-on-track

indicators

Misunderstanding and

non-understandingstrategies Investigate

theoreticalaspects ofproposed

reinforcementlearningmodel

Evaluatenon-understandingstrategies; develop

remaining strategies

Error handlingdecision process:

reinforcementlearning

experiments

Data collection forRL training

Data collection forRL evaluation

data indicators strategies decisions

Contingencydata collection

efforts

Additional experiments: extensions or

contingency work

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 35: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

35

Thank You!

Questions & Commentscommittee members,

then floor

Page 36: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

36

Indicators: Goals

Goal: Increase awareness and capacity to detect problems Develop indicators which can inform the error

handling process about potential problems

Understandingprocess

System acquiresinformation

System does not acquire information

Non-understanding

System acquirescorrect information

System acquiresincorrect informationMisunderstanding

OK

Page 37: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

37

problem : approach : support work : indicators : strategies : decision process : summary

Year 4 Year 5 Year 6 Spring’04 Summer’04 Fall’04 Winter’04-05 Spring’05 Summer’05 Fall’05 Winter 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Ex

pe

rim

en

ts

Data Collection and Experiments

BDC: Background Data Collection

[5] – 4 months DC-1: Data collection for belief updating and non-understanding strategies evaluation WOZ: Wizard-of-oz experiment for non-understanding strategies

BDC: Background Data Collection

[9] – 3 months DC-2L: Data collection for decision process training and baselines

[11] – 2 m DC-2E: Data collection for decision process evaluation

[14] – 6 months Contingency (or extension work items) data collections / experiments

Belief Updating (Work Item 5)

[6] – 5 months Build and evaluate belief updating models, integrate in RavenClaw

Ind

ica

tors

Non-understanding and Dialogue-On-Track Indicators (Work Item 6)

[7] – 3 months Implement dialogue-on-track indicators

Str

ate

gie

s

Error prevention and recovery strategies (Work Item 8)

[1] – 4 months - Finish RavenClaw implementations for the misunderstanding and non-understanding strategies

[4] – 6 months - Evaluate non-understanding strategies in random exploration mode and in a WOZ setting - Develop the rest of the error handling strategies

[15] – 6 months Refinements of the proposed model, follow-up work for evaluating adaptability and reusability of policies

De

cis

ion

P

roc

es

s Decision Process:

Reinforcement Learning Work (Work Item 9)

[2] – 12 months Investigate more the theoretical aspects of the proposed RL model, establish final structure for the topic and concept MDPs, design initial policies, and finalize structure for gating function. Implement the models in the RavenClaw dialogue management framework.

[10] – 6 months Perform reinforcement learning experiments/evaluation for the decision process

[16] – 6 months (Contingency time) Alternative data-driven models

[13] – 3 months Write decision process paper

Wri

tin

g

Writing

[3] – 3 months Write paper on RavenClaw conversational strategies for error handling

[8] – 3 months Write belief updating paper

[12] – 10 months Write thesis document

1 2 3 4 5 6 M1 8 9 10 11 M2 13 14 15 16 17 M3 19 20 21 22 23 24

Page 38: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

38

Three Desired Properties

Task-Independence Reuse the proposed architecture across different spoken

dialogue systems with a minimal amount of authoring effort

Adaptability Learn from experience how to adapt to the characteristics of

various domains

Scalability Applicable in spoken dialogue systems operating with large,

practical tasks

Page 39: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

39

HC

ExplConf

ImplConf

NoAct

LC

ExplConf

ImplConf

NoAct

MC

ExplConf

ImplConf

NoAct

0NoAct

Page 40: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

40

Belief Updating: Approach

Model the update in a dynamic belief network

C C

SystemAction

User response features

YesNo

CurrentTop Current2ndCurrent3

rd

Confidence

PositiveMarkers

NegativeMarkers

UtteranceLength

t t + 1 Top-N values Fixed structure Learn parameters

Data collection

Evaluation Accuracy Soft-error

problem : approach : infrastructure : indicators : strategies : decision process : summary

C C

SystemAction

CurrentTop Current2ndCurrent3

rd

ConfidenceYes

No

PositiveMarkers

NegativeMarkers

UtteranceLength

Page 41: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

41

Gated Markov Decision Processes

Issues: Structure of individual MDPs Gating mechanism Reward structure and learning

problem : approach : infrastructure : indicators : strategies : decision process : summary

RoomLine

Login

Welcome

AskRegistered AskName

GreetUser

user_nameregistered

GatingMechanism

Concept-MDP Concept-MDP

Topic-MDP

Topic-MDP

Topic-MDP

No Action

Explicit Confirm

No Action

No Action

No Action

ExplicitConfirmation

Page 42: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

42

Structure for individual MDPs

State-space: informative subset of corresponding indicators Concept-MDPs: confidence / beliefs Topic-MDPs: non-understanding, dialogue-on-

track indicators

Action-space corresponding system-initiated error handling

strategies

problem : approach : infrastructure : indicators : strategies : decision process : summary

Page 43: Error Awareness and Recovery in Task-Oriented Spoken Dialogue Systems Thesis Proposal Dan Bohus Carnegie Mellon University, January 2004 Thesis Committee.

43

Gating Mechanism

Heuristic derived from domain-independent dialogue principles Give priority to topics over concept Give priority to entities closer to the conversational

focus

problem : approach : infrastructure : indicators : strategies : decision process : summary