1 Approaches to dialogue Peter KühnleinHannes Rieser.

Post on 19-Jan-2016

213 views 0 download

Transcript of 1 Approaches to dialogue Peter KühnleinHannes Rieser.

1

Approaches to dialogue

Peter Kühnlein Hannes Rieser

2

Approaches to dialogue

Peter Kühnlein Hannes Rieser

http://129.70.104.40/TCD

3

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro

14:45

4

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro

14:45 Dialogue

Games I

5

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

14:45 Dialogue

Games I

6

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

14:45 Dialogue

Games I

Dialogue Games III

7

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

14:45 Dialogue

Games I

Dialogue Games III

8

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

9

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

Plan-based

Accounts II

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

10

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

Plan-based

Accounts II

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

Plan-based Accounts III

11

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

Plan-based

Accounts II

Plan-based Accounts IV

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

Plan-based Accounts III

12

Approaches to dialogue

Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

Dialogue Macro

Games

Plan-based

Accounts II

Plan-based Accounts IV

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

Plan-based Accounts III

Intentions in Dialogue I

13

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

14:45

14

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

14:45 Intentions in Dialogue III

15

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

14:45 Intentions in Dialogue III

16

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

17

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

Coordina-tion in

Dialogue III

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

18

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

Coordina-tion in

Dialogue III

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

Psycholin-guistics of Dialogue I

19

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

Coordina-tion in

Dialogue III

Psycholin-guistics of Dialogue II

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

Psycholin-guistics of Dialogue I

20

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

Coordina-tion in

Dialogue III

Psycholin-guistics of Dialogue II

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

Psycholin-guistics of Dialogue I

Psycholin-guistics of Dialogue III

21

Approaches to dialogue

Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

Coordina-tion in Dialogue I

Coordina-tion in

Dialogue III

Psycholin-guistics of Dialogue II

Discussion: Comparing Frame-works

14:45 Intentions in Dialogue III

Coordina-tion in

Dialogue II

Psycholin-guistics of Dialogue I

Psycholin-guistics of Dialogue III

Discussion: Comparing Frame-works

22

Approaches to dialogue

Acknowledgements

23

We thank the ERASMUS staff exchange programfor a grant.

Approaches to dialogue

24

We thank our colleagues from the computer sciencedepartment for the VR pictures.

Approaches to dialogue

25

We thank Trinity College Dublin for the organization of the seminar.

Approaches to dialogue

26

We thank Carl Vogel for his support.

Approaches to dialogue

27

Approaches to dialogue

28

Approaches to dialogue

Introduction

29

Corpus :22 construction dialogues, 15 to 32 min.15 with screenMaterials: transcripts, videos, speech recordings

Dialogue examples, setting & corpus

Introduction

30

(A)Inst: So, jetzt nimmst du

Well, now you takeCnst: eine Schraube

a screw.Inst: eine <-> orangene mit einem

Schlitz.an <-> orange one with a slit

Cnst: Ja. Yes

Introduction

Dialogue example & situation

31

(A)Inst: So, jetzt nimmst du

Well, now you takeCnst: eine Schraube

a screw.Inst: eine <-> orangene mit einem

Schlitz.an <-> orange one with a slit

Cnst: Ja. Yes

Available Bolts

Introduction

Dialogue example & situation

32

Previous step : highest coordination peak point

Coordination peak points & parts of construction

Introduction

33

0

10

20

30

40

50

60

1 6 11 16

21

26

31

36

41

46

51

56

61

66

71

76

81

86

91

Sufficiently informative propositions

Nu

mb

er o

f co

ntr

ibu

tio

ns

an

d o

f

pro

po

siti

on

s' p

ara

met

ers

Fig. 9: Coordination throughout the dialogue

Coordination throughout the dialogue

Introduction

34

(B)

Inst: Und steckst sie dadurch, also

And you put it through there,

let’s see

Cnst: Von oben.

From the top.

Inst: Von oben, daß also die drei festgeschraubt werden dann.

From the top, so that the three bars get fixed.

Cnst: Ja.

Yes.

Intended Junction

Intended Result

Dialogue example … c'td

Introduction

35

(A)Inst: Well, now you takeCnst: a screw.Inst: an <-> orange one with a slitCnst: Yes.

Dialogue example & situation c'td

Introduction

36

(A)Inst: Well, now you takeCnst: a screw.Inst: an <-> orange one with a slitCnst: Yes.

(B)Inst: And you put it through there, let’s seeCnst: From the top.Inst: From the top, so that the three bars get fixed.Cnst: Yes.

Dialogue example & situation c'td

Introduction

37

What is introduced: (A): object (screw; terminologically round head bolt)(B): direction (screwing bolt into port from designated top of fuselage)

Dialogue example & situation c'td

Introduction

38

What is introduced: (A): object (screw; terminologically round head bolt)(B): direction (screwing bolt into port from designated top of fuselage)

Observations:

1. Cooperativity: Inst and Cnst produce a directive together.

Stages in (A) : Inst starts production of an indirect speech act.Cnst wants to contribute the object-NP.

Similarly in (B): Inst demands a put-through-action.Cnst contributes the direction-AvP.

Dialogue example & situation c'td

Introduction

39

2. Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogueinitiated by Inst and completed by Cnst’s reply.

Dialogue example & situation c'td

Introduction

40

2. Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogueinitiated by Inst and completed by Cnst’s reply.

3. Repair++: Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply.

Motivation for sub-dialogue assumption: (A) and (B) can basically be seen astwo conjoined speech acts etc.; precond., grounding

Dialogue example & situation c'td

Introduction

41

2. Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogueinitiated by Inst and completed by Cnst’s reply.

3. Repair++: Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply.

Motivation for sub-dialogue assumption: (A) and (B) can basically be seen astwo conjoined speech acts etc.; precond., grounding

4. Coordination: Inst and Cnst have to coordinate their grammar. Especially clear from (A).

Cnst continues production (application of rule) of Inst’s.

Dialogue example & situation c'td

Introduction

42

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates.

Dialogue example & situation c'td

Introduction

43

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates

6. Common knowledge of how to produce a stable bolt-nut-combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far.

Dialogue example & situation c'td

Introduction

44

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates

6. Common knowledge of how to produce a stable bolt-nut-combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far.

7. Common knowledge concerning grammar and the speech act interface.

Dialogue example & situation c'td

Introduction

45

8. (A): Underlying intention of Inst’s forms utterance-level intention.intend(Inst, intend(Cnst, take (Cnst, bolt)))

Dialogue example & situation c'td

Introduction

46

8. (A): Underlying intention of Inst’s forms utterance-level intention.intend(Inst, intend(Cnst, take (Cnst, bolt)))

9. Recognition of intention on part of Cnst’s:Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt))))

Dialogue example & situation c'td

Introduction

47

8. (A): Underlying intention of Inst’s forms utterance-level intention.intend(Inst, intend(Cnst, take (Cnst, bolt)))

9. Recognition of intention on part of Cnst’s:Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt))))

10. Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s:

intend(Cnst, take (Cnst, bolt)Similarly for the (B)-case.

Dialogue example & situation c'td

Introduction

48

8. (A): Underlying intention of Inst’s forms utterance-level intention.intend(Inst, intend(Cnst, take (Cnst, bolt)))

9. Recognition of intention on part of Cnst’s:Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt))))

10. Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s:

intend(Cnst, take (Cnst, bolt)Similarly for the (B)-case.

11. Intentions linked to discourse segments Inst’s intention for (A) and (B): object selection and putting

Dialogue example & situation c'td

Introduction

49

12. Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies.

Dialogue example & situation c'td

Introduction

50

12. Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies.

13. Inst and Const know patterns for producing sub-dialogues:

Proposal + repair + reply. Proposal + confirmation of proposal + extension of proposal + reply.

Dialogue example & situation c'td

Introduction

51

12. Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies.

13. Inst and Const know patterns for producing sub-dialogues:

Proposal + repair + reply.

Proposal + confirmation of proposal + extension of proposal + reply.

14. Words that facilitate communication, interaction and

recognition of discourse structure: so/well/let’s see indicating next

step in task

Dialogue example & situation c'td

Introduction

52

Co-operativity, Coordination

Patterns:Speech actsAdjacency pairsRepairs, confirmationSub-dialogues

Intentions:Utterance level intentionsIntentions linked to discourse segments Intention recognition

Summary of observations

Introduction

53

Common knowledge:

Domain

Actions (production of aggregates)

Grammar-speech-act-interface

Patterns for spoken language interaction

Summary of observations c'td

Introduction

54

References

Dialogue (Macro)Games

Start

Levin & Moore (1977): Dialogue Games: Meta-communication structures for Natural Language Interaction. ISI/RR-77-53

Sequel

Mann (1988): Dialogue Games: Convention of Human Interaction. Argumentation 2, 511 – 532

Mann (2002): Dialogue Macro Games

Plan-based Accounts

Start

Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp. 163-200

Sequel

Grosz & Sidner (): Plans for Discourse.

Grosz & Kraus (1993): Collaborative Plans for Group

Activities. Proceedings of IJCAI-93 Vol. 1, pp. 367-373

55

Intentionalist Accounts

Start

Grosz & Sidner (1986): Attention, Intentions, and the Structure of Discourse. Comp. Ling., Vol. 12(3), pp. 175-204

Sequel

Bratman (1999): Shared Intention, Ch.6 in: Faces of Intention, CUP

Plan-based Accounts

Start

Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp. 163-200

Sequel

Litman, D. J., Allen, J., F.:1990, Discourse Processing and Commonsense Plans. Ch. 17 of Cohen, Ph. R et al. Eds, Intentions in Communication. MIT Press, pp. 365 - 388

Grosz & Sidner

References

56

Coordinative Accounts

Clark (1996): Using language, CUP

Psycholinguistics of Dialogue

Garrod & Pickering (to appear): The Interactive Alignment Model: Towards a mechanistic psychology of discourse, Behavioural and Brain Sciences

References