1 Approaches to dialogue Peter KühnleinHannes Rieser.

1

Approaches to dialogue

Peter Kühnlein Hannes Rieser

2


Peter Kühnlein Hannes Rieser

http://129.70.104.40/TCD

3


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro

14:45

4


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro

14:45 Dialogue

Games I

5


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1

14:00 Intro Dialogue Games II

14:45 Dialogue

Games I

6


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


14:45 Dialogue

Games I

Dialogue Games III

7


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

14:45 Dialogue

Games I

Dialogue Games III

8


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

9


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

Plan-based

Accounts II

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

10


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

Plan-based

Accounts II

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I

Plan-based Accounts III

11


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

Plan-based

Accounts II

Plan-based Accounts IV

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I


12


Schedule

Tue

Feb 25

Wed

Feb 26

Thu

Feb 27

Fri

Feb 28

Sat

Mar 1


Dialogue Macro

Games

Plan-based

Accounts II

Plan-based Accounts IV

14:45 Dialogue

Games I

Dialogue Games III

Plan-based

Accounts I


Intentions in Dialogue I

13


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7

14:00 Intentions in Dialogue II

14:45

14


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7


14:45 Intentions in Dialogue III

15


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7


Coordina-tion in Dialogue I


16


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7




Coordina-tion in

Dialogue II

17


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7



Coordina-tion in

Dialogue III


Coordina-tion in

Dialogue II

18


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7



Coordina-tion in

Dialogue III


Coordina-tion in

Dialogue II

Psycholin-guistics of Dialogue I

19


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7



Coordina-tion in

Dialogue III

Psycholin-guistics of Dialogue II


Coordina-tion in

Dialogue II


20


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7



Coordina-tion in

Dialogue III



Coordina-tion in

Dialogue II


Psycholin-guistics of Dialogue III

21


Schedule

Mon

Mar 3

Tue

Mar 4

Wed

Mar 5

Thu

Mar 6

Fri

Mar 7



Coordina-tion in

Dialogue III


Discussion: Comparing Frame-works


Coordina-tion in

Dialogue II


Psycholin-guistics of Dialogue III

Discussion: Comparing Frame-works

22


Acknowledgements

23

We thank the ERASMUS staff exchange programfor a grant.


24

We thank our colleagues from the computer sciencedepartment for the VR pictures.


25

We thank Trinity College Dublin for the organization of the seminar.


26

We thank Carl Vogel for his support.


27


28


Introduction

29

Corpus :22 construction dialogues, 15 to 32 min.15 with screenMaterials: transcripts, videos, speech recordings

Dialogue examples, setting & corpus

Introduction

30

(A)Inst: So, jetzt nimmst du

Well, now you takeCnst: eine Schraube

a screw.Inst: eine <-> orangene mit einem

Schlitz.an <-> orange one with a slit

Cnst: Ja. Yes

Introduction

Dialogue example & situation

31

(A)Inst: So, jetzt nimmst du

Well, now you takeCnst: eine Schraube

a screw.Inst: eine <-> orangene mit einem

Schlitz.an <-> orange one with a slit

Cnst: Ja. Yes

Available Bolts

Introduction

Dialogue example & situation

32

Previous step : highest coordination peak point

Coordination peak points & parts of construction

Introduction

33

0

10

20

30

40

50

60

1 6 11 16

21

26

31

36

41

46

51

56

61

66

71

76

81

86

91

Sufficiently informative propositions

Nu

mb

er o

f co

ntr

ibu

tio

ns

an

d o

f

pro

po

siti

on

s' p

ara

met

ers

Fig. 9: Coordination throughout the dialogue

Coordination throughout the dialogue

Introduction

34

(B)

Inst: Und steckst sie dadurch, also

And you put it through there,

let’s see

Cnst: Von oben.

From the top.

Inst: Von oben, daß also die drei festgeschraubt werden dann.

From the top, so that the three bars get fixed.

Cnst: Ja.

Yes.

Intended Junction

Intended Result

Dialogue example … c'td

Introduction

35

(A)Inst: Well, now you takeCnst: a screw.Inst: an <-> orange one with a slitCnst: Yes.

Dialogue example & situation c'td

Introduction

36

(A)Inst: Well, now you takeCnst: a screw.Inst: an <-> orange one with a slitCnst: Yes.

(B)Inst: And you put it through there, let’s seeCnst: From the top.Inst: From the top, so that the three bars get fixed.Cnst: Yes.


Introduction

37

What is introduced: (A): object (screw; terminologically round head bolt)(B): direction (screwing bolt into port from designated top of fuselage)


Introduction

38

What is introduced: (A): object (screw; terminologically round head bolt)(B): direction (screwing bolt into port from designated top of fuselage)

Observations:

1. Cooperativity: Inst and Cnst produce a directive together.

Stages in (A) : Inst starts production of an indirect speech act.Cnst wants to contribute the object-NP.

Similarly in (B): Inst demands a put-through-action.Cnst contributes the direction-AvP.


Introduction

39

2. Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogueinitiated by Inst and completed by Cnst’s reply.


Introduction

40


3. Repair++: Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply.

Motivation for sub-dialogue assumption: (A) and (B) can basically be seen astwo conjoined speech acts etc.; precond., grounding


Introduction

41


3. Repair++: Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply.

Motivation for sub-dialogue assumption: (A) and (B) can basically be seen astwo conjoined speech acts etc.; precond., grounding

4. Coordination: Inst and Cnst have to coordinate their grammar. Especially clear from (A).

Cnst continues production (application of rule) of Inst’s.


Introduction

42

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates.


Introduction

43

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates

6. Common knowledge of how to produce a stable bolt-nut-combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far.


Introduction

44

5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates

6. Common knowledge of how to produce a stable bolt-nut-combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far.

7. Common knowledge concerning grammar and the speech act interface.


Introduction

45

8. (A): Underlying intention of Inst’s forms utterance-level intention.intend(Inst, intend(Cnst, take (Cnst, bolt)))


Introduction

46


9. Recognition of intention on part of Cnst’s:Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt))))


Introduction

47



10. Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s:

intend(Cnst, take (Cnst, bolt)Similarly for the (B)-case.


Introduction

48



10. Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s:

intend(Cnst, take (Cnst, bolt)Similarly for the (B)-case.

11. Intentions linked to discourse segments Inst’s intention for (A) and (B): object selection and putting


Introduction

49

12. Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies.


Introduction

50


13. Inst and Const know patterns for producing sub-dialogues:

Proposal + repair + reply. Proposal + confirmation of proposal + extension of proposal + reply.


Introduction

51


13. Inst and Const know patterns for producing sub-dialogues:

Proposal + repair + reply.

Proposal + confirmation of proposal + extension of proposal + reply.

14. Words that facilitate communication, interaction and

recognition of discourse structure: so/well/let’s see indicating next

step in task


Introduction

52

Co-operativity, Coordination

Patterns:Speech actsAdjacency pairsRepairs, confirmationSub-dialogues

Intentions:Utterance level intentionsIntentions linked to discourse segments Intention recognition

Summary of observations

Introduction

53

Common knowledge:

Domain

Actions (production of aggregates)

Grammar-speech-act-interface

Patterns for spoken language interaction

Summary of observations c'td

Introduction

54

References

Dialogue (Macro)Games

Start

Levin & Moore (1977): Dialogue Games: Meta-communication structures for Natural Language Interaction. ISI/RR-77-53

Sequel

Mann (1988): Dialogue Games: Convention of Human Interaction. Argumentation 2, 511 – 532

Mann (2002): Dialogue Macro Games

Plan-based Accounts

Start

Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp. 163-200

Sequel

Grosz & Sidner (): Plans for Discourse.

Grosz & Kraus (1993): Collaborative Plans for Group

Activities. Proceedings of IJCAI-93 Vol. 1, pp. 367-373

55

Intentionalist Accounts

Start

Grosz & Sidner (1986): Attention, Intentions, and the Structure of Discourse. Comp. Ling., Vol. 12(3), pp. 175-204

Sequel

Bratman (1999): Shared Intention, Ch.6 in: Faces of Intention, CUP

Plan-based Accounts

Start

Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp. 163-200

Sequel

Litman, D. J., Allen, J., F.:1990, Discourse Processing and Commonsense Plans. Ch. 17 of Cohen, Ph. R et al. Eds, Intentions in Communication. MIT Press, pp. 365 - 388

Grosz & Sidner

References

56

Coordinative Accounts

Clark (1996): Using language, CUP

Psycholinguistics of Dialogue

Garrod & Pickering (to appear): The Interactive Alignment Model: Towards a mechanistic psychology of discourse, Behavioural and Brain Sciences

References

1 Approaches to dialogue Peter KühnleinHannes Rieser.

Documents

Transcript of 1 Approaches to dialogue Peter KühnleinHannes Rieser.