Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A]...

51
Accumulator Models of choice Leendert van Maanen

Transcript of Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A]...

Page 1: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

AccumulatorModelsofchoice

Leendert vanMaanen

Page 2: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 3: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

(Palmeretal,2005JVis)

Two-alternativeforcedchoice(2AFC)task

Page 4: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 5: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 6: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

9.5

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

10.2

Page 7: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 8: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

9.5

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

10.2

Page 9: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Overview

• Oneimplementation:LinearBallisticAccumulator• Estimatingparameters• Relationshipwithneuroscience• Anotherimplementation:The(EZ)diffusiondecisionmodel

Page 10: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Overview

• Oneimplementation:LinearBallisticAccumulator• Estimatingparameters• Relationshipwithneuroscience• Anotherimplementation:The(EZ)diffusiondecisionmodel

Page 11: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Howtoquantifyarace?

• SequentialProbabilityRatioTest(SPRT)• DiffusionDecisionmodel(DDM)(EZdiffusionmodel)• LinearBallisticAccumulatormodel(LBA)• LeakyCompetitiveAccumulatormodel(LCA)• RetrievalbyAccumulatingEvidenceinanArchitecture(RACE/A)• …

Page 12: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

9.5

0 2 4 6 8 10

0

20

40

60

80

100

Tijd (s)

Afs

tand

(m)

10.2

Page 13: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Threshold

Decision time

Start pointDrift

LinearBallisticAccumulator

Threshold

Decision time

Drift distribution

Threshold

Start pointdistribution

Decision time

Page 14: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 15: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Threshold (b)

Decision time

Start pointsampled from

U[0,A]

Decision time

Drift sampled from N(v,s)

Decision time

Response Alternative 1 Response Alternative 2 Response Alternative n...

LinearBallisticAccumulator

• Everyoptionhasitsownaccumulator• Fastestaccumulatorwins(thatoptiongetsselected)

Page 16: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Overview

• Oneimplementation:LinearBallisticAccumulator• Estimatingparameters• Relationshipwithneuroscience• Anotherimplementation:The(EZ)diffusiondecisionmodel

Page 17: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Modelfitting

• Whataretheoptimalparameters• Startpoint• Threshold• Driftrate• Non-decisiontime

• Optimal:Leastunexplainedvariance

Threshold

Decision time

Drift distribution

Start pointdistribution

Page 18: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Drift change

RT (s)

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Threshold change

RT (s)

Page 19: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Drift change

RT (s)

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Threshold change

RT (s)

Page 20: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

(Palmeretal,2005JVis)

Example:effectoftargetlocationin2AFCTarget dTarget d

Page 21: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Example:effectoftargetlocationin2AFC

• Binarychoice• Twoinstructions(blocks):”Focusonspeed”vs“FocusonAccuracy”• Targetlocationvaried

(VanMaanenetal.,2012,FDecNeuro)

Target

Low similarity alternative

�Target

High similarity alternative

Page 22: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Meanresponsetimes

0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6

0.0

0.5

1.0

1.5

Angle (rad)

MR

T (

s)

Participant 1

0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6

0.0

0.5

1.0

1.5

Angle (rad)

MR

T (

s)

Participant 2

0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6

0.0

0.5

1.0

1.5

Angle (rad)

MR

T (

s)

Participant 3

0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6

0.0

0.5

1.0

1.5

Angle (rad)M

RT

(s)

Participant 4

acc

spd

Page 23: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

RT#(ms)

Frequency

0 500 1500

0

20

40

60

80

100

120

Speed AccuracyCorrect Error Correct Error

116�

18�

14�

12�

Page 24: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6

0.6

0.8

1.0

1.2

pi/c(16, 8, 4, 2)

vsDrift

Angle

LBAparameters• Driftrate~angle• Threshold~instruction(speed/accuracy)• Othere parametersdidnotvaryacrossconditions

Threshold

Decision time

Drift distribution

Start pointdistribution

1 2 3 4

accspd

Thre

shol

d (b

) est

imat

e

0100

200

300

400

500

Threshold

Page 25: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

A

Acc

umul

ated

Evi

denc

e

Time

Response threshold

Time of choice

B

Acc

umul

ated

Evi

denc

e

Time

Response threshold

Time of choice

Speedinstruction:Lowerthreshold

OptionA

OptionB

Page 26: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Overview

• Oneimplementation:LinearBallisticAccumulator• Estimatingparameters• Relationshipwithneuroscience• Anotherimplementation:The(EZ)diffusiondecisionmodel

Page 27: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 28: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

LIP

LIP

MT

Page 29: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Decisionmakingnetworkinthebrain

striatum

Page 30: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 31: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Threshold

Decision time

Drift distribution

Start pointdistribution

Forstmann etal2008

Page 32: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Approach

• Fitmodelforindividualparticipants• Estimatetheoptimalsetofparameters

• ExtractaverageBOLDresponseperparticipant/condition• Orotherrelevantneurophysiologicalmeasure

• Dothesecorrelate?

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Drift change

RT (s)

0.0 0.5 1.0 1.5 2.0

0.0

0.5

1.0

1.5

Threshold change

RT (s)

Turneretal(2017)Approachestoanalysesinmodel-basedcognitiveneuroscience.JMP

Page 33: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Forstmann etal(2008)PNAS

Page 34: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative
Page 35: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Overview

• Oneimplementation:LinearBallisticAccumulator• Estimatingparameters• Relationshipwithneuroscience• Anotherimplementation:The(EZ)diffusiondecisionmodel

Page 36: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

(Palmeretal,2005JVis)

Example:effectoftargetlocationin2AFCTarget dTarget d

Page 37: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Target dTarget d(A)

(B)

Page 38: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

B BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

C CA

Four optionsBD

Target dTarget d(A)

(B)

P (Hi|D) =P (D|Hi)P (Hi)Pj P (D|Hj)P (Hj)

Page 39: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

B BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

C CA

Four optionsBD

Target dTarget d(A)

(B)

(A)

(B)

Page 40: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H

|D)

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

B BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

BA

Two options

-3 -2 -1 0 1 2 3

0.05

0.15

0.25

0.35

Direction of motion

Density

C CA

Four optionsBD

Target dTarget d

Target dTarget d

(A)

(B)

(A)(B)

(A)

(B)

(A)

(B)

Page 41: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

SequentialProbabilityRatioTest(SPRT)

• “Optimal”procedureforbinarychoices• Guaranteesminimalmeanresponsetime

• ForaspecificcriticalthresholdP(H|D)

P (Hi|D) =P (D|Hi)P (Hi)Pj P (D|Hj)P (Hj)

0 5 10 15 20

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H|D)

0 5 10 15 20

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H|D)

0 5 10 15 20

0.0

0.2

0.4

0.6

0.8

1.0

Time

P(H|D)

Page 42: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

DiffusionDecisionModel• “implementation”ofSPRT• EvidenceFORoption1=evidenceAGAINSToption2• Bydesignonlyapplicableto2AFC

Airplane

Noise

Page 43: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

DiffusionDecisionModel

Airplane

Noise

Page 44: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Lowerdriftrate

• Slowerresponses(effectislargerintailofRTdistribution)• Moreerrors

Page 45: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

DiffusionDecisionModel

Vliegtuig

Ruis

Airplane

Noise

Page 46: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Lowerthresholds

• Fasterresponses• Moreerrors

Page 47: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

DiffusionDecisionModel

Vliegtuig

Ruis

Airplane

Noise

Page 48: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Lowerstartpoint

• Slowercorrectresponses• Fastererrors• Moreerrors

<- Correct!

<- Error!<- Correct!

<- Error!

Page 49: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Lowernon-decisiontime

• NDT=TSE+TRE• RT=DT+NDT

• Fasterresponses• Nochangeinerrorrate

Page 50: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

EZDiffusionDecisionModel(Thursday)8 WAGENMAKERS, VAN DER MAAS, AND GRASMAN

2004). Many experimental psychologists, even those with a firm background in mathematics and computer pro-gramming, will find the amount of effort required to fit the Ratcliff diffusion model rather prohibitive.

The EZ-diffusion model constitutes an attempt to popu-larize a diffusion model analysis of two-alternative forced choice tasks. In order to achieve this goal, we have consid-erably simplified the Ratcliff diffusion model. These sim-plifications are warranted by the fact that the aim of the EZ model is much more modest than that of the Ratcliff model. The EZ model tries to determine only the most psychologically relevant parameters of the Ratcliff model: drift rate v (i.e., quality of information), boundary separa-tion a (i.e., response conservativeness), and nondecision time Ter. The EZ model does not seek to address the issue of RT distributions, especially not for error responses. Thus, the price that has to be paid for the simplification of the diffusion model is that it no longer provides a very detailed account of the observed behavior, but instead op-erates at a more macroscopic level. Of course, with few data, this may be the only available option. We will return to this issue in the General Discussion section.

The first simplification is that the EZ-diffusion model does not allow across-trials variability in parameters. This means that st, sz, and are effectively removed from the model. The effect of st—that is, the across-trials variabil-ity in Ter—is usually not very pronounced (see Ratcliff & Tuerlinckx, 2002). The effect of sz—that is, across-trials variability in starting point—allows the model to handle error responses that are on average faster than correct re-sponses. The effect of —that is, across-trials variability in drift rate—is to produce error responses that are on average slower than correct responses. From the bird’s-eye perspective taken by the EZ-diffusion model, these aspects of the data are outside the focus of interest.

The second and final simplification is that the starting point z is assumed to be equidistant from the response

boundaries, so that z a/2. As mentioned earlier, in prac-tical applications of the diffusion model this is often found to be approximately true (see Figure 3). For instance, Rat-cliff et al. (2001) had participants decide whether a screen with asterisks came from a “high” or “low” distribution. Since the design of the stimulus materials was symmetric, one would not expect participants to be biased toward ei-ther the “high” or the “low” response category (Ratcliff et al., 2001, p. 332).

In other experiments, however, biases in starting point are more plausible. Consider a hypothetical situation in which participants have an a priori bias to respond “word” to letter strings presented in a lexical decision task. When such a bias exists, the “vanilla” version of the EZ-diffusion model presented here is inappropriate. For-tunately, there exists an easy check for the presence of bias in the starting point: When participants have a start-ing point bias that favors the “word” response in a lexical decision task, this means that for word stimuli the correct responses are faster than the error responses, whereas for nonword stimuli the correct responses are slower than the error responses. Such a pattern of results indicates a bias in starting point, and this bias renders the results from an EZ-diffusion model analysis suspect. In the General Dis-cussion, we will discuss an extension of the EZ-diffusion model that can be applied to situations in which the start-ing point is biased. For now, we will work under the as-sumption that the starting point is equidistant from the response boundaries—that is, that z a/2.

As will soon be apparent, the simplifications above allow the EZ-diffusion model to determine v, a, and Ter without a complicated parameter-fitting exercise. Fig-ure 4 shows the EZ-diffusion model and its streamlined set of parameters.

Before proceeding, we should issue a general disclaimer. Any analysis that involves unobserved variables may lead to misleading results when the hypothesized model radically

T

a

av

s

Figure 4. The EZ-diffusion model.

Correctthreshold/boundary

Errorthreshold/boundary

Aspreparation,readWagenmakers,E.-J.,vanderMaas,H.L.J.,&Grasman,R.P.P.P.(2007). AnEZ-diffusionmodelforresponsetimeandaccuracy. Psychonomic Bulletin&Review,14,3-22

Page 51: Accumulator Models of choice · Threshold (b) Decision time Start point sampled from U[0,A] Decision time Drift sampled from N(v,s) Decision time Response Alternative 1 Response Alternative

Questions?Seeyouonthursday