Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New...
Transcript of Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New...
![Page 1: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/1.jpg)
Bayesian modeling of behaviorWei Ji Ma
New York University Center for Neural Science and Department of Psychology
Teaching assistants
Group 1: Anna Kutschireiter: postdoc at University of Bern Group 2: Anne-Lene Sax: PhD student at University of Bristol Group 3: Jenn Laura Lee: PhD student at New York University Group 4: Jorge Menéndez: PhD student at University College London Group 5: Julie Lee: PhD student at University College London Group 6: Lucy Lai: PhD student at Harvard Group 7: Sashank Pisupati: PhD student at Cold Spring Harbor Laboratory
WiFi: • Cosyne2019 Password: lisboa2y9, or • Username: epicsana19, Password: epicsana19 Go to www.cns.nyu.edu/malab/courses.html Download Exercises.pdf (link top right) If you want these slides, also download Slides.pdf
![Page 2: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/2.jpg)
What is your background?
Why are you here?
![Page 3: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/3.jpg)
“The purpose of models is not to fit the data but to sharpen the questions.”
“If a principled model with a few parameters fits a rich behavioral data set, I feel that I have really understood something about the world” — Wei Ji Ma, Cosyne Tutorial, 2019
— Samuel Karlin, R.A. Fisher Memorial Lecture, 1983
![Page 4: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/4.jpg)
From Ma lab survey by Bas van Opheusden, 201703
![Page 5: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/5.jpg)
From Ma lab survey by Bas van Opheusden, 201703
![Page 6: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/6.jpg)
From Ma lab survey by Bas van Opheusden, 201703
![Page 7: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/7.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 8: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/8.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 9: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/9.jpg)
Two kinds of models• Descriptive model: describe the data using a function
with parameters • E.g. neural networks • Danger: arbitrarily throwing parameters at it,
problems with understanding and generalization • Process model: model based on psychological
hypotheses about the process by which a mind makes a decision • Usually few parameters • Interpretable! • Potentially not as powerful
![Page 10: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/10.jpg)
Process models• Signal detection theory
David Heeger lecture notes
![Page 11: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/11.jpg)
Ratcliff 1978
• Drift-diffusion model
![Page 12: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/12.jpg)
A special kind of process model: Bayesian • State of the world unknown to decision-maker
• Uncertainty! • Decision-maker maximizes an objective function
• In categorical perception: accuracy • But could be hitting error, point rewards, survival
• Stronger claim: brain represents probability distributions
![Page 13: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/13.jpg)
Drugowitsch et al., 2016
Stocker and Simoncelli, 2006
Keshvari et al., 2012
![Page 14: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/14.jpg)
Why Bayesian models?
• Evolutionary/normative: Bayesian inference optimizes performance or minimizes cost. The brain might have near-optimized processes crucial for survival.
• Empirical: in many tasks, people are close to Bayesian.
• Bill Geisler’s couch argument:
“It is harder to come up with a good model sitting on your couch than to work out the Bayesian model.”
![Page 15: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/15.jpg)
• Basis for suboptimal models: Other models can often be constructed by modifying the assumptions in the Bayesian model. Thus, the Bayesian model is a good starting point for model generation.
![Page 16: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/16.jpg)
Where does uncertainty come from?
• Noise • Ambiguity
![Page 17: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/17.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 18: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/18.jpg)
![Page 19: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/19.jpg)
Hollow-face illusion
David Mack
Why do we see the dragon/the hollow face as convex?
![Page 20: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/20.jpg)
This hypothesis becomes your percept!
Posterior probability
convex concave convex concave
Likelihood how probable are the retinal image is if the hypothesis were true
convex concave
Prior x
how much do you expect the hypothesis based on
your experiences
∝
![Page 21: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/21.jpg)
This hypothesis becomes your percept!
Posterior probability
convex concave convex concave
Likelihood how probable are the retinal image is if the hypothesis were true
convex concave
Prior x
how much do you expect the hypothesis based on
your experiences
∝
![Page 22: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/22.jpg)
This hypothesis becomes your percept!
Posterior probability
convex concave convex concave
Likelihood how probable are the retinal image is if the hypothesis were true
convex concave
Prior x
how much do you expect the hypothesis based on
your experiences
∝
![Page 23: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/23.jpg)
Anamorphic illusion by Kurt Wenner
• Where is the ambiguity? • What role do priors play? • What happens if you view with
two eyes, and why?
![Page 24: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/24.jpg)
![Page 25: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/25.jpg)
Prioroverobjectsp(s)
Likelihoodoverobjectsgiven2DimageL(s)=p(I|s)
KerstenandYuille,2003
![Page 26: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/26.jpg)
Prioroverobjectsp(s)
Likelihoodoverobjectsgiven2DimageL(s)=p(I|s)
KerstenandYuille,2003
![Page 27: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/27.jpg)
Examples of priors: • Convex faces are more common than concave ones • Priors at the object level (Kersten and Yuille) • Light usually comes from above (Adams and Ernst) • Slower speeds are more common (Simoncelli and Stocker) • Cardinal orientations are more common (Landy and
Simoncelli)
![Page 28: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/28.jpg)
Take-home messages from these illusions: • Illusions are not just “bugs in the system”, they may be the
product of an inference machine trying to do the right thing. • “Wrong” percepts can often be traced back to a prior.
![Page 29: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/29.jpg)
Bayesian models are about priors
Bayesian models are about: • the decision-maker making the best possible decision
(given an objective function) • the brain representing probability distributions
Fake news
![Page 30: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/30.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 31: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/31.jpg)
OKGo, The writing’s on the wall. Music video by Aaron Duffy and 1stAveMachine
![Page 32: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/32.jpg)
How would a perceptual psychologist describe this kind of percept?
![Page 33: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/33.jpg)
“Spatial or temporal proximity of elements may induce the mind to perceive a collective entity.”
Law of proximity
“Spatial or temporal proximity of elements may induce the mind to perceive a collective entity.”
![Page 34: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/34.jpg)
“Elements that are aligned tend to be grouped together.”
Field, Hayes, Hess
Law of continuity
![Page 35: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/35.jpg)
Law of common fate
“When elements move in the same direction, we tend to perceive them as a collective entity.”
![Page 36: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/36.jpg)
Bayesian account of Gestalt percepts?
Open Case 1 on page 3
![Page 37: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/37.jpg)
The four steps of Bayesian modeling
STEP 1: GENERATIVE MODEL
a) Draw a diagram with each node a variable and each arrow a statistical dependency. Observation is at the bottom.
b) For each variable, write down an equation for its probability distribution. For the observation, assume a noise model. For others, get the distribution from your experimental design. If there are incoming arrows, the distribution is a conditional one.
STEP 2: BAYESIAN INFERENCE (DECISION RULE)
a) Compute the posterior over the world state of interest given an observation. The optimal observer does this using the distributions in the generative model. Alternatively, the observer might assume different distributions (natural statistics, wrong beliefs). Marginalize (integrate) over variables other than the observation and the world state of interest.
b) Specify the read-out of the posterior. Assume a utility function, then maximize expected utility under posterior. (Alternative: sample from the posterior.) Result: decision rule (mapping from observation to decision). When utility is accuracy, the read-out is to maximize the posterior (MAP decision rule).
STEP 3: RESPONSE PROBABILITIES
For every unique trial in the experiment, compute the probability that the observer will choose each decision option given the stimuli on that trial using the distribution of the observation given those stimuli (from Step 1) and the decision rule (from Step 2).
• Good method: sample observation according to Step 1; for each, apply decision rule; tabulate responses. Better: integrate numerically over observation. Best (when possible): integrate analytically.
• Optional: add response noise or lapses.
C
s
x
( ) 0.5p C =
Example: categorization task
( ) ( )2| N ; ,C Cp s C s µ σ=
( ) ( )2| N ; ,p x s x s σ=
( ) ( ) ( ) ( ) ( ) ( ) ( )2 2| | | | ... N ; ,C Cp C s p C p x C p C p x s p s C ds x µ σ σ∝ = = = +∫
( ) ( )2 2 2 21 1 2 2
ˆ 1 when N ; , N ; ,C x xµ σ σ µ σ σ= + > +
p C = 1| x( ) = Prx|s;σ N x;µ1,σ
2 +σ 12( ) > N x;µ2 ,σ 2 +σ 2
2( )( )
STEP 4: MODEL FITTING AND MODEL COMPARISON
a) Compute the parameter log likelihood, the log probability of the subject’s actual responses across all trials for a hypothesized parameter combination.
b) Maximize the parameter log likelihood. Result: parameter estimates and maximum log likelihood. Test for parameter recovery and summary statistics recovery using synthetic data.
c) Obtain fits to summary statistics by rerunning the fitted model. d) Formulate alternative models (e.g. vary Step 2). Compare maximum log
likelihood across models. Correct for number of parameters (e.g. AIC). (Advanced: Bayesian model comparison, uses log marginal likelihood of model.) Test for model recovery using synthetic data.
e) Check model comparison results using summary statistics.
( ) ( )#trials
1
ˆLL log | ;i ii
p C sσ σ=
= ∑
LL*
σ
LL(σ)
World state of interest
Stimulus
Observation
![Page 38: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/38.jpg)
Take-home message from Case 1: With likelihoods like these, who needs priors?Bayesian models are about the best possible decision, not necessarily about priors.
![Page 39: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/39.jpg)
MacKay (2003), Information theory, inference, and learning algorithms, Sections 28.1-2
![Page 40: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/40.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 41: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/41.jpg)
Michel Treisman, Science, 1977
![Page 42: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/42.jpg)
Take-home messages from Case 2: • Likelihoods and priors can compete with each other. • Where priors come from is an interesting question.
![Page 43: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/43.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 44: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/44.jpg)
Fundamental problem of color perception
Color of surface Color of illumination
Retinal observations
Usually not of interest (nuisance parameter)Usually of interest
![Page 45: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/45.jpg)
David Brainard
![Page 46: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/46.jpg)
![Page 47: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/47.jpg)
Light patch in dim illumination
Dark patch in bright illumination Ted Adelson
![Page 48: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/48.jpg)
Take-home messages from Case 3: • Uncertainty often arises from nuisance parameters. • A Bayesian observer computes a joint posterior over
all variables including nuisance parameters. • Priors over nuisance parameters matter!
![Page 49: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/49.jpg)
“The Dress”
![Page 50: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/50.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 51: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/51.jpg)
Demo of sound localization
![Page 52: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/52.jpg)
Step 1: Generative model
![Page 53: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/53.jpg)
Stimulus s
Pro
babi
lity
(freq
uenc
y)
-10 -8 -6 -4 -2 0 2 4 6 8 10
( )( )2
22
2
12
s
s
s
p s eµσ
πσ
−−
=
σs
( )( )2
222
1|2
x s
p x s e σ
πσ
−−=
Pro
babi
lity
(freq
uenc
y)
s
Measurement x
σ
0
a b
s
withµ=0
![Page 54: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/54.jpg)
Step 2: Inference, deriving the decision rule
Prior Likelihood
![Page 55: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/55.jpg)
Does the model deterministically predict the posterior for a given stimulus and given parameters?
![Page 56: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/56.jpg)
![Page 57: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/57.jpg)
Step 3: Response probabilities (predictions for your behavioral experiment)
p s s( )
Decision rule: mapping x→ sBut x is itself a random variable for given s
Therefore is a random variable for given ssSetsize1
Es*ma*onerror0-π π
Setsize8
0-π π sCan compare this to data!!
![Page 58: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/58.jpg)
Take-home messages from Case 4: • Uncertainty can also arise from measurement noise • Such noise is often modeled using a Gaussian • Bayesian inference proceeds in 3 steps. • The final result is a predicted response distribution.
![Page 59: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/59.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 60: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/60.jpg)
Cue combinationBayesian integration (prior x simple likelihood)
Less well known but often more interesting• Complex categorization • Combining information across multiple items (visual search) • Combining information across multiple items and across a
memory delay (change detection) • Inferring a changing world state (tracking, sequential
effects) • Evidence accumulation and learning
Well known
![Page 61: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/61.jpg)
A simple change point detection task
![Page 62: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/62.jpg)
Take-home messages from Case 5: • Inference is often hierarchical. • In such situations, the Bayesian observer marginalizes
over the “intermediate” variables (compare this to Case 3)
![Page 63: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/63.jpg)
Topics not addressed• Lapse rates and response noise • Utility and reward • Partially observable Markov decision processes • Wrong beliefs (model mismatch) • Learning • Approximate inference (e.g. sampling, variational
approximations) • How the brain represents probability distributions
![Page 64: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/64.jpg)
Bayesian models are about: • the decision-maker making the best possible decision
(given an objective function) • the brain representing probability distributions
![Page 65: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/65.jpg)
• This may underlie drivers’ tendency to speed up in the fog (Snowden, Stimpson, Ruddle 1998)
• Possible explanation: lower contrast → greater uncertainty → greater effect of prior beliefs (which might favor low speeds) (Weiss, Adelson, Simoncelli 2002)
• Lower-contrast patterns appear to move slower than higher-contrast patterns at the same speed (Stone and Thompson 1990)
![Page 66: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/66.jpg)
Probabilistic computationDecisions in which the brain takes into account trial-to-trial knowledge of uncertainty (or even entire probability distributions), instead of only point estimates
What does probabilistic computation “feel like”?
Point estimate of stimulus
Uncertainty about stimulus
Decision
![Page 67: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/67.jpg)
Maloney and Mamassian, 2009
Bayesian transfer
Ma and Jazayeri, 2014
Different degrees of probabilistic computation
Does the brain represent probability distributions?
![Page 68: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/68.jpg)
2006 theory, networks
2015 behavior, human fMRI
2017 trained networks
2018 behavior, monkey physiology
2013 behavior, networks
![Page 69: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/69.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 70: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/70.jpg)
a. What to minimize/maximize when fitting parameters? b. What fitting algorithm to use? c. Validating your model fitting method
![Page 71: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/71.jpg)
What to minimize/maximize when fitting a model?
![Page 72: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/72.jpg)
Try #1: Minimize sum squared error
Only principled if your model has independent, fixed-variance Gaussian noise Otherwise arbitrary and suboptimal
![Page 73: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/73.jpg)
Try #2: Maximize likelihood
Output of Step 3: p(response | stimulus, parameter combination)
Likelihood of parameter combination = p(data | parameter combination)
= p responsei stimulusi , parameter combination( )trials i∏
![Page 74: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/74.jpg)
What fitting algorithm to use?
• Search on a fine grid
![Page 75: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/75.jpg)
![Page 76: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/76.jpg)
Parameter trade-offs
Shen and Ma 2017
10 20 30 40 50 60
23456789
10
x 10-3
-700
-650
-600
-550
-500
τ
Log likelihood
DE1, subject #1
Van den Berg and Ma 2018
![Page 77: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/77.jpg)
What fitting algorithm to use?
• Search on a fine grid • fmincon or fminsearch in Matlab
![Page 78: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/78.jpg)
![Page 79: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/79.jpg)
What fitting algorithm to use?• Search on a fine grid • fmincon or fminsearch in Matlab • Bayesian Adaptive Direct Search (Acerbi and Ma 2016)
![Page 80: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/80.jpg)
![Page 81: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/81.jpg)
Validating your method: Parameter recovery
![Page 82: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/82.jpg)
Jenn Laura Lee
![Page 83: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/83.jpg)
Take-home messages model fitting• If you can, maximize the likelihood (probability of
individual-trial responses) if you can. • Do not minimize squared error! • Do not fit summary statistics (instead fit the raw data)
• Use more than one algorithm • Consider BADS when you don’t trust fmincon/fminsearch • Multistart • Do parameter recovery
![Page 84: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/84.jpg)
Model comparison
![Page 85: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/85.jpg)
a. Choosing a model comparison metric b. Validating your model comparison method c. Factorial model comparison d. Absolute goodness of fit e. Heterogeneous populations
![Page 86: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/86.jpg)
a. Choosing a model comparison metric
![Page 87: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/87.jpg)
Try #1: Visual similarity to the data
Shen and Ma, 2016
Fine, but not very quantitative
![Page 88: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/88.jpg)
Try #2: R2
• Just don’t do it • Unless you have only linear models
• Which almost never happens
![Page 89: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/89.jpg)
From Ma lab survey by Bas van Opheusden, 201703
Try #3: Likelihood-based metrics
Good! Problem: there are many!
![Page 90: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/90.jpg)
Metrics based on the full likelihood function (often sampled using Markov Chain Monte Carlo): • Marginal likelihood (model evidence, Bayes’ factor) • Watanabe-Akaike Information criterion
Metrics based on maximum likelihood: • Akaike Information Criterion (AIC or AICc) • Bayesian Information Criterion (BIC)
Cross-validation can be either
![Page 91: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/91.jpg)
Metrics based on prediction: • Akaike Information Criterion (AIC or AICc) • Watanabe-Akaike Information criterion • Most forms of cross-validation
Metrics based on explanation: • Bayesian Information Criterion (BIC) • Marginal likelihoods (model evidence, Bayes’ factors)
![Page 92: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/92.jpg)
Practical considerations: • No metric is always unbiased for finite data. • AIC tends to underpenalize free parameters, BIC
tends to overpenalize. • Do not trust conclusions that are metric-
dependent. Report multiple metrics if you can.
![Page 93: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/93.jpg)
Devkar, Wright, Ma 2015
![Page 94: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/94.jpg)
b. Model recovery
Challenge: your model comparison metric and how you compute it might have issues. How to validate it?
![Page 95: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/95.jpg)
Devkar, Wright, Ma, Journal of Vision, in press
Fitted model
Data generation
modelP
ropo
rtion
cor
rect
0.4 0.6 0.8
1
0.2
Pro
porti
on c
orre
ct
Pro
porti
on c
orre
ct
Change magnitude (º)
30 60 90 30 60 90 30 60 90 0 0 0
VP-SP VP-FP VP-VP
Synthetic VP-SP
-300
-200
-100
0
-500
-200 -100
0
-400 -300
-200
-100 -50
0
-150
VP-SP VP-VP
VP-SP VP-FP
VP-FP VP-VP
Log
mar
gina
l lik
elih
ood re
lativ
e to
VP
-SP
rela
tive
to V
P-E
P re
lativ
e to
VP
-VP
Synthetic VP-FP
Synthetic VP-VP
0.4 0.6 0.8
1
0.2
0.4 0.6 0.8
1
0.2
Both HR Mixed, HR change Mixed, LR change Both LR
30 60 90 30 60 90 30 60 90 0 0 0
30 60 90 30 60 90 30 60 90 0 0 0
A B
Model recovery example
![Page 96: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/96.jpg)
Devkar, Wright, Ma, Journal of Vision, in press
Fitted model
Data generation
modelP
ropo
rtion
cor
rect
0.4 0.6 0.8
1
0.2
Pro
porti
on c
orre
ct
Pro
porti
on c
orre
ct
Change magnitude (º)
30 60 90 30 60 90 30 60 90 0 0 0
VP-SP VP-FP VP-VP
Synthetic VP-SP
-300
-200
-100
0
-500
-200 -100
0
-400 -300
-200
-100 -50
0
-150
VP-SP VP-VP
VP-SP VP-FP
VP-FP VP-VP
Log
mar
gina
l lik
elih
ood re
lativ
e to
VP
-SP
rela
tive
to V
P-E
P re
lativ
e to
VP
-VP
Synthetic VP-FP
Synthetic VP-VP
0.4 0.6 0.8
1
0.2
0.4 0.6 0.8
1
0.2
Both HR Mixed, HR change Mixed, LR change Both LR
30 60 90 30 60 90 30 60 90 0 0 0
30 60 90 30 60 90 30 60 90 0 0 0
A B
![Page 97: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/97.jpg)
Model recovery
Bayes Strong + d noise
Bayes Weak + d n
oise
Bayes Ultraweak + d n
oise
Orientation Estimation
Linear Neural LinQuad
Fixed
model used to generate synthetic data
BayesStrong + d noise
BayesWeak + d noise
BayesUltraweak + d noise
Orientation Estimation
Linear Neural
Lin
Quad
Fixed
fitte
d m
odel
0
25
50
75
6100
" AIC
Adler and Ma, PLoS Comp Bio 2018
![Page 98: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/98.jpg)
c. Factorial model comparison
Challenge: how to avoid “handpicking” models?
![Page 99: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/99.jpg)
• Models often have many “moving parts”, components that can be in or out
• Similar to factorial design of experiments, one can mix and match these moving parts.
• Similar to stepwise regression • References:
• Acerbi, Vijayakumar, Wolpert 2014 • Van den Berg, Awh, Ma 2014 • Shen and Ma, 2017
c. Factorial model comparison
![Page 100: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/100.jpg)
![Page 101: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/101.jpg)
Van den Berg, Awh, Ma 2014
![Page 102: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/102.jpg)
d. Absolute goodness of fit
Challenge: the best model is not necessarily a good model.
![Page 103: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/103.jpg)
Absolute goodness of fit• How close is the best model to the data? • Method 1: Visual inspection (model checking)
Shen and Ma, 2016
![Page 104: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/104.jpg)
d. Absolute goodness of fit• Method 2: Deviance / negative entropy
• There is irreducible, unexplainable variation in the data • This sets an upper limit on the goodness of fit of any
model: negative entropy • How far away is a model from this upper bound? • Wichmann and Hill (2001) • Shen and Ma (2016)
![Page 105: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/105.jpg)
e. Hierarchical model selection
Challenge: what if different subjects follow different models?
(heterogeneity in the population)
![Page 106: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/106.jpg)
• Returns probability that each model is the most common one in a population
• Returns posterior probability for each model • Matlab code available online!
Consider all possible partitions of your population
Neuroimage, 2009
Neuroimage, 2014
![Page 107: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/107.jpg)
Take-home messages model comparison
• There are many metrics for model comparison. • Specialized lab meetings / reading club? • Do due diligence to prevent your conclusions from being
metric-dependent. • Do model recovery • Consider doing factorial model comparison • Quantify absolute goodness of fit if possible • Heterogeneity in population? Hierarchical model selection
![Page 108: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/108.jpg)
Schedule for today
• Why Bayesian modeling • Bayesian explanations for illusions • Case 1: Gestalt perception • Case 2: Motion sickness • Case 3: Color perception • Case 4: Sound localization • Case 5: Change point detection • Model fitting and model comparison • Critiques of Bayesian modeling
12:10-13:10
13:30-14:40
15:00-16:00
likelihoodsprior/likelihood interplay
nuisance parametersmeasurement noise
hierarchical inference
Concept
priors
![Page 109: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/109.jpg)
Critique of Bayesian models: • Prior is hard to get• Inference intractable• Behavior might not be Bayesian • Hard to apply to neural data / make connection to
neural representation • Parametric assumptions in distributions • Learning the structure of the Bayesian model• Scaling to large data sets• Weirdness in distribution (non-Gaussian) • Dynamics
![Page 110: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/110.jpg)
Please help me thank our amazing teaching assistants!
Anna Kutschireiter Anne-Lene Sax Jenn Laura Lee
Jorge Menéndez Julie Lee Lucy Lai
Sashank Pisupati
Organizers: Il Memming Park, Leslie Weekes
![Page 111: Bayesian modeling of behavior - Center for Neural ScienceBayesian modeling of behavior Wei Ji Ma New York University Center for Neural Science and Department of Psychology Teaching](https://reader033.fdocuments.in/reader033/viewer/2022053022/604d19652862990c65268421/html5/thumbnails/111.jpg)
Good job everyone!!