The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham...
-
Upload
clement-grant -
Category
Documents
-
view
216 -
download
0
Transcript of The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham...
![Page 1: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/1.jpg)
The Inner World As a Consequence of Behavioural and
Perceptual Simulation
Germund Hesslow
Birmingham 2003
Faculty of MedicineLund University
![Page 2: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/2.jpg)
Problems of the inner world
• How does the inner world arise?
• What is the function of the inner world?
• Can animals and robots have inner worlds?
![Page 3: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/3.jpg)
The Simulation Hypothesis
1) Behavioural simulation: early stages of an action can occur without causing overt movement.
2) Perceptual simulation: perceptual activity can be elicited within the brain without an external stimulus.
3) Anticipation: simulated perception can be elicited by (simulated) behaviour.
![Page 4: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/4.jpg)
David Hume (1711-76)
![Page 5: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/5.jpg)
Alexander Bain (1818-1903)
![Page 6: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/6.jpg)
Simulation of behaviour: covert, incipient behaviour
’The tendency of the idea of an action to produce the fact, shows that the idea is already the fact in a weaker form. Thinking is restrained speaking or acting.’ (Bain, 1868 p 340)
Analogues: Have the radio on but the volume turned down.Have the car engine running but with no clutch
![Page 7: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/7.jpg)
Hierarchical organisation of action
Draw triangle
Get pen Get paper Draw
Draw horizontal line Draw sloping ….
Contract m brachioradialis Contract ....
![Page 8: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/8.jpg)
Main signal flow
![Page 9: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/9.jpg)
Evidence for covert behaviour
Imaging studies
Lesion studies
Electrophysiology
Behavioural experiments
![Page 10: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/10.jpg)
Covert behaviour – primary motor cortex
Subjects were instructed to imagine forearm flexion¯ extension movements with their right arm.
TMS was applied to the motor cortex on one side, and the MEPs were recorded from the contralateral flexor muscle (biceps brachialis).
Flexion
Extension Extension
Flexion
Fadiga et al. Neuropsychologia, 37:147-158, 1999
![Page 11: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/11.jpg)
Simulation of Perception:sensory reactivation
‘What is the manner of occupation of the brain with a resuscitated feeling of resistance, a smell or a sound? There is only one answer that seems admissible. The renewed feeling occupies the very same parts, and in the same manner, as the original feeling, and no other parts, nor in any other assignable manner. ‘(Bain, 1868, p. 338)
![Page 12: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/12.jpg)
Pain Perception
![Page 13: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/13.jpg)
Phantom pain
![Page 14: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/14.jpg)
Seeing
![Page 15: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/15.jpg)
Imaging
![Page 16: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/16.jpg)
Evidence for perceptual simulation
Behavioural experiments
Imaging studies
Lesion studies
Electrophysiology
![Page 17: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/17.jpg)
Mental rotation
![Page 18: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/18.jpg)
Le Bihan et al. PNAS 90:11802-11805, 1993
MRI signal intensity in visual cortex during external vs imagined stimulus
![Page 19: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/19.jpg)
MRI activity with external and imagined stimulus
Tootell et al, TINS, 2: 174-183, 1998
![Page 20: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/20.jpg)
I am NOT suggesting
That the brain creates an image, a representation or a unified experience of the sensory input or that that image is then inspected to guide behaviour
![Page 21: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/21.jpg)
I AM suggesting
That a complex stimulus can elicit many different behaviours, such as describing the stimulus verbally, pointing towards it, avoiding it, drawing it…
The same is true about an internally generated stimulus.
![Page 22: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/22.jpg)
Anticipation:action-sensation associations
’The succession designated as cause and effect, are fixed in the mind by Contiguity. The simplest activity is where our own activity is the cause. We strike a blow, and there comes a noise and a fracture. … Hardly any bond of association arrives sooner at maturity, than the bond between our own actions and the sensible effects that follow from them.’ (Bain, 1868, p. 427)
![Page 23: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/23.jpg)
Predictable consequence
s1 r1
S2 s2 r2 R2
S1 R1
![Page 24: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/24.jpg)
Anticipation
s1 r1
S2 s2 r2 R2
S1 R1
![Page 25: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/25.jpg)
Tolman & Gleitman (1949) J Exp Psych 39: 810-819.
Anticipation – no maps
![Page 26: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/26.jpg)
Simulation of behavioural chain
S Rs r1 11 1
S Rs r2 22 2
s r3 33 3S R
S Rs r1 11 1
S Rs r2 22 2
s r3 33 3S R
S Rs r1 11 1
S Rs r2 22 2
s r3 33 3S R
Behavioural chain
![Page 27: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/27.jpg)
A B CA B C
D ED E
F G HF G H
LF(G) LF(G) D DRF(G) ERF(G) E
Do we need cognitive maps?
![Page 28: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/28.jpg)
rCBF during Tower of London task
Baker et el., Neuropsychologia. 34:515-26, 1996
![Page 29: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/29.jpg)
Conversation
![Page 30: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/30.jpg)
Talking to oneself
![Page 31: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/31.jpg)
Simulating conversation
![Page 32: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/32.jpg)
Why do motor structures participate in cognitive functions ?
a) Thinking is covert movementb) Abstract actions need similar auxiliary systems
![Page 33: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/33.jpg)
Working Memory as Covert Actions Extended in Time
Predictions:
Working memorya) involves prefrontal and posterior (sensory) cortex
b) utilises the same circuitry as long-term memory
c) is modality and feature specific
![Page 34: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/34.jpg)
Strong points of the simulation hypothesis
• Ontological parsimony: no representations, images …
• No evolutionary leaps: same structures underlying inner world as are used for perception and movement
• Explains relationship between cognitive and motor functions
![Page 35: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/35.jpg)
Problems of the inner world
• How does the inner world arise?
Yes, if their ”brains” can generate their own input
• Can animals and robots have inner worlds?
Inevitable consequence of simulation
• What is the function of the inner world?
By simulation of behaviour and perception
![Page 36: The Inner World As a Consequence of Behavioural and Perceptual Simulation Germund Hesslow Birmingham 2003 Faculty of Medicine Lund University.](https://reader030.fdocuments.in/reader030/viewer/2022032414/56649ee45503460f94bf3be0/html5/thumbnails/36.jpg)
Outline of the simulation hypothesis can be found in Hesslow G (2002) Conscious thought as simulation of behaviour and perception. Trends Cogn
Sci, 6:242-247
Many of the critical ideas can be found in the behaviourist literature, for instance Bain A (1855, 1868) The Senses and the IntellectSkinner BF (1974) About Behaviorism. Knopf, New York
For empirical evidence for covert behaviour, see papers by Jeannerod, e.g.Jeannerod M (1994) The representing brain: Neural correlates of motor intention and imagery.
Behav Brain Sci 17: 187-245
Evidence for simulation of perception is reviewed inKosslyn SM (1994) Image and Brain: The Resolution of the Imagery Debate. MIT Press,
Cambridge
Robot simulationZiemke T, Jirenhed D-A, Hesslow G (2002) Blind adaptive Behavior Based on Internal Simulation of Perception. Technical report HS-IDA-TR-02-001
More information on my website www.mphy.lu.se/avd/nf/hesslow
References