The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition...
Transcript of The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition...
![Page 1: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/1.jpg)
SSCI Tutorial – December 8th, 2015
The Theory of neuronal Cognition
Professor of Cognitive ScienceAix-Marseille University, F
[email protected]://claude.touzet.org/
Claude TOUZET
![Page 2: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/2.jpg)
Abstract
The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It
explains how a hierarchy of self-organizing maps is able to display
cognitive abilities including consciousness, intelligence, emotions,
planning, reading [2], creativity, motivation, joy [5], etc. TnC explanation
power encompasses modified states of consciousness (placebo effect,
hypnosis, sleep [3]) as well as many mental diseases symptoms and
therapies (such as for Alzheimer's disease, autism or schizophrenia). Of
even more interest for the IEEE SSCI participants is the fact that the
computing requirement of the TnC are limited [1] – because the
processing unit is not the neuron [4], but the cortical column (and there
are only 160,000 cortical columns in the human brain).
![Page 3: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/3.jpg)
1. the cortical column as the elementary unit of cognition,
2. the cortical map as a self-organizing associative memory,
3. the cortex as a hierarchy of maps allowing multi-level abstraction,
4. the synergy between sensory and sensory-motor maps that generates behaviors,
5. the pregnant illusion of consciousness, better described as an automatic verbalization,
6. the relativity of intelligence, better describes as a side effect of the observer knowledge,
7. the implementations of endogenous and exogenous attentions, as also episodic and semantic memories,
8. motivation, or joy, as a side effect of associative memories functioning,
9. the unsupervised nature of homeostasis,
10.the ability to forecast and favor creativity.
![Page 4: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/4.jpg)
1. The cortical column as the elementary unit of cognition
D. Hubel, Eye, Brain, and Vision, Freeman, May 1995. ISBN 978-0-7167-6009-2. http://hubel.med.harvard.edu/book/ch5.pdf
![Page 5: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/5.jpg)
1. The cortical column as the elementary unit of cognition
● Transmission of information (depolarisation) is very fast because the neuron « at rest » is already working (-60 mV).
● The cortical column activity does not exhibit the limitations of single neurons: activation can be sustained for very long periods (sec.) instead of been transient and subject to fatigue.
● 22% of the neurons belong to the cortex. The (human) cortex is composed of about 160,000 cortical columns (a column is a set of about 100,000 neurons), each column belonging to one of the estimated 160 cortical maps (80 are labelized)
![Page 6: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/6.jpg)
2. The cortical map as a self-organizing associative memory
Teuvo Kohonen, Self-Organizing Maps, Springer Series in Information Sciences, Vol. 30, 2001. Third Ed., 501 pages. ISBN 3-540-67921-9, ISSN 0720-678X
![Page 7: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/7.jpg)
W. Penfield, T. Rasmussen, The cerebral cortex of man, Macmillan, 1950.
2. The cortical map as a self-organizing associative memory
![Page 8: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/8.jpg)
● The illusion of semantics
red
Colors map
green
Red triangle Blue circle
Forms map
Forms & colors map
circle
triangle
3. The cortex as a hierarchy of maps allowing multi-level abstraction
![Page 9: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/9.jpg)
3. The cortex as a hierarchy of maps allowing multi-level abstraction
M. Silver and S. Kastner (2009) – Topographic maps in human frontal and parietal cortex, Trends in Cognitive Sciences, Vol. 13, No. 11, 488-495.
![Page 10: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/10.jpg)
Dehaene, S., Cohen, L., Sigman, M., & Vinckier, F. (2005). The neural code for written words: a proposal. Trends Cogn Sci, 9(7), 335-341.
3. The cortex as a hierarchy of maps allowing multi-level abstraction
![Page 11: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/11.jpg)
C. Touzet, A Biologically Plausible SOM Representation of the Orthographic Form of 50,000 French Words, WSOM 2014 (10th Workshop on Self-Organizing Maps), July 2014, Mittweida, G.
3. The cortex as a hierarchy of maps allowing multi-level abstraction
![Page 12: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/12.jpg)
3. The cortex as a hierarchy of maps allowing multi-level abstraction
![Page 13: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/13.jpg)
4. The synergy between sensory and sensory-motor maps that generates behaviors
Khepera (8 IR)
Nomad (16 sonar)
![Page 14: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/14.jpg)
100 learning iterations (16 neurons SOM)
Variations of situations
C. Touzet, "Modeling and Simulation of Elementary Robot Behaviors using Associative Memories", International Journal of Advanced Robotic Systems, Vol 3 n° 2, June 2006.
4. The synergy between sensory and sensory-motor maps that generates behaviors
![Page 15: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/15.jpg)
4. The synergy between sensory and sensory-motor maps that generates behaviors
Synthesizing a sequence of actions respectively to a goal
![Page 16: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/16.jpg)
Immediate synthesis of multiple behaviors: hunting, avoiding, following, ...
But :
Obstacle proche à droite
Obstacle loin à droite
Pas d'obstacle en vue
Obstacle loin devant
Obstacle proche à gauche
Obstacle loin à gauche
Obstacle proche devant
No obstacle in sight
No obstacle in sight
Far obstacle in front
Close obstacle in front
Far obstacle on left
Near obstacle on right
Near obstacle on left
4. The synergy between sensory and sensory-motor maps that generates behaviors
![Page 17: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/17.jpg)
Libet, Benjamin (1985). "Unconscious Cerebral Initiative and the Role of Conscious Will in Voluntary Action". The Behavioral and Brain Sciences 8: 529–566.
5. The pregnant illusion of consciousness, better described as an automatic verbalization
![Page 18: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/18.jpg)
● Feral childs, critical periods of development
Years
5. The pregnant illusion of consciousness, better described as an automatic verbalization
![Page 19: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/19.jpg)
Heard words = speech
verbalize = enunciate
● Baby-sitting
● internal voice
● speech
5. The pregnant illusion of consciousness, better described as an automatic verbalization
![Page 20: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/20.jpg)
● Something is (or isn't) « intelligent » depending on the knowledge of the observer.
● Since intelligence is relative, scales such as the IQ do not test or measure « intelligence » but knowledge. Have you already be in such situation (or a similar one) ?
● Comparing the IQ scores of young and senior people is meaningless.
6. The relativity of intelligence, better describes as a side effect of the observer knowledge
![Page 21: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/21.jpg)
a matching of two (until yet unrelated) objects
objet 1
Verbalization
objet 2
relation entre 1 et 2
(b)
objet 1 objet 2
(a)
faible activitéLow activities
A relation between 1 and 2
Object 1 Object 2
Object 2Object 1
6. The relativity of intelligence, better describes as a side effect of the observer knowledge
![Page 22: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/22.jpg)
Hebb learning rule:
"Let us assume that the persistence or repetition of a reverberatory
activity (or "trace") tends to induce lasting cellular changes that add
to its stability.… When an axon of cell A is near enough to excite a
cell B and repeatedly or persistently takes part in firing it, some
growth process or metabolic change takes place in one or both
cells such that A's efficiency, as one of the cells firing B, is
increased."
Donald Hebb, The Organization of Behavior : A Neuropsychological Theory, Wiley, 1949.
● And vice versa...
● A or B alone ?
● Inhibitory neurons ?
● Only known learning rule
● Pure local learning
7. The implementations of endogenous and exogenous attentions, as also episodic and semantic memories
![Page 23: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/23.jpg)
Endogenous attention - top-down
pre-activation
Low level
High level
7. The implementations of endogenous and exogenous attentions, as also episodic and semantic memories
![Page 24: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/24.jpg)
SOM as a regularity detector
Secondary cortex
Primary cortex
Extra-ordinary situations
Very frequent situations
Ordinary situations
Associative cortex
7. The implementations of endogenous and exogenous attentions, as also episodic and semantic memories
![Page 25: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/25.jpg)
Exogenous attention - bottom-up
expected
Low level
High level
unexpected
(1) (2)
« Selecting one aspect of the environment while ignoring other things »
● Prediction
● A-causal backward connections – loops (novelty filter)
7. The implementations of endogenous and exogenous attentions, as also episodic and semantic memories
![Page 26: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/26.jpg)
xy
z
Time
Charles R. Gallistel, The Organization of Learning, MIT Press, 1993.
● Episodic memories: time and space coordinates
● Semantic memories : no coordinates
7. The implementations of endogenous and exogenous attentions, as also episodic and semantic memories
![Page 27: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/27.jpg)
Def.: A behaviour without an explicit (enough) goal
Touzet C (2011) « The Illusion of Joy » In : J. Schmidhuber, K.R. Thórisson, and M. Looks (Eds.) Artificial General Intelligence 2011, Springer LNAI 6830, pp. 357-362.
8. Motivation, or joy, as a side effect of associative memories functioning
(a) (b)
● The smallest common activation pattern between multiple memorized events
is an attractor state.
![Page 28: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/28.jpg)
Evolution of the learning algorithms toward less and less supervision:
Supervised learning (Perceptron, 1959)
Self-organisation (data base, 1977)
Supervised learning (learning base, 1985)
Reinforcement learning (evaluation function, 1994)
Associative memory programming (targets, 2006)
Palimpsest learning (2014)
9. The unsupervised nature of homeostasis
![Page 29: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/29.jpg)
Hebb+:
It takes time to strengthen the synapse. If during this duration,
there is a new activation of one or both of the neurons, the current
modification will stop short to be replaced by the new one.
Therefore, only a modification - no followed too quickly by another
one - is going to be complete.
Since an equilibrium is defined by the fact that the frequency of
changes is particularly low, then the last “action” of the neurons will
be well recorded, and easily replayed next time the situation is
similar. Palimpsest learning favors the emergence of equilibriums
or “homeostasis”.
9. The unsupervised nature of homeostasis
![Page 30: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/30.jpg)
Palimpsest learning explains:
● How well-timed additional information (supervision) help organize
the various cortical maps,
● Why you must climb again on your horse after fall,
● Why a child must repeat until his/her pronunciation is correct.
9. The unsupervised nature of homeostasis
![Page 31: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/31.jpg)
10. The ability to forecast and favor creativity
Def.: the proposal of something new and valuable.
Forecast:
● Self-organization through experience of the high-level cortical maps, and
improvement by repetitions.
● Continuity of the representation of the events on –at least– one cortical
map.
● SOM trajectories allow predictions.
Favor:
● Thinking outside the box: multidisciplinarity, regular changes of topics.
![Page 32: The Theory of neuronal Cognition - COnnecting REpositories · The Theory of neuronal Cognition (TnC) was formalized in 2010 [6]. It ... Donald Hebb, The Organization of Behavior :](https://reader033.fdocuments.in/reader033/viewer/2022052923/5f0431df7e708231d40cc808/html5/thumbnails/32.jpg)
References
● Touzet C (2015) "The Theory of Neural Cognition applied to Robotics", Int J Adv Robot Syst 12:74 | doi: 10.5772/60693.
● Touzet C, Kermorvant C, Glotin H (2014) "A Biologically Plausible SOM Representation of the Orthographic Form of 50,000 French Words", in: Villmann, Th., Schleif, F.-M., Kaden, M., Lange, M. (Eds.) Advances in Self-Organizing Maps and Learning Vector Quantization, Springer AISC 295:303-312.
● Touzet C (2014) Hypnosis, Sleep, Placebo: the answers from the Theory of neuronal Cognition – Tome 2, Ed. la Machotte, 166 pages. (in French) ISBN: 978-2-919411-02-3.
● Touzet C (2013) "Why Neurons are Not the Right Level of Abstraction for Implementing Cognition", in A. Chella, R. Pirrone, K. Jóhannsdóttir, R. Sorbello (Eds.) Biologically Inspired Cognitive Architectures 2012, AISC196:317-318.
● Touzet C (2011) "The Illusion of Joy", in J. Schmidhuber, K.R. Thórisson, and M. Looks (Eds.) Artificial General Intelligence 2011, Springer-Verlag LNAI 6830:357–362.
● Touzet C (2010) Consciousness, Intelligence, Free-will: the answers from the Theory of neuronal Cognition, Ed. la Machotte, 156 pages. (in French) ISBN: 978-2-919411-00-9