Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of...
-
date post
15-Jan-2016 -
Category
Documents
-
view
213 -
download
0
Transcript of Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of...
![Page 1: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/1.jpg)
cse@buff
alo
The GLAIR Cognitive Architecture
Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science & Engineering
Center for Cognitive ScienceState University of New York at Buffalo
[email protected]@buffalo.edu
![Page 2: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/2.jpg)
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 2
![Page 3: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/3.jpg)
cse@buff
alo
Grounded Layered Architecture with Integrated Reasoning
• Major Concern:– Knowledge Representation and Reasoning
• Driving Motivation:– Natural Language Understanding & Generation
• Additional Concern:– Agents that act
• Question:– Where do beliefs come from?
• Partial Answer:– Agent’s being embodied– Agent’s being situated in the world
BICA 2009 Shapiro & Bona 3
![Page 4: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/4.jpg)
cse@buff
alo
Shapiro & Bona
BICA 2009 4
KL
PMLa
PMLb
PMLc
SAL
Mind
BodyIndependentof lower-body
implementation
Hearing
Vision
Motion
Speech WORLD
I/P s o c k e t s
GLAIR Architecture
Dependenton lower-bodyimplementation
Proprioception
![Page 5: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/5.jpg)
cse@buff
alo
Sensori-Actuator Layer
• Sensor and effector controllers
BICA 2009Shapiro & Bona 5
![Page 6: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/6.jpg)
cse@buff
alo
Perceptuo-Motor Layer
• PMLa• PMLb• PMLc
BICA 2009Shapiro & Bona 6
![Page 7: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/7.jpg)
cse@buff
alo
PMLc
• Abstracts sensors & effectors• Body’s behavioral repertoire
BICA 2009Shapiro & Bona 7
![Page 8: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/8.jpg)
cse@buff
alo
PMLb
• Translation & Communication– Between PMLa & PMLc
• Highest layer that knows body implementation
BICA 2009Shapiro & Bona 8
![Page 9: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/9.jpg)
cse@buff
alo
PMLa• Grounds KL symbols
– Perceptual structures– Implementation of primitive actions
• Registers for Embodiment & Situatedness– Deictic Registers– Modality Registers
BICA 2009Shapiro & Bona 9
![Page 10: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/10.jpg)
cse@buff
alo
The Knowledge Layer• Implemented in SNePS• Agent’s Beliefs• Representations of conceived of entities• Semantic Memory• Episodic Memory• Quantified & conditional beliefs• Plans for non-primitive acts• Plans to achieve goals• Beliefs re. preconditions & effects of acts• Policies: Conditions for performing acts• Self-knowledge• Meta-knowledge
BICA 2009 Shapiro & Bona 10
![Page 11: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/11.jpg)
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 11
![Page 12: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/12.jpg)
cse@buff
alo
SNePS
• A KRR system• Every non-atomic expression is simultaneously
– An expression of SNePS logic– An assertional frame– A propositional graph
• Every SNePS expression is a term– Denoting a mental entity
BICA 2009Shapiro & Bona 12
![Page 13: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/13.jpg)
cse@buff
alo
Ontology of Mental Entities• Entity
– PropositionAgent can believe it or its negationIncludes quantified & conditional beliefs
– ActAgent can perform it
– PolicyCondition-act rule agent can adopt
– ThingOther entities: individuals, categories, properties, etc.
BICA 2009Shapiro & Bona 13
![Page 14: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/14.jpg)
cse@buff
alo
PoliciesReasoning Acting
• Forward Reasoningwhendo(φ, α)wheneverdo(φ, α)
• Backward Reasoningifdo(φ, α)
BICA 2009Shapiro & Bona 14
![Page 15: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/15.jpg)
cse@buff
alo
Types of Acts I• External Acts
affect the environmentsupplied by agent designer
• Mental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadopt
• Control Actssequence, selection, loop, etc.
BICA 2009 Shapiro & Bona 15
![Page 16: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/16.jpg)
cse@buff
alo
Types of Acts II
• Primitive ActsImplemented in PMLa
• Composite ActsStructured by control acts
• Defined ActsDefined by ActPlan(α, p) belief
BICA 2009Shapiro & Bona 16
![Page 17: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/17.jpg)
cse@buff
alo
Acting ReasoningControl Acts
snif({if(φ1, α1), …, if(φn, αn), [else(δ)]})
sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})
withsome(x, φ(x), α(x), [δ])
withall(x, φ(x), α(x), [δ])
BICA 2009Shapiro & Bona 17
![Page 18: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/18.jpg)
cse@buff
alo
Goal Talk
GoalPlan(φ, p)
achieve(φ)
BICA 2009Shapiro & Bona 18
![Page 19: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/19.jpg)
cse@buff
alo
Shapiro & Bona
Behavior CycleEnglish
(Statement, Question, Command) (Current) Set of Beliefs
(Updated) Setof Beliefs
Actions(New Belief)
English sentence expressingnew belief answering question reporting actions
Answer
NL Analysis
NL Generation
ReasoningClarification DialogueLooking in World
Reasoning
BICA 200919
![Page 20: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/20.jpg)
cse@buff
alo
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 20
![Page 21: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/21.jpg)
cse@buff
alo
Shapiro & Bona
Entities, Terms, Symbols, Objects
• Agent’s mental entity: a person named Stu
• SNePS term: B4
• Object in world:
21BICA 2009
![Page 22: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/22.jpg)
cse@buff
alo
Shapiro & Bona
AlignmentMind (KL)
Body (PML/SAL)
World
KL term
PML structure
Object/Phenomenon Action
BICA 2009 22
![Page 23: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/23.jpg)
cse@buff
alo
Deictic Registers
For being situated in the worldPML registers hold KL terms
I term denoting agentYOU term denoting dialogue partnerNOW term denoting current time
BICA 2009Shapiro & Bona 23
![Page 24: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/24.jpg)
cse@buff
alo
Modality Registers
For privileged first-person knowledge of what agent is doing
Register for each modality holdsKL term denoting act modality is engaged in
BICA 2009Shapiro & Bona 24
![Page 25: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/25.jpg)
cse@buff
alo
Building Episodic Memory
BICA 2009Shapiro & Bona 25
KL
PML
e1
I
a1 b1
!
t1 e2
a2
!
t2
!
NOW
COUNT n
hom0
q!
before afterevent eventtime
time
time
act act
agent
agent
duration
ACT
![Page 26: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/26.jpg)
cse@buff
alo
For More DetailsSee the Paper
BICA 2009 Shapiro & Bona 26
![Page 27: Cse@buffalo The GLAIR Cognitive Architecture Stuart C. Shapiro and Jonathan P. Bona Department of Computer Science & Engineering Center for Cognitive Science.](https://reader035.fdocuments.in/reader035/viewer/2022062804/56649d2d5503460f94a0426c/html5/thumbnails/27.jpg)
cse@buff
alo
BICA 2009Shapiro & Bona 27
Collaborators
Past and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/