The GLAIR Cognitive Architecture
description
Transcript of The GLAIR Cognitive Architecture
cse@buffal
o
The GLAIR Cognitive Architecture
Stuart C. Shapiro and Jonathan P. BonaDepartment of Computer Science & Engineering
Center for Cognitive ScienceState University of New York at Buffalo
[email protected]@buffalo.edu
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 2
cse@buffal
o
Grounded Layered Architecture with Integrated Reasoning
• Major Concern:– Knowledge Representation and Reasoning
• Driving Motivation:– Natural Language Understanding & Generation
• Additional Concern:– Agents that act
• Question:– Where do beliefs come from?
• Partial Answer:– Agent’s being embodied– Agent’s being situated in the world
BICA 2009 Shapiro & Bona 3
cse@buffal
o
Shapiro & Bona
BICA 2009 4
KL
PMLa
PMLb
PMLc
SAL
Mind
BodyIndependentof lower-body
implementation
Hearing
Vision
Motion
Speech WORLD
I/P s o c k e t s
GLAIR Architecture
Dependenton lower-bodyimplementation
Proprioception
cse@buffal
o
Sensori-Actuator Layer
• Sensor and effector controllers
BICA 2009Shapiro & Bona 5
cse@buffal
o
Perceptuo-Motor Layer
• PMLa• PMLb• PMLc
BICA 2009Shapiro & Bona 6
cse@buffal
o
PMLc
• Abstracts sensors & effectors• Body’s behavioral repertoire
BICA 2009Shapiro & Bona 7
cse@buffal
o
PMLb
• Translation & Communication– Between PMLa & PMLc
• Highest layer that knows body implementation
BICA 2009Shapiro & Bona 8
cse@buffal
o
PMLa• Grounds KL symbols
– Perceptual structures– Implementation of primitive actions
• Registers for Embodiment & Situatedness– Deictic Registers– Modality Registers
BICA 2009Shapiro & Bona 9
cse@buffal
o
The Knowledge Layer• Implemented in SNePS• Agent’s Beliefs• Representations of conceived of entities• Semantic Memory• Episodic Memory• Quantified & conditional beliefs• Plans for non-primitive acts• Plans to achieve goals• Beliefs re. preconditions & effects of acts• Policies: Conditions for performing acts• Self-knowledge• Meta-knowledge
BICA 2009 Shapiro & Bona 10
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 11
cse@buffal
o
SNePS
• A KRR system• Every non-atomic expression is simultaneously
– An expression of SNePS logic– An assertional frame– A propositional graph
• Every SNePS expression is a term– Denoting a mental entity
BICA 2009Shapiro & Bona 12
cse@buffal
o
Ontology of Mental Entities• Entity
– PropositionAgent can believe it or its negationIncludes quantified & conditional beliefs
– ActAgent can perform it
– PolicyCondition-act rule agent can adopt
– ThingOther entities: individuals, categories, properties, etc.
BICA 2009Shapiro & Bona 13
cse@buffal
oPolicies
Reasoning Acting• Forward Reasoning
whendo(φ, α)wheneverdo(φ, α)
• Backward Reasoningifdo(φ, α)
BICA 2009Shapiro & Bona 14
cse@buffal
o
Types of Acts I• External Acts
affect the environmentsupplied by agent designer
• Mental Actsaffect the knowledge layerbelieve, disbelieveadopt, unadopt
• Control Actssequence, selection, loop, etc.
BICA 2009 Shapiro & Bona 15
cse@buffal
o
Types of Acts II
• Primitive ActsImplemented in PMLa
• Composite ActsStructured by control acts
• Defined ActsDefined by ActPlan(α, p) belief
BICA 2009Shapiro & Bona 16
cse@buffal
oActing Reasoning
Control Actssnif({if(φ1, α1), …, if(φn, αn), [else(δ)]})
sniterate({if(φ1, α1), …, if(φn, αn), [else(δ)]})
withsome(x, φ(x), α(x), [δ])
withall(x, φ(x), α(x), [δ])
BICA 2009Shapiro & Bona 17
cse@buffal
o
Goal Talk
GoalPlan(φ, p)
achieve(φ)
BICA 2009Shapiro & Bona 18
cse@buffal
o
Shapiro & Bona
Behavior CycleEnglish
(Statement, Question, Command) (Current) Set of Beliefs
(Updated) Setof BeliefsActions(New Belief)
English sentence expressingnew belief answering question reporting actions
Answer
NL Analysis
NL Generation
ReasoningClarification DialogueLooking in World
Reasoning
BICA 2009 19
cse@buffal
o
Outline
Overview
Integration of Acting and Reasoning
Symbol Grounding
BICA 2009Shapiro & Bona 20
cse@buffal
o
Shapiro & Bona
Entities, Terms, Symbols, Objects
• Agent’s mental entity: a person named Stu
• SNePS term: B4
• Object in world:
21BICA 2009
cse@buffal
o
Shapiro & Bona
AlignmentMind (KL)
Body (PML/SAL)
World
KL term
PML structure
Object/Phenomenon Action
BICA 2009 22
cse@buffal
o
Deictic Registers
For being situated in the worldPML registers hold KL terms
I term denoting agentYOU term denoting dialogue partnerNOW term denoting current time
BICA 2009Shapiro & Bona 23
cse@buffal
o
Modality Registers
For privileged first-person knowledge of what agent is doing
Register for each modality holdsKL term denoting act modality is engaged in
BICA 2009Shapiro & Bona 24
cse@buffal
o
Building Episodic Memory
BICA 2009Shapiro & Bona 25
KL
PML
e1
I
a1 b1
!
t1 e2
a2
!
t2
!
NOWCOUNT n
hom0
q!
before afterevent eventtime
time
time
act act
agent
agent
duration
ACT
cse@buffal
o
For More DetailsSee the Paper
BICA 2009 Shapiro & Bona 26
cse@buffal
o
BICA 2009Shapiro & Bona 27
Collaborators
Past and present members ofSNeRG: The SNePS Research Grouphttp://www.cse.buffalo.edu/sneps/