Autonomous affective cognition development

(Virtual character)

&

Social dynamic

presenter: Ildar Nurgaliev

/41

Ildar Nurgaliev

What we have at this time?

● Robots that "shows and recognise emotion"

● Virtual affective interaction (Milo - virtual

boy)

● Multimodal social dynamic

1Purpose of development affective

/41

Ildar Nurgaliev

Why we need emotions in the not-living beings?

2Robots

/41

Ildar Nurgaliev

Why we need emotions in the not-living beings?

2Robots

/41

Ildar Nurgaliev

Various virtual agents

1Virtual agents (collaboration)

/41

Ildar Nurgaliev

● Software should provide users with a more human-like interface

● Popular application areas for virtual character

● Like virtual training environment

● Portable personal guides

● Interactive fiction

● Storytelling systems

● E-commerce application in interface of consumer electronics

1

/41

Ildar Nurgaliev

More human like, please.

Develop psychotype 2

/41

Ildar Nurgaliev

People need difer psychotypeThe world expects a differ psychotype

of artificielle emotions,

because people can’t stand by

affectedness(наигранное) behaviour

1Develop psychotype

/41

Ildar Nurgaliev

Basic emotions (Ekman’s model)

Psychologically irreducible

emotion set:

these emotions

cannot be derived by any

other emotion and

new emotions are derived

from them.

Emotion Models and Related Work 2

/41

Ildar Nurgaliev

Mood

2Mood model

Obvious model is the model of a mood as a

simple and unique dimension: good mood

and bad mood.

A more complete approach pro-

posed by Thayer uses emotion spaces to

represent mood in two 2-mensions

(calm/tense and energy/tired ),

resulting in 4 mood emotional states:

Energetic-calm

Energetic-tense

Tired-calm

Tired-tense

/41

Ildar Nurgaliev

Personality: Big OCEAN

In this model, each first letter of OCEAN word defines a

dimension in the personality trait:

● Openness to experience

● Conscientiousness

● Extraversion

● Agreeableness

● Neuroticism

Emotion Models and Related Work

/41

Ildar Nurgaliev

Affective phenomena

Right now we have

- emotion

- mood

- personality

So, emotions are not static. They are experienced by each individual differ-

ently because of characteristics such as personality and mood,

/41

Ildar Nurgaliev

Emotional classifier

/41

Ildar Nurgaliev

Emotional classificator

/41

Ildar Nurgaliev

Temperament

Criterias:

1. General performance of mental activity and human behavior that expressed

in different level of acting in more active way.

2. The motor activity that shows state of the motoric and speech systems.

3. Emotional activity is expressed in the emotional sensibility (susceptibility

and sensitivity to emotional influences).

Temperament

1) sanguine 2) phlegmatic 3)choleric

4)melancholic

Classification of higher nervous system

/41

Ildar Nurgaliev

Temperament

Temperament

● Lots of arousal, but good inhibition:

sanguine.

● Lots of arousal, but poor inhibition:

choleric.

● Not much arousal, plus good inhibition:

phlegmatic.

● Not much arousal, plus poor inhibition:

melancholy

/41

Ildar Nurgaliev

Temperament

Temperament determines the nature of such features for example:

- Balance,

- Adaptability,

- Mobility or behavioral inertia,

- Attitude towards the new,

- Hard work.

However, temperament does not determine character fully.

Temperament

/41

Ildar Nurgaliev

Сlassification of characters

1. Strong-willed (active, purposeful, active)

2. Emotional (acting under the influence of Impulses, feelings)

3. Rational (measuring, everything in terms of reasonableness)

Classification of characters

Jung proposed to classify characters depending on the membership of

1) Extroverted type

2) Intravertirovannyh type

or

1) Dominant

2) Subordinate

/41

Ildar Nurgaliev

PAD temperamental model

●

P

●

Disdainful (

●

P+A

●

P+A+D)

Temperament

● Extraversion = 0.24P +0.72D

● Agreeableness = 0.76P +0.17A

. - 0.19D

● Conscientiousness = 0.29P +0.28D

● Emotional Stability = 0.50P -0.55A

● Sophistication = +0.28A +0.60D

/41

Ildar Nurgaliev

•I want to build an emotional agent, now

–Where do I start?

–Where do I end?

–When did I succeed?•A tree has no emotions•A mosquito has “emotional behavior” in the eye of the emotional beholder (fear, frustration).•A lizard has emotions, although probably only a couple of them (fight, flight, satisfaction)•A grown buffalo has emotions, and probably quite a lot of them (fear, excitement, joy, attraction, satisfaction).

•Agent?

•Emotion?

•Let’s dive into the details…

2Emotion Models and Related Work

/41

Ildar Nurgaliev

Let’s start design

Feasibility study

/41

Ildar Nurgaliev

Let’s start design

Feasibility study

/41

Ildar Nurgaliev

Environment type

Environment type:

➢ Partially observable

➢ Strategic (deterministic except for the actions of other agents)

➢ Sequential ( choice of action in each episode depends not only on the episode

itself)

➢ Semidynamic (environment does not but the agent’s performance score does change with the passage

of time)

➢ Discrete ( Emotional set is closed )

➢ Multyagent

/41

Ildar Nurgaliev

PEAS

Agent design (PEAS)

----------------------------------------------Start of agent design

➢ Performance measure: destinate a point in the environment, do more

communications with other agents,

➢ Environment: is limited and would be any shape without any walls only in

edges.

➢ Actuators: emotional expression (facial expression), registrate noises,

registrate chatting, chat a message to another agent, see, determine the

time, ...

Agent design

/41

Ildar Nurgaliev

Sensors (Eye)

Agent design (Sensors)

➢ Sensor:

○ Eyes with varying width of sign

which depends on emotional state

also.

ps: Visual sensor monitors the surrounding

agents, verifies their visibility, determines their

status.

/41

Ildar Nurgaliev

Sensors (ears)Agent design

Agent design

➢ Sensor:

○ Ears for listening noises.

ps: noise sensor determines the direction and

type of noise, for example, to respond to it.

/41

Ildar Nurgaliev

Sensors (Time sensor)

➢ Sensor:

○ Time sensor.

ps: time sensor needed to perform certain actions

on a schedule, and in order to regulate passed

time at some actions, for example agent can not

speak with one agent while 6 hours.

Agent design

/41

Ildar Nurgaliev

Sensors (message sensor)

➢ Sensor:

○ message sensor.

ps: message sensor allows agent to

exchange messages, report another agent

about him mood (state) and so one.

Agent design

/41

Ildar Nurgaliev Agent embodiment

➢ Agents have faces which

represents differ complex

emotional state: espesially for

debugging

/41

Ildar Nurgaliev

Model of emotion

- Temperament is the steady characteristics.

- On the other side, the emotional state of the agent is the dynamic set of

values which depends on the external influences, and on the agent’s

temperament

Agent design

So we can define emotion as a short episode triggered by an

(internal/external) event composed of

● subjective feelings

● inclinations to act

● facial expressions

● cognitive evaluation and

● physiological arousal.

/41

Ildar Nurgaliev

Emotional agent

Agent embodiment

/41

Ildar Nurgaliev

Component design

Component design

/41

Ildar Nurgaliev

Affective cognitioncomponent design

Agent embodiment

/41

Ildar Nurgaliev

A DUAL LAYER MODEL OF EMOTION

Physiological layer:

Force

Mobility

Steadiness

Emotional receptivity

Psychical layer

Pleasure, Arousal, Dominance (PAD)

Appraisal bank defines the needs, motivations and

stimulus of the agent as a set of subjective measures,

called appraisal dimensions

Agent embodiment

/41

Ildar Nurgaliev

Appraisal bank: BDI agentBeliefs:

● angry agents are dangerous;

● wall collisions are painful;

● happy agents are friendly and nice;

Desires:

● reach the beacon;

● satisfies personal (temperamental) need like necessity

of company of other agents or necessity of loneliness;

● don't get hurt;

Intentions:

● avoid threats (angry agents);

● avoid wall collisions;

● follow happy agents;

Appraisal bank

/41

Ildar Nurgaliev

BDI

/41

Ildar Nurgaliev

Appraisal-results are integrated

where Et is the emotional-state at time t,

Et+1 is the new emotional-state,

n is the number of appraisal banks and

ΔPADti the appraisal-result vector of bank i at time t.

/41

Ildar Nurgaliev

Initialisation state

/41

Ildar Nurgaliev

Initialisation state

/41

Ildar Nurgaliev

Develop agent’s character in society

Virtual agents (collaboration)

/41

Ildar Nurgaliev

Hard evolution of character

1Virtual agents (collaboration)

/41

Ildar Nurgaliev

Develop character

/41

Ildar Nurgaliev

Questions (pleas no)