A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

45
A Modified Backpropagati on Learning Algorithm With Added Emotional Coe fficients Qun Dai 2009-04-10

description

A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients. Qun Dai 2009-04-10. Outline. Introduction Related work Motivation The key Idea The authors’ work in this paper Emotional Back Propagation Learning Algorithm EmBP Application To Face Recognition - PowerPoint PPT Presentation

Transcript of A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Page 1: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

A Modified Backpropagation Learning Algorithm

With Added Emotional Coefficients

Qun Dai 2009-04-10

Page 2: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Outline

Introduction Related work Motivation The key Idea The authors’ work in this paper Emotional Back Propagation Learning Algorithm EmBP Application To Face Recognition Experimental Results And Comparison Conclusion

Page 3: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Introduction

Joy, sadness,anger, fear, disgust, and surprise “machines with emotions” A distinctive and challenging fact about human b

eings is a potential for both opposition and entanglement between will, emotion, and reason.

Just as emotions are critical to human behavior, they are equally critical for intelligent machines.

Page 4: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

Perlovsky states that aesthetic emotions are inseparable from every act of perception and cognition…

Emotions play an important role in human decision-making process …

Another researcher Fellous states “For a long time, the ‘cognitive’ has been opposed to the ‘affective’.

Page 5: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

Picard states “In affective computing, we can separately examine functions that are not so easily separated in humans…”

“In principle, we might be able to program a computer to do what a human (or a human brain) does, …”

Cooke suggests that we should make machines think the way that machines should think and not the way we humans think:…

Page 6: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

A number of models addressing emotion have been developed in cognitive science and AI.

Examples of integrated architectures focusing on emotion include the works of Davis and Lewis…

Moffat et al. [26] who examined an emotion model called ACRES, …

Page 7: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

Gratch and Marsella who developed a general computational model of human emotion, emotion and adaptation (EMA) …

Bates proposed a believable agent using a model described by Ortony et al. …

Ushida et al. proposed an emotion model for life-like agents with emotions and motivations.

Page 8: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

El-Nasr et al. proposed a fuzzy logic adaptive model of emotions (FLAME) as a system for generation of emotions in agents.

Gratch described one research effort that begins to address how behavior moderators such as stress and emotion can influence military command and control decision making, …

Page 9: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

Kort et al. suggested a model by which they aim to conceptualize the impact of emotions upon learning…

Poel et al. introduced modular hybrid neural network architecture, called SHAME, for emotion learning.

Doya presented a computational theory on the roles of the ascending neuro-modulatory systems…

Page 10: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

More recent research works proposed the addition of emotions to intelligent agents, thus making them more human-like.

Clocksin explored the issues in memory and affect in connection with possible architectures for artificial cognition.

Martinez-Miranda and Aldea presented a review of some research work done on the inclusion of emotions into intelligent systems…

Page 11: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Related work

Recently, Abu Maria and Abu Zitar proposed and implemented a regular and an emotional agent architecture,…

Gobbini and Haxby proposed a model for distributed neural systems that participate in the recognition of familiar faces,…

Page 12: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Common Question

Perhaps the common question among all these works and also the work that is presented within this paper is as follows: Should we, and can we, develop machines with feelings?

The answer to the first part is yes, we should have emotional and intelligent machines.

The answer to the second part is yes and no.

Page 13: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Motivation

The motivation for the work in this paper comes from our belief that we can have certain human emotions artificially modeled in machines.

The authors choose to model specific emotional parameters with the objective of improving the learning capability of a “nonhuman” system.

Page 14: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Motivation

The authors’ aim in this paper is to model simulated emotions within a simple supervised neural network structure, and to investigate the effect of the added emotional factors on the learning and decision making capabilities of the neural network.

Page 15: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The key idea

They only consider two emotions (anxiety and confidence), which they believe have an effect on learning and decision making in humans.

Page 16: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The authors’ idea

When we learn a new task, the anxiety level is high at the beginning and the confidence level is low. After time, practice and getting positive feedback, the anxiety level decreases while the confidence level increases. Once learning is achieved, we tend to be less anxious and more confident performing a task that we have already experienced. Therefore, anxiety and confidence are two dependent dimensions, where confidence is defined as the negative rate of change of anxiety.

Page 17: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The authors’ work in this paper

In this paper, they propose a new emotional backpropagation (EmBP) learning algorithm based on incorporating two essential emotions (anxiety and confidence) during the processes of learning and decision making.

The distinctive, emotion-related elements of EmBP are twofold. First, there is pattern averaging, which attempts mimicking the tendency for human emotional judgments and preferences to be based on general impressions rather than precise details of the objects being perceived. Second, there are the confidence and anxiety variables, which are influenced by the perceived objects.

Page 18: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The authors’ work in this paper

This paper suggests that these two emotional responses can be successfully simulated and used during the training of a supervised neural network with the purpose of providing more effective learning.

The two emotional variables are dependent on each other, where confidence is measured as the difference between anxiety levels at two different iterations.

Page 19: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The authors’ work in this paper

The novel “emotional” neural network, which is based on EmBP, will be implemented to a facial recognition problem using 400 face images from the Olivetti Research Laboratory (ORL) face database, and a comparison between this network and a conventional BP-based neural network will be provided.

Page 20: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

EMOTIONAL BACK PROPAGATION LEARNING ALGORITHM

Input-Layer Neurons

where and are, respectively, the input and output values of neuron in the input layer.

iXI

i iYI XI

iYI

Page 21: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 22: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Hidden-Layer Neurons

1

1 exp( )hh

YHXH

h hc hb hmXH TP TP TP

1

r

hc hi ii

TP W YI

hb hb bTP W X

hm hm mTP W X m PATX Y

max max,

max max1, 1

( , )x y

PATx y

Y P x y x y

Page 23: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Fig. 2. Input/output configuration of a hidden-layer neuron.

Page 24: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Output-Layer Neurons

1

1 exp( )jj

YJXJ

j jc jb jmXJ TP TP TP

1

l

jc jh hh

TP W YH

jb jb bTP W X

jm jm mTP W X m PATX Y

max max,

max max1, 1

( , )x y

PATx y

Y P x y x y

Page 25: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Fig. 3. Input/output configuration of an output-layer neuron.

Page 26: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The Emotional Backpropagation Parameters

The proposed emotional parameters are the anxiety coefficient ( ) and the confidence coefficient (k).

Page 27: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Assumption 1: The anxiety level is

dependent on the input patterns, where new

patterns cause higher anxiety. During the

first iteration (new task learning), the initial

anxiety coefficient value is set to “1.”

Page 28: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Assumption 2: The anxiety level is dependent on the difference (error) between the actual output of the neural network andthe desired (target) output. This is a kind of feedback that the emotional neural networkuses to measure how successful its learningis. Anxiety decreases with the minimizationof the error.

Page 29: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Assumption 3: The confidence level

increases with the decrease in anxiety level.

During the first iteration (new task learning),

the initial confidence coefficient value is set

to “0.”

Page 30: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Based on the above assumptions, the

anxiety coefficient value is defined as

AvPATY E

1

pN

AvPAT PAT pp

Y Y N

2

1

( )jN

j j p jj

E T YJ N N

0 ik

Page 31: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

The Error BP Calculations

2

1

( )jN

p pj pjj

E T YJ

( )j jYJ f XJ

Page 32: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

For output-layer neurons, a quantity called the error signal is represented by , which is defined inj

( ) ( )j j j jf XJ T YJ

(1 ) ( )j j j j jYJ YJ T YJ

Page 33: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Hidden-to-Output Weight Updating

( ) ( )jh jh jh jhW new W old Wc Wm

[ ( )]jh j h jhWc YH W old

[ ( )]jh j PAT jhWm Y k W old

Page 34: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Input-to-Hidden Weight Updating

1

( )jN

h h jh jj

f XH W

1

(1 )jN

h h h jh jj

YH YH W

( ) ( )hi hi hi hiW new W old Wc Wm

[ ( )]hi h i hiWc YI W old

[ ( )]hi h PAT hiWm Y k W old

Page 35: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

EmBP APPLICATION TO FACE RECOGNITION

Page 36: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 37: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 38: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

EXPERIMENTAL RESULTS AND COMPARISON

Page 39: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 40: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 41: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients
Page 42: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

CONCLUSION

The EmBP-based neural network has been shown to outperform the BP-based neural network in correct face recognition rate and in the significant reduction of the run time (execution) of the trained neural network.

Page 43: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

FUTURE WORK

Further work will focus on exploring different application areas where the proposed “emotional” neural network could be efficiently used.

Additionally, research work will continue exploring other human emotions and investigating the possibilities of simulating them artificially.

Page 44: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

REFERENCES

[1] D. S. Levine, “Neural network modeling of emotion,” Phys. Life Rev., vol. 4, pp. 37–63, 2007.[2] L. I. Perlovsky, “Toward physics of the mind: Concepts, emotions, consciousness,and symbols,” Phys. Life Rev., vol. 3, no. 1, pp. 23–55, Jan. 2006.[3] L. I. Perlovsky, “Integrated emotions, cognition, and language,” in Proc. Int. Joint Conf. Neural Netw., 2006, pp. 1570–1575.[4] D. I. Lewin, “Why is that computer laughing?,” IEEE Intell. Syst., vol. 16, no. 5, pp. 79–81, Sep./Oct. 2001.[5] R. W. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.[6] D. A. Norman, Emotional Design: Why We Love (or Hate) Everyday Things. New York: Basic Books, 2004.[7] J. Yoon, S. Park, and J. Kim, “Emotional robotics based on iT_Media,” in Proc. 30th Annu. Conf. IEEE Ind. Electron. Soc., Busan, Korea, 2004, pp. 3148–3153.[8] K. Boehner, R. DePaula, P. Dourish, and P. Sengers, “How emotion is made and measured,” Int. J. Human-Comput. Studies, vol. 65, pp. 275–291, 2007.

Page 45: A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients

Thanks!Any Qustions?