Counterpropagation NETWORK

17
ABRIL DE 2001 ESCOM I P N 1

Transcript of Counterpropagation NETWORK

Page 1: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 1

Page 2: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 2

CounterPropagation• The CounterPropagation update algorithm

updates a net that consists of a input, hidden and output layer. In this case the hidden layer is called the Kohonen layer and the output layer is called the Grossberg layer. At the beginning of the algorithm the output of the input neurons is equal to the input vector. The input vector is normalized to the length of one. Now the progression of the Kohonen layer starts.

Page 3: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 3

• This means that a neuron with the highest net input is identified. The activation of this winner neuron is set to 1. The activation of all other neurons in this layer is set to 0. Now the output of all output neurons is calculated. There is only one neuron of the hidden layer with the activation and the output set to 1.

Page 4: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 4

• This and the fact that the activation and the output of all output neurons is the weighted sum on the output of the hidden neurons implies that the output of the output neurons is the weight of the link between the winner neuron and the output neurons. This update function makes sense only in combination with the CPN learning function.

Page 5: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 5

Page 6: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 6

Page 7: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 7

Page 8: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 8

Page 9: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 9

Page 10: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 10

Page 11: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 11

Page 12: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 12

Page 13: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 13

Dudas ???

Page 14: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 14

Hasta la próxima !!!

Page 15: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 15

Page 16: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 16

Page 17: Counterpropagation NETWORK

ABRIL DE 2001 ESCOM I P N 17