ARTIFICIAL NEURAL NETWORK -...

18
ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining Ericks

Transcript of ARTIFICIAL NEURAL NETWORK -...

Page 1: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ARTIFICIAL NEURAL NETWORK -BACKPROPAGATIONUniversitas Gunadarma – Konsep Data Mining

Ericks

Page 2: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

JARINGAN ANN

Page 3: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ALGORITMA BACKPROPAGATIONInisialisasi semua bobot dengan bilangan acak dengan interval [0,1].

Hitung semua keluaran di unit Hidden Zj.

Hitung dengan fungsi aktivasi :

Page 4: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ALGORITMA BACKPROPAGATIONHitung semua keluaran jaringan di Output node Yk.

Hitung dengan fungsi aktivasi :

Page 5: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ALGORITMA BACKPROPAGATIONHitung Error yang terjadi pada Output node.

Hitung suku perubahan bobot Wkj :

Page 6: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ALGORITMA BACKPROPAGATIONHitung faktor δ unit tersembunyi berdasarkan error di setiap Hidden node (Zj).

Faktor δ unit tersembunyi :

Page 7: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ALGORITMA BACKPROPAGATIONHitung suku perubahan bobot Vij.

Perubahan bobot yang menuju output node :

Perubahan bobot menuju hidden node :

Page 8: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

JARINGAN ANN

Page 9: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

DATA AWAL

X1 = 1, X2 = 0, X3 = 1, Output (Otarget) = 1

Inisialisasi bobot awal secara acak.V14 = 0.15 V24 = 0.42 V34 =

0.45V15 = 0.32 V25 = 0.11 V35

= 0.88W46 = 0.28 W56 = 0.26

Page 10: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – OUTPUT NODE 4Hitung Hidden Node

Neuron 4Znet_1 = X1 * V14 + X2 * V24 + X3 * V34

= 1 * 0.15 + 0 * 0.42 + 1 * 0.45= 0.6

Z1 = = 0.6457

Page 11: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – OUTPUT NODE 5Hitung Hidden Node

Neuron 5Znet_2 = X1 * V15 + X2 * V25 + X3 * V35

= 1 * 0.32 + 0 * 0.11 + 1 * 0.88= 1.2

Z2 = = 0.7686

Page 12: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – OUTPUT NODE 6Hitung Output Node

Neuron 6Ynet_1 = Z1 * W46 + Z2 * W56

= 0.6457 * 0.28 + 0.7686 * 0.26= 0.180796 + 0.199836= 0.380632

Y1 = = 0.5940

Page 13: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 - ERROR

Hitung nilai Error Output dan Hidden layerNeuron 6Err6 = Y1 * (1 – Y1) * (Otarget - Y1)

= 0.5940 * (1 - 0.5940) * (1 - 0.5940) = 0.0979

Neuron 5Err5 = Z2 * (1 - Z2) * Err6 * W56

= 0.7686 * (1 - 0.7686) * 0.241164 * 0.26 = 0.0112

Neuron 4Err4 = Z1 * (1 – Z1) * Err6 * W46

= 0.6457 * (1 - 0.6457) * 0.241164 * 0.28 = 0.0155

Page 14: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – MODIFIKASI BOBOT

Modifikasi / Hitung Bobot baru

W46 = W46 + Err6 * Z1 = 0.28 + 0.0979 * 0.6457

W56 = W56 + Err6 * Z2= 0.26 + 0.0979 * 0.7686

V14 = V14 + Err4 * X1= 0.15 + 0.0155 * 1

Page 15: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – MODIFIKASI BOBOT

Modifikasi / Hitung Bobot baru

V15 = V15 + Err5 * X1

= 0.32 + 0.0112 * 1

V24 = V24 + Err4 * X2

= 0.42 + 0.0155 * 0

V25 = V25 + Err5 * X2

= 0.11 + 0.0112 * 0

Page 16: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ITERASI 1 – MODIFIKASI BOBOT

Modifikasi / Hitung Bobot baru

V34 = V34 + Err5 * X3

= 0.45 + 0.0112 * 1

V35 = V35 + Err5 * X3

= 0.88 + 0.0112 * 1

Page 17: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

ANN - BACKPROPAGATIONIterasi selesai sampai pada maksimum epoch yang

ditentukan atau Error < Target Error yang ditentukan.

Page 18: ARTIFICIAL NEURAL NETWORK - BACKPROPAGATIONmaukar.staff.gunadarma.ac.id/Downloads/files/44229/...ARTIFICIAL NEURAL NETWORK - BACKPROPAGATION Universitas Gunadarma – Konsep Data Mining

REFERENCESDrs. Jong Jek Siang, MSc, Jaringan Syaraf Tiruan, Bab 7, Penerbit Andi, 2009.