General Atari 2600 Game Playing - GeNeura...

General Atari 2600 Game Playing

Michael Bowling

Work with:Joel Veness, Marc Bellemare, Anna Koop, Mostafa Vafadoost

http://www.arcadelearningenvironment.org

Friday, September 14, 2012



Varied

ManyIndependent

Interesting


A.I.

0100010101...00001110101

Reinforcement Learning


A.I.

0100010101...00001110101

Planning


A.I.

Model

Model Learning


A.I.Expert

Imitation/Apprenticeship Learning


A.I.

.

.

.

Transfer Learning

Pitfall!

Pitfall II


A.I.

Intrinsic Motivation


TrainingGames

TestingGames


Contingency Awareness: knowing what you control

(Bellemare et al., AAAI 2012)




UnawareContingency Aware




1.0

0.5

0.0 00.20.40.60.81.0

Inter-Algorithm Score

Frac

tion

of G

ames

Inter-Algorithm Score Distribution

MaxColExtended MaxCol

Basic

Extended


Sketch-Based Hashing:tug-of-war vs. standard hashing

(Bellemare et al., NIPS 2012)

1.0

0.5

0.0 00.20.40.60.81.0

Frac

tion

of g

ames

Inter-algorithm score

Tug-of-War

Standard

Hash Table Size: 10001.0

0.5

0.0 00.20.40.60.81.0

Frac

tion

of g

ames


Tug-of-War

Standard

Hash Table Size: 50001.0

0.5

0.0 00.20.40.60.81.0

Frac

tion

of g

ames


Tug-of-War

Standard

Hash Table Size: 20,000

55 Testing Games


Model Learning:pixels, probabilities, and priors

(Bellemare et al., In Prep)



Questions?

Source code for ALE and all agents available!




Will there be a competition?

No

vs.


General Atari 2600 Game Playing - GeNeura...

Documents

Transcript of General Atari 2600 Game Playing - GeNeura...