MEIS 2015 : A Multilayered Model for Artificial Intelligence of Game Character as Agent Architecture

A Multilayered Model for

Artificial Intelligence of Game Character

as Agent Architecture*

Youichiro Miyake @miyayou https://www.facebook.com/youichiro.miyake

y.m.4160@gmail.com

2016.9.26 (Sat)

@Nishijin Plaza Kyushu University

http://mcg.imi.kyushu-u.ac.jp/meis2015/

Summary

• I am a game developer in game industry for more than 10 years.

• My research is focused on AI in digital game.

• There are some mathematical structures in AI.

• I want to show it in talk…

Contents

1. Introduction

2. Agent Architecture

3. Blackboard Architecture

4. Agent Architecture with Blackboard architecture

5. Subsumption Architecture

6. MODERN AGENT Architecture for A game Character

7. Umwelt

8. Hierarchical structure / commutative diagram / Homomorphism in Agent Architecture

9. Summary

INTRODUCTION

Introduction

• From classical AI to modern AI.

• It means from scripted AI to autonomous AI.

Navigation AI

Meta-AI

Character AI

Dynamic allocation of enemies Observing level in real-time Direction for agents Making progress of game

Autonomous thinking Cooperation Team AI

Preparing data to make meta-AI and character AI recognize the level Managing object representation Managing Navigation data Path-finding / Tactical point analysis

Support

Enemy character

Player

Information Acquisition

Control

http://dear-croa.d.dooo.jp/download/illust.html

http://www.kaiyodo.co.jp/revoltech/yamaguchi_2012.html

Contents

1. Introduction

7. Umwelt

9. Summary

AGENT ARCHITECTURE

Technological Innovation

The Industrial Revolution

Information Revolution

Network Revolution

Intelligence Revolution

Automation

Computerization

Networked

Intelligent

The 2nd Industrial Revolution

Motorization

1750 1860 1960 1990 Now…

Into “Intelligent” Wolrd

Society and AI

Generation

Poppulation

ageing society with fewer children Robot and AI will support ageing society with fewer children

Intelligent Game System

Game System Intelligent

Game System

Digital Games also has become intelligent. So, what is “Intelligent Game System” ?

What is digital game ?

• Interactive Digital Space

• The space becomes structured.

• AI becomes a module

The System of digital game AI

• A role of AI in digital game become clear.

• There are three roles of AI.

AI to control a whole game system

AI of character (Character’s Brain)

AI to recognize an environment in game by analyzing a level, terrain, and space.

Meta AI

Character AI

Navigation AI

Two Axis to categorize AI • The problem of “What is AI” is very difficult problem. • We had better know what problem AI is seeking to resolve.

Space Scale

Time Scale

Local Short time

Global timeless

Global Long time

Meta-AI

Character AI

Navigation AI

Meta-AI

Character AI

Dynamic allocation of enemies Observing level in real-time Direction for agents Making progress of game

Autonomous thinking Cooperation Team AI

Preparing data to make meta-AI and character AI recognize the level Managing object representation Managing Navigation data Path-finding / Tactical point analysis

Support

Enemy character

Player

Information Acquisition

Control

http://dear-croa.d.dooo.jp/download/illust.html

Environment and Character

Environment

Character

Character has interactions with an environment.

Environment

Character

IN PUT

Environment

Character

IN PUT

OUT PUT

Environment

Character Intelligence

IN PUT

OUT PUT

Intelligence

Sensor

Information Flow

Effector

Agent Architecture

Game World

（Environment/Level）

Five senses

Language

Knowledge Representation

Knowledge Making

Decision Making

Motion Making

Information Flow

Memory Internal Cyclic Information Flow

Sensor

Effector

Intelligence

Agent Architecture

Information Flow

• Information flow connects the outer (environment) and the inner(=intelligence).

• This is caused by mental activity to organize the inner mind’s dynamics.

Information Flow

Internal Cyclic Information Flow

Making AI is achieved by designing Information flow. In actually, there are many information flow inside a mind.

Contents

1. Introduction

7. Umwelt

9. Summary

BLACKBOARD ARCHITECTURE

Blackboard

Arbiter

Bruce Blumberg , Damian Isla, "Blackboard Architectures", AI Game Programming Wisdom (Charles River Media) , 2002

Blackboard Architecture (Knowledge-based AI)

Each KS (Knowledge Source) has special knowledge for a problem. KS read and write information on Blackboard. Arbiter controls all of KS.

All KSs communicate with each other via Blackboard.

Hierarchical Blackboard

Primitive data

Analyzed data

More analyzed data

Erman et Al. The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty, ACM Computing Surveys (CSUR) Surveys Homepage archive Volume 12 Issue 2, June 1980, Pages 213-253 http://dl.acm.org/citation.cfm?doid=356810.356816

Hierarchical Blackboard (Example)

Hearsay-II Voice Analysis Process

Blackboard

KS (Knowledge Source)

Blackboard Arbiter

PARAMETER

SYLLABLE

SEGMENT

Contents

1. Introduction

7. Umwelt

9. Summary

AGENT ARCHITECTURE WITH BLACKBOARD ARCHITECTURE

Game World

Five senses

Language

Knowledge Making

Decision Making

Motion Making

Information Flow

Sensor

Effector

Intelligence

Agent Architecture

Agent Architecture applied Blackboard Architecture

Blackboard

Modularization has advantage of game development, because each module can be developed and improved independently. And it becomes easy to add a module in the development. More intelligent creature has more intelligent modules in its architecture.

Blackboard in Agent Architecture gives scalability and customizability.

Contents

1. Introduction

7. Umwelt

9. Summary

SUBSUMPTION ARCHITECTURE

Subsumption Architecture

INPUT OUTPUT

Abstraction (verbalizing)

Reactive

More Abstract thinking

Theoretical thinking

Abstract thinking

primitive stimuli becomes language

Making a body action Making a behavior

Classical : Central domain All processes of intelligent modules are executed in sequence.

Subsumption : parallel & layered All processes of intelligent modules are executed in parallel.

Rodney Brooks, A robust layered control system for a mobile robot Robotics and Automation, IEEE Journal of (Volume:2 , Issue: 1 ) 1986

Roomba (iRobot)

http://www.irobot.com/en/us/learn/home/roomba.aspx

Roomba has a subsumption architecture.

INPUT OUTPUT

Reactive

When a robot sees an object, It turns around.

INPUT OUTPUT

Reactive

When a robot sees an object, and Sees a cliff on the side It stops turning and gets back .

INPUT OUTPUT

Reactive

Abstract thinking

R When a robot hears a sound, It stops anyway by stopping all motions.

INPUT OUTPUT

Reactive

Abstract thinking

When a robot cleans all rooms, It goes to energy station.

INPUT OUTPUT

Abstraction (verbalizing)

Reactive

Abstract thinking

primitive stimuli becomes language

Making a body action Making a behavior

Agent Architecture applied subsumption architecture.

Game World

Five senses

Language

Knowledge Making

Decision Making

Motion Making

Information Flow

Sensor

Effector

Intelligence

Agent Architecture

Game World

Five senses

Language

Knowledge Making

Decision Making

Motion Making

Memory

Sensor

Effector

Agent Architecture

Hierarchical Recognition

Synthesis of motions

Knowledge Making

Decision Making

Motion Making

Knowledge Making

Decision Making

Motion Making

Game World

Five senses

Language

Knowledge Making

Decision Making

Motion Making

Memory

Sensor

Effector

Agent Architecture

Knowledge Making

Decision Making

Motion Making

Knowledge Making

Decision Making

Motion Making

Game World （Environment/Level）

Five senses

Language

Knowledge Making

Decision Making

Motion Making

Memory

Sensor

Effector

Agent Architecture

Knowledge Making

Decision Making

Motion Making

Knowledge Making

Decision Making

Motion Making

Distributed Layered

Architecture ＝

References

http://people.csail.mit.edu/brooks/publications.html

Contents

1. Introduction

6. Modern Agent Architecture for A game Character

7. Umwelt

9. Summary

MODERN AGENT ARCHITECTURE FOR A GAME CHARACTER

身体の反射レベル

Decision-Making

Physical Informat

Abstract Informat

More Abstract Informat

Abstraction

Decision-Making

Multi-Layered Blackboard

Abstraction

Reduction

Sensor Effector

World Dynamics

Artificial Intelligence

Decision-Making

Physical Informat

Abstract Informat

More Abstract Informat

Abstraction

Decision-Making

Multi-Layered Blackboard

Abstraction

Reduction

Sensor Effector

World Dynamics

Abstraction

Reduction

Object

Object image on the lowest layer (Umwelt)

Object image on the second layer

Object image on the third

Object image on the top

Sensor Effector

Abstraction

Reduction

Object

Sensor Effector

Information Flow

Contents

1. Introduction

7. Umwelt (Environment World)

8. Hierarchical structure / commutative diagram / Homomorphism in agent architecture

9. Summary

UMWELT

Umwelt

• “Umwelt” means a subjective world which a living thing has.

• “Umwelt” depends on its ecology.

Umwelt

Jakob Johann Baron von Uexkül, Adolf Portmann, Streifzüge durch die Umwelten von Tieren und Menschen, ROWOHLT HAMBURG,1956 http://monoskop.org/Monoskop

Umwelt

A living thing grasps an objects in the world by two hands: functional effectors and perceptual sensors.

Object

Functional Organ (Body = Effector)

Perceptual Organ (Sensor)

Umwelt

Object

A subjective world is created by functional effectors and perceptual sensors.

Umwelt

Object

Each living thing has its different body and sensors.

A subjective world is created by functional effectors and perceptual sensors.

Umwelt

Object

Each living thing has a different subjective world. = Umwelt

Bee’s Umwelt Objective

Bee’s Umwelt

Bees are interested in flowers.

Snail's Umwelt Research

①Put a snails on a ball. ②iterate to push and pull a bar in front of the snails. ③change a frequency of the iteratetion.

Experiment

Result

In 1-3 /sec frequency, a snail did not go to the front, but Over 4 frequency, It went front.

Conclusion

A snails recognize the bar stops over 4 frequency. ＝In snails’ Umwelt, a frequency of sensors is under 4. (Human frequency is about 18.)

Snail's Umwelt Research

A child chicken is tied to a bar with rope and closed in a transparent dome which prevent sound propagation.

Experiment

Result

（Upper） Parent chicken ignored it. （Lawer） Parent chicken went to help a child.

Conclusion

In chicken’s Umwelt, voice is more important rather than visual sensor.

ユクスキュル/クリサート、「生物から見た世界」（岩波文庫）

Abstraction

Reduction

Object

Sensor Effector

Information Flow

Contents

1. Introduction

7. Umwelt (Environment World)

9. Summary

HIERARCHICAL STRUCTURE / COMMUTATIVE DIAGRAM / HOMOMORPHISM IN AGENT ARCHITECTURE

Abstraction

Reduction

Object

Sensor Effector

Information Flow

Real World

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

Image of object Image of body (=self)

R R Representation

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Image of object Image of body (=self)

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

O’’ S’’

Action: f’’

Sense: p’’

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Sequence of Self

Sequence of Object

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Sequence of Self

Sequence of Object

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Sequence of Self

Sequence of Object

“Self” is a sequence of selfs. “Object” is a sequence of objects.

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Sequence of Self

Representation

• “Representation” is essential concept of AI.

• “Knowledge Representation” (KR) is representation of knowledge AI uses.

• To transform “real things” to KR is the most basic techniques in AI.

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Sequence of Self

Vector to move Vector to enter

Dude, Where's My Warthog: From Pathfinding to General Spatial Competence, D. Isla, Invited talk, Artificial Intelligence and Interactive Digital Entertainment (AIIDE) 2005 http://naimadgames.com/publications.html

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Killzone 2 Multiplayer Bots Remco Straatman, Tim Verweij, Alex Champandard | Paris Game/AI Conference 2009, Paris, June 2009 http://www.guerrilla-games.com/publications.html

S (Body)

O (Object)

Action: f

Sense: p

Action: f’

Sense: p’

O’’ S’’

Action: f’’

Sense: p’’

Handling Complexity in the Halo 2 AI, D. Isla, GDC 2005 Dude, Where's My Warthog: From Pathfinding to General Spatial Competence, D. Isla, Invited talk, Artificial Intelligence and Interactive Digital Entertainment (AIIDE) 2005 http://naimadgames.com/publications.html

Contents

1. Introduction

7. Umwelt

9. Summary

SUMMARY

Summary

• I am a game developer in game industry for more than 10 years.

• My research is focused on AI in digital game.

• There are some mathematical structures in AI.

• I want to show it in talk…

MEIS 2015 : A Multilayered Model for Artificial Intelligence of Game Character as Agent Architecture

Science

Transcript of MEIS 2015 : A Multilayered Model for Artificial Intelligence of Game Character as Agent Architecture

File MEIS 11

Multilayered mood board

A bending element for isotropic, multilayered and ... · A bending element for isotropic, multilayered and ... Y. Sadeghi et al / A bending element for isotropic, multilayered and

Relocation of Daresbury MEIS to Huddersfield University

Photocurrent Enhancement by Multilayered Porphyrin ...homepages.rpi.edu/~dinolp/publications/19_RPI_ACSAppMatInt_2013_… · Photocurrent Enhancement by Multilayered Porphyrin Sensitizers

Module 1 – Unit 1 Applying ICT in MEIS Policy & Practice ICT Use in MEIS.

Tribological behaviour of multilayered textile … behaviour of multilayered textile ... on the tribological behaviour of multilayered textile composites ... rapier automatic loom

PETROGLIFOS DE MEIS

MEIS Rates Table-2

File MEIS 5 - Jurnal Middle East and Islamic Studies

JEM MEIS INC1920 31407 Marangoni Experiment Inc19/20

File MEIS 4

Multilayered Optical Feedback for Controlling …ijcsn.org/.../Multilayered-Optical-Feedback-for-Controlling-Haptic...Multilayered Optical Feedback for Controlling Haptic Devices ...

Individual Tree Identification from High Resolution MEIS ...

Integrated Multilayered Triboelectric ARTICLE ...engineering.case.edu/centers/afosrcasemuri/sites/engineering.case... · Integrated Multilayered Triboelectric Nanogenerator for Harvesting

MAGNETIC-PLASMONIC MULTILAYERED NANORODS by …

Rev. Vincent L. Parsons Pastor Sr. Vera Meis, C.S.J ...

Multilayered Architecture for PCI Express eVCparadigm-works.com/wp-content/uploads/Multilayered... · 2015-03-19 · Multilayered Architecture for PCI Express eVC. Introduction Layering

Merchandise Exports from India Scheme (MEIS)- …apeda.gov.in/apedawebsite/Announcements/addition.pdf · Merchandise Exports from India Scheme (MEIS)- ... 254. 08013220 Cashew ...

File MEIS 6