Timeline Presentation
-
Upload
abdelrahman-al-ogail -
Category
Education
-
view
1.230 -
download
0
description
Transcript of Timeline Presentation
![Page 1: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/1.jpg)
ADAPTIVE INTELLIGENT AGENT IN REAL-TIME STRATEGY GAMES
An Introduction
![Page 2: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/2.jpg)
PROJECT MEMBERS
Omar Enayet
Amr Saqr
Ahmed Atta
Abdelrahman Al-Ogail
Dr. Mostafa Aref
Dr. Ibrahim Fathy
![Page 3: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/3.jpg)
WHY THIS MEETING?
Sponsoring us in MIE competition. Get feedback from business wise industry. Get into business:
Production of a commercial AI Engine for RTS Games.
Embedding the developed AI in a commercial game.
![Page 4: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/4.jpg)
AGENDA
Problem Definition. Project Challenges. Motivations. Objectives. Domain Platform. Project Background
Survey. Approaches. AI Engine Architecture.
Expected Deliverables. Development Tools. Project Time Plan. Web Resources & References.
![Page 5: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/5.jpg)
PROBLEM DEFINITION
Static ScriptsComputer AI relies completely on static scripting techniques.
![Page 6: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/6.jpg)
PROBLEM DEFINITION
Experience LossThe Absence of sharing experience costs a lot.
![Page 7: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/7.jpg)
PROJECT CHALLENGES
PredictabilityComputer Opponent actions easily predicted.
![Page 8: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/8.jpg)
PROJECT CHALLENGES
Non-AdaptabilityComputer Opponent doesn’t adapt to changes in human actions.
![Page 9: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/9.jpg)
PROJECT CHALLENGES - DETAILS
Resource management.
Recognize current situation.
City building.
Reconnaissance.
Learning
AI opponent gets in the same trap repeatedly
Know safe map locations and get away from kill
zones
![Page 10: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/10.jpg)
PROJECT CHALLENGES - DETAILS
More strategies less tactics.
Construct consistent army (solders, tanks,
planes).
Think about reinforcements.
How to retreat.
Setup and detect ambushes.
![Page 11: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/11.jpg)
PROJECT CHALLENGES - DETAILS
Opponent Modeling :
Know how human player attacks and which units
he favors
Does the player rushes ?
Does the player rely on units that require certain
resources?
Does he frequently build a number of critical
structures in a poorly defensive place?
Are his attacks balanced? ( rock, paper, scissors
example)
![Page 12: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/12.jpg)
MOTIVATIONS
InterestedIn Machine Learning
![Page 13: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/13.jpg)
MOTIVATIONS
InterestedIn RTS Games
![Page 14: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/14.jpg)
MOTIVATIONS
MeetsOur Career Ambitions as AI Programmers
![Page 15: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/15.jpg)
OBJECTIVES
Adaptive A.I.Making the Computer Opponent adapt to changes like human do.
![Page 16: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/16.jpg)
OBJECTIVES
Mobile Experience
Making Sharing Experience Possible Among Machines
![Page 17: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/17.jpg)
PLATFORM – NOT CHOSEN
ORTSAn Open-Source RTS Game
![Page 18: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/18.jpg)
PLATFORM – NOT CHOSEN
WargusAn Open-Source RTS Game based in Stratagus Game Engine
![Page 19: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/19.jpg)
PLATFORM – THE CHOSEN ONE
BosWarsAn Open-Source RTS Game based in Stratagus Game Engine
![Page 20: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/20.jpg)
SURVEY
Asking ExpertsAlex Champandard, Eric Kok and more.
Alex Champandard Eric Kok
![Page 21: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/21.jpg)
SURVEY
Reference BookThe Book “AI Game Engine Programming” talks about the drawbacks
in learning and planning in RTS Games.
![Page 22: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/22.jpg)
SURVEY
Recent PapersWe Collected more than 30 papers concerning this field, different in their way of approaching the problem and the techniques used to
solve the problem. Examples of them are above ^
•Adaptive Reinforcement Learning Agents in RTS Games
•Case-based planning and execution for real-time strategy games.
•Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL
![Page 23: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/23.jpg)
APPROACHES - TECHNIQUES
Reinforcement LearningA Sub-Science of Machine Learning.
![Page 24: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/24.jpg)
APPROACHES - TECHNIQUES
Case-Based PlanningPlanning using Case-based reasoning.
![Page 25: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/25.jpg)
APPROACHES - TECHNIQUES
BDI Agents Tech.Beliefs-Desires-Intentions Agents.
![Page 26: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/26.jpg)
TECHNIQUES - SUMMARY
Reinforcement Learning
Case-Based PlanningBDI-Agent Tech.
![Page 27: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/27.jpg)
APPROACHES - LANGUAGES
C++The Main Language our Open Source Game is coded with.
![Page 28: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/28.jpg)
APPROACHES - LANGUAGES
2APLAn Agent-Oriented Language.
![Page 29: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/29.jpg)
APPROACHES - LANGUAGES
LUAA Scripting Language widely used in Video-Games.
![Page 30: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/30.jpg)
AI ENGINE ARCHITECTURE
![Page 31: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/31.jpg)
PROJECT TIME PLAN
Specifying project problem
Survey on recent research
Building background in general Game AI
Searching for open-source platform
Developing UML of BosWars
Building background on Machine Learning techniques
Developing a framework for each technique
Integrating techniques within platform
Testing
Documentation
1-Sep-09 21-Oct-09 10-Dec-09 29-Jan-10 20-Mar-10 9-May-10
![Page 32: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/32.jpg)
EXPECTED DELIVERABLES
Enhanced AI EngineAn AI Engine which makes the computer behavior in the game as
human as possible.
![Page 33: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/33.jpg)
EXPECTED DELIVERABLES
Experimental ResultsComparison of the results of the enhanced AI Engine with ordinary
static AI.
![Page 34: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/34.jpg)
Visual Studio 2008 Professional Edition
2APL Environment C++ Libraries : Boost, Guichan ..etc.
DEVELOPMENT TOOLS
![Page 35: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/35.jpg)
Project Blog : http://rtsairesearch.wordpress.com/
SVN Repository : https://mzrtaiengine.googlecode.com/svn/trunk/
WEB RESOURCES
![Page 36: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/36.jpg)
Book : AI Game Engine Programming Book : Artificial Intelligence for Games The Most Important Papers/Theses :
Thanks
REFERENCES
•Eric Kok - Adaptive Reinforcement Learning Agents in RTS Games –– Master Thesis – University of Utrecht - 2008
•Santi Onta˜n´on, Kinshuk Mishra, Neha Sugandh, and Ashwin Ram. Case-basedplanning and execution for real-time strategy games. In Proceedings of ICCBR - 2007 - 2007
•Manu Sharma, Michael Holmes, Juan Carlos Santamaria, Arya Irani, Charles Lee Isbell Jr., Ashwin Ram: Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL. IJCAI 2007: 1041-1046
![Page 37: Timeline Presentation](https://reader036.fdocuments.in/reader036/viewer/2022062515/5480bf6ab4af9f161e8b4578/html5/thumbnails/37.jpg)
WEB REFERENCES
http://gadgets.softpedia.com/news/US-Soldiers-Will-be-Half-Robots-Half-Human-by-2015-1334-01.html
http://www.france24.com/en/20090205-sciences-usa-robot-future-american-army-videogame-soldiers-machine