The ARLearn toolkit for mobile serious games and field-trips

dr. Stefaan Ternier

Open University of the Netherlands

1Friday, November 2, 12

Augmented Reality=

camera + gps + accelerometer

2Friday, November 2, 12

Augmented Reality: Locatory

3Friday, November 2, 12

4Friday, November 2, 12

Senses

• sight• hearing• taste• smell• touch• balance• ....

5Friday, November 2, 12

ARLearn: hearing

6Friday, November 2, 12

7

•Real environment•enriched with virtual objects

•Virtual environment•enriched with virtual objects

Milgram, P. and Kishino, A. F. (1994) Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329.

Friday, November 2, 12

ARLearn Architecture– Serious game engine

• Score• Progress• Team play

– Android and streetview clients

– excursions possible– notification framework– Rich media: video, audio,

multiplechoice questions, ...– location based assignments

and triggers Media8

Friday, November 2, 12

Lifecycle of a media item

9

Invisible

visible

Invisible

dependsOn

disappearOn

Friday, November 2, 12

ARLearn data model

10Friday, November 2, 12

ARLearn dependency model

11Friday, November 2, 12

12

Florence case Amsterdam case Hostage case

Game design

Scavenger game Adventure game Decision game

Delivery Channel

augmented reality augmented virtuality augmented reality

Pedagogic approach

situated learning expository learning learning through decision taking

ARLearn Case studies

Friday, November 2, 12

Cultural Science Fieldtrip in Florence

13Friday, November 2, 12

Lessons Learned

• Choose a location for fieldwork with proper GPS reception

• High buildings, narrow streets :(

• Reserve time for users to make themselves acquainted with the smartphone

• Battery life ~ GPS/network operations

• Balance between automatic start and manual start of audiofragments.

14Friday, November 2, 12

Hostage Simulation: Real World Training for critical situations

15Friday, November 2, 12

Roles / teams

Head of Office - Security Officer - Staff Welfare

a role is performed by a small group with smartphone.

advance organizer for real drill

take decissions / collaborate

16Friday, November 2, 12

17Friday, November 2, 12

18Friday, November 2, 12

Streetlearn: ARLearn streetview client

• cultural heritage case : Amsterdamse grachtengordel

• Unesco site with 100% google streetview coverage• storyboard based on real historic event:

smuggling marihuana from Libanon in early 1970s• Player takes role of Ada Jobse, a police officer

19Friday, November 2, 12

Streetlearn: ARLearn streetview client

20Friday, November 2, 12