CONTENT AND EXPERIENCE OF AUGMENTED REALITY APPLICATIONS IN MUSEUMS AND HERITAGE TOURISM

Contribution from the EduMUST Project

Fekri Hassan

French University in Egypt

ICT-Learn 2017Towards a Smart Learning Society–Cairo Dec 5-6, 2017

The Technology-Content Gap

The proliferation and expansionof Information and CommunicationTechnology applications (ICT) inMuseums and archaeological siteshas advanced much faster thanthe provision of appropriatecontent that takes advantage ofthe new spectacular technologicalinnovations.

AIM

TLC

TLC

Technology Learning Content

Technology Learning Content

Here, Technology is used to enhance the

Learning experience which depends on

the Content transmitted in the learning process.

Enhancement of [Learning] ExperienceOne of the uses of Augmented (AR) and Virtual Reality (VR) in museums and archaeological sites is emerging as a means to enhance visitor’s experience and to gain a competitive edge. However, so far most of the emphasis has been on the technological aspects of this cutting edge technology.

Enhancement of Experience

However, there are other dimensions that must be included if this technology is not to be no more than an “enhancement of experience”.

This leads to the question:What is “Experience”?

audition day is an enjoyable experience for any seven-year old

“an event or occurrence which leaves an impression on someone.”

Emotionality

Experience may thus be expressed in terms of emotional impact.Emotional excitation can be a goal in itself, as in the case of getting a sense of pleasure or experiencing fear or terror. In Museum Education, emotional experiences can be deployed to attract attention to the “information content”.

For example, the attraction to mummies can be used as means to attract viewers to a deeper and enlightening knowledge of the many subjects that can be unlocked through mummies.

One striking example from the Egypt is the Mummy of Tutankhamen

From basic description to Deep (thick) Content

ICT methods can provide not just information on date, material, and affiliation of an “object”.

Many layers of information domains can be un-masked

For example, ICT methods can inform the visitor of the mummification process through augmented reality and animation.

Mummification can be also used to introduce the visitor to ancient Egyptian chemistry through a discussion of the materials used in the mummification process. This can be done in Educational contexts relatedto the school curriculum.

VR can also provide a means by which intangible heritage elements, such as religious belief and mortuary rituals can be explained and appreciated.

The “Icon” of Anubis in the mummification scene, may then lead to the scene of “Judgement” by which more informtioncan be provided by pointing to other icons shown.

This dynamic, interactive display may thus reveal a great deal on Egyptian religion and royal state society. The Mummy of a Pharaoh may be the NODE of information on the life of the Pharaoh. AR can “re-vive” the mummified corpse.

Heritage ICT can also be used to critically engage the viewer in the various constructions

As well as on palaeopathology, family inherited diseases and Egyptian Medicine

It can also lead the viewer to understand the methods used in the study of mummies.

There is also the possibility of revealing royal family connections.

Nefertiti Akhenaten

A mobile application can also be done by guiding the visitor to other objects in the museum.

Or in Other Museums

The Sensory Experiences

The senses are the conduits of experience, and engagement of senses other than the “visual” would provide more intense and poignant experiences. As in evoking the scent of “incense”

How to turn your smartphone into a 'smell phone'Award-winning chef Andoni Luis Aduriz is developing an app to bring the full sensory experience of his cooking to smartphones.The app allows the user to virtually recreate one of his signature dishes which can then be smelt through the use of a device which plugs into the phone.BBC Click's Lara Lewington reports.

The Sensory Experiences

“Reality” may also be augmented by the use of sounds of music from an ancient harp or a flute

Enhancing Experiences through Digital StorytellingOne of the most successful real

world uses of interactive digitalstorytelling is augmented reality (AR),such as that employed to greateffect at the British Museum. Thetechnology transformed the museumexperience for a child into a storypuzzle using a dedicated tablet app.The app sets up a game, A Gift forAthena, which rewards the visitor forfinding certain statues from theiroutlines by telling them more aboutthe exhibit and directing them intothe next stage of the game.

Example: CHESS ProjectCultural Heritage Experiences through Socio-personal interactions and Storytelling

CHESS Project (a shorter name for the much longer CulturalHeritage Experiences through Socio-personal interactions andStorytelling) takes digital storytelling much further and plans tomake interactive content such as games and augmentedreality available to the entire museum sector.

A group-based digital storytelling journey, where visitor-to-visitor engagement takes place under the frame of an interactive, mobile technology-based story. The results suggest not only the potential to cultivate social interaction between individuals using their own mobile devices, but also to generate immediate transcultural and transgenerational understanding and cooperation in situ.

Cultivating mobile-mediated social interaction in the museum: Towards group-based digital storytelling experiencesA. Katifori, S. Perry, M. Vayanou. L.Puiol, A. Chrysanthi, V. Kourtis, Y. Ioannidis

Personalized RecordsThe Mobile Application may also include a means by which selected objects or data can be saved and for sharing photos, memos and “e-cards”.

Case study: Multilayered Experiences-Buxton Museum Example

EU-funded MeSch project is putting physical interaction back at the heart of cultural heritage experiences. By embedding digital content in smart objects, curators, artists and designers can create new experiences in museums that bridge the gap between abundant digital information and fragile physical objects.

MeSch has sidestepped apps with a series of lightweight low-budget MOBILE TOURS that use WordPress and GPS technology to deliver rich experiences on a limited budget.

The coming generations of museum-goers are going to bring with them some kind of intimate personal technology.

personalised layers of interpretation about objects to discover and create new ways of exploring the museum.

Indoor-OutdoorNew applications allow the visitor to connect museum objects with outdoor archaeological or historical sites, as in connecting the Mask of Tutankhamen or his other treasures to his tomb in the Valley of the kings.

Museum Visitor may also experience a virtual tour of the tomb

Augmented Reality may also allow the visitor to “experience” the moment of discovery

If the Archaeological site is close the Museum, the visitor may be directed to go for a “Real” walk following an outdoor Itinerary (the reverse can also be done).

For example, a visitor to the Islamic Museum, may select an itinerary at to suit his interests.

This would be ideal for Heritage Tourism which can be a means for economic development.

One notable example is the Museum of LondonSTREETMUSEUM application which was one of thefirst history-related augmented reality apps for iOS.The app allows users to select a destination from aLondon map or use geo-tagging and GoogleMaps to discover their location. Once selected, ahistorical image of their London location appearson the screen, which can be expanded andexplored in detail, along with historical informationabout the subject. The historical image can beoverlaid onto the current view of a given site.

Streetmuseum app can recognise a user's location and then overlay a historic image onto the camera view.

Each image on the free app can be expanded and explored, along with historical information about the subject.

In an application for Historic Cairo, old photographs , postcards and paintings can provide a means for animating the present scenes

It is also possible to use the map to see the changes in the urban plan throughout history

Design of Personalized ItineraryThe itinerary may be selected for the visitor not only depending on his interests, but also how much time he/she has to spend, his/her historical preferences, fitness (for walking), time of day (hear, sunlight, shade), shopping.

Design of Personalized ItineraryThe itinerary may be selected for the visitor not only depending on his interests, but also how much time he/she has to spend, his/her historical preferences, fitness (for walking), time of day (hear, sunlight, shade), shopping.

Part II

Experience for what purpose?

?

Objectives

In developing new means and technologies of presenting and interpreting museum objects and archaeological sites, the ultimate objectives for such elements of heritage management have to be contemplated.Education ResearchConservation RecreationEconomic Aesthetic/Art Ethical………….

Objectives

One of the primary educational objectives is nurturing a deeper understanding of social dynamics that shape our lives and to fathom the realms of human ingenuity and creativity.

From Cornell Social dynamics lab

A dynamic, interactive display , as mentioned before, may reveal a great deal on Egyptian religion and royal state society.

The visitor may be provided with information that trans-cut historical narrative to a comparative juxtaposition of religions or political structures from different periods or different civilizations.

CreativityLearning should encourage visitors to comprehend the role of creativity in the transformation of human societies.The Saqqia is aRemarkable Example.

Another principal [Ethical] objective is Intercultural Dialogue for mutual understanding and to enhance the cause of peaceful coexistence and empathy.

Occasional flooding of the Valley of the Kings can serve as research case study on climate change

Increasing awareness of Conservation issues can be achieved through information on restoration of mechanical damage or treatment of microbial infestation of tomb wall paintings.

Also, digitization of museum object may be used to restore objects after damage or trace stolen objects

Into the Future

Personalized Multilayered Deep Experience of Cultural Heritage Resources Linking museums with archaeological sitesThis can be both economically rewarding and socially significant in a world that suffers both from economic woes and social ills.

There is a great future for an Integrated Mobile application that provides:

Objectives

Content

ICT-Learning

Social & Economic Development

Sustainable Development Goals (SDGs)