AISN

http://www.cs.bgu.ac.il/~royif/AISN

Yakir DahanVitali Sepetnitsky

Royi Freifeld

Auditory imaging for sightless navigation

Overview Project Goals

Challenges

Main Steps

Technologies

Schedule

Project Goals Sightless navigation by sensory

substitution

› Development of an application that allows a

person to navigate, relying primarily on the

sense of hearing

Development of spatial auditory

environment

Providing a flexible testing environment

for future research

Main challenges 3D sound generation

› Choosing / generating sound samples that on

one hand will reveal as much information as

possible about the visual objects and on the

other hand will be intuitive (easily

interpreted).

Image analysis

› Applying a reliable object tracking mechanism

Shapes detection

Objects tracking

Sounds creation (according to a 3D

image)

Human subject research

Main steps

Technologies Image processing

› OpenCV

3D sound generation and processing

› Binaural spatialization using HRTF datasets

› OpenAL (Creative Labs / Rapture3D)

› JavaSound3D

› DirectSound3D

Project schedule (expected)

Summer 2010 – Theoretic research

› Learning and testing 3D sound & image technologies

October – November

› Choosing technologies

› System architecture

› Application Requirements Document draft

December – January 2011

› Final version of ARD

› Working on prototype

Project schedule (cont.) February – March

› Final prototype

› Application Design Document draft

› Application development

April - May

› Final version of ADD

› Application testing and experiments conduction

June

› Preparation to the Projects day