EMERGENCY DEMONSTRATOR

bart.adams@luciad.com

EMERGENCY DEMONSTRATOR LEADER

2

Partners involved in demonstrator

Centralized system

• Amount of information can be overwhelming

• Difficult to make right decisions

Text and audio communication

• Not integrated

• Difficult when many actors involved

• Limited situational awareness

Supported by paper documents

• Information often outdated

• No real-time updates

EMERGENCY DISPATCHING

CURRENT PRACTICE

3

EMERGENCY DISPATCHING

THE FUTURE WITH ASTUTE

Pro-active decision support • Aid commanders, superiors,... by

providing suggestions for actions

• Show relevant data only

Multi-modal communication • Integrated audio, video, voice, haptic,

messaging, map annotations,…

Adaptive map-centric HMI • Embedded on-sleeve, in-vehicle, etc.

• Updated in real-time with tracking feeds, annotations,...

All based on user state and context

ASTUTE BENEFITS

5

Pro-activeness: Pro-actively compute best approach given weather forecast and presence

of dangerous goods

Decision support: Aid commander by assigning most appropriate team members to task

Multi-modal HMI: Choose between visual, haptic, audio alerts based on severity

Adaptive HMI: Switch to audio-only firefighter HMI when visibility lost due to smoke

Seamless connectivity: All actors maintain situational picture through embedded, mobile, and

remote HMIs

USER CENTRIC APPROACH

Mental Model

Timeline, Personas, Relationships

Realistic Scenario, Storyboarding

Field Studies

Task Analysis, Information Needs

Requirements

Architecture, HMI Designs

Usability Tests

Prototype Implementation

Footer 7

Storyboard

Footer 8

Timeline

Footer 9

Information Needs

Footer 10

HMI Designs

PROTOTYPE IMPLEMENTATION

11

Server

inside firetruck

Commander

Tablet-size HMI

Crisis team

Web-based HMI

Firefighters

On-sleeve HMI

USABILITY TESTS

12

3 days testing by Belgian firefighters and commanders

• 8 firefighters (Merksplas, Hasselt, Ninove)

• 7 commanders (Dendermonde, Genk, Merksplas, Hasselt, Ninove)

Example tests • Commander: find location of dangerous goods

• Firefighter: perform search-and-rescue operation

TEST RESULTS

Positive Feedback • Plans and realtime information are great

• I like tablet applications for crisis management

• Looks to be very applicable and to be integrated with other research projects

• I would certainly buy this

• This would be a great help in exploring unknown buildings

• ...

Concerns • Can make firefighter negligent

• More information should be provided pro-actively

• ...

14

15

TECHNICAL CHALLENGES TACKLED

16

• High performance visualization and interaction Resource-constrained mobile devices

• Reasoning on fast changing context using ontologies Many events (e.g., position updates)

Separate asynchronous engines (e.g., routing)

• Data preparation and packaging Efficient file format

OGC GeoPackage

• Offline/online operation

• Seamless connectivity Messaging protocol

OGC GeoPackage

OGC GEOPACKAGE

17

• Upcoming standardized format for geospatial data Vector data (streets, buildings) and raster data (aerial imagery)

Based on sqlite

• Improved interoperability, ideal for mobile

• Active involvement in SWG by Luciad from within Astute Open source draft implementation available

https://bitbucket.org/luciad/libgpkg

CONCLUDING NOTES

18

Current work practice in emergency domain is suboptimal • Logical next step is to provide digital documents on tablet

Astute emergency demonstrator looks beyond next step • Field operations through multi-modal and adaptive HMIs • Proactive support taking user state and context into account

Applicable to other domains involving field operations

Relation to other projects • Smart@Fire: Next generation firefighter suit • FireBee: Indoor localization for emergency situations

THANK YOU!

QUESTIONS?