AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng:...

47
AISHUD Data fusion and display system prototype for enhanced submarine crew awareness using augmented reality 1

Transcript of AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng:...

Page 1: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AISHUDData fusion and display system

prototype for enhanced submarine crew awareness using augmented reality

�1

Page 2: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Augmented reality

Page 3: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AR enhanced visualization

Page 4: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AR enhanced visualization

Page 5: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Enhanced view

Page 6: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Enhanced view

Page 7: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Enhanced view

Page 8: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Enhanced communication

Page 9: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Iron BaronHeading: NEDistance: 3m

Waikiki ToursHeading: S

Distance: 2m

ShipHeading: W

Distance: 1m

Enhanced communication

Page 10: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Iron BaronHeading: NEDistance: 3m

Waikiki ToursHeading: S

Distance: 2m

ShipHeading: W

Distance: 1m

Enhanced communication

Page 11: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Iron BaronHeading: NEDistance: 3m

Waikiki ToursHeading: S

Distance: 2m

ShipHeading: W

Distance: 1m

Enhanced communication

Page 12: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Enhanced communicationIron BaronHeading: NEDistance: 3m

Waikiki ToursHeading: S

Distance: 2m

ShipHeading: W

Distance: 1m

Page 13: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 14: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 15: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 16: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 17: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

lat: 21.279lng: -157.846

lat: 21.281lng: -157.845

lat: 21.274lng: -157.849

lat: 21.258lng: -157.852

Screen positioning

with observer and point of interest

GPS coordinates

Page 18: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 19: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Page 20: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Location based AR

Iron BaronHeading: NEDistance: 3m

Page 21: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 22: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 23: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 24: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 25: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 26: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 27: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 28: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 29: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 30: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

Page 31: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Our journey

< 1 miles

1-2 miles

>2-to-3 miles

Page 32: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Page 33: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Daisy 2+ AIS Raspberry Pi Zero W iOS/Android

Page 34: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Daisy 2+ AISRaspberry Pi

Zero W iOS/Android

Page 35: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Daisy 2+ AISRaspberry Pi

Zero W iOS/Android

Page 36: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Daisy 2+ AISRaspberry Pi

Zero W iOS/Android

W240210

Page 37: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

AIS heads up display

Daisy 2+ AISRaspberry Pi

Zero W iOS/Android

W240210Camera orientation

Elevation

Compass heading

Page 38: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasPersistent AR

Observer A

Page 39: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasPersistent AR

Observer A

Page 40: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasPersistent AR

Observer B

Page 41: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasOther communication methods

Page 42: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasOther communication methods

Page 43: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasOther communication methods

Page 44: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasObject detection

Page 45: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning

Future ideasObject detection

Page 46: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning
Page 47: AISHUD MANTAS kn · 2018. 10. 26. · Location based AR lat: 21.279 lng: -157.846 lat: 21.281 lng: -157.845 lat: 21.274 lng: -157.849 lat: 21.258 lng: -157.852 Screen positioning