Enterprise-Grade AR for Operational Environments by Chad Udell at FocusOn 2016

37
Copyright © 2016 Float. All rights reserved. www.gowithfloat.com @gowithfloat 1 Enterprise-Grade AR for Operational Environments: A Postmortem

Transcript of Enterprise-Grade AR for Operational Environments by Chad Udell at FocusOn 2016

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

@gowithfloat

1

Enterprise-Grade AR for Operational Environments:

A Postmortem

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 2

Advanced Augmented Reality: OCR Case Study on Facial Detection and More

Copyright © 2016 Float. All rights reserved.www.gowtihfloat.com

About Chad UdellManaging Director at Float

Faculty for over 10 years at Bradley University in Interactive Media

Been designing and developing web and learning solutions for nearly 20 years

A bit of a hacker/tinkerer, and a learning technology and design geek

[email protected] - @visualrinse on Twitter

Author of Learning Everywhere: How Mobile Content Strategies are Transforming Training, Editor and Author of Mastering Mobile Learning: Tips and Techniques for Success

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

AR Technolust.

4

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 5

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 6

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 7

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

AR in Common Use.

8

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 9

http://adage.com/article/cat-creativity-and-technology/ge-takes-super-bowl-holograms-smart-grid-push/134229/

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 10

https://www.youtube.com/watch?v=RWwQXi9RG0w

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 11

https://www.youtube.com/watch?v=9ZiBbghbbRQ

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 12

https://www.youtube.com/watch?v=uqQqn7RWffE

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

What are the obstacles?

13

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

What are the obstacles?•Technology Availability•Price•True Use Case Identification•Risk

14

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

So, what did we propose?• Technology Availability

• Only using commercially available products• Price

• Make sure hardware was something that departments or agencies could purchase

• True Use Case Identification• All use cases needed detailed stories and personas

created• Risk

• Research Project with Plans for Transition and Release Based on Outcomes

15

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Float’s Experience.

16

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 17

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 18

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

@gowithfloat

19

http://2015.icdar.org/

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Hardware.

20

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 21

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Epson Moverio BT-200

22

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Osterhout Design Group R-6

23

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Lessons Learned.

24

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Face Detection• Open CV• Android

- android.hardware.Camera.startFaceDetection- Deprecated in API level 21- Requires Android camera access- Unity compatibility issues

25

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Face Recognition• Microsoft Project Oxford Face API

- how-old.net

26

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Text Detection• Commercial solutions• WordLens & PhotoOCR• Tesseract• tess-two• Otsu thresholding

Bissacco, A., Cummins, M., Netzer, Y., Neven, H. (2013). PhotoOCR: Reading text in uncontrolled conditions. Google, Inc.

27

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 28

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Text Detection• Commercial solutions• WordLens & PhotoOCR• Tesseract• tess-two• Otsu thresholding• Stroke width transform• libccv

29

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 30

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Location Tracking• Indoor location• GPS unavailable• Sensor fusion

- Bluetooth- Wi-Fi- Gravitometer- Magnetometer

• Area learning• Model generation

- Tango- Robots

• Bluetooth

Image credit: Google Project Tango

31

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

User Interface• Stereoscopy

- Platform SDKs• Cardboard SDK

- Drift- Tango SDK Compatibility

• Color choice- Fonts

• Intent

32

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Build Process• Gradle• AAR• Editor plugins• Automate• Time to build

- Maintaining flow- Iterating

• Test• Demos

33

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 34

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com 35

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

Q&A.

36

Copyright © 2016 Float. All rights reserved.www.gowithfloat.com

@gowithfloat

37

Thank you!