TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark
-
Upload
alan-quayle -
Category
Technology
-
view
227 -
download
2
Transcript of TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark
![Page 1: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/1.jpg)
SEND WHAT YOU SEE
Twitter: @niallroche
![Page 2: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/2.jpg)
“ For those time when you ‘have’ to be there to understand it ”
@niallroche
![Page 3: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/3.jpg)
USES• For quickly sending messages without the user needing to type in
text that is in front of them
• can be useful for auditing by storing text sent rather than just an audio stream of words
• Users with Disabilities
• Remote Support & Technical Support
• from field engineers to fixing issues for family members ;-)
• Low bandwidth scenarios video not possible, images too large audio quality poor
• Translation issues for foreign text@niallroche
![Page 4: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/4.jpg)
OPERATION• Text Recongnition
• Place text in the ‘identify’ region of screen
• Choose Focus on area
• Identify Text (Aquire - Target - Compare to dictionary)
• Display Text in ‘text display’ region of screen
• User flicks the selected text to send to a spark message room (send all option TBD)
• Optional Text to speech on identified text and received messages (TBD) so no need to leave text capture screen@niallroche
![Page 5: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/5.jpg)
ARCHITECTURE
Spark
Camera Capture(Vuforia)
Spark Networking
Android
Text Recognition
Text Display
HTTPS
Send Message
Get Messages (TBD)
User1
xasdsad
User 1 User 2
@niallroche
![Page 6: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/6.jpg)
EXTENSIONS• Speech for incoming messages, good for hands free
support if audio quality poor
• Language translation
• Symbol translation - warning labels etc
• Object recognition - identify machine/part models send meter readings for diagnosis of issues
• Capture entire image from camera and send to message room
• send instructions to someone fixing the machine@niallroche
![Page 7: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/7.jpg)
ISSUES• Spark Java API is not Android compatible (even
with some hacking)
• Required building integration from scratch
• General configuration and environment issues as Image Capture required use of Android NDK and libraries and Vuforia API
• OpenCV is an alternative but Vuforia had better object and text recognition
@niallroche
![Page 8: TADHack London, Send What you See, Niall Roche & Daniel Fozzati, CiscoSpark](https://reader035.fdocuments.in/reader035/viewer/2022070515/587833eb1a28abef5d8b7207/html5/thumbnails/8.jpg)
Team: DEMONSTRABLE LABS
Niall Roche from
with support from
The Institute for Innovation and Entrepreneurship - UCL
@niallroche