Moritz von Grotthuss (gestigon) Natural User Interfaces at AR and VR
30
A NATURAL USER INTERFACE IN EVERY CAR, HOME, EVERY PERSONAL DEVICE
-
Upload
augmentedworldexpo -
Category
Technology
-
view
63 -
download
2
Transcript of Moritz von Grotthuss (gestigon) Natural User Interfaces at AR and VR
A NATURAL USER INTERFACEIN EVERY CAR, HOME, EVERY PERSONAL DEVICE
Virtual-/Augemented- and Mixed Realityrequire hand based natural interaction.
… everyone knows!
In Augmented Reality you need your hands even more.
You can use controllers.
And they are not bad.
But are controllers
NATURAL? ALWAYS ON?
EVERYWHERE AVAILABLE?
gestigon puts your hands into AR, VR and MR.5 years of relevant experience. 28 software engineers.
Key learnings.
3D depth sensors provide the data.
Avatar
How do you visualize the hand?vs RGB-cut-out vs true hand & skin customization
Latency. Matters. Most.
How did we solve it?
HAND DETECTION AND SKELETON TRACKING IS GREAT.
FINGER TIP DETECTION IS FASTER AND SUFFICIENT
> 35 DIFFERENT DEPTH SENSORS INTEGRATEDany technology, any chipset, any supplier
CAMBOARD PICO FLEXX (TOF Sensor)• Direct measurement of depth in every pixel for
highest accuracy• Monocular system architecture with no requirement
for mechanicalbaseline
• Easy once-in-a-lifetime calibration and no need for recalibration
• Ready for AR, VR and 3D scanning - only depth sensing technology whichis integrated into mobile devices (Lenovo Phab2 Pro)
INUITIVE VERONICA REFERENCE DESIGN Veronica is the Inuitive‘ reference design
for AR/VR Enhanced IR stereo depth sensor NU3000 Multicore processors Additional vision processors by CEVA
gestigon and Inuitive cooperate to provide gesture control and hand visualisation solutions for AR/VR
FOCU S ON EM BEDDED SYSTE MS
Example - A R M Cortex M4• ARM Cortex M4 based processor
(STM32F429NIH6 microcontroller)• 180MHz• 2 GB Micro5Dcard• 8MB RAM
-+ Fingertip tracking runs at 1oof ps
MOVIDIUS VISION PROCESSING PLATFORM ‚MYRIAD 2‘
Movidius is the leader in platforms for embedded visual intelligence Ultra low power, high
performance Programmable achitecture Small size / footprint
gestigon integrated it‘s gesture tracking solutions on the Myriad 2 platform with a focus on AR/VR use cases
DIN ISO 9001 (certified 06/16)
2016: A-SPICE Level 22017: A-SPICE Level 3
It simply works.
You don‘t need more than this..
Components you need.
gestigon. CARNIVAL AR/VR Interaction Suite.
POKEMON GO on a Cardboard in Mixed Reality
PRODUCTION PROCESS PLANNINGUsing gestigon‘ VR tools for digital planning of production lines
VR IS ARRIVING IN THE MARKETObama and Merkel at HannoverMesse 2016using gestigon‘ SDK & cardboard design
