Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor...
Transcript of Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor...
![Page 1: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/1.jpg)
Project TangoJohnny Lee, IEEE CESocDec 2014
![Page 2: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/2.jpg)
human-scale understanding of space and motion
![Page 3: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/3.jpg)
![Page 4: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/4.jpg)
ARM Cortex A9 Dual @ 1.5GHz
Qualcomm CortexA8 @ 1GHzARM Cortex
A8 @ 1GHz
ARM11412MHz
ARM7500FE40MHz
Today
NVIDIA Tegra K1
![Page 5: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/5.jpg)
the compute is here
![Page 6: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/6.jpg)
focused effort to pull forward the state of 3D sensing hardware and software on mobile
![Page 7: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/7.jpg)
demo & video
![Page 8: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/8.jpg)
4MP 2um Pixel Camera
Motion Tracking Camera
Integrated Depth Sensing
NVIDIA Tegra K1128GB SSD
4GB RAM Built for 3D.Built for Compute.
Sign-up @ http://g.co/ProjectTango
![Page 9: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/9.jpg)
![Page 10: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/10.jpg)
![Page 11: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/11.jpg)
![Page 12: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/12.jpg)
Google Confidential and Proprietary
Roughly, how does Project Tango Work:
Scene
HW Timestamped Wide Camera
Gyro/Accel2D Feature Point
Extraction3D Motion Tracking
On DeviceLocation Map CreationTracking & Recovery
On Device3D Geometry
Reconstruction
Depth Sensor
Indoor NavGamesVR/ARProfessional Apps
<50us timestamping allows accurate 3D tracking.
Optimized ISP for computer vision rather than photography. Cleaner RAW data, minimize noise & latency.
HW accelerated feature extraction and tracking (optical flow)
Sensor fusion of camera, gyro, and accelerometer data.
Recognizing the location of previously visited locations.
Vendor providedHW sensor/SW library.
Compute intensive 3D reconstruction algorithms (1st & 3rd party).
![Page 13: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/13.jpg)
demo & video
![Page 14: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/14.jpg)
Google Confidential and Proprietary
Emerging:Virtual RealityRobotics
Professional:Building-scale3D scanning &measurement
Prosumer:Virtual ShowroomShoppingRemodeling
Consumer:Centimeter-scale IndoorNavigation (no GPS/Wifi/Bluetooth)
Entertainment:Motion GamingGeo-Social Activities
Use Cases
![Page 15: Project Tangosite.ieee.org/scv-ces/files/2015/06/Project-Tango-IEEE... · 2015. 6. 26. · Indoor Nav Games VR/AR Professional Apps](https://reader036.fdocuments.in/reader036/viewer/2022062609/60ff94af712a1738d422a565/html5/thumbnails/15.jpg)
Google Confidential and Proprietary