Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama...
-
date post
20-Jan-2016 -
Category
Documents
-
view
219 -
download
0
Transcript of Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama...
![Page 1: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/1.jpg)
Presenters: Brendan O’Leary and Lee StearnsPresenters: Brendan O’Leary and Lee Stearns
Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang
Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang
Team Vision is: Christopher Cheng, Brendan O’Leary, Lee Stearns, Steve Caperna, Junghee Cho, Victoria Fan, Avishkar Luthra, Jansen Sheng, Andrew Sun, Roni Tessler, Paul Wong, and Jimmy Yeh
Team Vision is: Christopher Cheng, Brendan O’Leary, Lee Stearns, Steve Caperna, Junghee Cho, Victoria Fan, Avishkar Luthra, Jansen Sheng, Andrew Sun, Roni Tessler, Paul Wong, and Jimmy Yeh
![Page 2: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/2.jpg)
![Page 3: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/3.jpg)
The White CaneThe White Cane Other Commercial Navigation SolutionsOther Commercial Navigation Solutions
![Page 4: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/4.jpg)
Objects and Landmarks to IdentifyObjects and Landmarks to Identify
![Page 5: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/5.jpg)
Our Goal: A Complete Navigation System for the BlindOur Goal: A Complete Navigation System for the Blind
GPSAlgorithm
Computer Vision
Algorithm
GPS UnitInertial
Navigation
Speech OutputPush-to-TalkVoice Input
Camera
Audio Feedback
GraphImage
DatabaseAudio Interface
![Page 6: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/6.jpg)
Hot Swappable Templates
Hot Swappable Templates
Too few featuresToo few features
Too few matchesToo few matches
No consensusNo consensus
Object LocationObject Location
The SIFT Computer Vision Algorithm
The SIFT Computer Vision Algorithm
![Page 7: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/7.jpg)
A Demonstration of Our Speech MenuA Demonstration of Our Speech Menu
![Page 8: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/8.jpg)
Throat Microphone with Push-to-Talk ButtonThroat Microphone with Push-to-Talk Button
![Page 9: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/9.jpg)
A Sample Grammar FileA Sample Grammar File
![Page 10: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/10.jpg)
The Discrete Speech InterfaceThe Discrete Speech Interface
![Page 11: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/11.jpg)
The Continuous Beacon InterfaceThe Continuous Beacon Interface
![Page 12: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/12.jpg)
An Early Test of Our Vision AlgorithmAn Early Test of Our Vision Algorithm
![Page 13: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/13.jpg)
Sign Experiment SetupSign Experiment Setup 3D Object Experiment Setup3D Object Experiment Setup
![Page 14: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/14.jpg)
Locating a Restroom SignLocating a Restroom Sign
![Page 15: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/15.jpg)
Locating a CaneLocating a Cane
![Page 16: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/16.jpg)
Initial Results:
Discrete Mode:
Average Location Time: 16 sec
Continuous Mode:
Average Location Time: 12 sec
With Consistent Tracking: 5 sec
Initial Results:
Discrete Mode:
Average Location Time: 16 sec
Continuous Mode:
Average Location Time: 12 sec
With Consistent Tracking: 5 sec
![Page 17: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/17.jpg)
Some Future PeripheralsSome Future Peripherals
Headphones that Don’t Block
External Sounds
Headphones that Don’t Block
External Sounds
Higher Resolution Camera with
Better Auto-Focus
Higher Resolution Camera with
Better Auto-Focus
Current Test SystemCurrent Test System
![Page 18: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/18.jpg)
CameraFeed
CameraFeed SIFTSIFT BBFBBF RANSACRANSAC 3D
Transform3D
TransformObject
LocationObject
Location
11 22 33 44 55 66
![Page 19: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/19.jpg)
Questions?Questions?
![Page 20: Presenters: Brendan O’Leary and Lee Stearns Coauthors: Gemstone Team Vision, Bobby Bobo, Rama Chellappa, and Cha-Min Tang Coauthors: Gemstone Team Vision,](https://reader035.fdocuments.in/reader035/viewer/2022062322/56649d405503460f94a199cd/html5/thumbnails/20.jpg)
Our test system:
Toshiba Satellite A75-S2311 Windows XP Professional (32-bit)
Service Pack 23.3 GHz Pentium 4 processor1.5 GB of RAM
First-generation Logitech QuickCam for Notebooks Pro (mounted on sunglasses)
USB microphoneOver-the-ear headphones
Our test system:
Toshiba Satellite A75-S2311 Windows XP Professional (32-bit)
Service Pack 23.3 GHz Pentium 4 processor1.5 GB of RAM
First-generation Logitech QuickCam for Notebooks Pro (mounted on sunglasses)
USB microphoneOver-the-ear headphones