Beyond the PC Kiosks & Handhelds
description
Transcript of Beyond the PC Kiosks & Handhelds
![Page 1: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/1.jpg)
Beyond the PCKiosks & Handhelds
Albert HuangLarry Rudolph
Oxygen Research GroupMIT CSAIL
![Page 2: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/2.jpg)
Overview
Computation is useful everywhere We need to explore interaction modes
beyond the desk: Kiosks Handhelds
These are mutually complimentary
![Page 3: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/3.jpg)
OK-Net Kiosk
![Page 4: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/4.jpg)
Kiosk Specifications
Touch screen monitor Small computer inside kiosk Minimal infrastructure Hacker-hardened Nothing exposed
![Page 5: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/5.jpg)
Under the hood
![Page 6: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/6.jpg)
Self contained
![Page 7: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/7.jpg)
Interaction Modes
General Public Similar to web browser: point-and-click Content harvested automatically
seminars, events, directory, news, etc.
Adapt to user extension of user’s digital world extension of user’s mobile devices
![Page 8: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/8.jpg)
Identify User by Doodle
People initially interact with a doodle
Conjecture: doodles are unique like signature
Provides a moderate amount of id strong id not necessary
![Page 9: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/9.jpg)
Other Interaction
s User input
touch & speech phone and PDA as remote finger
Information Transfer SMS email Bluetooth (OBEX push)
![Page 10: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/10.jpg)
Simple Kiosk App:
Stata Guidance
Stata is confusing Kiosk provides several guide modes Passive:
show & push map to Bluetooth-enabled device
Active: guide user along the way
![Page 11: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/11.jpg)
A graph for each floorNodes: junctions or destinations
![Page 12: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/12.jpg)
Given start and destinationcompute a path
![Page 13: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/13.jpg)
Send it all to phone
![Page 14: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/14.jpg)
Real-time navigation Track user (phone) in Stata Trivial deployment
Bluetooth beacon in each PC < $20 per beacon
Indoor GPS for phones scan for Bluetooth beacons map detected beacons to a
location
![Page 15: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/15.jpg)
Real-time navigation
![Page 16: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/16.jpg)
Real-time navigation
![Page 17: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/17.jpg)
Real-time navigation
![Page 18: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/18.jpg)
Real-time navigation
![Page 19: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/19.jpg)
Real-time navigation
![Page 20: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/20.jpg)
Improvements needed
Takes too long to recognize beacons Much better results
with two beacons Signal comes and goes
Incorporate model of human motion
Probabilistic filtering
![Page 21: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/21.jpg)
Some people cannot read maps
A “human-centric” navigation guide without sound without abstraction
A picture is worth 1000 words photo sequence
![Page 22: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/22.jpg)
![Page 23: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/23.jpg)
![Page 24: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/24.jpg)
![Page 25: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/25.jpg)
![Page 26: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/26.jpg)
![Page 27: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/27.jpg)
Digital Assistant
Kiosks can send content to phones But users also generate content
pictures audio memos text memos selections
![Page 28: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/28.jpg)
Human-centric organization
Organize as it happens Associate content for subsequent
retrieval Display associated content together Content can be displayed manually or
automatically
![Page 29: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/29.jpg)
External Triggers
Time (the usual alarms) Location
enter super market, home, car, office
Meeting someone Phone call from someone Many others to be discovered
![Page 30: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/30.jpg)
Testbed:Conference Domain
When attending technical conference Select interesting talks at kiosk Send details to phone
Take notes during a talk camera for photos, videos, printed text microphone for audio notes, annotations keypad, laptop for text notes
Associate content with events
![Page 31: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/31.jpg)
Process content offline
Apply recognition technologies for images OCR, Object, People, Place audio speech transcription video sketch & gesture
Build semantic web to integrate with services
Potential use Automatically generate conference
report
![Page 32: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/32.jpg)
Sharing content
Content tagged as public or private Phone-phone or phone-kiosk interaction
synchronizes public content Content spreads throughout community
each new recipient tags it anew More complicated than public/private
User may want to share content among her own devices, e.g. laptop, phone, iPod, etc.
User may want to share some content with her boyfriend’s devices
![Page 33: Beyond the PC Kiosks & Handhelds](https://reader035.fdocuments.in/reader035/viewer/2022062408/56813d17550346895da6d3fc/html5/thumbnails/33.jpg)
Conclusion about Kiosks
Kiosks: new interaction model? are they just glorified web browsers? interaction with hand-held devices proximity provides simple, physical
interface