Post on 19-Dec-2015
Sentient Computing
Ubiquitous Computing visionComputing devices everywhere
Access to applications anywhere
Whatever is on hand is available
Sentient Computing visionUbiquitous Computing made context-aware
Physical context used for automatic control
Sensors and space are part of computing systems
Programming With Space
The componentsNotions and representations of physical space
Data and computational models
Sensor information
User interface the real world
Components for Programming With Space
Devices
Platforms
Sensors
Networks
+Architecture
Conduits
Components for Programming With Space
Devices
Platforms
Sensors
+Architecture
Sensors: Location Information
Containment– GSM, UMTS, broadband radio– Active badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Sensors: Location Information
Containment– GSM, UMTS, Broadband Radio– Active Badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Containment: Active Badge
Infra-Red Network 10 meter range
diffuse
room-scale location
Sensors: Location Information
Containment– GSM, UMTS, Broadband Radio– Active Badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active Bat
Sensors: Location Information
Containment– GSM, UMTS, broadband radio– Active badge
Proximity – Bluetooth, IrDA– PICOnet
Co-ordinate– GPS– Active bat
Ultrasonic Location System
Mobile transmitter (Bat)
Fixed receiversCeiling
Active BatsUltrasonic transponder
Measure pulse time-of-flight
Radio synchronised
DSP Ceiling Array
25,000 MIPS to cover AT&T Laboratories Cambridge!
Components for Programming With Space
Devices
Platforms
Sensors
Networks
+Architecture
Conduits
Telephone318
Computer“Pumpkin”
Computer“Papaya” Person
“Mike”
Person“Pete”
Representing the Real World
Model real world as collection of objects
Computer“Plantain”
Person“Andy”
Follow-mePhonebook
MobileDesktop
Telephone241
Telephone217
CTIswitch
Resourcemonitor
Keyboardmonitor
Locationservice
Applications
Software objects
Sensors
– Objects maintain state using sensor data
– Applications query relevant sets of objects
Data Model Visualisation
Spatial Monitoring
Vague spatial facts formalised as geometric containment and overlapping relationships between spaces
X
M
‘X is holding the microphone M’‘X can be seen by
camera B but not by camera A’
A
B
X
Spatial Indexing
Generates all positive/negative overlapping or containment events
thro
ug
hp
ut
(‘00
0 u
pd
ates
s-1)
1
3
2
4
population (‘000)10 20 30
non-overlapping spaces
overlapping spaces
Putting It All Together
Move user’s desktop to screen in front of them
Visible
A
Visib
le
B
Visible
C
Callbacks
Registration+ve Containment (Andy)-ve Overlapping (Andy)
-ve Overlapping(Andy,”Visible B”)
CLEAR DESKTOP FROM B
-ve Overlapping(Andy,”Visible A”)
CLEAR DESKTOP FROM A
+ve Containment(Andy,”Visible B”)
MACHINE B: NOT IN USEMOVE DESKTOP TO B
+ve Containment(Andy,”Visible C”)MACHINE C: IN USE NO ACTION
Example Applications
Corporate memoryRecord me / what’s around me
Annotate multimedia stream
Camera field-of-view
Flat display
Compositedisplay
“Plonk-and-play” systemsSpatial configuration determines logical
configuration
No need to know device IDs
Automatic personalisation
Sentient Computing: New User Interfaces
Non-user interfaces!
Objects and people are cursors in the real-world of icons
Aural and visual feedback