S ensing M y D evice and C ontextual A wareness: M y N ew D imensions of C ommunication

1 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

Sensing My Device and Contextual

Awareness: My New Dimensions of

Communication

Roope TakalaNokia Research Center


• Sensing the context and the user

• Communicating

• Input• Sensing the user and enabling his interaction.

• Output• Multimodality in output relies on coherent Visual,

Audible and Tactile feedback

Contextual Awareness and Tangibility in Personal Communications


• Environmental sensors• Temperature • Pressure • Sound• acceleration

• Touch sensing• Touch screens/pads• Movement

• Sensing other devices• Bluetooth• RFID• Inductive

• Merging non sensor data• Date / Time• Network type / cell

Sensors and Signals


My Personal IDENTITY for the situation

Situation based Applications

Suggesting My AUTOMATION for the situationNon-intrusive

USER INTERFACE for the situationAccess toWHAT I NEED in the situation

Adjusting My COMMUNICATION to the situationMy Personal

SECURITY for the situationVersatile INTERACTION for the situation

Casual

INTERACTION for the situation


• Keys

• Touch sensitive surfaces

• Stylus sensitive surfaces

• Tilting and turning

• Analog pointing devices

• Digital pointing devices

• Rotating dials

Tangible Input Methods


• Visual • Larger more colorfull

displays

• Audible• Beeps, clicks• Polyphonic sound• MIDI output

• HAPTICS and TANGIBLE UI’s

• Breaking down the problem

• Practical research tools• Some tools for developing and

testing user experience and the technologies.

Research towards Tactility


Haptics a key element of Tangibility


DIP3System is a basic setup designed to run UI simulations on PDP

Basic PDP setup with:Color display (Calypso display update speed ~1.2fps)

(faster display units with Pica monocrome displays are also available)

Joystick, resistive keypadVibra motor, audio, cameraSerial cable (or BT) link to PC where the

simulation is runMaestro UI simulator compatible

Stable generic phone simulation.


OLIVE : Secure Wireless IPv6 TerminalOLIVE implements a wireless Internet handheld terminal optimized for web applications. The terminal utilizes WLAN for the wireless access, MobileIPv6 for mobility management, IPSEC for encryption and RFID for user identification.

Key Features:Jappla2 engine with OMAP 120MHz, SDRAM 64MB / Flash 16MB,

Bluetooth.Nokia D211 WLAN/GPRS13.56MHz RFID reader4 inch color VGA touch screen displayMobileIPv6 and IPSec on Montavista LINUX

IPv6WLAN

RFID

VoIP MobileIPv6IPsecHome agent

Application server


RocinanteRocinante is a demonstration of a generic media phone. Focus is on testing media phone related HW components and developing SW.

User Interface:PDP based user inteface board incl.: Control keys, Camera, HF-

speaker, and microphone.3.5’’ Transflective TFT-LCD, 53.6mm x 71.5mm, 240 x 320 pixels;

260K colors

Engine (Jappla2(TI OMAP)) :Operating system: LinuxMCU: ARM925 / 120 MHz / 120MIPSDSP: TI C55x / 120MHz / 220MIPSPCM Audio codecMemory: SDRAM 64MB / Flash

Expandability:Compact Flash Connector, Multi Media Card Connector, Bluetooth,

WLAN, Pop-Port™

Size 160 x 70 x 28 mm


User & technology views on devices

Application needsForm-Factor needs

FeasibleMobile Devices

User

Sensor Technology

Mechanical structures

SW systems

Technology


True multimodal input and feedback is on its’ way

Summary

Adaptability of technology to new applications

Tactile feel and feedback

All user interfaces havesome historical carry over

Usable for multiple applications


Thank You

Questions?

S ensing M y D evice and C ontextual A wareness: M y N ew D imensions of C ommunication

Documents

Transcript of S ensing M y D evice and C ontextual A wareness: M y N ew D imensions of C ommunication