1 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

Sensing My Device and Contextual

Awareness: My New Dimensions of

Communication

Roope TakalaNokia Research Center

2 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

• Sensing the context and the user

• Communicating

• Input• Sensing the user and enabling his interaction.

• Output• Multimodality in output relies on coherent Visual,

Audible and Tactile feedback

Contextual Awareness and Tangibility in Personal Communications

3 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

4 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

• Environmental sensors• Temperature • Pressure • Sound• acceleration

• Touch sensing• Touch screens/pads• Movement

• Sensing other devices• Bluetooth• RFID• Inductive

• Merging non sensor data• Date / Time• Network type / cell

Sensors and Signals

5 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

6 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

7 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

My Personal IDENTITY for the situation

Situation based Applications

Suggesting My AUTOMATION for the situationNon-intrusive

USER INTERFACE for the situationAccess toWHAT I NEED in the situation

Adjusting My COMMUNICATION to the situationMy Personal

SECURITY for the situationVersatile INTERACTION for the situation

Casual

INTERACTION for the situation

8 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

• Keys

• Touch sensitive surfaces

• Stylus sensitive surfaces

• Tilting and turning

• Analog pointing devices

• Digital pointing devices

• Rotating dials

Tangible Input Methods

9 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

• Visual • Larger more colorfull

displays

• Audible• Beeps, clicks• Polyphonic sound• MIDI output

• HAPTICS and TANGIBLE UI’s

• Breaking down the problem

• Practical research tools• Some tools for developing and

testing user experience and the technologies.

Research towards Tactility

10 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

Haptics a key element of Tangibility

11 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

DIP3System is a basic setup designed to run UI simulations on PDP

Basic PDP setup with:Color display (Calypso display update speed ~1.2fps)

(faster display units with Pica monocrome displays are also available)

Joystick, resistive keypadVibra motor, audio, cameraSerial cable (or BT) link to PC where the

simulation is runMaestro UI simulator compatible

Stable generic phone simulation.

12 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

OLIVE : Secure Wireless IPv6 TerminalOLIVE implements a wireless Internet handheld terminal optimized for web applications. The terminal utilizes WLAN for the wireless access, MobileIPv6 for mobility management, IPSEC for encryption and RFID for user identification.

Key Features:Jappla2 engine with OMAP 120MHz, SDRAM 64MB / Flash 16MB,

Bluetooth.Nokia D211 WLAN/GPRS13.56MHz RFID reader4 inch color VGA touch screen displayMobileIPv6 and IPSec on Montavista LINUX

IPv6WLAN

RFID

VoIP MobileIPv6IPsecHome agent

Application server

13 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

RocinanteRocinante is a demonstration of a generic media phone. Focus is on testing media phone related HW components and developing SW.

User Interface:PDP based user inteface board incl.: Control keys, Camera, HF-

speaker, and microphone.3.5’’ Transflective TFT-LCD, 53.6mm x 71.5mm, 240 x 320 pixels;

260K colors

Engine (Jappla2(TI OMAP)) :Operating system: LinuxMCU: ARM925 / 120 MHz / 120MIPSDSP: TI C55x / 120MHz / 220MIPSPCM Audio codecMemory: SDRAM 64MB / Flash

Expandability:Compact Flash Connector, Multi Media Card Connector, Bluetooth,

WLAN, Pop-Port™

Size 160 x 70 x 28 mm

14 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

User & technology views on devices

Application needsForm-Factor needs

FeasibleMobile Devices

User

Sensor Technology

Mechanical structures

SW systems

Technology

15 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

True multimodal input and feedback is on its’ way

Summary

Adaptability of technology to new applications

Tactile feel and feedback

All user interfaces havesome historical carry over

Usable for multiple applications

16 © NOKIA MIT Media Lab Europe 200404.PPT / 20-04-2004 / RTT

Thank You

Questions?