New Interaction Techniques

New Interaction Techniques

Department of Computer SciencesUniversity of Tampere, Finland

Department of Computer SciencesUniversity of Tampere, Finland

Grigori Evreinov

www.cs.uta.fi/~grse

Data Input throughFriction and Vibration

Data Input throughFriction and Vibration

September – December, 2003

TAUCHI MMIG G. Evreinov p 01_23 11.11.2003

data input through friction & vibration• how many buttons do you need????

http://www.gkos.net/

Smartquill of British Telecom http://oud.refdag.nl/weet/981013weetfo07.html

Fossil Wrist PDA with Palm OShttp://www.fossil.com/

http://www.spbsoftwarehouse.com/products/fsk/

http://www.gkos.net/

http://oud.refdag.nl/weet/981013weetfo07.html

http://www.fossil.com/

http://www.spbsoftwarehouse.com/products/fsk/


Body Coupled FingeRing: Wireless Wearable Keyboard [Fukumoto & Tonomura, CHI’97]

data input through friction & vibration

Samsung Scurry wearable keyboard http://www.futurelooks.com

http://www.futurelooks.com/

www.n-scribe.com/

TAUCHI MMIG G. Evreinov p 03_23 11.11.2003ANOTO pen http://www.anoto.com

VPenTM

http://www.otmtech.com/vpen3.asp

XWpen http://www.research.microsoft.com/users/lyn/

SmartQuill http://www.neoambiental.com.br/html/terceiromilenio/html/texto_terc_tecnologia04.htm



ANOTO Pen

• the digital pen writes on ordinary paper

printed with a special pattern that is

almost invisible to the naked eye

• the dots have a nominal spacing of 0.3

mm (0.01 inch)

• a minute portion of the total pattern

uniquely defines its position in the full

pattern

http://www.anotofunctionality.com/navigate.asp



chessboard grating

Optical Translation Measurement

OTM™

• OTM™ sensor measures the relative

motion of surfaces placed adjacent to

its aperture

• it includes a laser diode, detectors

and optics integrated into a small

transistor-style package

• the grating reflected beam serves as

a local oscillator, which interferes with

the reflected surface light for coherent

homodyne detection by the detector relief profile of the chessboard grating http://www.otmtech.com/otm.asp



InkLinkTM

binaural technology the InkLink™ Data Clip continuously

listens for communications from the InkLink pen while it

tracks the natural movement of the hand

http://www.jdjstore.com/jdjstore/inhansys.html


http://www.jdjstore.com/jdjstore/inhansys.html


a pair of ear-microphones output signals were examined to detect

the side of teeth-chattering, right or left [Hashimoto, Yonezawa and Itoh, 5th Int. Conf. ICCHP’96]


homogenous texture with definite angle of ribs


II

discrete textured input as a prototype of command mode for menu pointing task

continuous variable textures with definite decrement of roughness



• potential of diverse effects depends on pressuring force and

speed of relative motion between end effector and surface

• when the size of the end of the pen is commensurable to the ribs,

increasing applied force will increase the magnitude of recorded

roughness

• if vibratory signals take place during fingers manipulations along

of texture they can be recorded through piezoelectric transducer



• diverse textures can produce different sound patterns by

strengthening primary feedback during finger manipulation along

of textured surfaces

• these signals and their combinations could be used to input

commands or add new functions to keyboard, mouse, joystick or

another controls

• texture recognition has various interesting applications which

include both medical and more autonomous mobile robotics

ScrollStrip http://www.synaptics.com/products/index.cfm


18 common materials were explored through a

sensing “finger” with an piezoelectric

microphone, covered by a rugged material

a system for tactile texture detection achieved

more than 93% of recognition

Mayol-Cuevas et al, 1998


Mayol-Cuevas, W.W., Juárez-Guerrero, J. & Muñoz-Gutiérrez, S.

The first approach to tactile texture recognition

http://ganso5.fi-b.unam.mx/ligasdoc/TCTSMC98.PS.gz


x.wavinput device and the experimental setup





spectrums of vibration patterns during a linear motion across four textures


• Unistroke and Graffiti alphabet characters were used to simulate

gestures with definite structure (uninterrupted hand motion)


• the goal of our experiment was to evaluate spatial-temporary

segmentation of vibration patterns formed by handwriting

• segmented textured layout (modulator) and miniature

microphone (M294) performed spatial-temporal coding of pen

position


data input through friction & vibrationA B C D E F G H I J K L M

Unistroke

adapted

combinedcontinuous

N O P Q R S T U V W X Y Z

Unistroke

adapted

combinedcontinuous

vibratory patterns of the adapted unistrokes and combined continuous gestures (B, G, W)



.

.

.

.

.

.


• the proposed method has a potential for development new

interaction techniques for wearable computers

• 52 sound patterns during input of continuous gestures coding the

characters of English alphabet were registered and had a

recognizable structure

• diverse textures were assembled and explored to shape vibration

patterns when pen rubs over textured layout

• spectral averaging over the frequency range was found to be

effective tools for segmentation of vibration patterns received on

the textured layout


h.wav

SoundPen



assume, Freq.N = 400 Hz, then

at average speed of the pen motion

Vf = 25 mm/s

d = Vf / Freq.N , i.e., d = 0.06 mm

if = 65 then

dV = dN / cos dV = 0.14 mm

dH = dN / sin dH = 0.066 mm

correspondingly

Freq.V 180 Hz Freq.H 380 Hz

thus, if we shall provide texture with given

polarization, vibratory patterns will have

recognizable structure

d

Freq.V

Freq.H

Freq.N



vibratory patterns of the characters


a.wav

d.wav

h.wav

b.wav

o.wav

f.wav



• western script has several handwriting styles for elementary

school-aged children

• loops and other groups can provide systematic steps for letter

analysis and are often used for learning of the recognition system

• for designing of diverse gestures, we have selected seven

segments, which are most often used in handwriting sheets for

learning to write characters in cursive


vibratory patterns of handwriting

elements for cursive performance


_.wav

_.wav

_.wav

_.wav

_.wav

_.wav

_.wav



• this method was not intended for text entry, but has a potential

for human-computer interaction through special gestures along

textured surface

• while the size of the end of the pen was commensurable to the

ribs, sound patterns during input of handwriting characters were

registered and had recognizable structure

• the ribbed polarized textures similar to the diffraction grid were

proposed and explored to shape sound patterns when pen rubs

over these surfaces

• the vertical and horizontal components of the vibration frequency

had difference in two times


New Interaction Techniques

Documents

Transcript of New Interaction Techniques