Data -Driven Texture Rendering on an Electrostatic Tactile...

19
Haptics & Robotics Lab Department of Mechanical Engineering Boğaziçi University Data-Driven Texture Rendering on an Electrostatic Tactile Display Gholamreza ILkhani Ph.D. candidate Workshop on Electrostatic Tactile Display IEEE World Haptics 2017 Fürstenfeldbruck (Munich), German June 6

Transcript of Data -Driven Texture Rendering on an Electrostatic Tactile...

Page 1: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Haptics & Robotics LabDepartment of Mechanical Engineering

Boğaziçi University

Data-Driven Texture Rendering on an

Electrostatic Tactile Display

Gholamreza ILkhaniPh.D. candidate

Workshop on Electrostatic Tactile DisplayIEEE World Haptics 2017

Fürstenfeldbruck (Munich), GermanJune 6

Page 2: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Electrostatic tactile display evolution

Senseg“Tixel1”

Disney Research “TeslaTouch2”

Tanvas3

2

1. “Senseg”, https://www.senseg.com2. “Teslatouch” , https://www.disneyresearch.com3. “Tanvas”, https://tanvas.co

Page 3: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

3

You feel what you don’t see

Page 4: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

“ Texture ”• Texture by its definition is the feel or shape of

a surface or substance.• In haptic science, texture is the quality which

is fashioned virtually and body perceives this virtually created property.

4

Page 5: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Psychophysical Evaluation for Quality Extraction

5

• Dimensions for texture perception and identification

1) Rough/Smooth 2) Hard/Soft3) Sticky/Slippery4) Warm/Cold • At least two dimensions are necessary for tactile

texture perception and maximum number of these dimensions must be covered for a realistic haptic

rendering“Psychophysical Dimensions of Tactile Perception of Textures” by Okamoto et al., 2013

Page 6: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

6

“Data-driven or measurement-based haptic rendering ”

An emerging technique which provides an opportunity to record data from real objects and

replay them on a haptic system

Page 7: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Two Hypothesis-Two parts experiments

• Hypothesis1 The data-driven method is more realistic in than

the ones generated with periodic signals.

• Hypothesis2Roughness and stickiness are the primary dimensions in the perception of virtually-

created textures using electrostatic attraction

7

Page 8: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Part 1

8

Tangential component of

the accelerations(X axis) for 3

materials VS.

square wave with 80Hz,

240Hz,400Hz

Data collection setup

Page 9: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 11. Scaling of input voltage

9

Result 1Lower voltage for data-driven signal

Page 10: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 1

10

2. Texture Similarity Rating

Result 2Higher similarity and classification number for data-drive method

Page 11: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 1

11

3. Multidimensional perceptual space

Result 3Data driven signals are closer

to their corresponding materials

Result 4Dimension 1: RoughnessDimension 2: Stickiness

Page 12: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 2

12“One hundred data- driven haptic texture models and open-source methods for rendering on 3D objects” by Culbertson et al.

=∑− ∑

Page 13: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 2

13

Sample materials

Page 14: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 2

14

1. Scaling of input voltage

“skipped”

Just done for one material to find the converging scaling value

• Velocity updated for 10 interval• Normal force assumed constant F<0.5N

Page 15: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 2

15

Result 1Pretty acceptable similarity rating

and number of classification

2. Texture Similarity Rating

Page 16: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Experimental procedure 2

16

3. Multidimensional perceptual spaceResult 2

• MDF, leather, foam fully rendered

• Plastic mesh and vinyl slightly deviated

• Abs plastic rubber lost fidelity

Result 3Dimension 1: RoughnessDimension 2: Stickiness

Page 17: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Conclusion

17

• Type of the input signal is important while rendering a surface.

• Data-driven method is an efficient way for texture rendering.

• Roughness and stickiness are the primary dimensions of texture rendering on an electrostatic tactile display.

• Couldn’t draw any conclusion on effect of velocity.

Page 18: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Future study

• Vision effect on judgment• Effect of frequency on assigned signal• Increase number of material

18

Page 19: Data -Driven Texture Rendering on an Electrostatic Tactile ...haptics.boun.edu.tr/wp-content/uploads/2017/07/Microsoft-PowerPoi… · The data -driven method is more realistic in

Haptics & Robotics LabDepartment of Mechanical Engineering

Boğaziçi University

19

QUESTIONS?

Gholamreza Ilkhani, PhD candidatehttp://haptics.boun.edu.tr

Be realistic!