Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon,...

30
Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso http://www.idc.ul.ie/ztiles/

Transcript of Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon,...

Page 1: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Z-Tiles: Building Blocksfor Modular,

Pressure-Sensing Floorspaces

Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

http://www.idc.ul.ie/ztiles/

Page 2: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Introduction

• New Pressure-

Sensitive Floorspace

• Successor to

Litefoot (1998) &

Magic Carpet (1997)

Paradiso et al. (1997) The Magic Carpet: Physical Sensing for Immersive Environments. CHI’97Griffith and Fernstrom (1998) LiteFoot: A Floor Space for Recording Dance and Controlling Media. ICMC’98.

Page 3: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Authors

Bruce Richardson

Interaction Design Centre, UL.

Krispin Leydon

Interaction Design Centre, UL.

Mikael Fernström

Interaction Design Centre, UL.

Joe Paradiso

MIT Media Lab, Boston

Page 4: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Requirement

Scalable => Modular and interchangable

Page 5: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Requirement

Managable => Self-organising and reconfigurable

Page 6: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Requirement

Real-Time => Fast scanning and fast output

• Scan at 100 Hz

• Low latency data routing

• Minimal network overhead

Page 7: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Sensor Units

Page 8: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Z-Tile Circuitry

Page 9: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Z-Tile Architecture

Page 10: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Floor Prototype

QuickTime™ and aDV - PAL decompressor

are needed to see this picture.

Page 11: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Data Bottleneck

• Many wires vs. One wire• Bottleneck at connection point

Page 12: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Options

1. Output only changed pressure readings

2. Group similar pressure readings

Page 13: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Options

1. Output only changed pressure readings

2. Group similar pressure readings

Page 14: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Blob Matching

Page 15: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Considerations

• 100 pressure scans/sec

10ms maximum computation time

• Minimum number of parameters

• Accurate blob matching

• Trade off

Close “fit” vs Fewer parameters

Page 16: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Ellipse Matching

• Circles:

Loose fit, few parameters

• Polygons:

Tight fit, many parameters

Page 17: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Ellipses

Ellipses - good compromise

Page 18: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Simple Matching

Page 19: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Average -> Centre

Page 20: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Axes -> Bounding Box

Page 21: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Resultant Ellipse

Page 22: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Results

• Pressures distilled to blobs

• 5 parameters per blob

• Implemented on a microcontroller

>800 scans processed per second

Rate achieved at 1/10 speed

Page 23: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Evaluation

• Processing time to

spare

• Difficulty with

diagonal blobs

• Therefore, look for

better match

Page 24: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Angled Ellipses

Pressure Readings We have We want

Page 25: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

General Method

• Determine centre

as before

• Locate 2 most

distant points

• Set this as major

axis

Page 26: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

General Method cont’d

• Rotate points so

axis is horizontal

• Use bounding box

to determine major

and minor axes

lengths

Page 27: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Results

• Implemented on microcontroller

• Integer-only calculations

• Lookups for rotations

• Computation time 1-2ms

Page 28: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Summary

• Blob detection to reduce data• 2 ellipse-matching algorithms• Run time on hardware: <2ms

Page 29: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Future Work

• Integrate blob detection algorithm into tile software

• Detect blobs across tiles

Page 30: Z-Tiles: Building Blocks for Modular, Pressure-Sensing Floorspaces Bruce Richardson, Krispin Leydon, Mikael Fernström, Joseph A. Paradiso

Questions?

http://www.idc.ul.ie/

http://www.idc.ul.ie/ztiles/