iGesture: A General Gesture Recognition Framework
-
Upload
beat-signer -
Category
Technology
-
view
2.519 -
download
2
description
Transcript of iGesture: A General Gesture Recognition Framework
![Page 1: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/1.jpg)
ICDAR 2007, September 26
A General Gesture Recognition Framework
Beat Signer, Ueli Kurmann and Moira C. Norrie
Institute for Information Systems, ETH Zurich
8092 Zurich, Switzerland
http://vub.academia.edu/BeatSigner
![Page 3: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/3.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 3
Requirements
Java API
Different types of input devices
digital pen and paper, mouse, etc.
Support application and algorithm developers
Definition and evaluation of new gesture sets
Simple acquisition of gesture data
![Page 4: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/4.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 4
iGesture Components
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 5: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/5.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 5
iGesture Admin Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 6: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/6.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 6
Capture of Samples Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 7: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/7.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 7
iGesture Test Bench Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 8: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/8.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 8
iGesture Test Data Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 9: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/9.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 9
Evaluation Tools Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 10: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/10.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 10
Recogniser API
Configuration configuration =
XMLTool.importConfiguration(new File(RUBINE));
GestureSet gestureSet =
XMLTool.importGestureSet(new File(RUBINE_SET));
configuration.addGestureSet(gestureSet);
recogniser = new Recogniser(configuration);
...
ResultSet result = recogniser.recognise(note);
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 11: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/11.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 11
Gesture Representation Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 12: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/12.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 12
Recognition Algorithm Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 13: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/13.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 13
Persistence Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
![Page 14: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/14.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 14
Current Status
Algorithms
Rubine, SiGeR, E-Rubine, SiGrid
Gesture Sets
Graffiti numbers, Graffiti letters, MS application
gestures, customised multi-stroke gestures
Input Devices
Anoto digital pen (e.g. Magicomm G303), mouse
![Page 15: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/15.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 15
Conclusions
Simple gesture recogniser Java API
Experimental platform for implementing and
testing new gesture recognition algorithms
Definition and evaluation of new gesture sets
Extensibility in terms of
input devices
algorithms
gestures sets
![Page 16: iGesture: A General Gesture Recognition Framework](https://reader036.fdocuments.in/reader036/viewer/2022062704/5560f72ed8b42a0e408b4abb/html5/thumbnails/16.jpg)
ICDAR 2007, September 26 Beat Signer, [email protected] 16
References
B. Signer, M. C. Norrie and U. Kurmann. iGesture: A
Java Framework for the Development and Deployment
of Stroke-Based Online Gesture Recognition Algorithms.
Technical Report ETH Zurich TR 561, September 2007
iGesture Framework,
Apache License, V2.0
http://www.igesture.org