Slide 1
Slide 1 text
ICDAR 2007, September 26
A General Gesture Recognition Framework
Beat Signer, Ueli Kurmann and Moira C. Norrie
Institute for Information Systems, ETH Zurich
8092 Zurich, Switzerland
Slide 2
Slide 2 text
ICDAR 2007, September 26 Beat Signer, [email protected] 2
Interactive Paper
Digital Pen and Paper
https://beatsigner.com/interactive-
paper.htmlhttps://beatsigner.com/interactiv
e-paper.html
Slide 3
Slide 3 text
ICDAR 2007, September 26 Beat Signer, [email protected] 3
Requirements
▪ Java API
▪ Different types of input devices
▪ digital pen and paper, mouse, etc.
▪ Support application and algorithm developers
▪ Definition and evaluation of new gesture sets
▪ Simple acquisition of gesture data
Slide 4
Slide 4 text
ICDAR 2007, September 26 Beat Signer, [email protected] 4
iGesture Components
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 5
Slide 5 text
ICDAR 2007, September 26 Beat Signer, [email protected] 5
iGesture Admin Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 6
Slide 6 text
ICDAR 2007, September 26 Beat Signer, [email protected] 6
Capture of Samples Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 7
Slide 7 text
ICDAR 2007, September 26 Beat Signer, [email protected] 7
iGesture Test Bench Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 8
Slide 8 text
ICDAR 2007, September 26 Beat Signer, [email protected] 8
iGesture Test Data Tab Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 9
Slide 9 text
ICDAR 2007, September 26 Beat Signer, [email protected] 9
Evaluation Tools Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 10
Slide 10 text
ICDAR 2007, September 26 Beat Signer, [email protected] 10
Recogniser API
Configuration configuration =
XMLTool.importConfiguration(new File(RUBINE));
GestureSet gestureSet =
XMLTool.importGestureSet(new File(RUBINE_SET));
configuration.addGestureSet(gestureSet);
recogniser = new Recogniser(configuration);
...
ResultSet result = recogniser.recognise(note);
Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 11
Slide 11 text
ICDAR 2007, September 26 Beat Signer, [email protected] 11
Gesture Representation Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 12
Slide 12 text
ICDAR 2007, September 26 Beat Signer, [email protected] 12
Recognition Algorithm Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 13
Slide 13 text
ICDAR 2007, September 26 Beat Signer, [email protected] 13
Persistence Common Data Structures
Management
Console
Evaluation
Tools
Recogniser
Slide 14
Slide 14 text
ICDAR 2007, September 26 Beat Signer, [email protected] 14
Current Status
▪ Algorithms
▪ Rubine, SiGeR, E-Rubine, SiGrid
▪ Gesture Sets
▪ Graffiti numbers, Graffiti letters, MS application
gestures, customised multi-stroke gestures
▪ Input Devices
▪ Anoto digital pen (e.g. Magicomm G303), mouse
Slide 15
Slide 15 text
ICDAR 2007, September 26 Beat Signer, [email protected] 15
Conclusions
▪ Simple gesture recogniser Java API
▪ Experimental platform for implementing and
testing new gesture recognition algorithms
▪ Definition and evaluation of new gesture sets
▪ Extensibility in terms of
▪ input devices
▪ algorithms
▪ gestures sets
Slide 16
Slide 16 text
ICDAR 2007, September 26 Beat Signer, [email protected] 16
References
▪ B. Signer, M. C. Norrie and U. Kurmann. iGesture: A
Java Framework for the Development and Deployment
of Stroke-Based Online Gesture Recognition Algorithms.
Technical Report ETH Zurich TR 561, September 2007
▪ iGesture Framework,
Apache License, V2.0
▪ http://www.igesture.org