Post on 02-Jan-2016
1
Sketch tools and Related Research
Rachel Patel
2
Outline
Introduction InkKit Introduction InkKit DEMO Rachel’s Research
Exploring better techniques for diagram recognition
3
Introduction
DiagrammingPaper & Pen vs Tablet PC
•Flexibility•Encourages creativity>>Better designs
•Interaction like pen & paper
•Easy distribution•More formal>>Better designs
4
InkKit
Diagramming sketch tool Domain independent Example driven recognition Can transform diagrams into various
formats e.g. Word documents, HTML, java
5
InkKit’s Recognition Engine
Divider
Stro
kes
Tablet OS Recognition engine
Joiner Basic Shape Recognition
Component Recognition
Domain SpecificDomain Independent
Com
ponent
sWords
Shapes
•InkKit DEMO
6
Rachel’s Research – Outline
Exploring better techniques for diagram recognition Motivation Method Experimental Results Implementation & DEMO Conclusions & Future Work
7
Motivation
Accurate recognition is vital to InkKit
Made difficult by the presence of both words and shapes in diagrams
Improving the divider of words and shapes is my focus
Also interested in improving basic shape recognition
8
Method
Gathered sketches Extracted data Special interest in pressure and
time data Analyzed data to identify which
features could be used to distinguish between shapes and words
Implement & Evaluate
9
Experimental Results I
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
150
160
170
180
0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 1700 1800 1900 2000 2100
Time (Ticks)
Pre
ss
ure
Text
Text 2
Rectangle
Pen pressure for word and shape strokes
10
Experimental Results II
0
10
20
30
40
50
60
70
80
90
100
110
120
130
140
0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 1700 1800 1900 2000 2100 2200 2300
Time (ticks)
Dis
tan
ce
Circle
Rectangle
Speed of circle and rectangle shape stroke
11
Experimental Results III
Decision tree for word/shape divider
12
Implementation
3 main dividers My divider InkKit’s existing divider Microsoft divider
Variations of my divider and the existing divider in terms of stroke grouping Single Strokes Intersecting Strokes Close Strokes
DEMO
13
Conclusion and Future Work
Currently evaluating my divider against InkKit’s existing divider Microsoft divider
Further statistical analysis is being carried out in regards to improving basic shape recognition
14
Questions ???