1

Sketch tools and Related Research

Rachel Patel

2

Outline

Introduction InkKit Introduction InkKit DEMO Rachel’s Research

Exploring better techniques for diagram recognition

3

Introduction

DiagrammingPaper & Pen vs Tablet PC

•Flexibility•Encourages creativity>>Better designs

•Interaction like pen & paper

•Easy distribution•More formal>>Better designs

4

InkKit

Diagramming sketch tool Domain independent Example driven recognition Can transform diagrams into various

formats e.g. Word documents, HTML, java

5

InkKit’s Recognition Engine

Divider

Stro

kes

Tablet OS Recognition engine

Joiner Basic Shape Recognition

Component Recognition

Domain SpecificDomain Independent

Com

ponent

sWords

Shapes

•InkKit DEMO

6

Rachel’s Research – Outline

Exploring better techniques for diagram recognition Motivation Method Experimental Results Implementation & DEMO Conclusions & Future Work

7

Motivation

Accurate recognition is vital to InkKit

Made difficult by the presence of both words and shapes in diagrams

Improving the divider of words and shapes is my focus

Also interested in improving basic shape recognition

8

Method

Gathered sketches Extracted data Special interest in pressure and

time data Analyzed data to identify which

features could be used to distinguish between shapes and words

Implement & Evaluate

9

Experimental Results I

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

160

170

180

0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 1700 1800 1900 2000 2100

Time (Ticks)

Pre

ss

ure

Text

Text 2

Rectangle

Pen pressure for word and shape strokes

10

Experimental Results II

0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

0 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 1700 1800 1900 2000 2100 2200 2300

Time (ticks)

Dis

tan

ce

Circle

Rectangle

Speed of circle and rectangle shape stroke

11

Experimental Results III

Decision tree for word/shape divider

12

Implementation

3 main dividers My divider InkKit’s existing divider Microsoft divider

Variations of my divider and the existing divider in terms of stroke grouping Single Strokes Intersecting Strokes Close Strokes

DEMO

13

Conclusion and Future Work

Currently evaluating my divider against InkKit’s existing divider Microsoft divider

Further statistical analysis is being carried out in regards to improving basic shape recognition

14

Questions ???