Connect the Dots
description
Transcript of Connect the Dots
![Page 1: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/1.jpg)
CONNECT THE DOTSIntroduction to Computational and Biological VisionKeren shemesh
![Page 2: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/2.jpg)
INTRODUCTION The game
educative and creational Motivation & Goal
Kids often play the game alone. Errors causing false understanding of the
numerical system. Kids can check themselves.
Known topics in computer vision: OCR Hough and Circular Hough transform
![Page 3: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/3.jpg)
ASSUMPTIONS Dot Circles
circle-shaped in range of 5 to 15 approximately the same size and shape filled black
All numbers same font size All digits
can easily be isolated and extracted horizontal
the intensity of the components is clearly different from the intensity of the background
![Page 4: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/4.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 1 finds all connected dots in the image
Finding all circles using Circular Hough Transform Creating bounding box Filter circles
Ratio of white-pixels/pixels in the bounding box < threshold
The center of the circle is black
![Page 5: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/5.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 1
![Page 6: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/6.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 2 finding all numbers in the image
Extracting all connected components
![Page 7: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/7.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 2 filtering out the potential connected dots
while assuming that a connected dot is not ‘in’ a number And vice versa
![Page 8: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/8.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 2 filtering out components not on the average
height filtering out components not on the average
width
![Page 9: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/9.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 2 Link all digit in the same number
![Page 10: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/10.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 3 Interpreting each digit using OCR detection
pre-saved database of font templates for every number 0-9
the best fit correspondence between a component and the database is calculated using correlation
![Page 11: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/11.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 3
![Page 12: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/12.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 4 matching the dot circles with the numbers by
proximity Match the closest digit of every number to every
dot circle Only the closest circle is matched to each
number - removing spare circles All linked digits are calculated to a number All connected dots with matched numbers are
sorted by the numbers
![Page 13: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/13.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 4
![Page 14: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/14.jpg)
PRINCIPLES OF THE ALGORITHM: STAGE 5 + 6 Drawing lines between connected dots with
sequential numbers using interpolation Filing the image with random numbers
![Page 15: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/15.jpg)
RESULTS
![Page 16: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/16.jpg)
KNOWN ISSUES False identification of number False identification of connected dot Inaccurate OCR detection due to an unknown
font False identification of connected dot and a
number
![Page 17: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/17.jpg)
DISCUSSION AND CONCLUSIONS Correct identification depends on the
components in the image Size Proximity to others Font of the numbers
![Page 18: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/18.jpg)
THE APPLICATION
![Page 19: Connect the Dots](https://reader036.fdocuments.in/reader036/viewer/2022081503/56815ed6550346895dcd7029/html5/thumbnails/19.jpg)
QUESTIONS?