Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept....

25
Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA [email protected], http://www.DocJava.com Copyright 2002 © DocJava, Inc.

Transcript of Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept....

Page 1: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Interactive Heuristic Edge Detection

Douglas A. Lyon, Ph.D.Chair, Computer Engineering Dept. Fairfield

University, CT, USA

[email protected], http://www.DocJava.com

Copyright 2002 © DocJava, Inc.

Page 2: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Background

• It is easy to find a bad edge!• We know a good edge when we see it!

Page 3: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

The Problem

• Given an expert + an image.

• The expert places markers on a good edge.

• Find a way to connect the markers.

Page 4: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Motivation

• Experts find/define good edges

• Knowledge is hard to encode.

Page 5: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Approach

• Mark an important edge

• Pixels=graph nodes

• Search in pixel space using a heuristic

• A* is faster than DP

Page 6: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Assumptions

• User is a domain expert

• Knowledge rep=heuristics+markers

Page 7: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Applications

• Photo interpretation

• Path planning (source+destination)

• Medical imaging

Page 8: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Photo Interpretation

Page 9: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Echocardiogram

•3D-multi-scale analysis

Page 10: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Path Plans, the idea

Page 11: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Path Planning-pre proc.•hist+thresh

•Dil+Skel

Page 12: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Path Planning - Search

Page 13: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

The Idea

• The mind selects from filter banks

• The mind tunes the filters

Page 14: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Gabor filter w/threshold

• The Strong edge is the wrong edge!

Page 15: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Sub bands for 3x3 Robinson

Page 16: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Sub Bands 7x7 Gabor

Page 17: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Gabor-biologically motivated

Page 18: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Log filters=prefilter+laplacian

2 1

2 2 ex 2 y 2

2 2

1

4 1 x2 y2

2 2

ex 2 y 2

2 2

2 f (x, y) 2 f

x2 2 f

y2

Page 19: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Mexican Hat (LoG Kernel)

Page 20: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

The Log kernel

Page 21: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Oriented Filters are steerable

Page 22: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Changing Scale at 0 Degrees

Page 23: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Changing Phase at 0 degrees

Page 24: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

Summary

• Heuristics+markers= knowledge• Low-level image processing still needed• Global optimization is not appropriate for

all applications• Sometimes we only want a single, good

edge

Page 25: Interactive Heuristic Edge Detection Douglas A. Lyon, Ph.D. Chair, Computer Engineering Dept. Fairfield University, CT, USA Lyon@DocJava.com, ://.

http://www.DocJava.com