Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same...

56
Digital Image Correlation: Overview of Principles and Software Correlated Solutions, Inc.

Transcript of Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same...

Page 1: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Digital Image Correlation: Overview of

Principles and Software

Correlated Solutions, Inc.

Page 2: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

2D Image Correlation Fundamentals

Page 3: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Outline

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Page 4: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Introduction

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Page 5: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Purpose

Deformation

measurement

▫ Full-field

measurement

▫ Non-intrusive

▫ Planar specimen only

▫ No out of plane motion

Page 6: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Purpose

▫ Large range of size scales

(10-9 to 102 m.)

▫ Large range of time scales

(static to 200MHz)

Page 7: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Monocular (cyclopean)

vision cannot determine

the size of objects

▫ Consequence: a 200%

isotropic deformation of

an object produces the

same image as if the

object was moved to one-

half its original distance

from the visual sensor

▫ We must assume the

object is planar, parallel

to and at a constant

distance from the visual

sensor during the entire

experiment

Page 8: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Image Correlation Technique

▫ How? Given a point and its signature in the

undeformed image, search/track in deformed

image for the point which has a signature which

maximizes a similarity function

Time t Time t”Time t’

trackingtracking

Page 9: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Image Correlation Technique

▫ In practice, a single value is not a unique

signature of a point, hence neighboring pixels

are used

▫ Such a collection of pixel values is called a

subset or window

Time t Time t’

Page 10: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Image Correlation Technique

▫ The uniqueness of

each signature is

only guaranteed if

the surface has a

non repetitive,

isotropic, high

contrast pattern

▫ Random textures

fulfill this constraint

(speckle pattern)

Repetitive

Anisotropic

High-contrast

Non-repetitive

Anisotropic

High-contrast

Non-repetitive

Isotropic

Low-contrast

Non-repetitive

Isotropic

High-contrast

Page 11: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Matching by DIC

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Page 12: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example

▫ The camera acquires 9x9 pixel images

▫ The specimen is marked with a cross-like pattern

Pixels

Image, on screen

Page 13: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example

▫ White pixels are gray level 100

▫ Black pixels are gray level 0

▫ An image is a matrix of natural integers

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

Image, on screenImage, in memory

Page 14: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example

▫ The specimen moves such that its image moves 1 pixel up

and right

100 100 100 0 100 100

100 100 100 0 100 100

0 0 0 0 0 0

100 100 100 0 100 100

100 100 100 0 100 100

100 100 100 0 100 100

100 0 0

100 0 0

0 0 0

100 0 0

100 0 0

100 0 0

0 0 0

0 0 0

100 0 0

0 0 0

0 0 0

0 100 100

0 0 0

0 0 0

100 100 100

Image after motion, on screenImage after motion, in memory

Page 15: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example: we define a 5x5 subset in the reference image

(before motion)

▫ Problem: find where the subset moved (matching)

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

Image before motion

100 100 100 0 100 100

100 100 100 0 100 100

0 0 0 0 0 0

100 100 100 0 100 100

100 100 100 0 100 100

100 100 100 0 100 100

100 0 0

100 0 0

0 0 0

100 0 0

100 0 0

100 0 0

0 0 0

0 0 0

100 0 0

0 0 0

0 0 0

0 100 100

0 0 0

0 0 0

100 100 100

Image after motion

?

Subset

Page 16: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Solution: check possible matches at several locations and use a similarity score (correlation function) to grade them

▫ Classic correlation function: sum of squared differences (SSD) of the pixel values (smaller values = better similarity)

22/

2/,

* )),(),((),,,( jvyiuxIjyixIvuyxCn

nji

Correlation function

Pixel coord., reference image

Displacement (disparity)

n: subset size (9 in our example)

Image before motion Image after motion

Pixel value at (x+i; y+j) Pixel value at (x+u+i; y+v+j)

Page 17: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example: subset at (x;y)=(5;5), displacement candidate (u;v)=(-2;-2)

22

2,

* ))25,25()6,5(()2,2,5,5( jiIjiICji

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

Ima

ge

be

fore

mo

tion

100 100 100 0 100 100

100 100 100 0 100 100

0 0 0 0 0 0

100 100 100 0 100 100

100 100 100 0 100 100

100 100 100 0 100 100

100 0 0

100 0 0

0 0 0

100 0 0

100 0 0

100 0 0

0 0 0

0 0 0

100 0 0

0 0 0

0 0 0

0 100 100

0 0 0

0 0 0

100 100 100

Ima

ge

afte

r mo

tion

(x;y)=(5;5)

(u;v)=(-2;-2)

000,18)0100()1000()1000()1000()100100(

)00()1000()1000()1000()1000(

)00()1000()1000()1000()1000(

)00()1000()1000()1000()1000(

)0100()00()00()00()0100(

22222

22222

22222

22222

22222

Page 18: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example: subset at (x;y)=(5;5), displacement candidate (u;v)=(1;1)

▫ Better correlation score than candidate (u;v)=(-2;-2) [18,000]Indeed it is the smallest score achieveable (perfect match)

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

100 100 100 100 100 100

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

0 0 0

Ima

ge

be

fore

mo

tion

100 100 100 0 100 100

100 100 100 0 100 100

0 0 0 0 0 0

100 100 100 0 100 100

100 100 100 0 100 100

100 100 100 0 100 100

100 0 0

100 0 0

0 0 0

100 0 0

100 0 0

100 0 0

0 0 0

0 0 0

100 0 0

0 0 0

0 0 0

0 100 100

0 0 0

0 0 0

100 100 100

Ima

ge

afte

r mo

tion

(x;y)=(5;5)

(u;v)=(1;1)

0)1,1,5,5( C

Page 19: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ In reality, images are corrupted by some noise

▫ The SSD function will likely never be 0 for a perfect match

103 101 99 105 100 96

101 104 98 101 98 100

103 96 99 102 103 98

98 101 102 96 97 102

97 98 103 103 98 100

102 99 101 104 102 101

2 0 1

1 4 3

0 2 2

0 1 0

0 2 0

2 0 0

1 1 2

0 2 1

0 3 0

3 0 1

0 3 0

2 0 0

2 3 0

1 3 3

0 0 2

99 100 101 2 100 102

101 97 98 0 96 102

0 1 3 1 2 0

97 99 100 0 97 101

101 103 98 1 99 96

102 99 96 3 102 100

102 3 0

101 1 2

3 2 0

101 3 2

101 0 1

103 2 3

0 2 1

0 1 1

103 0 2

1 0 3

2 2 0

1 102 101

1 0 3

1 3 2

101 100 100

Image before motion Image after motion

Page 20: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Principle

▫ Example

▫ The specimen moves such that its image moves 0.5

pixel to the right

▫ Need to interpolate the image at non-integer locations

103 101 99 55 100 96

101 104 98 51 98 100

103 96 99 52 103 98

98 101 102 46 97 102

97 98 103 53 98 100

102 99 101 54 102 101

52 0 1

51 4 3

49 2 2

52 1 0

51 2 0

48 0 0

1 1 2

0 2 1

0 3 0

3 0 1

0 3 0

2 0 0

2 3 0

1 3 3

0 0 2

Perfect match

Page 21: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Photometric Mapping

▫ During image acquisition:

▫ Lighting conditions may change

▫ Sensor integration time adjusted

▫ Pattern may become lighter/darker when

expanded/compressed

Page 22: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Photometric Mapping

▫ The photometric mapping is not

guaranteed to be an identity, hence the

DIC algorithm may have false matches

▫ Solution: model the photometric

transformation and use it to design a

robust correlation function

Page 23: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Displacement Mapping

▫ General circumstances:

▫ The subset in the deformed image has changed

shape, e.g. a square initial subset is likely to be non-

square

Time t Time t’Specimen deformation

Page 24: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Displacement Mapping

▫ Solution: model this displacement

transformation (called subset shape function)

and use it to define the deformed subset

Page 25: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Image Interpolation

▫ Optimization algorithms require the criterion

to be continuous over its parameter space

▫ Images are discrete, hence we need to

reconstruct the continuous information by

means of interpolation

▫ B-splines are a good choice for that purpose

Raw image Bi-linear B-spline interp. Bi-cubic B-spline interp.

Page 26: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Conclusions

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Summary

Acknowledgments

Conclusions

Page 27: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Principle

Measuring Displacem.

Introduction

Principle

Photometric Mapping

Displacement Mapping

Advanced Topics

Matching by DIC

Method

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Summary

▫ Matching process

▫ Photometric mapping

▫ Shape function

▫ Implications

Time t Time t”Time t’

trackingtracking

Page 28: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual
Page 29: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Three-Dimensional Digital Image Correlation

Overview

Page 30: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Outline

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 31: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Introduction

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 32: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Purpose

▫ 3-D shape

▫ Strain map

▫ Full-field measurement

▫ Non-intrusive

▫ Any specimen shape

▫ Any motion

Page 33: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Purpose

▫ Large range of size

scales

(10-9 to 102 m.)

3-D shape of letter „R‟ from “E PLURIBUS UNUM” on U.S. Penny coin using a Scanning Electron

Microscope

1X 50X 200X

Page 34: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Basic Idea

▫ Much like human

vision, two imaging

sensors provide

enough information to

perceive the

environment in three-

dimensions

Page 35: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Basic Idea

▫ DIC for stereo-

matching: two

3-D shapes

▫ DIC for

tracking:

relates the two

3-D shapes

through time

Temporal matching

(tracking)

Matching

by stereo-correlation

3-D

Matching by

stereo-correlation

3-DTime t

Time t’

Page 36: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Principle

▫ Monocular (cyclopean)

vision cannot resolve

for the scale of

objects

Page 37: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Principle

▫ Recovering the three-

dimensional structure

of the environment

using two imaging

sensors is called

stereo-triangulationObject coordinate

system

Page 38: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Principle

▫ Stereo-

triangulation

requires computing

the intersection of

two optical rays

▫ Feasible only if

these rays are

formulated in a

common coordinate

system

▫ We need to model

and calibrate the

stereo-rig

? ?

?

Page 39: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Calibration

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 40: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Model

Perspective projection

Rigid transform Perspective projection

▫ Model: one extrinsic rigid transformation,

two intrinsic perspective projections

Page 41: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Data Acquisition

▫ Acquire pairs of

images of a special

target undergoing

arbitrary motions

▫ Calibration is shape

measurement process

(bundle-adjustment)

Page 42: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Parameter Estimation

▫ Dedicated pattern

recognition algorithm

Stereo RigTarget

3-D points

(approx.

known)

Pairs of

2-D points

(auto-recognized)

Transfer function

▫ Identification of the

transfer function Calibration target examples

Left: raw image, right: automatic pattern

recognition

Page 43: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Parameter Estimation Techniques

▫ Bundle Adjustment

▫ No knowledge of calibration target required

aside from a scale.

▫ Shape of the target is measured during calibration.

▫ Typically, a relatively flat target is used for

initialization through a linear method.

▫ Generally regarded as the optimal method to

calibrate cameras.

▫ Complex to implement due to large equation

systems.

▫ Require block matrix solvers to efficiently invert

large equation systems.

▫ Can provide confidence margins on all

parameters estimated.

Page 44: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Parameter Estimation Techniques

▫ There are only two constraints required

to accomplish calibration.

1. The calibration target must not deform

between images.

2. A distance between two points on the

target must be known.

Page 45: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Matching by DIC

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 46: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

3-D Reconstruction

▫ 3-D Shape Measurement given a pair of images

Temporal matching

(tracking)

Matching

by stereo-correlation

3-D

Matching by

stereo-correlation

3-DTime t

Time t’

Page 47: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

3-D Reconstruction

Two steps:

1. Stereo-correlation

2. Stereo-triangulation

Page 48: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Tracking: Similar to 2-D DIC

▫ Allow to

relate 3-D

shapes

through

time

▫ Algorithms

similar to

2-D DIC

Temporal matching

(tracking)

Matching

by stereo-correlation

3-D

Matching by

stereo-correlation

3-DTime t

Time t’

Page 49: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Combining everything

▫ The technology

behind 3-D DIC

▫ Stereo-correlation

▫ Tracking by

correlation

▫ Stereo-

triangulation

(needs

calibration)

Temporal matching

(tracking)

Matching

by stereo-correlation

3-D

Matching by

stereo-correlation

3-DTime t

Time t’

Page 50: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Combining everything

▫ Example

Page 51: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Strain Computation

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Limitations, Benefits

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 52: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Principle

▫ Strains are computed from the measured

displacements of object points

(strains displacements)

3-D shape at time t

3-D shape at time t’

3-D displacement

Page 53: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Principal

▫ Strains are only defined in the tangential

plane of the surface.

▫ The DIC data can be converted to a

triangular mesh.

▫ Since triangles are planar by definition, it

is simple to compute the strain on each

triangle.

▫ Same equations as found

in FEM.

Page 54: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Smoothing

▫ The strains computed on each triangle are

noisy, unless the triangles are fairly large.

▫ The strains are normally smoothed using

low-pass filters.

▫ Low-pass filtering decreases spatial

resolution.

Page 55: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Conclusions

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Principle

Strain Computation

Summary

Acknowledgments

Conclusions

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Page 56: Digital Image Correlation: Overview of Principles and Software€¦ · an object produces the same image as if the object was moved to one-half its original distance from the visual

Purpose

Basic Idea

Camera Convention

Principle

Introduction

Model

Estimation

Calibration

Stereo Matching

Tracking

Stereo Tracking

Lens Distortion

Matching by DIC

Limitations, Benefits

Acknowledgments

Conclusions

Principle

Strain Computation

Summary

▫ Matching process – identical to 2D

▫ Combining matching with triangulation

▫ Combining triangulation with tracking