DigitalImageFundamentalas_GM.ppt
Transcript of DigitalImageFundamentalas_GM.ppt
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
1/50
Digital Image Processing in Life Sciences
March 14th, 2012
Lecture number 1: Digital Image Fundamentals
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
2/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
3/50
Terms to be conveyed:
Pixel
Gray level
Bit depth
Dynamic range
Connectivity types/neighborhood
Interpolation types
Look-up tables
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
4/50
Book:
Digital Image Processing, Rafael C. Gonzales and Richard E.Woods
Web resources:
www.microscopy.fsu.edu (very thorough and informative)
www.cambridgeincolour.com (beautiful examples, excellent tutorials)
http://www.microscopy.fsu.edu/http://www.cambridgeincolour.com/http://www.cambridgeincolour.com/http://www.microscopy.fsu.edu/ -
7/29/2019 DigitalImageFundamentalas_GM.ppt
5/50
Next topics:
2. Image enhancement in the spatial domain
3. Segmentation
4. Image enhancement in the frequency domain
5. Multi dimensional image processing
6-7. Guest lectures-TBD
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
6/50
What Is A Digital Image?
Image= a two-dimensional function, f(x,y), where x and y are spatialcoordinates, and the amplitude of f at any pair of coordinates (x, y) is
called the intensity (gray level of the image) at that point. When x, y, andthe amplitude values of f are all finite, discrete quantities, we call theimage a digital image. (Gonzalez and Woods).
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
7/50
These sets of numbers can be depicted in terms of frequencies
http://cvcl.mit.edu/hybrid_gallery/gallery.html
http://cvcl.mit.edu/hybrid_gallery/gallery.htmlhttp://cvcl.mit.edu/hybrid_gallery/gallery.html -
7/29/2019 DigitalImageFundamentalas_GM.ppt
8/50
We can define three types of computerized processes:
Low-, mid-, and high-level.
Low: image preprocessing, noise reduction, enhance contrast etc.
Mid: segmentation, sorting and classification.
High: assembly of all components into a meaningful coherent form
Digital Image Processing-Points to consider:
Why process?
Are both the input and output of a process images?
Where does image processing stop and image analysis start?
Are the processing results intended for human perception or for machine perception?
Character recognition and fingerprint comparisons vs intelligence photos
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
9/50
Digital image origins-
The digital image dates back to
the 1920s and the Bartlane cable picture transmission system between NY and
London. The image took 3 hours to transmit, instead of more than one week.
They started with 5 tone levels and increased to 15 levels by 1929.
Taken from Gonzalez and Woods
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
10/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
11/50
Essential steps when processing digital images:
Acquisition
Enhancement
Restoration
Color image restoration
Wavelets
Morphological processing
Segmentation
Representation
Recognition
Outputs are
digital images
Outputs are
attributes ofthe image
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
12/50
Image acquisition
Acquire or receive an image for further processing.
This step has a major impact over the entire procedure of processing and
analysis.
Image Enhancement
Improving quality subjectively (e.g. by change of contrast)
Image Restoration
Improving quality objectively (e.g. by removing psf)
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
13/50
microscopy.fsu.edu
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
14/50
microscopy.fsu.edu
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
15/50
microscopy.fsu.edu
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
16/50
Morphological processing
Extracting components for the purpose of representing shapes
Segmentation
Deconstructing the image into its constituent objects. A crucial step for
successful recognition of the image contents.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
17/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
18/50
Morphological processing
Extracting components for the purpose of representing shapes
Segmentation
Deconstructing the image into its constituent objects. A crucial step for
successful recognition of the image contents.
Representation
Feature selection-classification/grouping of objects
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
19/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
20/50
Keep in mind:
The sensor we used to create the image has a continuous output.
But, the transition from a continuum to a digital image requires two processes:sampling and quantization.
Sampling is the process of digitizing the spatial coordinates.
Quantization is the process of digitizing the amplitude values at those spatialcoordinates.
The arrangement of the sensor used to create the image determines the samplingmethod and its output.
Different limits determine the performance of the optical sensors and of the
mechanical sensors.
Sampling and quantization
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
21/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
22/50
Sampling and quantization result in arrays of discrete quantities.
By convention, the coordinate (x,y)=(0,0) is located at the upper leftmost
corner of the image.
picture elements=image elements=pels=pixels
(Gonzales and Woods)
Sampling results in typical image sizes that can vary from 128 x 128 to 4096 x
4096 or any combination thereof.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
23/50
An Image Formation Model
Let l(x0, y0) be the gray level (gl) value at (x0, y0) : l=f (x0, y0)
l is bounded by Lmin and Lmax and the boundary [Lmin, Lmax] is the gray scale.
This interval is usually shifted to [0, L-1] where 0 represents black gl values,
and L-1 represents white gl values.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
24/50
Quantization results in discrete values of gray levels, typically an integer power of
2: L=2k .
If k=8, the result is 256 gray levels, from 0 to 255.
Dynamic range- the portion of the gray levels in the image out of the entire gray
scale of the image.
Think about high vs low dynamic range images: how does the dynamic range
affect the contrast of the image? Next lecture
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
25/50
Gray level (bit-depth)
Resolution
How many bits are required to save a digital image?
b=M x N x k (or M2k for images of equal dimensions).
Size (kb)
8 (256) 12 (4096) 16 (65536)
128 16.384 24.576 32.768
256 65.536 98.304 131.072
512 262.144 393.216 524.288
1024 1048.576 1572.864 2097.152
2048 4194.304 6291.456 8388.608
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
26/50
8bit images- values are integers, unsigned
16bit images- values are integers, some softwares allow signed.
32bit images-floating-point, signed.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
27/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
28/50
Spatial and gray-level resolution
Spatial resolution is rather intuitive, and is determined by the quality and density of
the sampling.
Sampling theories (eg Nyquist-Shannon) state that sampling should be performed at
a rate that is at least twice the size of the smallest object/highest frequency.Based on this, over-sampling and under-sampling (=spatial aliasing) can occur.
Gray level resolution is a term used to describe the binning of the signal rather thanthe actual difference we managed to obtain when we quantized the signal. 8-bit and
16-bit images are the most common ones, but 10- and 12-bit images can also be
found.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
29/50
128 x 128
256 x 256
512 x 512
64 x 64
Changing the resolution of the image without changing bit-depth
checker board patterns
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
30/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
31/50
2bit
3bit
4bit
8bit
1bit
Changing the bit-depth of the image without changing resolution
False contouring
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
32/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
33/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
34/50
(x+1, y), (x-1, y), (x, y+1), (x, y-1)= 4 neighbors of p, or N4(p)
(x+1, y+1), (x+1, y-1), (x-1, y+1), (x-1, y-1)= the four diagonal neighbors, or Nd(p).
N4(p) together with Nd(p) are N8(p).
Consider the case of image borders.
Neighbors of a pixel
(x,y) (x+1, y)(x-1, y)
(x, y+1)
(x, y-1)
(x+1, y+1)
(x+1, y-1)
(x-1, y+1)
(x-1, y-1)
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
35/50
Adjacency/Connectivity, Regions, and Boundaries
Pixels are said to be connected if they are neighbors and if their gray levels
satisfy a specified criterion of similarity.
Consider this example of binary
pixels
V- the set of gray levels used to define adjacency. In this binary example, V={0}
to define adjacency of pixels with the value 0. In non-binary images, the valuesof V can have a wider range.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
36/50
The region R of an image- a subset of pixels which is a connected set, meaning that
there exists a path that connects the adjacent pixels.
The boundary (=border=contour) of R is the set of pixels in R that have one or more
neighbors that are not in R.
What happens when R is the entire image?
Do not confuse boundary with edge. The edge is formed by discontinuity of gray
levels at a certain point.
In binary images, edges and boundaries correspond.
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
37/50
Distances between pixels
Between (x,y) and (s,t):
Eucladian distance: given by Pythagoras
D4 distance (=city-block distance):D4(p, q) = |x s| + |y t|.
3,3
3,2
3,1
4,22,2
2,31,3 4,3 5,3
4,43,42,4
3,5
0
1
1
1
1
2 2
2
2
2
2
2
2
Diamond pattern
Pixel coordinates:
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
38/50
D8(p, q) =max( |x s| , |y t|) results in a square pattern around the center pixel.
0
1
1
1
1
1 1
2
2
1
2
1
2
2 2
2
2
22
22
2
2
22
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
39/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
40/50
Zooming and shrinking digital images
Zoom: 1. Create new pixel locations
2. Assign gray level values to the locations
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
41/50
For increasing the size of an image an integer number of times, the
method of pixel replication is used.
For example, when changing a 512 x 512 image to 1024 x 1024, every
column and every row in the original image is duplicated.
At high magnification factors, checkerboard patterns appear.
Nearest neighbor interpolation
Bilinear interpolation (2 x 2)
Bicubic interpolation (4 x 4)
Examples of non-adaptive interpolation
Scaling up using different methods
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
42/50
Pixel replication
Bilinear
Bicubic
Scaling up using different methods
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
43/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
44/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
45/50
Look up tables:
Save computational time (LUTs can be found early in history)
Require a mapping or transformation function- an equation that converts thebrightness value of the input pixel to another value in the output pixel
Do not alter pixel values
Image transformations that involve look-up tables can be implemented by either
one of two mechanisms: at the input so that the original image data aretransformed, or at the output so that a transformed image is displayed but the
original image remains unmodified.
www.microscopy.fsu.edu
http://www.microscopy.fsu.edu/http://www.microscopy.fsu.edu/ -
7/29/2019 DigitalImageFundamentalas_GM.ppt
46/50
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
47/50
What Is Digital Image Processing?
(The Origins of Digital Image Processing)
Fundamental Steps in Digital Image Processing
Image Sampling and Quantization
Spatial and Gray-Level Resolution
Some Basic Relationships Between Pixels
Zooming and Shrinking Digital Images
Lookup tables
Color spaces
Lectures outline
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
48/50
There are ways to describe color images other than the RGB space
Color space=color gamut
RGB= 3 X 8-bit channels= 24bit= true color
The histograms of RGB images can be viewed either as separate channels or as
the weighted average of the channels.
Some representations of color images calculate a weighted average of green,
red and blue.
Hue-Saturation-Intensity (more intuitive as we perceive the world):
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
49/50
Hue-Saturation-Intensity (more intuitive, as we perceive the world):
Hue= color spectrum, Saturation= color purity, Intensity= brightness
More: Hue-Saturation-Lightness; Hue-Saturation-Brightness
-
7/29/2019 DigitalImageFundamentalas_GM.ppt
50/50
End of Lecture 1
Thank you!