Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat...
Transcript of Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat...
![Page 1: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/1.jpg)
EC-433 Digital Image Processing
Lecture 2
Digital Image Fundamentals
Dr. Arslan Shaukat
1
![Page 2: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/2.jpg)
Fundamental Steps in DIP
![Page 3: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/3.jpg)
Image Acquisition
An image is captured by a sensor (such as a monochrome
or color TV camera) and digitized.
If the output of the camera or sensor is not already in
digital form, an analog-to-digital converter digitizes it.
Pre-processing such as scaling.
![Page 4: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/4.jpg)
Image Enhancement
To bring out detail which is obscured, or simply to
highlight certain features of interest in an image.
![Page 5: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/5.jpg)
Image Enhancement
![Page 6: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/6.jpg)
Enhancing objects of interest
![Page 7: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/7.jpg)
![Page 8: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/8.jpg)
Image Restoration
Improving the appearance of an image
Tend to be based on mathematical or probabilistic models
of image degradation
Distorted Image Restored Image
![Page 9: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/9.jpg)
Color Image Processing
Gaining in importance because of the significant increase
in the use of digital images over the Internet
![Page 10: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/10.jpg)
Wavelets
Foundation for representing images in various degrees of
resolution.
Used in image data compression and pyramidal
representation (images are subdivided successively into
smaller regions)
![Page 11: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/11.jpg)
Compression
Reducing the storage required to save an image or the
bandwidth required to transmit it.
Example is JPEG (Joint Photographic Experts Group)
image compression standard.
![Page 12: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/12.jpg)
Morphological Processing
Tools for extracting image components that are useful in
the representation and description of shape.
![Page 13: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/13.jpg)
Image Segmentation
Image processing system tries to separate objects from
the image background
Output of the segmentation stage is raw pixel data,
constituting either the boundary of a region or all the
points in the region itself.
![Page 14: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/14.jpg)
Segmentation
![Page 15: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/15.jpg)
Segmentation
http://people.csail.mit.edu/xgwang/SLDA.html
![Page 16: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/16.jpg)
http://www.umiacs.umd.edu/~mishraka/downloads/iccv2009_activeSeg.pdf
![Page 17: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/17.jpg)
Representation & Description
Representation make a decision whether the data
should be represented as a boundary or as a complete
region.
– Boundary representation focus on external shape
characteristics, such as corners and inflections.
– Region representation focus on internal properties, such as
texture or skeleton shape.
Description, also called feature selection, deals with
extracting attributes that result in some quantitative
information of interest or are basic for differentiating one
class of objects from another.
![Page 18: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/18.jpg)
Representation & Description
![Page 19: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/19.jpg)
Recognition
Recognition the process that assigns a label to an
object based on the information provided by its
descriptors.
![Page 20: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/20.jpg)
Knowledge Base
A problem domain detailing regions of an image
where the information of interest is known to be located.
Help to limit the search
![Page 21: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/21.jpg)
Not All the Processes are Required
Example: Postal Code Problem
![Page 22: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/22.jpg)
Human Visual Perception
Developing a basic understanding of human visual
perception
Interest lies in the mechanics and parameters related to
how images are formed in the eye.
![Page 23: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/23.jpg)
Human Eye
The eye's lens, iris & cornea form
the optical system to projects an
upside down image onto retina
The iris is a membrane in the eye,
responsible for controlling the
diameter and size of the pupil and
the amount of light reaching the
retina.
The pupil is an opening located in
the centre of the iris of the eye that
allows light to enter the retina
Retina contains the light sensors
![Page 24: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/24.jpg)
Retina – The Sensor Chip
Cones -- Responsible for bright-light vision
(Photopic Vision)
• 6 to 7 million
• Resolve fine details
• High visual resolution
Rods -- Responsible for dim-light vision
(Scotopic Vision)
• 75 to 150 million
• Lesser details – overall picture
• Monochrome vision
![Page 25: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/25.jpg)
Image Formation in the Eye
The distance between the lens and the retina is fixed.
Focal length needed to achieve proper focus is obtained
by varying the shape of the lens.
![Page 26: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/26.jpg)
Brightness Discrimination
The ability of the eye to
discriminate between
changes in brightness is of
considerable interest.
I is a uniform illumination
on a flat area large enough to
occupy the entire field of
view.
ΔIc is the change in the
object brightness required to
just distinguish the object
from the background
Weber's ratio: ΔIc/I
If ΔIc/I is small
Good brightness discrimination
If ΔIc/I is large
Poor brightness discrimination
![Page 27: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/27.jpg)
Weber Ratio
Brightness discrimination is poor (the Weber ratio is large) at low
levels of illumination, and it improves significantly (the Weber
ratio decreases) as background illumination increases.
At low levels of illumination vision is carried out by rods, whereas
at high levels (showing better discrimination) vision is the function
of cones.
![Page 28: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/28.jpg)
Brightness Discrimination
Brightness is not a simple
function of intensity.
Visual system tends to
undershoot or overshoot
around the boundary of
regions of different
intensities.
The intensity of the stripes is
constant but we actually
perceive a different
brightness pattern.
![Page 29: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/29.jpg)
Simultaneous Contrast
All the small squares have exactly the same intensity, but
they appear to the eye progressively darker as the
background becomes brighter.
Region’s perceived brightness does not depend simply on
its intensity.
![Page 30: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/30.jpg)
Human Perception Phenomena
![Page 31: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/31.jpg)
Imaging Source --- Illumination
– Sunlight, X-Rays
Reflectance
– Certain wavelengths absorbed; certain reflected
Imaging Surface
– Sensor or Eye
– The reflected or transmitted energy is focused onto a photo
converter (e.g., a phosphor screen), which converts the energy
into visible light
Components of an Image Formation
![Page 32: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/32.jpg)
Image Sensing and Acquisition
Incoming energy is
transformed into a
voltage by the
combination of input
electrical power and
sensor material
The output voltage
waveform is the
response of the
sensor(s), and a digital
quantity is obtained from
each sensor by digitizing
its response.
![Page 33: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/33.jpg)
Image Acquisition
![Page 34: Lecture 2 Digital Image Fundamentals Dr. Arslan … 2 Digital Image Fundamentals Dr. Arslan Shaukat 1 Fundamental Steps in DIP Image Acquisition An image is captured by a sensor (such](https://reader031.fdocuments.in/reader031/viewer/2022021511/5accf9337f8b9ab10a8d1167/html5/thumbnails/34.jpg)
Image Acquisition
Collect the incoming energy and focus it onto an image
plane.
If the illumination is light, the front end of the imaging
system is a lens, which projects the viewed scene onto the
lens focal plane.
The sensor array, which is coincident with the focal
plane, produces output voltage.
Digital and analog circuitry sweep these outputs and
convert them to an analog signal, which is then digitized
by another section of the imaging system.
The output is a digital image.