Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A...
-
Upload
ferdinand-turner -
Category
Documents
-
view
214 -
download
0
Transcript of Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A...
![Page 1: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/1.jpg)
Compiled By:Raj G Tiwari
![Page 2: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/2.jpg)
A pattern is an object, process or event that can be given a name.
A pattern class (or category) is a set of patterns sharing common attributes and usually originating from the same source.
During recognition (or classification) given objects are assigned to prescribed classes.
A classifier is a machine which performs classification.
![Page 3: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/3.jpg)
• Optical Character
Recognition (OCR)
• Biometrics
• Diagnostic systems
• Military applications
• Handwritten: sorting letters by postal code, input device for PDA‘s.
• Printed texts: reading machines for blind people, digitalization of text documents.
• Face recognition, verification, retrieval. • Finger prints recognition.• Speech recognition.
• Medical diagnosis: X-Ray, EKG analysis.• Machine diagnostics, waster detection.
• Automated Target Recognition (ATR).
• Image segmentation and analysis (recognition from aerial or satelite photographs).
![Page 4: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/4.jpg)
“The assignment of a physical object or event to one of several pre-specified categories” –Duda and Hart
“The science that concerns the description or classification (recognition) of measurements” –Schalkoff
“The process of giving names ω to observations x” –Schürmann
Pattern Recognition is concerned with answering the question “What is this?” –Morse
![Page 5: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/5.jpg)
Adaptive Signal Processing Machine Learning Artificial Neural Networks Robotics and Vision Cognitive Sciences Mathematical Statistics Nonlinear Optimization Exploratory Data Analysis Fuzzy and Genetic systems Detection and Estimation Theory Formal Languages Structural Modeling Biological Cybernetics Computational Neuroscience
![Page 6: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/6.jpg)
Lie detector,Handwritten digit/letter recognitionBiometrics: voice, iris, finger print, face, and gait recognitionSpeech recognitionSmell recognition (e-nose, sensor networks)Defect detection in chip manufacturingReading DNA sequencesFruit/vegetable recognitionMedical diagnosisNetwork traffic modeling, intrusion detection… …
![Page 7: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/7.jpg)
x
nx
x
x
2
1Feature vector
- A vector of observations (measurements). - is a point in feature space .
![Page 8: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/8.jpg)
![Page 9: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/9.jpg)
![Page 10: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/10.jpg)
The quality of a feature vector is related to its ability to discriminate examples from different classes◦ Examples from the same class should have
similar feature values◦ Examples from different classes have different
feature values
![Page 11: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/11.jpg)
![Page 12: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/12.jpg)
12
“Sorting incoming Fish on a conveyor according to species using optical sensing”
Sea bassSpecies
Salmon
![Page 13: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/13.jpg)
13
Problem Analysis
◦ Set up a camera and take some sample images to extract features
Length Lightness Width Number and shape of fins Position of the mouth, etc…
This is the set of all suggested features to explore for use in our classifier!
![Page 14: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/14.jpg)
14
Preprocessing
◦ Use a segmentation operation to isolate fishes from one another and from the background
Information from a single fish is sent to a feature extractor whose purpose is to reduce the data by measuring certain features
The features are passed to a classifier
![Page 15: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/15.jpg)
15
![Page 16: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/16.jpg)
16
Classification
◦ Select the length of the fish as a possible feature for discrimination
![Page 17: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/17.jpg)
17
![Page 18: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/18.jpg)
18
The length is a poor feature alone!
Select the lightness as a possible feature.
![Page 19: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/19.jpg)
19
![Page 20: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/20.jpg)
20
Threshold decision boundary and cost relationship
◦ Move our decision boundary toward smaller values of lightness in order to minimize the cost (reduce the number of sea bass that are classified salmon!)
Task of decision theory
![Page 21: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/21.jpg)
21
Adopt the lightness and add the width of the fish
Fish xT = [x1, x2]
Lightness Width
![Page 22: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/22.jpg)
22
![Page 23: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/23.jpg)
23
We might add other features that are not correlated with the ones we already have. A precaution should be taken not to reduce the performance by adding such “noisy features”
Ideally, the best decision boundary should be the one which provides an optimal performance such as in the following figure:
![Page 24: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/24.jpg)
24
![Page 25: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/25.jpg)
25
However, our satisfaction is premature because the central aim of designing a classifier is to correctly classify novel input
Issue of generalization!
![Page 26: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/26.jpg)
26
![Page 27: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/27.jpg)
27
Sensing
◦ Use of a transducer (camera or microphone)◦ PR system depends of the bandwidth, the
resolution sensitivity distortion of the transducer
Segmentation and grouping
◦ Patterns should be well separated and should not overlap
![Page 28: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/28.jpg)
28
![Page 29: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/29.jpg)
29
Feature extraction◦ Discriminative features◦ Invariant features with respect to translation, rotation
and scale.
Classification◦ Use a feature vector provided by a feature extractor to
assign the object to a category
Post Processing◦ Exploit context input dependent information other than
from the target pattern itself to improve performance
![Page 30: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/30.jpg)
Consider the problem of recognizing the letters L,P,O,E,Q◦ Determine a sufficient set of features◦ Design a tree-structured classifier
![Page 31: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/31.jpg)
31
Data collection Feature Choice Model Choice Training Evaluation Computational Complexity
![Page 32: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/32.jpg)
32
![Page 33: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/33.jpg)
33
Data Collection
◦ How do we know when we have collected an adequately large and representative set of examples for training and testing the system?
![Page 34: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/34.jpg)
34
Feature Choice
◦ Depends on the characteristics of the problem domain. Simple to extract, invariant to irrelevant transformation insensitive to noise.
![Page 35: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/35.jpg)
35
Model Choice
◦ Unsatisfied with the performance of our fish classifier and want to jump to another class of model
![Page 36: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/36.jpg)
36
Training
◦ Use data to determine the classifier. Many different procedures for training classifiers and choosing models
![Page 37: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/37.jpg)
37
Evaluation
◦ Measure the error rate (or performance and switch from one set of features to another one
![Page 38: Compiled By: Raj G Tiwari. A pattern is an object, process or event that can be given a name. A pattern class (or category) is a set of patterns sharing.](https://reader036.fdocuments.in/reader036/viewer/2022062518/56649eb25503460f94bb8dbc/html5/thumbnails/38.jpg)
38
Computational Complexity
◦ What is the trade-off between computational ease and performance?
◦ (How an algorithm scales as a function of the number of features, patterns or categories?)