A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems...

38
1 Jing Yi Tou, 1 Yong Haur Tay, 2 Phooi Yee Lau 1 Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2 Hanyang University, Republic of Korea E-mails: {toujy,tayyh}@utar.edu.my , [email protected] A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION TECHNIQUES ON WOOD SPECIES RECOGNITION PROBLEM The 5 th International Conference on Natural Computation and the 6 th International Conference on Fuzzy Systems and Knowledge Discovery (ICNC’09-FSKD’09)

Transcript of A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems...

Page 1: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

1Jing Yi Tou, 1Yong Haur Tay, 2Phooi Yee Lau

1Computer Vision and Intelligent Systems (CVIS) Group,

Universiti Tunku Abdul Rahman (UTAR), Malaysia2Hanyang University, Republic of Korea

E-mails: {toujy,tayyh}@utar.edu.my, [email protected]

A COMPARATIVE STUDY FOR TEXTURE

CLASSIFICATION TECHNIQUES ON WOOD

SPECIES RECOGNITION PROBLEM

The 5th International Conference on Natural Computation and the 6th International

Conference on Fuzzy Systems and Knowledge Discovery (ICNC’09-FSKD’09)

Page 2: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

OUTLINE

• Introduction

• Feature Extraction

• Classifier

• Experiments

• Conclusion

• Acknowledgement

• References

Page 3: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Introduction

Page 4: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Introduction

• What is wood species recognition?

• Wood species recognition is important as different species

of wood has different characteristics and features, these

might affect the results or products when they are used for

different purposes. In the industry, wood material must be

examined before it is selected to be used to produce a

product.

• Applications: construction, conservation, archaeology,

forensic investigation, and etc.

Page 5: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Introduction

Pear Tree

(Pyrus calleryana)

Chinese Fan Palm

(Livistona chinensis)

Coconut Palm

(Cocos nucifera)

Apple Tree (Malus

domestica)

?

?

Page 6: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Wood Cross-section Surface

Sepetir (Species A)

Sindora coriacea

Punah (Species B)

Tetramerista glabra

(Species C)

Myristica iners

Merbau (Species D)

Intsia palembanica

Ramin (Species E)

Gonystylus bancanus

(Species F)

Artocarpus kemando

References:

Menon, P. K. B. (revised by Sulaiman, A. and Lim, S. C.). (1993). Structure and identification of Malayan woods: Malayan forest records no. 25. Malaysia: Forest Research Institute of Malaysia.

?

Page 7: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Texture

• Texture is “the variation of data at scales smaller than the

scales of interest”

• Textures are generally pattern that we can percept from the

surface of an object that helps us recognize what it is and

to predict the properties that it has, such as a smooth or

rough, hard or soft.

References:Petrou, M. and Sevilla, P. G. (2006). Image processing dealing with texture. West Sussex, England: John Wiley & Sons.

Page 8: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Texture

• Applicable in many pattern recognition applications:

• Wood species recognition, face detection, document

analysis, etc.

References:

Tuceryan, M. and Jain, A. K. (1998). Texture analysis. In: The Handbook of Pattern Recognition and Computer Vision. 2nd Edition. (pp 207-248). Singapore: World Scientific Publishing.

Page 9: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Wood Species Recognition [Manual]

• Wood species recognition is performed on the cross-

section surface of the wood samples because it contains

most characteristics

• Experts uses a hand lens (10 x) to view the surface and

identify it with the characteristics observed

Cross-Section Surface

Page 10: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Motivation

• Introducing potential texture analysis algorithm:

• Texture classification is useful to solve various pattern

recognition problems

• Consistent time for the recognition process:

• Experts may take up to days or weeks to determine the

species of a wood due to the number of species and

difficulties to differentiate certain species

• Demand from the market:

• Could be used in furniture manufacture, construction,

immigration, forensics, wood studying firms and etc

Page 11: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Objectives

• To recognize the wood species through the cross section

surface of the wood samples through different texture

classification techniques.

• To compare the performance of each texture classification

technique.

Page 12: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Feature Extraction

Page 13: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

1. Grey Level Co-occurrence (GLCM)

• GLCM shows relationship

between grey-scaled pixels

values of the image.

• Step 1:

Select direction and spatial

distance to generate the GLCM

• Step 2:

Generate the GLCM according to

the selected parameters

Reference:

Haralick, R. M., Shanmugam, K. and Dinstein, L. (1973). Textural features for image classification. IEEE Transactions on System, Man, and Cybernectics, 3, 610-621.

Directions and Spatial Distances

Generated Raw GLCMs

Images

Images

Page 14: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

1. GLCM (cont.)

Reference:Haralick, R. M., Shanmugam, K. and Dinstein, L. (1973). Textural features for image classification. IEEE Transactions on System, Man, and Cybernectics, 3, 610-621.

• Step 3:

Use textural feature functions on

the GLCM to extract features

Normalization:

Textural Features

Page 15: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

2. Gabor Filters

• Extract features by analysing the frequency domain of the image

• Step 1:

Create Gabor filters according to the radial center frequency and

orientation.

Reference:W. H. Yap, M. Khalid, and R. Yusof, “Face Verification with Gabor Representation and Support Vector Machines”, IEEE Proc. of the First Asia International Conference on Modeling and

Simulation, 2007, pp. 451-459. c

Imaginary Part for Gabor filter

Real Part for Gabor filter

Page 16: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

2. Gabor Filters (cont.)

• Step 2:

FFT -> convolution -> IFFT

• Step 3:

Principal Component Analysis (PCA) to reduce feature

dimension

- Singular Value Decomposition (SVD)Reference:W. H. Yap, M. Khalid, and R. Yusof, “Face Verification with Gabor Representation and Support Vector Machines”, IEEE Proc. of the First Asia International Conference on Modeling and

Simulation, 2007, pp. 451-459. c

Orientations

Radial Center

Frequencies

Images filtered by the Gabor filters

Page 17: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

3. Combined GLCM and Gabor Filters

• Texture classification techniques are often combined

• The GLCM features are combined with the Gabor features

by directly appending the Gabor features after the GLCM

features.

• Proven to be better than either GLCM or Gabor filters in

some applications.

Reference:J.Y. Tou, Y.H. Tay, P.Y. Lau, “Gabor Filters and Grey-level Co-occurrence Matrices in Texture Classification”, MMU International Symposium on Information and Communications

Technologies, Petaling Jaya, 2007.

J.A.R. Recio, L.A.R. Fernandez, and A. Fernandez-Sarria, “Use of Gabor filters for texture classification of digital images”, 2005.

Page 18: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

4. Covariance Matrix

• The covariance matrix is used to represent the co-variance

between the Gabor filters

• It reduces the dimension of the Gabor features

• The covariance matrices did not lie on Euclidean space,

hence Forstners and Moonen’s distance is used

Reference:J. Y. Tou, Y. H. Tay, and P. Y. Lau, “Gabor Filters as Feature Images for Covariance Matrix on Texture Classification Problem”, Lecture Notes in Computer Science - Proc. 15th International

Conference on Neural Information Processing, vol. 5507, Nov 2008, pp. 745-751.

Page 19: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Classifier

Page 20: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

1. k-Nearest Neighbor (k-NN)

• Winning class decided by the k selected best neighbors

from the query sample

Page 21: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

2. Verification-based Recognition: Feature

• GLCM is used as the features

• Eight directions are calculated for each test sample rather

than rotating the input images

Reference:J.Y. Tou, Y.H. Tay, and P.Y. Lau, “Rotational Invariant Wood Species Recognition through Wood Species Verification”, Proc. 1st Asian Conference on Intelligent Information and Database

Systems, Apr. 2009, pp. 115-120.

Eight Directions for GLCM Generation

Page 22: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

2. Verification-based Recognition: Verification

• Each training samples are used as templates

• The energy value is calculated as the distance between all

training samples

• A threshold value is calculated for each template based on

the same species

• The energy value for the test sample is the minimum energy

obtained for the eight directions

n

i

yx ififyxE1

2))()((),(

xxxx EExT 2

1

n

i

ififE1

2

360...0

))()((min

Reference:J.Y. Tou, Y.H. Tay, and P.Y. Lau, “Rotational Invariant Wood Species Recognition through Wood Species Verification”, Proc. 1st Asian Conference on Intelligent Information and Database

Systems, Apr. 2009, pp. 115-120.

Page 23: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

2. Verification-based Recognition: Recognition

• For each test sample, the species with most winning

templates accepted is the winning species

Reference:J.Y. Tou, Y.H. Tay, and P.Y. Lau, “Rotational Invariant Wood Species Recognition through Wood Species Verification”, Proc. 1st Asian Conference on Intelligent Information and Database

Systems, Apr. 2009, pp. 115-120.

Page 24: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Experiments

Page 25: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Experimental Dataset

• Macroscopic wood images from CAIRO (Centre of Artificial

Intelligence and Robotics), Universiti Teknologi Malaysia

(UTM)

• 6 species of wood

• 90 training samples for each species

• 10 testing samples for each species

1. Sesendok (Endospermum

malaccense)

2. Keledang (Artocarpus

kemando)

3. Nyatoh (Palaquium

impressinervium)

4. Punah (Tetramerista

glabra)

5. Ramin (Gonystylus

bancanus)

6. Melunak (Pentace triptera)

Page 26: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

• Best recognition rate: 85.00% for Gabor-filter-based

Covariance Matrix

Comparison of Different Techniques

Texture Classification Techniques Accuracy (%)

GLCM features 76.67

Raw GLCM 78.33

Gabor features 73.33

Combined GLCM and Gabor features 76.67

Gabor filter-based Covariance Matrix 85.00

Verification-based Recognition 78.33

Page 27: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Findings

• Strong difference between training and testing samples of

sixth species (Melunak, Pentace triptera)

• The train samples (left) has more obvious white lines and

black dots but both characteristics are not obvious in the

test samples (right)

Melunak (Training Sample) Melunak (Testing Sample)

Page 28: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Findings

• Strong similarity between different species

• Samples from Punah, Tetramerista glabra (left) and Nyatoh,

Palaquium impressinervium (right) are both sharing similar

patterns of black pores and bright markings occurring

along the rays.

Punah (Tetramerista glabra) Nyatoh (Palaquium impressinervium)

Page 29: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Findings

• Defects causes misclassification in first species (Sesendok,

Endospermum malaccense)

• Certain image has a form of defects which are whitish

shown in the circled areas

Defects

Page 30: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Conclusion

Page 31: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Conclusion

• Similar findings compared to general texture classification:

• Raw GLCM outperform GLCM features.

• Gabor filters produced poorer result.

• Combine GLCM and Gabor features outperform both

when used independently.

• Gabor filter-based covariance matrix performed the best

(85%).

• Wood species recognition is more challenging that general

texture classification due to the natural similarity of

textures among wood species.

Page 32: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Future Works

• Proposed embedded device for wood species recognition

Page 33: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Acknowledgement

Page 34: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Acknowledgement

• The authors would like to thank Y. L. Lew and the Centre for

Artificial Intelligence and Robotics (CAIRO) of Universiti

Teknologi Malaysia (UTM) for sharing the wood images.

• This research is partly funded by Malaysian MOSTI

ScienceFund 01-02-11-SF0019.

Page 35: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

References

Page 36: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

References

1. Y.L. Lew, Design of an Intelligent Wood Recognition System for the Classification of Tropical

Wood Species, M. E. Thesis, Universiti Teknologi Malaysia, 2005.

2. J.Y. Tou, P.Y. Lau, Y.H. Tay, “Computer Vision-based Wood Recognition System”, Proc. Int’l

Workshop on Advanced Image Technology, Bangkok, 2007, pp. 197-202.

3. J.Y. Tou, Y.H. Tay, P.Y. Lau, “Gabor Filters and Grey-level Co-occurrence Matrices in Texture

Classification”, MMU International Symposium on Information and Communications

Technologies, Petaling Jaya, 2007.

4. J.Y. Tou, Y.H. Tay, and P.Y. Lau, “Rotational Invariant Wood Species Recognition through

Wood Species Verification”, Proc. 1st Asian Conference on Intelligent Information and

Database Systems, Apr. 2009, pp. 115-120.

5. M. Tuceryan, A.K. Jain, “Texture Analysis”, in: C.H. Chen, L.F. Pau, P.S.P Wang (eds.), The

Handbook of Pattern Recognition and Computer Vision (2nd Edition), World Scientific

Publishing Co, 1998.

6. Y.Q. Chen, Novel Techniques for Image Texture Classification, PhD Thesis, University of

Southampton, United Kingdom, 1995.

7. R.M. Haralick, K. Shanmugam, I. Dinstein, “Textural Features for Image Classification”,

IEEE Transactions on Systems, Man and Cybernatics, 1973, pp. 610-621.

8. M. Petrou, P.G. Sevilla, Image Processing: Dealing with Texture, Wiley, 2006.

9. J.A.R. Recio, L.A.R. Fernandez, and A. Fernandez-Sarria, “Use of Gabor filters for texture

classification of digital images”, 2005.

10. O. Tuzel, F. Porikli, and P. Meer, “Region Covariance: A Fast Descriptor for Detection and

Classification”, European Conference on Computer Vision, vol. 1, 2006, pp. 697-704.

Page 37: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Q & A

Page 38: A COMPARATIVE STUDY FOR TEXTURE CLASSIFICATION …€¦ · 1Computer Vision and Intelligent Systems (CVIS) Group, Universiti Tunku Abdul Rahman (UTAR), Malaysia 2Hanyang University,

Thank You!