CSE 5331/7331 F'07 1

CSE 5331/7331CSE 5331/7331Fall 2007Fall 2007

Image MiningImage Mining

Margaret H. DunhamMargaret H. DunhamDepartment of Computer Science and Department of Computer Science and

EngineeringEngineeringSouthern Methodist UniversitySouthern Methodist University

2CSE 5331/7331 F'07

The 2000 ozone hole over the antarctic seen by EPTOMS http://jwocky.gsfc.nasa.gov/multi/multi.html#hole

3CSE 5331/7331 F'07

Table of ContentsTable of Contents

Image Mining – What is it?Image Mining – What is it? Feature ExtractionFeature Extraction Shape DetectionShape Detection Color TechniquesColor Techniques Video MiningVideo Mining Facial RecognitionFacial Recognition BioinformaticsBioinformatics

4CSE 5331/7331 F'07

Image Mining – What is it?Image Mining – What is it? Image RetrievalImage Retrieval Image ClassificationImage Classification Image ClusteringImage Clustering Video MiningVideo Mining Applications Applications

– BioinformaticsBioinformatics– Geology/Earth ScienceGeology/Earth Science– SecuritySecurity– ……

5CSE 5331/7331 F'07

Feature ExtractionFeature Extraction

Identify major components of imageIdentify major components of image ColorColor TextureTexture ShapeShape Spatial relationshipsSpatial relationships Feature Extraction & Image ProcessingFeature Extraction & Image Processing

http://users.ecs.soton.ac.uk/msn/book/http://users.ecs.soton.ac.uk/msn/book/ Feature Extraction TutorialFeature Extraction Tutorial

http://facweb.cs.depaul.edu/research/vc/http://facweb.cs.depaul.edu/research/vc/VC_Workshop/presentations/pdf/VC_Workshop/presentations/pdf/daniela_tutorial2.pdfdaniela_tutorial2.pdf

6CSE 5331/7331 F'07

Shape DetectionShape Detection

BlobBlobhttp://elib.cs.berkeley.edu/blobworld/http://elib.cs.berkeley.edu/blobworld/

Boundary/Edge DetectionBoundary/Edge Detection Time Series – Eamonn KeoghTime Series – Eamonn Keogh

http://www.engr.smu.edu/~mhd/8337sp07/shhttp://www.engr.smu.edu/~mhd/8337sp07/shapes.pptapes.ppt

7CSE 5331/7331 F'07

Color TechniquesColor Techniques

Color RepresentationsColor Representations

RGB:RGB:

http://en.wikipedia.org/wiki/Rgbhttp://en.wikipedia.org/wiki/Rgb

HSV: HSV: http://en.wikipedia.org/wiki/HSV_color_spacehttp://en.wikipedia.org/wiki/HSV_color_space

Color HistogramColor Histogram Color AnglogramColor Anglogram

http://www.cs.sunysb.edu/~rzhao/publications/Videohttp://www.cs.sunysb.edu/~rzhao/publications/VideoDB.pdfDB.pdf

8CSE 5331/7331 F'07

What is SimilarityWhat is Similarity??

(c) Eamonn Keogh, eamonn@cs.ucr.edu

9CSE 5331/7331 F'07

Video MiningVideo Mining

Boundaries between shotsBoundaries between shots Movement between framesMovement between frames ANSES:ANSES:

http://mmir.doc.ic.ac.uk/demos/anses.htmlhttp://mmir.doc.ic.ac.uk/demos/anses.html

10CSE 5331/7331 F'07

Facial RecognitionFacial Recognition Based upon features in faceBased upon features in face Convert face to a feature vectorConvert face to a feature vector Less invasive than other biometric techniquesLess invasive than other biometric techniques http://www.face-rec.orghttp://www.face-rec.org http://computer.howstuffworks.com/facial-recognitiohttp://computer.howstuffworks.com/facial-recognitio

n.htmn.htm SIMS: SIMS:

http://http://www.casinoincidentreporting.com/Products.aspxwww.casinoincidentreporting.com/Products.aspx

11CSE 5331/7331 F'07

Microarray Data Microarray Data AnalysisAnalysis

Each probe location associated with geneEach probe location associated with gene Measure the amount of mRNAMeasure the amount of mRNA Color indicates degree of gene expressionColor indicates degree of gene expression Compare different samples (normal/disease)Compare different samples (normal/disease) Track same sample over timeTrack same sample over time QuestionsQuestions

– Which genes are related to this disease?Which genes are related to this disease?– Which genes behave in a similar manner?Which genes behave in a similar manner?– What is the function of a gene?What is the function of a gene?

ClusteringClustering– HierarchicalHierarchical– K-meansK-means

12CSE 5331/7331 F'07

Affymetrix GeneChipAffymetrix GeneChip®® ArrayArray

http://www.affymetrix.com/corporate/outreach/lesson_plan/educator_resources.affx

13CSE 5331/7331 F'07

Microarray Data - Microarray Data - ClusteringClustering

"Gene expression profiling identifies clinically relevant subtypes of prostate cancer"

Proc. Natl. Acad. Sci. USA, Vol. 101, Issue 3, 811-816, January 20, 2004