1 ECE533 Digital Image Processing Morphological Image Processing.
Image Processing
-
Upload
vrt-medialab -
Category
Technology
-
view
990 -
download
1
description
Transcript of Image Processing
![Page 1: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/1.jpg)
PISAProduction, Indexing and Search
of Audio-visual Material
Image ProcessingTinne Tuytelaars, IBBT – PSI – K.U.Leuven
![Page 2: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/2.jpg)
61
Computer Assisted Analysis
! Intelligent analysis = reverse engineering
! Shot cut detection
! Scene segmentation
! Video reuse detection
! Face detection
! Face recognition
! Audio classification
demo
demo
demo
demo
demo
![Page 3: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/3.jpg)
62
Shot cut detection
= Split the video stream in atomic units, corresponding to a
continuously moving camera
! Distinguish between abrupt and smooth shotcuts
! Experimented with different methods
! Using color histograms
! Using affine motion compensation
! Using motion estimation within the compressed domain
![Page 4: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/4.jpg)
68
Scene segmentation
![Page 5: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/5.jpg)
69
Video reuse detection
The same video material is often reused
! can be detected automatically
! Robust to post-processing
! Efficiency
! Based on spatio-temporal local features and locality
sensitive hashing
![Page 6: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/6.jpg)
70
Face Detection
• Face candidates selection:" Candidate regions have skin color # region-based skin
segmentation
" Personalized chrominance skin boundary
• Verification based on cues:" Shape of ellipse
" Ellipse-filling percentage
" Gray-tone smoothness
" Corners of the facial features
![Page 7: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/7.jpg)
71
Face detection results
• 92% good face detections
"Comparable to state-of-the-art face learning of ‘Viola & Jones’ obtains 93%
"adaptation to lighting conditions and personal face looks
![Page 8: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/8.jpg)
72
Face recognition
! Based on a 3D morphable model
! 3D model is fitted to 2D image
! Shape and texture parameters used as face descriptor
! Robust to
! viewpoint changes,
! illumination changes,
! partial occlusions.
![Page 9: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/9.jpg)
73
Face recognition
![Page 10: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/10.jpg)
74
Face recognition
![Page 11: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/11.jpg)
75
Face recognition
![Page 12: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/12.jpg)
76
Face recognition
![Page 13: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/13.jpg)
77
Face recognition
![Page 14: Image Processing](https://reader033.fdocuments.in/reader033/viewer/2022051818/54b4d1624a795997278b457e/html5/thumbnails/14.jpg)
79
Future work
! Include facial expressions in face recognition
! Multi-modal scene segmentation
! Feedback loop from Trouvaille
! Object or scene recognition
! Thesaurus-based speech recognition