Automatic Photo Annotator
-
Upload
brooke-forbes -
Category
Documents
-
view
40 -
download
0
description
Transcript of Automatic Photo Annotator
![Page 1: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/1.jpg)
Automatic Photo Automatic Photo AnnotatorAnnotator
Bryan KlimtBryan Klimt
May 10, 2005May 10, 2005
![Page 2: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/2.jpg)
Photo AnnotatorPhoto Annotator
Photos must be labeled with keywords Photos must be labeled with keywords to enable effective searchto enable effective search
Hand labeling photos is a tedious Hand labeling photos is a tedious processprocess
Automatic Photo Annotator labels Automatic Photo Annotator labels incoming photos based on statistical incoming photos based on statistical learninglearning
Annotator then learns from user Annotator then learns from user corrections corrections
![Page 3: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/3.jpg)
Most common keywordsMost common keywords
Colors or PatternsColors or Patterns sky, water, trees, cloud, hazysky, water, trees, cloud, hazy
PeoplePeople bryan, amy, shyambryan, amy, shyam
LocationsLocations china, italy, pisa, tiantan, florence,china, italy, pisa, tiantan, florence,
firenze, beijing, luccafirenze, beijing, lucca
![Page 4: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/4.jpg)
Types of ClassifiersTypes of Classifiers
Color-based methodsColor-based methods color histogramscolor histograms cumulative color histogramscumulative color histograms
Face-based methodsFace-based methods Face detectionFace detection Face recognitionFace recognition
Time-based methodsTime-based methods k Nearest Neighborsk Nearest Neighbors
![Page 5: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/5.jpg)
Color-based PerformanceColor-based Performance
![Page 6: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/6.jpg)
Cumulative ColorCumulative Color
![Page 7: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/7.jpg)
Why does “color” fail?Why does “color” fail?
Photos that are Photos that are mislabeledmislabeled (because (because the feature is not the focus of the the feature is not the focus of the photo).photo).
Photos with similar color-patterns, Photos with similar color-patterns, but of completely different subjects.but of completely different subjects.
![Page 8: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/8.jpg)
Hazy?Hazy?
![Page 9: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/9.jpg)
Water?Water?
![Page 10: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/10.jpg)
Face-based PerformanceFace-based Performance
![Page 11: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/11.jpg)
FacesFaces
![Page 12: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/12.jpg)
Faces?Faces?
![Page 13: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/13.jpg)
Time-based ResultsTime-based Results
![Page 14: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/14.jpg)
Final ResultsFinal Results
![Page 15: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/15.jpg)
ConclusionsConclusions
Time-based annotator performed bestTime-based annotator performed best
Color-based annotator has inherent Color-based annotator has inherent limitslimits
Face-based annotator may become Face-based annotator may become important with more training dataimportant with more training data
![Page 16: Automatic Photo Annotator](https://reader030.fdocuments.in/reader030/viewer/2022032612/5681341f550346895d9b0be1/html5/thumbnails/16.jpg)
Future WorkFuture Work
Hybrid MethodsHybrid Methods
Pattern-based annotatorsPattern-based annotators
Improving face recognizer with Improving face recognizer with unlabeled data?unlabeled data?