A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

27
A Survey of Research Prospects for more Manageable Personal Digital Photo Collections Nicholas Taylor @nullhandle Personal Digital Archiving February 21, 2013 Photo Mosaic-Orange Daisy ” by Flickr user BerniMartin under CC BY-N

description

Presentation given at Personal Digital Archiving on promising technologies demonstrated in research literature that may ultimately improve annotation and management of personal digital photo collections.

Transcript of A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Page 1: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

A Survey of Research Prospects for more

Manageable Personal Digital Photo Collections

Nicholas Taylor

@nullhandle

Personal Digital ArchivingFebruary 21, 2013 “Photo Mosaic-Orange Daisy” by Flickr user BerniMartin under CC BY-ND 2.0

Page 2: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

what metadata matters?

• event• location• people• time

Page 3: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“Shoebox No. 1” by Flickr user kahala under CC BY-NC-ND 2.0

the metaphorical shoebox

Page 4: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Good: “How many photos have ever been taken?”

our digital photos are proliferating

Page 5: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

our digital photos are distributed

Page 6: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

our digital photos are many

Lev Manovich: “Cultural Analytics visualizations on ultra high resolution displays”

Page 7: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“My work table and some beloved tools~ 6 of 6 photos” by Flickr user Urban Woodswalker under CC BY-NC-ND 2.0

we have some tools

Page 8: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“Picasa Face Recognition is cool” by Flickr user vanholy under CC BY-NC-ND 2.0

facial recognition

Page 9: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

flickr: “Explore everyone's photos on a Map”

geotagging

Page 10: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“The Facebook Manual Auto-tag” by Flickr user Ambuj Saxena under CC BY 2.0

social annotation

Page 11: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“Adding IPTC Metadata with Adobe Bridge” by Flickr user StevenErat under CC BY-NC-SA 2.0

metadata standards

Page 13: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

tools provenance

• forensics (security, law enforcement, counterterrorism)

• robotics (autonomous)• consumer applications (photo

management)

Page 14: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

dating digitized photos by color processing technology

Palermo, Hays, and Efros: “Dating Historical Color Images”

Page 15: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

image orientation detection of digitized photos

Datar and Qi: “Automatic Image Orientation Detection Using the Supervised Self-Organizing Map”

Page 16: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Hays and Efros: “IM2GPS: estimating geographic information from a single image”

probabalistic regional geotagging by visual

similarity

Page 17: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

satellite and ground imagery corroboration for geotagging

Grosse and Johnson: “Matching a photograph to satellite images”

Page 18: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

“Eiffel Tower” by Flickr user HarshLight under CC BY 2.0

identifying cities by trivial visual

elements

Doersch et al.: “What Makes Paris Look Like Paris?”

Page 19: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

geotagging and 3D scene construction using large photo

sets

Snavely, Seitz, and Szeliski: “Photo Tourism: Exploring Photo Collections in 3D”

Page 20: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

historical photo overlay

WhatWasThere: “Jimmy Carter on a Campaign Stop in Plains”

Page 21: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

automatic “event” identification by temporal and

visual clustering

Cooper et al.: “Temporal Event Clustering for Digital Photo Collections”

Page 22: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

recognizing persons using body patch

matching

Suh and Bederson: “Semi-Automatic Photo Annotation Strategies Using Event Based Clustering and Clothing Based Person Recognition”

Cooray et al.: “Identifying Person Re-Occurrences for Personal Photo Management Applications”

Page 23: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Naaman et al.: “Leveraging Context to Resolve Identity in Photo Albums”

recognizing persons using social context

Page 24: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Stone et al.: “Autotagging Facebook: Social Network Context Improves Photo Annotation”

recognizing persons using social network

context

Page 26: A Survey of Research Prospects for more Manageable Personal Digital Photo Collections

Hangal: “Muse: Revive Precious Memories Using Email.”

graphing incidence of individuals over time