©2004 Florida State University

A Flexible Image Browsing Interface

testerPeter JörgensenSchool of Information StudiesFlorida State University

ASIST ’04November 15, 2004

©2004 Florida State University

Warning

©2004 Florida State University

General communication

©2004 Florida State University

Wayfinding

©2004 Florida State University

living

©2004 Florida State University

Instructions

©2004 Florida State University

Finding the image

Keyword searching

CBIR

©2004 Florida State University

keyword queries

©2004 Florida State University

CBIR

©2004 Florida State University

Browsing final candidates

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

Slide Show

©2004 Florida State University

Story Board

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

©2004 Florida State University

Browsing limitations

System speeds

bandwidth

refresh rate

compression

Human factors

©2004 Florida State University

Human Factors

Images per second (minute)

size

bit depth

task

©2004 Florida State University

Previous ResearchVideo surrogates

Cinque et al 1998

Video keyframes

Komlodi & Marchionini, 1998

Tse et al 1998

Lee et al 2000

Geisler, 2003

©2004 Florida State University

Potter & Levy (1969)

Potter, M. C., & Levy, E. I. (1969). Recognition Memory for a Rapid Sequence of Pictures. Journal of Experimental Psychology, 81(1), 10-15.

©2004 Florida State University

A third approach

Slide Show

Storyboard

Multiple Scrolling Thumbnails

©2004 Florida State University

Multiple Scrolling Thumbnails

ASIST 2001 - Yang, Geisler, et al (2003)

Storyboard layout

Slide show animation

©2004 Florida State University

©2004 Florida State University

Instrument development

ibi

Image Browsing Interface

AppleScript Studio under Xtools (now Xcode)

800 MHz iMac running OS X

©2004 Florida State University

ibi specifications

Three Modes

Single image

Slide Show

Multiple Scrolling Images

©2004 Florida State University

ibi - parameters

Single images

Frames per second

image size

image set source movie

©2004 Florida State University

ibi – parameters

Multiple Images

Number of columns

Number of rows

Max. 12 images

©2004 Florida State University

ibi – data logText file, tab delimited

Date and time

Mode & frame rate

# rows and columns

Image set movie file

Number of images viewed

©2004 Florida State University

Subjects

26 volunteers from School

students

faculty

©2004 Florida State University

Tasks

2 face recognition

2 subject recognition

©2004 Florida State University

Images used

Face Set

AR Faces Database (Martinez & Benavente, 1998)

General Set

(Jörgensen & Jörgensen, 2002)

©2004 Florida State University

Target Images

©2004 Florida State University

Alternate Targets

©2004 Florida State University

Results

Hits

< 3 seconds after target presentation

Near hit

< 3 seconds after alternate target presentation

©2004 Florida State University

Data

Combined faces data

similarity

threw out arches data

too many similar

two identical

©2004 Florida State University

ResultsSuccess Rate vs Frame Rate

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 4 8 12 16Frames per second

HitsTotal Hits

©2004 Florida State University

ConclusionSupports Potter & Levy (8 fps is practical maximum for untrained browsers.)

Much more testing needs to be done

Size

color vs grayscale

Modes

©2004 Florida State University

Questions?Funded by FSU First Year Assistant Professor Award,Information Institute of the School of Information Studiesand the Dean of the School of Information Studies

http://faculty35.lis.fsu.edu/~peter/asist04_pej.pdfhttp://faculty35.lis.fsu.edu/~peter/jorgensen2004_ibi.pdf