Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of...
-
date post
22-Dec-2015 -
Category
Documents
-
view
214 -
download
1
Transcript of Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of...
![Page 1: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/1.jpg)
Dynamic Interfaces for Digital Libraries: The Open Video
Project
Gary Marchionini
University of North Carolina at Chapel Hill
NJ/ASIST Distinguished Lecture
April 4, 2002
![Page 2: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/2.jpg)
Outline
• User Interfaces as crucial elements of DLs
• Overview of Open Video Project
• Agile Views interface framework
• Open Video examples of AVs
• User study example and near term plans
• Long term implications
• Summary
![Page 3: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/3.jpg)
Observations
• Physical libraries architect space to aid information seeking
• Librarians interact with patrons in many ways:– Show a welcoming face– Clarify needs and queries– Assist with retrieval and use
• Digital libraries depend on the user interface to serve these purposes, thus user interfaces are crucial to success of high-volume digital libraries
![Page 4: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/4.jpg)
Interface Principles for DLs
• Consider physical and conceptual interface issues.• Consider representations and user control
mechanisms.• Provide a multiplicity of indexes (representations):
Help people help themselves.• Minimize user effort: A click is a radical act.• Use a variety of iterative user studies to
understand user needs, common tasks, and interface effects.
![Page 5: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/5.jpg)
Open Video Project• Goals
– Create an open source DL for use by researchers, students, and the public.
– A testbed for interactive interfaces– An environment for building a theory of human information
interaction
• Ongoing work: begun 1995 with colleagues at UMD• Current funding: NSF# IIS-0099538, NCNI• Collaborators: I2-DSI, ibiblio, CMU, UMD, NIST,
Internet Archive• www.open-video.org
![Page 6: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/6.jpg)
![Page 7: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/7.jpg)
Current Status
• ~ 0.5 TB of content
• ~1600 video segments
• ~1100 different titles
• ~2000 unique visitors per month
• I2-DSI video channel
• OAI provider
• Ongoing user studies
![Page 8: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/8.jpg)
MPEG etc.MPEG etc.
MPEG etc.
Digitization
Segmentation
Keyframe Extraction
Keyword (text)
Surrogates
Keyword (audio)
Metadata
Client(Browser)
Database(MySQL)
AVI
Search
Contribute
Browse
Open Video Server
Production System
Distributed Files
![Page 9: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/9.jpg)
Agile Views Interface
• Provide a variety of access representations (e.g., indexes) and control mechanisms
• Usual search and browse capabilities
• Leverage both visual and linguistic cues
• Create and test surrogates for overview and preview
![Page 10: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/10.jpg)
Agile Views Framework
![Page 11: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/11.jpg)
Evolution of Agile View Design Techniques
• Various dynamic query interfaces (HCIL UMD)• Relation Browser (BLS, SILS seminars)
– Federal statistics, overviews of relationships (several different partitions). Useful for small number of attribute sets, each with small number of attribute values. Backend database of metadata, Java applet interface
• Enriched Links (Sony Labs)– Complex web sites, previews, overviews, and reviews of pages.
Backend computation and Javascript interface
• Integrated overviews and previews (BLC UMD)– Multimedia digital library, backend computation, Java applet
interface
![Page 12: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/12.jpg)
Relation Browser
![Page 13: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/13.jpg)
Enriched Links:Preview
![Page 14: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/14.jpg)
Enriched Links: Overview
![Page 15: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/15.jpg)
Enriched Links: Shared View
![Page 16: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/16.jpg)
Overviews and Previews: One Screen
![Page 17: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/17.jpg)
The Open Video Project Case
![Page 18: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/18.jpg)
Browse: by Categories & Attributes
Note Results Data
![Page 19: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/19.jpg)
Search: by Category & Attribute
![Page 20: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/20.jpg)
Search: by Free Text & Keyword
![Page 21: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/21.jpg)
Search Results
NoteMouseoverPopup forDetails;Click yieldsNext segmentBib record
![Page 22: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/22.jpg)
Segment Details
![Page 23: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/23.jpg)
Video Transcript Text
![Page 24: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/24.jpg)
Video Segment Preview
![Page 25: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/25.jpg)
Research Agenda 2001-04• What kinds of surrogates to provide for overviews and previews?• Currently, we are designing and testing cost-benefit tradeoffs
for:– Storyboards
• text keywords
• audio keywords
– Slideshows
• text keywords
• audio keywords
– Fast-forwards
• Integration of many specific good ideas lead to emergence or chaos?
![Page 26: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/26.jpg)
AgileViews Overview – Genre: Documentary
NoteOne keyframePer segmentShown onMouseover;Direct selectsupported
![Page 27: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/27.jpg)
AgileViews Overview – Genre: Education
![Page 28: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/28.jpg)
AgileViews Overview – Color/B&W
![Page 29: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/29.jpg)
Previews
![Page 30: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/30.jpg)
Agile Views Preview – Faces
![Page 31: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/31.jpg)
Agile Views Preview – Faces
![Page 32: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/32.jpg)
Agile Views Preview – Superimposition
![Page 33: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/33.jpg)
Agile Views Preview – Brightness
![Page 34: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/34.jpg)
R&D SchemeTASK
CHARACTERISTICS
VIDEOCHARACTERISTICS
INDIVIDUALCHARACTERISTICS
SURROGATECHARACTERISTICS
Dependent Variables:
PERFORMANCE
PREFERENCE
![Page 35: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/35.jpg)
![Page 36: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/36.jpg)
User Study 1: Explore Surrogate Space (Fall 01)
• five video surrogates compared– Storyboard (6x6 grid of keyframes)
with text keywords– Storyboard with audio keywords– Slide show (keyframes displayed @
250ms per frame) with text keywords– Slide show with audio keywords– Fast forward (at 4 times original
speed)
![Page 37: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/37.jpg)
• 10 subjects with video experience (about 2 hours each)
• Two phases– Three surrogates for each of four videos
• Preferences changed over time, support for ff development• Gist meant: topicality, narrative structure, and visual style
– One surrogate (free choice) for each of 3 videos• write statement of gist• Select statements of gist• Object recognition (textual)• Object recognition (visual)• Action recognition• Visual gist
![Page 38: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/38.jpg)
Best Worst
Gist determination, free text
Slide show w/ audio keywords
Storyboard w/ text keywords
Storyboard w/ audio keywords
Fast forward
Gist determination, multiple-choice
Fast forward Slide show w/ audio keywords
Storyboard w/ text keywords
Storyboard w/ audio keywords
Object recognition, textual
Storyboard w/ text keywords
Fast forward Slide show w/ audio keywords
Storyboard w/ audio keywords
Object recognition, graphical
Storyboard w/ text keywords
Slide show w/ audio keywords
Fast forward Storyboard w/ audio keywords
Action recognition Fast forward Storyboard w/ text keywords
Storyboard w/ audio keywords
Slide show w/ audio keywords
Visual gist Storyboard w/ audio keywords
Storyboard w/ text keywords
Slide show w/ audio keywords
Fast forward
![Page 39: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/39.jpg)
Next Steps (short term)
• Study 2 (spring 02) – Compare different fast forward rates– 30 subjects
• Interactive Shared Educational Environment (ISEE) for video (remote study)
• CHI 02 – The commons with demos and study of narrativity
• Summer study (02)– Eye-tracking study of effects of textual and audio cues
![Page 40: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/40.jpg)
Next Steps (long term) From DLs to the Sharium
DigitalLibrary
ChannelsFilesTools
Contribution Contribution
M e s s a g i n g
Problem Solving/Construction
Problem Solving/Construction
Search/Discovery
Presentation
Search/Discovery
Presentation
The Sharium Work Space
![Page 41: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/41.jpg)
Integration Hypothesis
• As information resources and technologies are integrated as digital libraries (sharia or collaboratories), institutional boundaries will blur. Examples:– Types of learning (formal, informal,
professional)– Types of libraries– Levels of government (local, state, federal)
![Page 42: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/42.jpg)
Long-Term Implications for Social Sciences Research
• What does it mean when you can have everything you can possibly access anywhere, available everywhere? Removing the bounds of access implies ubiquity and augmented memory. What does it then mean to be informed? Intelligent? Consider a cascading set of issues such as trust, ownership/IP, communication, human relationships, and socio-technical symbiosis.
![Page 43: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/43.jpg)
Summary: Open Video as Testbed
• Give people many ‘views’ to look ahead• Make these views easy to manipulate (agile)• Challenges
– Mapping video characteristics to surrogates (e.g., keyframes, keywords), mapping surrogates to control mechanisms (e.g., mouse actions)
– Automating production processes
• Use the repository, contribute to the repository! We would especially like to include cultural video in the collection.
![Page 44: Dynamic Interfaces for Digital Libraries: The Open Video Project Gary Marchionini University of North Carolina at Chapel Hill march@ils.unc.edu NJ/ASIST.](https://reader036.fdocuments.in/reader036/viewer/2022062715/56649d815503460f94a6583e/html5/thumbnails/44.jpg)
Pointers and Thanks
• www.open-video.org
• www.ils.unc.edu/idl
• Thanks to:– National Science Foundation– North Carolina Networking Initiative– Contributors– NJ ASIST