Visualizing Digital Collections at

Archive-It

Kalpesh Padia, Yasmin Alnoamany, Michele C. Weigle Department of Computer Science

Old Dominion University, Norfolk, VA

kpadia@cs.odu.edu

http://ws-dl.blogspot.com/

Archive-It

6/11/2012

http://archive-it.org

2 JCDL 2012

11 Collections, 2K+ Sites, 70K+ Mementos

6/11/2012 3 JCDL 2012

Data Retrieval & Processing

• Retrieval: Screen scrape

Copy collection hierarchy

Store page content

• Processing: Calculate TF and TF-IDF

Generate screenshots

Generate wordles

Heuristic categorization

Construct JSON

6/11/2012 4 JCDL 2012

Visualizations – Bubble Chart

6/11/2012

Title bar

Visualization

Area

Visualization

Options

5 JCDL 2012

Visualizations – Image Plot with Wordle

6/11/2012 6 JCDL 2012

Visualizations – Image Plot with Wordle

6/11/2012 7 JCDL 2012

Visualizations – Image Plot with Wordle

6/11/2012 8 JCDL 2012

Visualizations - Timeline

6/11/2012 9 JCDL 2012

Visualizations - Timeline

6/11/2012 10 JCDL 2012

Visualizations - Timeline

6/11/2012 11 JCDL 2012

Visualizations - Timeline

6/11/2012 12 JCDL 2012

Visualizations - Timeline

6/11/2012 13 JCDL 2012

No categorization

6/11/2012

http://www.archive-it.org/collections/2836

14 JCDL 2012

Improper Categorization

6/11/2012

http://www.archive-it.org/collections/2323

15 JCDL 2012

Rule based categorization

News Web Sites

6/11/2012

http://www.archive-it.org/collections/2836

Blogs

Social Media

Videos

16 JCDL 2012

Special URI and TLD based categorization

Pakistani news sites

6/11/2012

http://www.archive-it.org/collections/2836

17 JCDL 2012

Comparison

Pakistan Floods Collection

without categorization

Pakistan Floods Collection after

categorization

6/11/2012 18 JCDL 2012

Future Work

• Detailed user evaluation

• Generic system for any digital archive

• Visualization of mementos

6/11/2012 19 JCDL 2012

Conclusion

• Novel visual interface

• Bubble chart

6/11/2012 20 JCDL 2012

Conclusion

• Novel visual interface

• Bubble chart

• Image plot

6/11/2012 21 JCDL 2012

Conclusion

• Novel visual interface

• Bubble chart

• Image plot

• Wordle

6/11/2012 22 JCDL 2012

Conclusion

• Novel visual interface

• Bubble chart

• Image plot

• Wordle

• Timeline

6/11/2012 23 JCDL 2012

Conclusion

• Novel visual interface

• Bubble chart

• Image plot

• Wordle

• Timeline

• Heuristic categorization

6/11/2012 24 JCDL 2012

Extra Info

6/11/2012 25 JCDL 2012

Digital Archives

6/11/2012

http://lcweb2.loc.gov/diglib/lcwa/html/visual/visual-browse.html

http://www.webarchive.org.uk/ukwa/collection/4325386/page/1

26 JCDL 2012

Visualizing Archives

6/11/2012

http://www.webarchive.org.uk/ukwa/wall/Blogs

27 JCDL 2012

Browsing Archive-IT collections

6/11/2012

http://www.archive-it.org/collections/1068

28 JCDL 2012

Time Span

Time span

Small 1 Day - 2 Weeks

Medium 2 Weeks - 4 Months

Large > 4 Months

6/11/2012

http://wayback.archive-it.org/1068/*/http://amigosdemujeres.org/

29 JCDL 2012

Groups

Groups

Small 1

Medium 2 - 5

Large > 5

6/11/2012

http://www.archive-it.org/collections/1068

30 JCDL 2012

URI Domains

URI Domains

Small 1 - 10

Medium 11 - 20

Large > 20

6/11/2012

http://www.archive-it.org/collections/2836

31 JCDL 2012

Sites & Source Types

Sites

Small 1 - 10

Medium 11 - 99

Large > 99

6/11/2012

http://www.archive-it.org/collections/2836

Source Types

Small 1

Medium 2 - 5

Large > 5

32 JCDL 2012