1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications –...

78
1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy & Recovery)” Edward A. Fox [email protected] http://fox.cs.vt.edu • Dept. of Computer Science, Virginia Tech • Blacksburg, VA 24061 USA

Transcript of 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications –...

Page 1: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

1

World Bank(Washington, D.C. – 20 November 2007)

“Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs,

and CTR (Crisis, Tragedy & Recovery)”

Edward A. Fox

[email protected] http://fox.cs.vt.edu

• Dept. of Computer Science, Virginia Tech

• Blacksburg, VA 24061 USA

Page 2: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

Acknowledgements (selected)

• Colleagues: Lillian Cassel, Debra Dudley, Weiguo Fan, Marcos Gonçalves, Doug Gorton, Rohit Kelapure, Neill Kipp, Aaron Krowne, Ming Luo, Uma Murthy, Manuel Perez, Ananth Raghavan, Rao Shen, Hussein Suleman, Srinivas Vemuri, Layne Watson, …

• Sponsors: ACM, AOL, CAPES, DFG, Google, IBM, IMLS, INL, Microsoft, NSF (CCF-0722259; IIS-9986089, 0080748, 0086227, 0307867, 0325579, 0535057, 0535060, 0736055 ; DUE-0121679, 0121741, 0136690, 0333531, 0333601, 0435059, 0532825), SUN, …

Page 3: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

3

Outline

• Digital Libraries• 5S• Archaeology• Education• ETDs• CTR (Crisis, Tragedy & Recovery)

Page 4: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

4

SynchronousScholarly Communication

Same time, Same or different place

Page 5: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

5

Asynchronous, Digital Library Mediated Scholarly Communication

Different time and/or place

Page 6: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

DL OverviewWhy of Global Interest?

• National projects can preserve antiquities and heritage: cultural, historical, linguistic, scholarly

• Knowledge and information are essential to economic and technological growth, education

• DL - a domain for international collaboration– wherein all can contribute and benefit– which leverages investment in networking– which provides useful content on Internet & WWW– which will tie nations and peoples together more

strongly and through deeper understanding

Page 7: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

Digital Libraries --- Objectives

• World Lit.: 24hr / 7day / from desktop• Integrated “super” information systems: 5S:

Table of related areas and their coverage• Ubiquitous, Higher Quality, Lower Cost • Education, Knowledge Sharing, Discovery• Disintermediation -> Collaboration • Universities Reclaim Property• Interactive Courseware, Student Works• Scalable, Sustainable, Usable, Useful

Page 8: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

Computing (flops)Digital content

Com

mun

icat

ions

(ban

dwid

th, c

onne

ctiv

ity)

Locating Digital Libraries in Computing andCommunications Technology Space

Digital Libraries technologytrajectory: intellectualaccess to globally distributed information

less moreNote: we should consider 4 dimensions: computing, communications,content, and community (people)

Page 9: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

9

Borgman et al.:Workshop Report onSocial Aspects ofDigital Libraries: http://www-lis.gseis.ucla.edu/DL/

InformationLifeCycle

Page 10: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

10

Information Life Cycle

AuthoringModifying

OrganizingIndexing

StoringRetrieving

DistributingNetworking

Retention/ Mining

AccessingFiltering

UsingCreating

Page 11: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

11

crea

tion

distributionsee

kingutilization

E1:starting

E2: chaining

E3: browsin

g

E4: diffe

rentia

ting

E5: monito

ring

E6: extra

cting

storing, archiving,

networking

K1:

in

itia

tion

K2:

se

lectio

n

K3:

explorationK4:

formulation

K5: collection

K6:

presentation

auth

orin

g, m

odify

ing,

desc

ribin

g org

anizi

ng, i

ndex

ing

pres

erva

bilit

y,

sim

ilari

ty,

tim

elin

ess,

accuracy, completeness,

conformance accessibility, preservability

DL Success Constructs

Activ

e Semi-active

Inactive

E: Ellis’ modelK: Kuhlthau’s model

Page 12: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

12

Digital LibrariesShorten the Chain from

Editor

Publisher

A&I

Consolidator

Library

Reviewer

Page 13: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

13

DLs Shorten the Chain to

Author

Reader

Digital

LibraryEditor

Reviewer

Teacher

Learner

Librarian

Page 14: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

14

D ig ita l L ib ra r y C o n te n t

A rtic le s ,R e p o rts,

B o o ks

T e xtD o cum e n ts

S p ee ch ,M u s ic

V id eoA u d io

(A e ria l)P h o tos

G e og rap h icIn fo rm ation

M o d e lsS im u la tio ns

S o ftw a re ,P ro g ra m s

G e no m eH u m a n,a n im a l,

p la n t

B ioIn fo rm ation

2 D , 3 D ,V R ,C A T

Im ag es a ndG ra p h ics

C o nte n tT yp e s

Page 15: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

15

Informal 5S & DL Definitions

DLs are complex systems that

• help satisfy info needs of users (societies)

• provide info services (scenarios)

• organize info in usable ways (structures)

• present info in usable ways (spaces)

• communicate info with users (streams)

Page 16: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

16

• “Streams”

- All types of contents

(as well as communications and flows over networks, or into sensors, or sense perceptions)

• “Structures”

- Organizational schemes

(including data structures, databases, and knowledge representations – taxonomies, ontologies)

5S Framework

Page 17: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

17

5S Framework

• “Spaces” - 2D and 3D interfaces, GIS data,

representations of documents and queries. • “Scenarios”

- System states and events, but also can represent situations of use by human users (or machine

processes, yielding services or transformations of data). • “Societies”

- Both software “service managers” and fairly generic “actors” who could be (collaborating) human (users).

Page 18: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

18

5S and DL formal definitions and compositions (April 2004 TOIS)

5S

structures (d.10)streams (d.9) spaces (d.18) scenarios (d.21) societies (d. 24)

structural metadataspecification(d.25)

descriptive metadataspecification(d.26)

repository(d. 33)

collection (d. 31)

(d.34)indexingservice

structured stream (d.29)

digitalobject (d.30)

metadata catalog (d.32)

browsingservice

(d.37)

searchingservice (d.35)

digital library(minimal) (d. 38)

services (d.22)

sequence (d. 3)

graph (d. 6)function (d. 2)

measurable(d.12), measure(d.13), probability (d.14), vector (d.15), topological (d.16) spaces

event (d.10)state (d. 18)

hypertext(d.36)

sequence (d. 3)

transmission(d.23)

relation (d. 1) language (d.5)

grammar (d. 7)

tuple (d. 4)*

Page 19: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

19

5S definitional structure

Digital Object

RepositoryRepositoryCollectionCollection Minimal DL

Metadata Catalog

Descriptive Metadata

Specification

Structural Metadata

Specification

StreamsStreams StructuresStructures SpacesSpaces ScenariosScenarios SocietiesSocieties

indexingindexing

browsingbrowsing searchingsearching

servicesservices

hypertexthypertext

Structured Stream

Page 20: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

20

5S and Generating DLs

• 5S Framework• 5S definitions, services taxonomy, ontology• 5SL• 5SGraph• 5SGen (and DL development)• DL development of union DL• 5SGen into DSpace• 5SQual

Page 21: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

21

Digital Objects

Metadata

Services

• Completeness

• Conformance

• Accessibility

• Similarity

• Significance

• Timeliness

• Efficiency

• Reliability

Numeric

Indicators

5SQual - Dimensions

Page 22: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

22

ETANA-DL

• Archaeological DL• Integrated DL

– Heterogeneous data handling

• Applies and extends the OAI-PMH– Open Archives Initiative Protocol for Metadata

Handling

• Design considerations– Componentized– Extensible– Portable

Page 23: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

23

Page 24: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

24

Member DLs of ETANA-DL

Repository

Catalog

DatabaseSearching

and Browsing

Archaeologists

Society

Archaeologists

Archaeologists

Society

Service

Lahav

Repository

Catalog

DatabaseSearching

and Browsing

Archaeologists

Society

Archaeologists

Archaeologists

Society

Service

Madaba

Repository

Catalog

DatabaseSearching

and Browsing

Archaeologists

Society

Archaeologists

Archaeologists

Society

Service

Megiddo

Repository

Catalog

DatabaseSearching

and Browsing

Archaeologists

Society

Archaeologists

Archaeologists

Society

Service

Umayri

Page 25: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

25

Architecture of ETANA-DL, with centralized catalog and partially

decentralized repository

Union Catalog

Union Repository

ArchaeologistsGeneral Public

Union Society

Union Services

Harvesting, MappingSearching, Browsing, Recommendation,

Annotation, Object Comparison, Object SharingBinding, Visualization

Page 26: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

26

ETANA-DL Approach• Applying and extending Digital Library (DL)

techniques to solve key problems: making primary data available, data preservation, and interoperability

• Modeling archaeological information systems using 5S to better understand the domain and design the system and the supporting services

• Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks:– eliciting requirements– refining metamodel and union schema– modeling sites– mapping– harvesting– providing useful services

Page 27: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

27

ETANA Societies

1. Historic and pre-historic societies (being studied)2. Archaeologists (in academic institutes, fieldwork

settings, or local and national governmental bodies)

3. Project directors4. Technical staff (consisting of photographers,

technical illustrators, and their assistants)5. Field staff (responsible for the actual work of

excavation)6. Camp staff (e.g., camp managers, registrars, tool

stewards)7. General public (e.g., educators, learners, citizens)

Page 28: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

28

ETANA Societies

• Social issues1. Who owns the finds?

2. Where should they be preserved?

3. What nationality and ethnicity do they represent?

4. Who has publication rights?

5. What interactions took place between those at the site studied, and others? What theories are proposed by whom about this?

Page 29: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

29

ETANA Scenarios1. Life in the site in former times2. Digital recording: the planning stage and the excavation stage 3. Planning stage: remote sensing, fieldwalking, field surveys, building

surveys, consulting historical and other documentary sources, and managing the sites and monuments

4. Excavation1. Detailed information is recorded, including for each layer of soil, and for

features such as pole holes, pits, and ditches. 2. Data about each artifact is recorded together with information about its

exact find spot. 3. Numerous environmental and other samples are taken for laboratory

analysis, and the location and purpose of each is carefully recorded. 4. Large numbers of photographs are taken, both general views of the

progress of excavation and detailed shots showing the contexts of finds. 5. Organization and storage of material6. Analysis and hypotheses generation and testing7. Publications, museum displays8. Information services for the general public

Page 30: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

30

ETANA Spaces

1. Geographic distribution of found artifacts2. Temporal dimension (as inferred by

archaeologists) 3. Metric or vector spaces

1. used to support retrieval operations, and to calculate distance (and similarity)

2. used to browse / constrain searches spatially

4. 3D models of the past, used to reconstruct and visualize archaeological ruins

5. 2D interfaces for human-computer interaction

Page 31: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

31

ETANA Structures

1. Site Organization1. Region, site, partition, sub-partition, locus,

2. Temporal orderings (ages, periods)

3. Taxonomies1. for bones, seeds, building materials, …

4. Stratigraphic relationships1. above, beneath, coexistent

Page 32: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

32

ETANA Streams

1. successive photos and drawings of excavation sites, loci, unearthed artifacts

2. audio and video recordings of excavation activities and discussions

3. textual reports

4. 3D models used to reconstruct and visualize archaeological ruins.

Page 33: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

33

local schema global schema

Page 34: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

34

Mapping recommendation

Page 35: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

35

Mapping confirmation

Mapping history

Page 36: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

36No recommendation for “Tomb_Area”

Page 37: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

37User-decided mapping

Page 38: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

38

Degree of Structure

Chaotic Organized Structured

Web DLs DBs

Page 39: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

39

Digital Objects (DOs)

• Born digital

• Digitized version of “real” object– Is the DO version the same, better, or worse?– Decision for ETDs: structured + rendered

• Surrogate for “real” object– Not covered explicitly in metamodel for a

minimal DL– Crucial in metamodel for archaeology DL

Page 40: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

40

Metadata Objects (MDOs)

• MARC

• Dublin Core

• RDF

• IMS

• OAI (Open Archives Initiative)

• Crosswalks, mappings

• Ontologies

• Topics maps, concept maps

Page 41: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

41

Databases

• 5S perspective: structures, streams, scenarios

• Extending database technology

• Structured and unstructured info

• Multimedia databases

• Link databases

• Performance, transaction processing

• Replicated storage, rollback/recovery

Page 42: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

42

User interfaces and visualization

• 2D interfaces

• 3D interfaces

• GIS

• Other paradigms

• Stepping Stones and Pathways– http://fox.cs.vt.edu/SSP/

Page 43: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

43

Streams

text

audio

image

video digitalobject

Repository

CollectionCatalog

describes

stores

is_version_of/ cites/links_to

Index

Service

Scenario

event

extends

reuses

ServiceManager

Actor

operationexecutes

participates_in

recipient

runs

Scenarios

Societies

inherits_from/includes

association

uses

Topological

ProbabilisticMetric

Measurable

Measure

describes

employsproduces

employsproduces

employs

produces

Structures

Spaces

Vector

contains

metadata specifications

is_a is_a

precedes

happens_before

is_a

redefinesinvokes

contains

contains

Page 44: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

44

OAI = Technical Umbrella forPractical Interoperability…

ReferenceLibraries

PublishersE-Print

Archives

…that can be exploited by different communities

Museums

Page 45: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

45

OAI – Repository PerspectiveRequired: Protocol

DODO DO DO

MDO

MDO MDOMDOMDO

MDOMDOMDO

Page 46: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

46

OAI – Black Box Perspective

OA 1

OA 2

OA 4

OA 3

OA 5OA 6

OA 7

Page 47: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

47

Goals of Institutional Repositories (by Steven Harnad, U. Southampton) Self Archiving of Institutional ResearchSelf Archiving of Institutional Research

Thesis and Dissertations (VTLS NDLTD Project)Thesis and Dissertations (VTLS NDLTD Project)Article preprints and post printsArticle preprints and post printsInternal documents and mapsInternal documents and maps

Management of digital collectionsManagement of digital collections

Preservation of materials – decentralized approachPreservation of materials – decentralized approach

Housing of teaching materialsHousing of teaching materials

Electronic Publishing of journals, books, posters, maps, Electronic Publishing of journals, books, posters, maps, audio, video and other multimedia objectsaudio, video and other multimedia objects

Adapted from Slide by V. Chachra, VTLS

Page 48: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

48

Fedora™Repository

E x ter n a lC o n ten tS o u r c e

E x ter n a lC o n ten tS o u r c e

HT

TP

E x ter n a l C o n ten tR etr iev er

X M L F ile s

Re la t io n a l D B

S e s s io n M a n a g e me n tU s e r A u th e n t ic a t io n

P o l icies

U s ers /G ro u p s

H T T P

F T P

D atas tr eam s

D ig ita l O b jec tsS to rag e S u b s ys te m

S e c u rityS u b s ys te m

W e b Se r vi c eE xpo s ur eL aye r

SO

AP

R em o teS er v ic e

L o c alS er v ic e

M an ag e A c c e s s S e arc h O A I P ro v id e r

M an ag e m e n tS u b s ys te m

A c c e s sS u b s ys te m

HT

TP

FT

P

H T T PH T T P S O A P H T T P S O A P H T T P S O A P

C lie n tA pplica t io n

B a tchPro g ra m

S e rv e rA pplica t io n

W e bB ro ws e r

Co mp o n e n t M g mt

O b je c t M g mt

O b je c t Va lid a t io n

P ID Ge n e ra t io n

O b je c t D is s e min a t io n

O b je c t Re fle c t io n

P o lic y En fo rc e me n t

P o lic y M g mt

Co n te n t

Web Service Web Service Exposure Exposure LayerLayer

Adapted from Slide by V. Chachra, VTLS

Page 49: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

49

Browsing Collaborating Customizing Filtering Providing access Recommending Requesting Searching Visualizing

Annotating Classifying Clustering Evaluating Extracting Indexing

Measuring Publicizing

Rating Reviewing (peer)

Surveying Translating

(language)

Conserving Converting

Copying/Replicating Emulating Renewing

Translating (format)

Acquiring Cataloging

Crawling (focused) Describing Digitizing

Federating Harvesting Purchasing Submitting

Preservational Creational

Add Value

Repository-Building

Information Satisfaction

Services

Infrastructure Services

Page 50: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

50

Ontology: Applications

Page 51: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

51

Requirements Analysis Design Implementation Test

5S 5SLOO ClassesWorkflow Components

DLEvaluation

5SGraph 5SLGenFormalTheory/Metamodel

DL XMLLog

Page 52: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

52

5S MetaModel

5SGraphDL

Expert

DL Designer

5SL DL

Model

5SLGen

Practitioner

Researcher

TailoredDL

Services

Teacher

componentpool

ODLSearch,ODLBrowse,ODLRate,ODLReview,

…….

Requirements (1) Analysis (2)

Implementation (4)

Design (3)

5SGraph 5SGen

Mapping Tool

5SSuite

5SQual

Page 53: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

53

• Help users model their own instances of a digital library (DL) in the 5S language (5SL).

• A simple modeling process which enables rapid generation of digital libraries

• Features– 5SGraph loads and displays a metamodel in a structured toolbox.– The structured editor of 5SGraph provides a top-down visual

building environment for the DL designer.– 5SGraph produces syntactically correct 5SL files according to the

visual model built by the designer.

5SGraph: A DL Modeling Tool

Page 54: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

54

Overview of 5SGraph

Workspace

(instance model)

Structured

toolbox

(metamodel)

Page 55: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

55

Page 56: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

56

Page 57: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

57

Page 58: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

58

Page 59: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

59

5SLGen – Version 2: ODL, Services, Scenarios

5SL-SocietiesModel (1)

XPATH/JDOMTransform (2)

XMI:ClassModel (3)

Xmi2Java (4)

JavaClasses

Model (5)

superclass

DeterministicFSM (10)

SMC (11)

JavaFinite

State MachineClass

Controller (12)

5SL-ScenarioModel (6)

XPath/JDOMTransform (7)

StateChartModel (8)

Scenario Synthesis (9)

ODLSearch

Java

Wrapping

import

ComponentPool

ODLBrowse

Java

Wrapping

import

.

.

.

JSPUser

InterfaceView (13)

Generated DL Services

DLDesigner

DLDesigner

binds

5SLGen

5SL-SocietiesModel (1)

XPATH/JDOMTransform (2)

XMI:ClassModel (3)

Xmi2Java (4)

JavaClasses

Model (5)

superclass

DeterministicFSM (10)

SMC (11)

JavaFinite

State MachineClass

Controller (12)

5SL-ScenarioModel (6)

XPath/JDOMTransform (7)

StateChartModel (8)

Scenario Synthesis (9)

ODLSearch

Java

Wrapping

import

ComponentPool

ODLBrowse

Java

Wrapping

import

.

.

.

ODLSearch

Java

Wrapping

import

ComponentPool

ODLBrowse

Java

Wrapping

import

.

.

.

JSPUser

InterfaceView (13)

Generated DL Services

DLDesigner

DLDesigner

binds

5SLGen

Page 60: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

60

5SGraph5S Archaeology

MetaModelArchDL Expert ArchDL Designer

Structure Sub-model

ETANA-DLUnion Services

Descriptions

HarvestingMapping

SearchingBrowsing

Scenario Sub-model

VN Metadata Format

ETANA-DL Metadata Format

HD Metadata Format

Mapping Tool

Wrapper4VN Wrapper4HD

Inverted Files

Services DB

Index

Index

BrowseService

SearchService

Browse DB

OtherETANA-DL

Services

Web

Interface

XOAI

XOAI

VNCatalog

HDCatalog

UnionCatalog

5SGen

ComponentPool

Browsing…

Page 61: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

61

NSDL Information ArchitectureEssentially as developed by the Technical Infrastructure Workgroup

referenceditems &

collections

referenceditems &

collections

Special Databases

NSDLServicesNSDL

ServicesOther NSDLServices

CI Services

annotation

CI Services

discussion

CI Services

personalization

CI Services

authentication

CI Services

browsing

Core Services:information retrieval

Core Collection-Building Services

harvesting

Core Collection-Building Services

protocols

Core Services:metadata gathering

Portals &ClientsPortals &

ClientsPortals &Clients

Usage Enhancement

Collection Building

User Interfaces

NSDLCollections

NSDLCollections

NSDLCollections

CoreNSDL“Bus”

Page 62: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

62

Digital Libraries in Education

• Analytical Survey, ed. Leonid Kalinichenko• © 2003, www.iite-unesco.org, [email protected]• Transforming the Way to Learn• DLs of Educational Resources & Services• Integrated/Virtual Learning Environment• Educational Metadata• Current DLEs: US (NSDL, DLESE, CITIDEL,

NDLTD), Europe (Scholnet, Cyclades), UK (Distributed National Electronic Resource)

Page 63: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

63

Knowledge Society

HCI

Visualization

Knowledge Management

Systems Analysis & Design

Programming

Database

Algorithms

Architecture

Net-Centricity

Intelligent Systems

Social & Ethical

Library Information Science

Simulation

Chemistry

Biology

Communi-

cations

Healthcare

Art

Music

Marketing

Finance

Modeling

Engineering

Sociology

Psychology

Physics

Architecture

History

Political Science

Geography

Knowledge Society

HCI

Visualization

Knowledge

Systems Analysis & Design

Database

Algorithms

Intelligent Systems

Social & Ethical

Library & Information Science

Economics

Simulation

Chemistry

Biology

Healthcare

Art

Music

Marketing

Finance

Engineering

Sociology

Psychology

Physics

Architecture

History

Political Science

Geography

English

Math

Living In the KnowlEdge Society (LIKES):Core surrounded by enabling concepts, problem providing disciplines

Page 64: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

64

Objectives – 1 of 3

• Enhance education in the discipline:

– New courses: Living in the Global Knowledge Society, Knowledge Management

– Enhanced courses to be more driven by the LIKES theme: Artificial Intelligence, Data Mining, Digital Libraries, Multimedia/Hypertext/Information Access, …

Page 65: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

65

Objectives – 2 of 3• Give special attention, inside the discipline and across

disciplines:• to the areas of data, information, and knowledge;• to key concepts and methods, such as:

representation/views search/discovery

inference/decisions comparison/matching

complexity/heuristics analysis/mining

integration/mapping modeling/simulation

Page 66: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

66

Objectives – 3 of 3

• Engage researchers and teachers and students in the Knowledge Society’s problems, as motivation, orientation, and to help with solutions, e.g.,– Shifting toward digital government, including statutes,

rules, regulations, and procedures;– Handling attacks, including spam and viruses;– Ensuring quality even with disinformation, through

knowledge sourcing, provenance, and sharing of community expertise;

– Ensuring changes through education, that is cross-disciplinary, globally contextualized, based on awareness of human development, learning theory, and cognitive psychology

Page 67: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

67

Potential Course Areas/Courses• Personal Knowledge Management

– Computer Science and Information Systems, e.g., multi-media, process design and evaluation, and Human-Computer / Human-Information interaction.

– Psychology, e.g., knowledge organization principles, human cognitive processes.– Industrial Systems Engineering, e.g., Ergonomic factors of knowledge environments. – Ethics, e.g., ethical issues of information disclosure.

• Communication and Collaboration– Communications, e.g., Communication using digital visualizations, using knowledge access

in constructing digital messages.– Information Systems and Computer Science, e.g., computer supported cooperative work

and group support systems.– Marketing, e.g., influence of knowledge presentation on on-line customer behavior.

• Organization– Information Systems, e.g., service innovation and development, system design and

development.– Management Science, e.g., decision support systems concepts, capabilities, techniques,

and tools.– Management, Marketing, Accounting, and Finance, e.g., business in the information age.

• Society– Sociology, e.g., impact of knowledge differentials across society and countries.– Political Science, e.g., governmental collection and use of knowledge, impact of technology

on elections and government.

http://www.likes.org.vt.edu/

Page 68: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

A Digital Library Case Study

• Domain: graduate education, research

• Genre:ETDs=electronic theses & dissertations

• Submission: http://etd.vt.edu

• Collection: http://www.theses.org

Project: Networked Digital Library of Theses & Dissertations (NDLTD) http://www.ndltd.org

Page 69: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

• Aiding universities to enhance graduate education, publishing and IPR efforts

• Helping improve the availability and content of theses and dissertations

• Educating ALL future scholars so they can publish electronically and effectively use digital libraries (i.e., are Information Literate and can be more expressive)

What are we doing?

Page 70: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

70

NDLTD Incorporation

• Networked Digital Library of Theses and Dissertations incorporated May 20, 2003 in Virginia, USA

• Charitable and educational purposes (501 c 3)

• Officers– Executive Director (Ed Fox)– Secretary (Gail McMillan)– Treasurer (Austin McLean)

Page 71: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

71

UNESCO and ETDs(by Axel Plathe at ETD2003)

• Promoting the use of the Internet as a tool for disseminating scientific knowledge

• Facilitating the transfer of ETD expertise from developed to developing countries

 

• 1998: Member of the NDLTD Steering Committee• 1999: First UNESCO ETD meeting on ETD

internationalisation  

• 2002: “UNESCO Guide to Electronic Theses and Dissertations”

 

• 2003: Model training programmes and training courses• 2003: Sponsor pilot projects• 2003: Pilot projects (Africa, Europe, Latin-America)

Page 72: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

72

Why ETD? Short Answer

• For Students:– Gain knowledge and skills for the Information Age– Richer communication (digital information, multimedia, …)

• For Universities: – Easy way to enter the digital library field and benefit

thereby

• For the World: – Global digital library – large, useful, many services

• General:– Save time and money– Increased visibility for all associated with research results

Page 73: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

73

Page 74: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

74

Moving from a minimal DL towards a DL reference model

Minimal DL DL reference model

(DELOS – EU Network of Excellence on DLs)

Multimedia

Annotation

Knowledge management Practical DL

systems

PIMDL quality

Domain-specific DLs

Page 75: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

75

Hypothesize Model

a) Traditional research sequence

b) DL-supported research sequence

Collect Data Analyze Results

Test Hypotheses Publish Results

Refine Hypotheses

Identify Scope (Study, Content)

Collect Available Data, Request Added Data

Add to DL: Ontologies, Classifications, Analyses, …

Provide Services: Searching, Browsing, Mining, Visualization, …

Support: Analysis, Synthesis, Collaboration, Hypothesis Testing, …

DLs for Crisis, Tragedy & Recovery

Page 76: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

76

News

Blogs,Wikis

Web 2.0 Sites

Online Forums

CDDC

Surveys,Interviews,

Submissions

Data Sources

CrawlingIndexingCategorizingData Curation

DL-VT416

Social Tagging

Data Mining

Visualization

Browsing

Searching

Social NetworkAnalysis

Services

Web InterfaceDesktop Client

Specification Through Focus Groups

Sustainability Through Archiving

FederatedAccess, Mapping,Mediating

http://www.dl-vt-416.org/

Page 77: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

77

Page 78: 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy.

78

Summary

• Digital Libraries• 5S• Archaeology• Education• ETDs• CTR (Crisis, Tragedy & Recovery)