ETANA-DL(Electronic Tools and Near Eastern

Archives Digital Library)

Edward A. Fox, Virginia TechJames W. Flanagan, Case Western Reserve U.

AIA 106th Annual Meeting, Boston, Jan. 2005

fox@vt.edu http://fox.cs.vt.edu

http://fox.cs.vt.edu/talks/

Outline Acknowledgements ETANA-DL High Level Overview Harvesting, Open Archives Initiative OCKHAM, Reference Models OAIS (ISO Standard for Archiving) 5S (Digital Library Framework) ETANA-DL Approach, Services, Integration Conclusions

NSF ITR Funding IT Research Digital library: Integration of DB,

HCI, HT, IR, LIS, MM, …

Complexity! Variety! Distributed! => 5S Framework + OAI / ODL

Archaeology Research Multiple sites Multiple kinds of artifacts Multiple terminologies

General/special services Multiple views Hypothesis testing Rapid publication

Map courtesy: www.enchantedlearning.com

Initial ETANA-DL Member Locations

Virginia Tech

Mississippi State University

Vanderbilt University

Canadian University College

Walla Walla College

Andrews University

CWRU

Willamette University

Acknowledgements

Contributors:• Karen Borstad, MPP• Douglas Clark, Walla Walla College• Larry Herr, Canadian University College• Christopher Holland, LRP• Paul Jacobs, Mississippi State U.• Stan LaBianca, Andrews U.• David McCreery, Willamette U.• David Schloen, U. of Chicago• Randall Younker, Andrews U.• . . .

Team:• Joanne Eustis, CWRU

• Weiguo Fan, Virginia Tech

• Nick Fischio, CWRU

• Paul Gherman, Vanderbilt U.

• Marcos Goncalves, Virginia Tech

• Doug Gorton, Virginia Tech (CS4624)

• Douglas Knight, Vanderbilt U.• Likhita Krishnamurthy, VT (CS5604)• Ming Luo, Virginia Tech• Ananth Raghavan, VT (CS5604)• Divya Rangarajan, VT (Ind. Study)• Unni Ravindranathan, Virginia Tech• Jack Sasson, Vanderbilt U.• Rao Shen, Virginia Tech• Ricardo Torres, U. Campinas, Brazil• Srinivas Vemuri, Virginia Tech

Lahav Website

Megiddo Opening Screen

Locus Screen: Pictures

View all

Area Screen

ETANA-DL Website

ETANA-DL Architecture

Users Services Data ETANA-DLUnion Services Users

DigBase

DigKit

ETANA-DL ArchitectureDigBase and DigKit

LahavNimrin

UmayriHisban

Megiddo

Jalul

New Sites

DATABASE

WRAPPERS

ETANA-DLUNION

CATALOG

SearchUSER

INTERFACE

BrowseRecommend

NotePersonalize

ReviewVisualizationsArchaeology

Specific

1st Prototype

…

Open Archives InitiativeOAI

www.openarchives.org

Open Archives Initiative (OAI)Protocol for Metadata Harvesting

Black Box Perspective

OA 1

OA 2

OA 4

OA 3

OA 5OA 6

OA 7

OAI = Technical Umbrella forPractical Interoperability…

ReferenceLibraries

Publishers E-PrintArchives

…that can be exploited by different communities

Museums

OAIRepositoryPerspective

Required: Protocol

DODO DO DO

MDO

MDO MDOMDOMDO

MDOMDOMDO

Discovery CurrentAwareness Preservation

Service Providers

Data Providers

Metada ta

ha rve sti ng

OAI: Data & Service Providers

Data and Service Providers

Data Providers possess metadata and share it (internally / externally) via well-defined OAI protocols (e.g., database servers)

Service Providers harvest and preserve data from Data Providers provide higher-level services to users (e.g., search engines)

Who will fit where in ETANA-DL? Data Provider – YOUR PROJECT Service Provider – ETANA-DL

NSDLOCKHAM

Services

NSDLServices

Teachers LearnersLibrarians

OCKHAMLibrary

Network

LibraryServices

OCKHAM Simplicity (a la OCCAM’s razor) Support by Mellon and DLF Four main ideas:

1. Components2. Lightweight protocols3. Open reference models (e.g., 5S, OAIS)4. Community perspective and involvement

Funded by NSF in NSDL, with P2P

Reference Models Reference Model: a common vocabulary

and description of components, services, and inter-relationships that comprise a system under consideration

Useful as a tool to foster consensus and common understanding in a time of rapid change and/or disagreement

OAIS RLG Pages - www.rlg.org

OAIS RLG Examples – 1 of 2

OAIS RLG Examples – 2 of 2

http://ssdoo.gsfc.nasa.gov/nost/isoas/

Informal 5S Definitions

DLs are complex systems that

help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)

5SSs Examples Objectives

Streams Text; video; audio; image Describes properties of the DL content such as encoding and language for textual material or particular forms of multimedia data

Structures Collection; catalog; hypertext; document; metadata

Specifies organizational aspects of the DL content

Spaces Measure; measurable, topological, vector, probabilistic

Defines logical and presentational views of several DL components

Scenarios Searching, browsing, recommending

Details the behavior of DL services

Societies Service managers, learners, teachers, etc.

Defines managers, responsible for running DL services; actors, that use those services; and relationships among them

Site Partition Sub-partition Locus Container

Lahav FieldI

AreaA8

LocusA8074

Basket224

Nimrin QuadrantNW

Quadrant ValueN25/W50

Locus96

Bag240

Umayri FieldA

Square7J59

Locus001

Pail12

5S Structural Model Organization

5S MetaModel

5SGraphDL

Expert

DL Designer

5SL DL

Model

5SLGen

Practitioner

Researcher

TailoredDL

Services

Teacher

componentpool

ODLSearch,ODLBrowse,ODLRate,ODLReview,

…….

Requirements (1) Analysis (2)

Implementation (4)

Design (3)

5SGraph 5SGen

Mapping Tool

5S Suite

ETANA-DL Architecture

UnionCatalog

Inverted Files

Services DB

Index

Index

BrowseComponent

SearchComponent

Browse DB

OtherETANA-DL

Services

Web Interface

XOAI

XOAI

DigBase

DBData

MappingComponent

OA

I Data Provider

OAI

Archaeological Site ETANA-DL

DigKit

Configure

Digital Object

RepositoryCollection Minimal DL

Metadata Catalog

Descriptive Metadata

Specification

A Minimal DL in the 5S Framework

Structural Metadata

Specification

Streams Structures Spaces Scenarios Societies

indexingbrowsing searching

services

hypertext

Structured Stream

5S Archaeological DL Modeling

Modeling archaeological information systems

using the 5S theory to better understand the domain and design the system and the supporting

services

Streams Structures Spaces Scenarios Societies

indexingbrowsing searching

services

hypertext

Structured Stream

Descriptive Metadata

specification

SpaTemOrg

StraDia

Arch Descriptive Metadata specification

ArchDO

ArchObj

ArchColl

Arch Metadata catalog

ArchDColl ArchDR Minimal ArchDL

A Minimal ArchDL in the 5S Framework

Modeling ETANA-DL – An Archaeological DL Meta-model

Text Video Audio

*Site *Sub-partition *Container *Artifact*LocusRegion

Taxonomies

Temporal Artifact-specific

Space model

Structuremodel

Metadata

Drawing Photo 3DStreammodel

*Partition

Society model

ArchaeologistGeneral public

Geographic space

Service Manager

Information Satisfaction

Value added

Repository buildingScenario

model Services

Domain specific

User interface Metric space

Spatial

Modeling ETANA-DL – ETANA Model

*Field *Pail *Bone*LocusJordan

Taxonomies

Space model

Structuremodel Field record,

locus sheet

Figurine image (photo)

Streammodel

Umayri

Society model

Archaeologist

Generic public

Site-specific coordinate system Web interface Vector space

ETANA-DLService Manager

Searching, Browsing

Annotation, binding

Harvesting, Converting Scenario

model Services

Object comparison, marking item for analysis

Archaeologicalperiods

Bone type

Seed species

*Square

*Figurine*Quadrant *Bag*LocusJordan Valley Nimrin *Square*Field *Basket*LocusSouthern Israel Halif *Area

*Seed

Site/field plan(drawing)

Preliminary/FinalReport (application/pdf)

Spatial

Overall objective of 5SGraph:Help users model their own instances of a digital library (DL) in the 5S language (5SL).

A simple modeling process which enables rapid generation of digital libraries is needed.

Support non-expert users. Speed-up development process. Increase the quality of final product.

5SGraph: A DL Modeling Tool

Overview of 5SGraph

Workspace

(instance model)

Structured

toolbox

(metamodel)

Space Model

Society Model

ETANA-DL Approach Applying and extending Digital Library (DL)

techniques to solve key problems: making primary data available, data preservation, and interoperability

Modeling archaeological information systems using 5S to better understand the domain and design the system and the supporting services

Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks: eliciting requirements refining metamodel and union schema modeling sites mapping harvesting providing useful services

Marking – writingnotes for

a specific user

Marking Items

Marked Items Display

Sender, Date,Object OAI ID

SenderComments

Options:View Record,

Add record to Items Of Interest,Re-mark item (Redirect),

Unmark item (Remove item from list)

Discussions Page

Discussions about an

object

View/Post messages, create new

threads

Recommendations

Items recommendedon the basis of

similar interests

ETANA-DL Searching ServiceSearch

ETANA-DL Multi-dimensional Browsing3 new sites

2 new types of artifacts

ETANA-DL Visual Browsing Service

Visual BrowseBy site

Visual Browsing Nimrin: Topographical Drawings

Full site North west quadrant

Square:N40/W20

Visual Browsing Nimrin : Square information

Square:N40/W20

Locus: 86Loci layout

Visual Browsing Nimrin : locus sheet

Visual Browsing Bab edh-Dhra' Cemetery

Pottery # 25

Visual Browsing Bab edh-Dhra' Cemetery

Pottery # 25

Repository1

DL1

Repository2

Union Catalog

Union Repository

Catalog1 Catalog2

Searching

Union DL DL2

archaeologists

Society

General Public

Society

ArchaeologistsGeneral Public

Union Society

ServiceBrowsingService

Union Service

Harvesting, Mapping,Searching, Browsing,

Clustering, Visualization

Architecture of a Union DL

Union Catalog

VNCatalog

Union Catalog Integration

Virtual Nimrin(VN)

Halif DigMaster(HD)

HDCatalog

VN MetadataFormat

MappingTool

MappingTool

Global MetadataFormat

Wrapper

Wrapper

HD MetadataFormat

Site Artifact Type Original data source Number of records harvested

Bab edh-Dhra’ Pottery cp6 database file 786

Lahav Figurine Tab-delimited text file 563

Madaba Locus field record Tables in Access DB 786

Mozan Publication PDF files 19

NimrinBone field record Table in Oracle DB 7419

Seed field record Table in Oracle DB 429

Locus field record Table in Oracle DB 2101

Umayri Bone field record 2 tables in Access DB 2122

Total 18404

Heterogeneous data handling

ETANA-DL Schema Design

Bone Seed Figurine

ETANA-DLObject

Count

Animal

……Species

Name

……Description

Dimensions

……

Owner

Subpartition

PartitionLocus

ID Container

Collection

……

Visualizing Components

Mapper1

Composite Mapper

Mapper2 Mapper3 Mapper4

Visual Mapping Tool Architecture

Data Mapping (state-of-the-art)

local schema global schema

Mapping recommendation

Mapping confirmation

Mapping history

No recommendation for “Tomb_Area”

User-decided mapping

5SGraph5S Archaeology

MetaModelArchDL Expert ArchDL Designer

VN Metadata Format

ETANA-DL Metadata Format

Mapping Tool

Wrapper4VN Wrapper4HD

HD Metadata Format

Inverted Files

Services DB

Index

Index

BrowseService

SearchService

Browse DB

OtherETANA-DL

Services

Web Interface

XOAI

XOAI

VNCatalog

VNCatalog

UnionCatalog

Structure Sub-modelScenario

Sub-model

Harvesting description

Mappingdescription

Browsing description

…

5SGen

ComponentPool

Browsing…

Conclusions

Working on 5S book … See http://feathers.dlib.vt.edu/ Thanks to NSF ITR IIS-0325579! Please fill in and return/send survey!