1

Digital Library Network atDeveloping Countries

Case Study:The Indonesian Digital Library Network

Ismail Fahmi < ismail@itb.ac.id >Knowledge Management Research

Group ITB

Presented at APAN Digital Library Tutorial Session, August 21 2001, Malaysia

2

Acknowledgement

Funding: IDRC, International Development Research

Centre (Canada) YLTI, Yayasan Litbang Telekomunikasi dan

InformatikaSupport in-kind: Perpustakaan Pusat ITB AI3/ITB, Asian Internet Interconnection

Initiatives CNRG, Computer Network Research Group KMRG, Knowledge Management Research

Group

3

Agenda

About IndonesiaDLN Philosophy Mission

Common Problems Basic Requirements Strategies

Architecture of the Network Standard Metadata Metadata Exchange Protocol

Implementation Status Future Direction

4

Definition

Digital Library vs Online Catalog Digital Library = containing

electronic resources (document, audio, video)

Online Catalog = only bibliographic database

Online catalog usually related to Library Automation

5

So, what is Digital Library?

Not a single entity; Requires technology to link the

resources; Linkage between digital library systems

are transparent to the end users; The goal is universal access to the

information services and digital libraries;

The collection is not only documents.

6

And, What is IndonesiaDLN?

It is a --

Network of Digital Library Networks

in Indonesia

7

Philosophy

“Dan (ingatlah), ketika Allah mengambil janji dari orang-orang yang telah diberi kitab (yaitu):"Hendaklah kamu menerangkan isi kitab itu kepada manusia, dan jangan kamu menyembunyikannya," lalu mereka melemparkan janji itu ke belakang punggung mereka dan mereka menukarnya dengan harga yang sedikit. Amatlah buruk tukaran yang mereka terima.”

-- Ali Imran 187

8

Philosophy

Our primordial commitment: “Will share our knowledge to others and never withhold it” -- Al Qur’an

“All knowledge all discoveries belong to everybody. ... All knowledge all discoveries belong to you by right. It is time to demand what belongs to you." -- William S. Burroughs, The Job

9

O ACPTUNSYIAH

O JBPTITBPP

O IJPTUNCEN

O JBPTIPBMMA O JIPTUMMO JKPKBPPKO JKPKELNUSAO JKPKFORLINKO JKPNPNRIO JKPTBINUSO JKUNUAJ

O SAPTUNSRAT

O SGPTUNHALU

O YOPTIAIN

Mission

Unlock !

Unlock ACCESS to the Indonesian knowledge

10

Common Problems

Internet connection availability Bandwidth Human Resources Awareness of the Leaders

Inhabitants: 210 million

11

Basic Requirements

We need SOLUTION. Not state of the art of the technology, but a Regional Technology.

Running on narrow bandwidth and unreliable connections.

Common-sense User Interface. Attract individual and institution

(knowledge producers). Easy to implement and join.

12

About Data Integration

Integration

global definedfrom local

global “independent”of local

CWA

global-schema-as-view

OWA

global-as-view-of-local

local-as-view-of-global

Database Schema Integration Data Warehousing Mediation

13

Strategies (Technical)

Networked: through a national networked digital library

Distributed: every institutions can manage their own digital library system

Unified: all knowledge will be unified Disseminated: all knowledge will be

disseminated (mirroring), bring information near to the users.

Standardized: using international acknowledged metadata standard (Dublin Core)

Portal-like user interface: search and browse presentation

14

Strategies (Society)

Bottom-Up movement ! Type of partnership: Institution,

Individual, and Internet Café. Promote sub-networks: I.e. health,

agriculture, human rights, etc.

15

Knowledge Map

Information: abstract and full content of the LOCAL CONTENT.

Including: Research report Final Project, Theses, Dissertation Article, paper, proceeding, journal E-book, e-learning material, course

material clipping, Heritage, Multimedia, expertise

directory, etc.

16

Knowledge Sources

University Research

institution NGO Government Business

Playgroup, TK, SD, SMP, SMA

Pesantren, Mosque, Religion institution

Citizen organization, cooperation

Etc

17

Architecture of GDL Network

Key:-Standard Metadata-Protocol

There are a hub and many digital library servers.

*GDL = GaneshaDigital Library

18

IndonesiaDLN Interoperability Metadata Std. Objective: to manage electronic resources

(documents, audio, video files) on the Internet among the digital library networks.

Dublin Core Metadata Element Sets Has the same objective Simple, multipurpose Widely used

IndonesiaDLN Interoperability Metadata Std was derived from NDLTD Metadata Std (also based on Dublin Core).

19

Elements of the Metadata

15 Core elements:

TitleCreatorPublisherSubjectDescriptionDateType

FormatIdentifierSourceLanguageRelationCoverageRights

20

Qualifiers of The Elements

Some elements have qualifiers. IndonesiaDLN allows

implementation of specific qualifiers within the digital library networks,

But when the networks will share into IndonesiaDLN, they must use the IndonesiaDLN Interoperability Metadata Std. (see http://idln.itb.ac.id).

21

Example for Agribusiness

AgribusinessDigital Library Network

Use FAO Agriculture Metadata Standardfor intra-network metadata

exchange

IndonesiaDLNHUB

Use IndonesiaDLNInteroperability MetadataStandard

22

Example of the Qualifiers

Element: TitleQualifiers:

Alternative dc.title.alternative Series dc.title.series

Element: CreatorQualifiers:

Orgname dc.creator.orgname Email dc.creator.email …

23

Example of the XML format

<?xml version=“1.0” ?><IndonesiaDLN><dc.title> Title goes here (native language)

<alternative>Title in English is here </alternative><series> series, number,… </series>

</dc.title><dc.creator> creator full name

<orgname> organization of the creator </orgname><email> creator’s email </email>

</dc.creator>……</IndonesiaDLN>

Generated by servers during exchange process.

24

Example: Metadata in XMLMetadata is formatted into XML before exchanged among the digital library servers.

All digital library servers in IndonesiaDLN should use the IndonesiaDLN Interoperability Metadata Standard. Currently is version 1.1.

25

Key factor: Identifier

Every metadata will be recognized from its IDENTIFIER.

Identifier is unique within IndonesiaDLN. It contains the following information:

Publisher ID Digital Library Network ID Type of the electronic resources Year of creation Creator Record number, and Content theme

26

Example of Identifier

jbpeismail-gdl-res-2001-ismail-11-idrc

Publisher IDDigital Library Network IDType of the electronic resourcesYear of creationCreatorRecord number, andContent theme

Benefit: Entering URL containing the identifier to any digital library servers will show the same metadata content.Example:

http://digilib.xxx.xxx/go.php?id= jbpeismail-gdl-res-2001-ismail-11-idrc

27

File Naming

The IDENTIFIER also be used to assign name to files that are uploaded together with their metadata.

Example: jbpeismail-gdl-res-2001-ismail-11-idrc-report-1.zip jbpeismail-gdl-res-2001-ismail-11-idrc-report-2.pdf jbpeismail-gdl-res-2001-ismail-11-idrc-software-3.zip

28

Metadata Exchange Protocol (Synchronization)

Using the services of: HTTP (operational)

Real time transaction Good for reliable connection

SMTP (in progress) Not real time Good for unreliable connection

Post office :-) Burned into CD-ROM, takes days or weeks Good for no internet connection at all

29

The Synchronization Services

Data ProviderLOCAL

Service ProviderHUB

metadata, file

metadata

PUT protocolrequests:- PutMetadata- ListMyIdentifiers- DeleteMetadata- PutFileFragment- MergeFileFragment- PutMembers

GET protocolrequests:- ListIdentifiers- GetMetadata- GetPublishers

AUTHENTICATIONprotocol requests:- Connect- Disconnect- GetMemberInfo

authentication

Metadata are:- sent from LOCAL to HUB server and,- downloaded from HUB to LOCAL server,

through the synchronization services.

Optionally, the files also can be sent from LOCAL to HUB.

There are 3 groups of requests: Authentication, PUT, and GET.

30

Authentication

Server authentication before synchronization

Member roaming login

31

PUT

Send PUBLIC information to HUB server

Including: Metadata and File Member Registries

32

PUT The Files

Optionally (especially for temporary connection), the metadata related files can be PUT into HUB server.

Files will be sliced (by 10 KB, or customized) before they are sent.

Using HTTP PUT Method.

33

GET

Download: Metadata Publisher registries

34

Publisher Registry

<?xml version="1.0"?><DC.PUBLISHER>

GaneshaDL Central Hub<ID>GDLHUB</ID><TYPE>INSTITUTION</TYPE><APPS>GDL</APPS><ORGNAME>Knowledge Management Research Group ITB</ORGNAME><HOSTNAME>gdlhub.indonesiaDLN.org</HOSTNAME><IPADDRESS>167.205.23.27</IPADDRESS><PROTOCOL>HTTP</PROTOCOL><ADMIN>donfau@kmrg.lib.itb.ac.id</ADMIN><CKO>cko@kmrg.lib.itb.ac.id</CKO><POSTMASTER>pm@digilib.itb.ac.id</POSTMASTER><CONNECTION>DEDICATED</CONNECTION>

</DC.PUBLISHER>

File: /util/publisher.ini

35

User InterfaceMost users are familiar with interface like Yahoo, Google, Altavista, etc.

The information is organized by categories. Easy to Navigate and Search.

36

GDL-NetworkGDL-Network

IndonesiaDLN Topology

IndonesiaDLNHUB

institusiwarnet

personal

New SpektraHUB

In-CUVLGDL-HUB

37

GDL-Network

GDL-NetworkGDL-Network

institusiwarnet

personal

GDL-HUB

ITB

RSHS

Unsyiah

UMM

Binus

UAJ

IPB

Salman

Depkes

38

Scenario of Sharing & Replication

GDL-NetworkGDL-Network

institusiwarnet

personal

GDL-HUB

ITB

RSHS

Unsyiah

UMM

Binus

UAJ

IPB

Salman

Depkes

Share

Replication

Replication

Replication

39

Scenario of Access

GDL-NetworkGDL-Network

institusiwarnet

personal

GDL-HUB

ITB

WarnetWarnet

Server GDL Warnet

Server GDL ITB (Source)

Search &^%?

Result = url

Download Full resources

40

GDL Sub-HUB

GDL-NetworkGDL-Network

GDL-HUB

GDL Sub HUBInstitusi X

Dept A

Dept B

personal

personal

GDL-NetworkHUB

Institution XGDL Sub HUB

GDL Server Dept

41

Benefits of Promoting Sub-Hub

Encourage institutions with distributed offices to develop DL network.

Boost the number of IndonesiaDLN partners.

Managing subject-specific knowledge and information (ie. Agriculture, healthy, human rights, etc)

42

Implementation Status

GDL (Ganesha Digital Library) version 1 = End of 1999.

Idea of developing the IndonesiaDLN = October 2000.

Launching of IndonesiaDLN = June 2001 (it just 2 months ago).

43

The Technology

Operating system: Unix/Linux Windows 98/NT/2000 Windows 95 – needs winsock32

Web server: Apache Scripting Lang: PHP 4 Database Server: MySQL Infrastructure: Dedicated or Dial-Up

44

Benefits

Easy to install (especially for Windows)

Able run on PC, Laptop promote personal digital library, small institution, SME

Allow dial-up and behind-proxy installation (temporary connection) good for small institution, personal, and internet café.

45

Problems & Limitations

Updating information at resource server will not automatically update the mirror sites.

46

The Networks

Currently only GDL-Network that has been fully operational.

Near future: Spektra Virtual Library Future: DLN for Human Rights,

Agribusiness, Distance Learning, Bibliographic, Health Research, and Heritage.

47

The Network of Networks

IndonesiaDLN

GDL-Engine

GDL-Network

GDL-Engine

Human Rights-Network

GDL-Engine

Agribusiness

Network

GDL-Engine

Heritage-Network

GDL-EngineBiblio-

Network

GDL-Engine

NewSpektraDistance Learning-

Network

GDL-Engine

48

GDL-Network PartnersBy August 2001

49

The Distribution Map of GDL-Network PartnersBy August 2001

50

Members of GDL-Network

Member = users that have registered at GDL servers.

Currently the total members registered at GDL Hub is about 3028 users.

51

Members of GDL-Network (by partners)By August 2001

52

Members’ Country

By August 2001

53

Members’ JobBy August 2001

54

The ContentsBy August 2001

55

Alternatives to join for Department

Using existing GDL server (Central Library), http://digilib.itb.ac.id

Install GDL server at Department, http://digilib.DEPT.itb.ac.id

56

How Students Can Join?

Steps: Free registration to become a member, at:

GDLHUB, http://gdlhub.indonesiaDLN.org Or at other GDL Servers ( of partners)

Upload & share the abstract and full content of the paper, reports, theses, etc.

Member’s Personal Directory:http://[server]/go.php?top=/Member/email@your.com/

Then: GDL server will share them automatically to

IndonesiaDLN! Member’s contribution can be accessed widely.

57

Important URLs

IndonesiaDLN web site; Mailing list; technical, scenario, society, announcement; standard, http://idln.itb.ac.id

About GDL-Network, registration, join, software, patch, download, etc, http://gdlhub.indonesiaDLN.org/faqgdl.php

Download GDL source code for free, http://gdl.itb.ac.id/download/

GDL-HUB, http://gdlhub.indonesiaDLN.org Digital Library ITB, http://digilib.itb.ac.id Contact KMRG: kmrg@kmrg.lib.itb.ac.id

58

Demo

Try to access this:

http://172.16.2.86/

Login: superuser@localhost Password: apan

59

Thank youThank you