The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001...

34
the OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University -- Computer Science

Transcript of The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001...

Page 1: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

the OAI: overview and historical context

OAI Open Meeting – Washington DC – January 23rd 2001

Herbert Van de Sompel & Carl LagozeCornell University -- Computer Science

Page 2: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

herbert van de sompel

The Open Archives Initiative has been set up to create a forum to discuss and solve matters of interoperability between preprint solutions, as a way to promote their global acceptance. Paul Ginsparg, Rick Luce & Herbert Van de Sompel

OAI origin

herbert van de sompel

Page 3: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

preprint solutions

herbert van de sompel

• attractive building block in ongoing transformation

of scholarly communication

• interoperability could increase impact of preprints:

• amongst preprint solutions

• with building blocks that implement other

functions of scholarly communication

• with the established communication system

Page 4: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

e-print

e-print accessibility

e-print

e-print

e-print

herbert van de sompel

e-print

Page 5: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

e-print

e-print accessibility

e-print

e-print

e-print

herbert van de sompel

e-print

Page 6: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

preprint solutions

herbert van de sompel

• Santa Fe meeting: improve accessibility of

preprints

• by improving searchability

• via the provision of an interoperability spec

Page 7: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

Core concepts of Santa Fe convention

herbert van de sompel

• low-barrier interoperability

• data-provider & service-provider model

• metadata harvesting model

• shared metadata format and parallel, community-

specific metadata formats

• acceptable use

Dienst subset

OAMS

XML reply

HTTP based

Gentelmen’s agreement

Page 8: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

metadata harvesting

herbert van de sompel

metadata

e-print

e-print

e-print

e-print

e-print

Page 9: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

metadata harvesting

herbert van de sompel

metadata

AuthorTitleAbstractIdentifer

e-print

e-print

e-print

e-print

e-print

Page 10: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

interest from other communities

herbert van de sompel

• Digital Library Federation meetings ~ research library community has many materials for which they would like to ‘expose’ metadata

• OAI San Antonio meeting: ~ interest from librarians, publishers, others, ...

Page 11: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

resulting actions: organizational

herbert van de sompel

• establish organizational stability for the OAI:

• institutional backing from CNI & DLF

• steering committee: policy guidance

• technical committee: technical specifications

• executive group: day to day coordination

• workshops: public dissemination, feedback

Page 12: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

resulting actions: technical

herbert van de sompel

• [09/2000] revise specifications to allow adoption beyond preprints: technical committee

• [09/2000-01/2001] compile new specifications: editing by Carl and Herbert

• [11/2000-01/2001] alpha-test specifications: oai-alpha group

• [01/2001] discontinue the Santa Fe Convention

• [01/2001] release version 1.0 of the OAI protocol

Page 13: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

core concepts in OAI 1.0

herbert van de sompel

• low-barrier interoperability

• data-provider & service-provider model

• metadata harvesting model

• shared metadata format and parallel, community-

specific metadata formats

• acceptable use

• flexibility

OAI 1.0 protocol

Dublin Core

HTTP based

Community specific

Reply • XML Schema

• Self contained

Page 14: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

low-barrier interop umbrella

herbert van de sompel

metadata

OPAC

image

FTXT

A&I

e-print

Page 15: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

low-barrier interop umbrella

herbert van de sompel

metadata

OPAC

image

FTXT

A&I

e-print

AuthorTitleAbstractIdentifer

Page 16: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

OAI harvesting tools

herbert van de sompel

DatestampIdentifierSet

Records

repos i tory

harves ter

service provider data provider

Page 17: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

OAI harvesting tools

herbert van de sompel

Supporting protocol requests:• Identify• ListMetadataFormats• ListSets

Harvesting protocol requests:• ListRecords• ListIdentifiers• GetRecord

repos i tory

harves ter

service provider data provider

Page 18: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

modes of running OAI 1.0 repository

herbert van de sompel

• mode 0:

• no registration of repository in the OAI registry

Page 19: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

modes of running OAI 1.0 repository

herbert van de sompel

• mode 1:

• registration of repository in public OAI registry

[includes validation of replies]existence of the repository is visible

Page 20: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

modes of running OAI 1.0 repository

herbert van de sompel

• mode 2:

• registration of repository in public OAI registry

• usage of the OAI format for identifiers

resolver for OAI formated identifiers

existence of the repository is visible

Page 21: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

tools to support OAI implementation

herbert van de sompel

• Hussein’s Repository explorer

• XSV Schema Validator

• XML Spy

• the OAI comformance tester [soon]

Page 22: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

communication re OAI

herbert van de sompel

• lists: subscribe via http://www.openarchives.org

• oai-general list [replaces UPS list; UPS-

subscribers will be moved]

• oai-implementers list

• web: http://www.openarchives.org

• FAQ: http://www.openarchives.org/faq.htm

• mail: [email protected]

Page 23: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

• freeze specifications for 12 -18 months:

• stable for experimentation; not definitive• minimize risk for early adopters

• maximize chances for future interoperability across communities

revision of specifications

herbert van de sompel

Page 24: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

The Open Archives Initiative develops and promotes interoperability standards that aim to facilitate the efficient dissemination of content.

new OAI mission statement

herbert van de sompel

Page 25: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

The Open Archives Initiative has its roots in an effort to enhance access to e-print archives as a means of increasing the availability of scholarly communication. Continued support of this work remains a cornerstone of the Open Archives program.

new OAI mission statement

herbert van de sompel

Page 26: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

The fundamental technological framework and standards that are developing to support this work are, however, independent of the both the type of content offered and the economic mechanisms surrounding that content, and promise to have much broader relevance in opening up access to a range of digital materials.

[...]

new OAI mission statement

herbert van de sompel

Page 27: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

http://www.openarchives.org

[email protected]

Page 28: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

the oai-alpha test

OAI Open Meeting – Washington DC – January 23rd 2001

Herbert Van de Sompel & Carl LagozeCornell University -- Computer Science

Page 29: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

alpha test of specs [11/2000-01/2001]

herbert van de sompel

• data providers:• arXiv -- Los Alamos • NACA -- NASA• CogPrints -- U Southampton• ETD -- Virginia Tech• Thesis & Dissertations from WorldCat -- OCLC• American Memory -- Library of Congress

Page 30: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

• data providers:• HeinOnline law journals -- Cornell U • TEI-lite collection -- U Tennessee• STM publisher metadata -- U Illinois• Resource Disovery Network -- UKOLN• Open Language Archives -- U Pennsylvania• Open Video Project -- U Northern Carolina• CIMI

alpha test of specs [11/2000-01/2001]

herbert van de sompel

Page 31: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

• software:

• OAI harvesting interface to Ex Libris Aleph 500 Integrated Library System -- Ex Libris

• Open-source software capable of creating a merged catalog of metadata harvested from OAI-servers -- OCLC

• OAI 1.O compliant eprints.org software -- U Southampton

alpha test of specs [11/2000-01/2001]

herbert van de sompel

Page 32: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

• service providers:• Repository explorer -- Virginia Tech• ARC service -- Old Dominion U

alpha test of specs [11/2000-01/2001]

herbert van de sompel

Page 33: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

Credits: oai-alpha group for a truly incredibly good job.

Special thanks: Hussein Suleman, Michael Nelson, Simeon Warner for playing a distinct enabling role.

Page 34: The OAI: overview and historical context OAI Open Meeting – Washington DC – January 23 rd 2001 Herbert Van de Sompel & Carl Lagoze Cornell University --

http://www.openarchives.org

[email protected]