EXtensible Catalog Software Portfolio Part 1: Overview.

eXtensible Catalog

Software PortfolioPart 1: Overview

2

XC Software Overview

• eXtensible Catalog is open source, user-centered, next generation software for libraries.

• It comprises four software components that can be used independently to address a particular need or combined to provide an end-to-end discovery system to connect library users with resources.

3


• Implement next generation catalog interfaces on an extensible and adaptable architecture

• Offer innovative services to end users• Migrate local customizations into

future version upgrades• Maximize cataloging investments and leverage

existing staff in new way

4


• User Interface: – Faceted, FRBRized, customizable search interface– Web application framework for libraries

• Metadata Tools: – Automated metadata processing: Enable libraries

to aggregate metadata and run services on it• Connectivity Tools:

– Harvest and synchronize metadata with OAI-PMH– Circulation and authentication with NCIP

5

MARCXMLDC

XC Software Components

User Interface for searching and browsing

Library Website (on Drupal)

Integrated Library System Repository

XC Drupal Toolkit

Tools for automated processing of large batches of metadata

XC Metadata Services Toolkit

Tools for connectivity between XC and an ILS

XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

Download XC software at

eXtensibleCatalog.org

eXtensible Catalog

Software PortfolioPart 2: Drupal Toolkit (User Interface)

8




Drupal Toolkit

Integrated Library System

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit


MARCXMLDC

Repository


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

9

Drupal Toolkit


MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

Features

XC OAI Toolkit


MARCXMLDC

Repository


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

• Single search interface across:– Library catalog– Digital repository– Website resources

• Faceted browsing of results• Extensive customization• Integration with ILS circulation

system

10

Drupal Toolkit

Features

• Adds support for library metadata into Drupal

• XC Schema– MARC is converted to XC

Schema using the Metadata Services Toolkit

– XC Schema is FRBRized to enable a new kind of results navigation


MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit


MARCXMLDC

Repository


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

11

Drupal Toolkit: Search Interface

The XC Drupal Toolkit provides a public search interface for XC on top of the Drupal platform.

It uses the default Drupal theme (colors, fonts, layout) which can be customized.

In this example, the user has done a keyword search for “xml.”

12


Features:- Simple keyword search- Facets- Customizable metadata display- Circulation status - Syndetic Solutions content- Why am I getting these results for my query?

13


Features:- Additional facets- Navigation

14

Drupal Toolkit: Full Record Display

Features:- Customizable metadata display for full record- XC Schema enabled…- MST Normalization enabled…

15

Drupal Toolkit: Modular

Features:- Image zoom feature - “Lightbox2” module (Drupal.org)

16

Drupal Toolkit: Full Record Display

Features:- Reviews from Syndetic Solutions- Related Subjects- Configurable “Browse Similar Items”- Full record metadata (XC Schema) available for display

17

Drupal Toolkit: Staff Interface

Form to customize element display:This form determines how to display the creator element of a (FRBR) manifestation on the results screen.

Select a metadata schema: The Drupal Toolkit can handle multiple metadata formats, it is a platform for library metadata.

Select a FRBR level: XC metadata is FRBRized.

The “element template” box allows libraries to write simple PHP code and offers more flexibility.

All options are pre-filled with “good” defaults .

Menus take staff to other configuration options.

18

Drupal Toolkit: Staff Interface

Form to customize “More Like This”Solr is free open-source software that XC incorporates.

“More Like This” is a feature of Solr that displays related items.

This administrative web form makes configuration easy.

19

Drupal Toolkit: Custom Search/Browse Pages

• Create database-driven web applications to browse catalog content.

• Examples:– Search/Browse eJournals– Search/Browse databases by subject– Browse new titles– Search/Browse collections

• The following example shows a browsable list of videos and DVDs that could be created without any programming.

20


This example allows users to browse a subset of the catalog: the videos and DVDs collection

On this page, users can browse by language. Other tabs support browse by director and genre.

Limits can be set for format: VHS or DVD

21


Custom Search/Browse Page:On this page, users can do a keyword search, or browse the collection alphabetically.

22


Several web forms were used to construct this application.

Note the “Browse By Title” controls.

23


This is the form used to add the “Browse by Title” (A to Z list) to the user interface.

24


Again, several web forms were filled out to create this custom search/browse page.

25


The Drupal Toolkit provides this summary of the options that were selected.

26

Metadata storage features:- Multiple schemas- Support for MySQL and SOLR- Drupal hooks

Drupal Toolkit:Provided Modules

The Drupal Toolkit is actually a collection of Drupal add-on modules.

27

Drupal Toolkit:Provided Modules

XC Drupal Modules:- OAI-PMH Harvester- Metadata Import and export- NCIP Integration- Authentication- EZProxy- Syndetic Solutions- Search

eXtensible Catalog

Software PortfolioPart 3: Metadata Services Toolkit

30




MARCXMLDC



XC Drupal Toolkit


Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

Metadata Services Toolkit

XC



XC Drupal Toolkit

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

31

Metadata Services Toolkit

Features:

New type of staff client for processing large batches of metadata through an orchestrated set of services.

Harvest from multiple sources (silos) to address format and quality issues.

Aggregate and de-dupe metadata.

Automatic synchronization propagates changes in source metadata through services and on to discovery interface.

MARCXMLDC



XC Drupal Toolkit


Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit



XC Drupal Toolkit

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

XC

32

MST: Login and Setup

Library staff are able to use the username and password they are already familiar with. The MST includes both local and LDAP authentication options.

New users are greeted with clear, unobtrusive instructions on what to do first.

For most users, the first step is to add a “repository.” This feature allows staff to tell the MST about remote sources of metadata that they are interested in aggregating.

33

MST: Adding a RepositoryTelling the MST about a repository is easy. Assign a name of your choice and enter the URL.

After adding a repository, the MST will automatically do a “handshake” with it and provide “Success” or “Error” messages for each step in the handshake.

When successful, the MST reports on what formats and sets are available in the remote database.

The MST supports all XML schemas, but individual services are schema-specific.

In case of an error, the “View Log” button takes you to more information. Errors can occur when a remote server is not responding, or does not implement the protocol correctly.

34

MST: Harvesting

The next step is to schedule the harvesting of metadata from the remote repository.

Options- Set the schedule- Choose start and end dates- Select sets and formats

Features- Performance: millions of records per hour depending on hardware and network- Incremental updates: only changed records are sent on successive harvests- On screen status indicator

35

MST: Adding a Service

The next step is to install a metadata service.

A service is a separate program, written in Java, that is managed by the MST.

Services can be downloaded from the XC website or you can write your own by following the developer’s manual.

In order to use a service, you place the downloaded file in a directory by following the MST manual.

This screen can then be used to install the service in the MST.

36

MST: Services and Processing Rules

This example shows two services already installed in this Metadata Services Toolkit (MST): MARC Normalization and MARC-to-XC-Transformation.

Now we need to tell the MST which metadata records we want proccessed through which services, and in what order. This is called service orchestration.

We will now add a “Processing Rule”

37

MST Service Orchestration: Add Processing Rule

38

MST Service Orchestration: Add Processing Rule

39

MST: Browse Records

“Browse Records” is a feature of the MST that includes faceted browse and full-text search.

The MST has a local copy of all harvested metadata and all metadata produced by each installed service.

40

MST: Browse Records

Library staff use “Browse Records” to verify that services are functioning properly and to debug any issues.

41

MST: Browse Records

Navigation to full record display (MST handles display of any XML schema)

Whenever a record is processed by a service, the original record is preserved and one or more new records may be produced. These records are called successors.

Navigation links take you to predecessor and successor records. In this case, links connect MARC records to their normalized successor. In another case, links connect a normalized MARC record to its successor Work, Expression and Manifestation records.

42

MST: Browse Records

Each service can register error messages with the MST upon installation. In this example the MARC Normalization service has attached errors to specific records.

Errors are facets in the MST.

The “i” icon links to a customizable webpage with instructions for staff to address the error.

43

MST: View Full Record

Full Record Display: MARC Holding Record

Administrative metadata managed by the MST

Predecessor and successor links

XML viewer (supports any XML schema)

44

MST: Log Files

Log file management system with navigation.

This page shows MST system log files. Each installed service as well as harvest-in and harvest-out logs are available.

45

MST: XC Schema

XC Schema:

FRBRized- Work- Expression- Manifestation- Holdings- Item

RDA (Resource Description and Access)- First implementation of an RDA schema- MST offers a testbed for RDA and FRBR

Linked Data

MARCXMLDC



XC Drupal Toolkit


Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit



XC Drupal Toolkit

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

XCXC

46

MST: XC Schema

Features:

The XC Schema combines metadata fields from multiple standard schemas (RDA and DC) plus adds new XC schema elements.

MARCXMLDC



XC Drupal Toolkit


Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit



XC Drupal Toolkit

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

XCXC

<?xml version="1.0" encoding="UTF-8"?><xc:frbr xmlns:xc="http://www.extensiblecatalog.info/Elements" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:rdvocab="http://rdvocab.info/Elements" xmlns:dcterms="http://purl.org/dc/terms/" xmlns:rdarole="http://rdvocab.info/roles"><xc:entity type="manifestation" id="oai:mst.rochester.edu:MST/MARCToXCTransformation/10083"><xc:recordID type="LCCN">2004012234</xc:recordID><xc:identifier type="bnb">GBA466907</xc:identifier><xc:identifier type="Uk">012991839</xc:identifier><xc:identifier type="YBP">99809225526</xc:identifier><xc:recordID type="OCoLC">55518224</xc:recordID><xc:recordID type="NRU">2726457</xc:recordID><rdvocab:statementOfResponsibilityRelatingToTitle>Christopher Sawyer-Lauc<U+0327>anno.</rdvocab:statementOfResponsibilityRelatingToTitle><dcterms:title>E.E. Cummings : a biography /</dcterms:title><rdvocab:placeOfProduction>Naperville, Ill. :</rdvocab:placeOfProduction><dcterms:publisher>Sourcebooks,</dcterms:publisher><dcterms:issued>c2004.</dcterms:issued><dcterms:extent>xvi, 606 p., [32] p. of plates :</dcterms:extent><rdvocab:dimensions>24 cm.</rdvocab:dimensions><dcterms:description>Includes bibliographical references (p. [545]-588) and indexes.</dcterms:description><dcterms:tableOfContents>Their son -- In just- Spring -- Poet of simplicity -- A smattering of languages, a first taste of independence, and the truest friends -- The graduate student as poet -- Poetic excursions -- La Guerre -- Singing of Olaf and Elaine -- Poet, painter, and papa in New York -- The enormous room -- Abroad -- An American in Paris -- Tulips and chimneys -- Marriage and unmarriage -- The life and times of Edward Seul -- Anne -- Him -- Viva Cummings -- Worlds of was (and is) -- Carefully into growing and into being and into loving -- Nourish my failure with thy freedom -- Never the soft adventure of undoom -- Freedom as breakfastfood -- Allegiance only to the imagination -- We know who we are -- Xaipe and controversy -- Ordeals by audience -- When such marvels vanish -- Steering for dream.</dcterms:tableOfContents><dcterms:description>MAG Stacks copy signed by the author, Christopher Sawyer-Lauc<U+0327>anno.</dcterms:description><xc:expressionManifested>oai:mst.rochester.edu:MST/MARCToXCTransformation/10082</xc:expressionManifested></xc:entity></xc:frbr>

eXtensible Catalog

Software PortfolioPart 4: ILS Connectivity (OAI and NCIP Toolkits)

49

MARCXMLDC

XC Software Components




XC Drupal Toolkit




XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

XC OAI Toolkit

50

ILS Connectivity


MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC OAI Toolkit + XC NCIP Toolkit =

Connectivity between a range of ILSs and XC software

Standards based to enable other next-generation catalog products to work with many legacy ILSs

XC OAI Toolkit

51

OAI Toolkit


MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC NCIP Toolkit

DC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Overview:

Expose ILS metadata to XC’s next generation catalog interface and metadata tools.

Synchronize ongoing changes in ILS records with XC software automatically.

XC NCIP Toolkit

XC OAI Toolkit

Web services make ILS metadata available to the XC search interface and to other web applications.

MARC metadata

metadata

52

OAI Toolkit: Compatibility


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Compatibility:

The XC OAI Toolkit works with virtually any ILS that includes MARC export capabilities.

XC NCIP ToolkitILS Export

Script-writers Manual

ILS system administrators can program the OAI Toolkit with a familiar scripting language.

No Java programming is required to make the OAI Toolkit work witha particular ILS.

Voyager ILS Aleph ILS NTT ILS

III ILS III/Oracle ...

XC OAI Toolkit

53

OAI Toolkit: Cleanup


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Cleanup:

The XC OAI Toolkit includes tools to address data issues.

XC NCIP Toolkit

XC OAI Toolkit

Built-in XSLT processor includes scripts for common data issues, or library staff can write their own.

XSLT Processor(includes script library)

MARCXML Schema(modifiable)

Library staff can even modify a local copy of the MARCXML.xsd file, if necessary.

XC OAI Toolkit

54

OAI Toolkit: Transformations


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Metadata Transformations:

The XC OAI Toolkit converts batches of metadata into other formats.

XC NCIP Toolkit

Output FormatsMARCXML

Dublin CoreMODSHTML

Input FormatsMARC

MARCXML

XC OAI Toolkit

XC OAI Toolkit

55

OAI Toolkit: Multiple ILS


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Multiple ILS Environments:

One OAI Toolkit can be loaded with metadata from multiple Integrated Library Systems.

XC NCIP Toolkit

XC OAI Toolkit

Voyager ILS

Aleph ILS

Note: Each metadata record must include an ILS-specific identifier. The XC OAI Toolkit includes an option to add the identifier if necessary.

XC OAI Toolkit

Script A

Script B

Records from multiple ILSs are now harvestable from one repository.

56

OAI Toolkit: Interfaces


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Interfaces

XC NCIP Toolkit

• Interfaces are used by people or by other applications to interact with the OAI Toolkit

• The OAI Toolkit includes 3 interfaces:– Command Line Interface– Web Interface– OAI-PMH Provider Interface

XC OAI Toolkit

57

OAI Toolkit: Command Line Interface


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Command Line Interface

XC NCIP Toolkit

Convert and Load

Convert, Modify and Load

Sample Scripts

Included sample scripts are set with the most commonly used options to get you started.

Convert

Modify

Load

Each of the commands offer an array of complex and powerful options.

XC OAI Toolkit

58

http://localhost/OAIToolkit

OAI Toolkit: Web Interface


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Web Interface

XC NCIP Toolkit

• Configure XC OAI Toolkit with a web admin interface

– OAI-PMH Identify response– Performance settings– Default MARCXML schema– Select storage: mySQL or

Lucene• View user manual• Send test OAI-PMH requests with

a single clickXC OAI Toolkit

59

OAI Toolkit: OAI-PMH Interface


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

OAI-PMH Provider Interface

XC NCIP Toolkit

• Users do not need to understand the OAI-PMH protocol to use XC.

• OAI-PMH allows other XC applications, such as the XC Metadata Services Toolkit to synchronize metadata with the ILS.

• Since OAI-PMH is a web-based protocol, you can try it out with any web browser. XC OAI

Toolkit

MARCXML

60


XC NCIP Toolkit

NCIP Toolkit

XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Overview

Enable XC’s next generation catalog interface access to ILS authentication, circulation and patron services.

XC OAI Toolkit

Circ

. Sta

tus/

Req.

Auth

entic

ation

XC OAI Toolkit

XC or other discovery software sends requests in real time while the user is interacting with the search interface.

live request

XC NCIP Toolkit

ILS-specific driverlive request

Example Requests

- Circulation status lookup- Renew an item- Lookup patron information

XC OAI Toolkit

MARCXML

61

NCIP Toolkit: Compatibility


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Compatibility:

The XC NCIP Toolkit works with many Integrated Library Systems.

XC OAI ToolkitXC OAI Toolkit

NCIP Developer

Manual

Build your own Java driver to allow the NCIP Toolkit to support an additional ILS.

The NCIP Toolkit allows developers to focus on interfacing with their ILS rather than learning the details of the NCIP protocol.

Circ

. Sta

tus/

Req.

Auth

entic

ation

Voyager ILS Aleph ILS NTT ILS

III ILS III/Oracle ...

62

NCIP Toolkit: Authentication


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Enables Authentication:

XC software includes features to manage user login credentials.

Users will not need to learn a new username and password to access any feature.


Circ

. Sta

tus/

Req.

Auth

entic

ation

63

NCIP Toolkit: Authentication


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Enables Authentication:

Support for complex IT environments.


Circ

. Sta

tus/

Req.

Auth

entic

ation

ILSLocal

authentication

Scenario 1: ILS configured for built-in authentication

XC NCIP Toolkit

LDAP Server

ILSExternal

authentication

Scenario 2: ILS configured for external authentication

XC NCIP Toolkit

64

NCIP Toolkit: Circulation


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Enables Circulation Services:

XC displays live circulation status at the item level for materials in the ILS.

XC users can place requests (such as holds and recalls) without leaving the XC user interface.


Circ

. Sta

tus/

Req.

Auth

entic

ation

Lookup live circulation status and location:

XC NCIP Toolkit ILS

1) Send request to lookup circulation status with a Bibliographic, Holding or Item ID(s)

2) Return circulation status and location

65

NCIP Toolkit: Patron Services


XC NCIP Toolkit

MARCXMLDC


Repository

XC Drupal Toolkit


XC

Circ

. Sta

tus/

Req.

Auth

entic

ation

Enables Patron Services:

The XC “my account” page shows a list of checked out items with options to renew.

XC offers a platform for combined “my account” page that pulls information from multiple ILSs and/or the interlibrary loan system.


Circ

. Sta

tus/

Req.

Auth

entic

ation

EXtensible Catalog Software Portfolio Part 1: Overview.

Documents

Transcript of EXtensible Catalog Software Portfolio Part 1: Overview.