NIST Common Access Platform WO CHANG, NIST, NOVEMBER 3, 2014

Conceptual Model: Problem Space

NIST Public Servers

Other Fed Agency

Repositories

Publications Community Repositories

Cloud

NIST Internal Servers

Other NIST

Storage

Software

Production

Tools

Test, Development, …

Data

Reference

Resource

Research

Publications

Peer Reviewed

Gray Literature

White Papers, Talk Slides, …

2

Logical Model (PIDs)

Data. Extended

Pub.Extended Extended Metadata

HDL: 11429/PDO###,

ExtMetadata

Specialized Metadata

Minimum Metadata

Primary Digital Objects

HDL: 11429/PDO###, SpecialMetadata

HDL: 11429/PDO###,

Metadata

HDL: 11429/PDO###

Software. Extended

Software. Metadata

Software. SpecialMeta

Pub. SpecialMeta

Pub. Metadata

Pub

Software

Data

Data. Metadata

Data. SpecialMeta

3

Specialized Knowledge

Shared Understanding

Core Metadata

Domain Metadata

Relationship Metadata

Data Consumer

(1) Discover (2) Map

(3) Access

Type Registry Service

Metadata Registry Service

Types

Properties

Other Fed. MR

Data Service

Data Service

Data Service

Harvest Harvest Harvest

NIST Fed. MR

Data Service

Data Service

Data Service

Fedora DSpace CKAN

CAP Testbed

NIST CAP Conceptual Architectural Diagram Fed. MR – Federated Metadata Registry

- Supplier - Enricher

- Aggregator - Developer

PID

Infr

astr

uct

ure

4

Persistent Identifiers (e.g. Handle System) 5

11429/12345.C4F

1 PK publickey

2 IP rights data

3 Publisher NIST

4 GUID a8-0c-22-7f-c1-00

5 URL http://pubmed.nih..

6 HDL 11429/789

… … …

In this example the Handle System maps a persistent

identifier to a set of metadata.

hdl:11429/12345.C4F protocol prefix identifier

http://hdl.handle.net/11429/12345.C4F

via PKI optionally

PID Client PID Resolver

Metadata Registry – Example

Content owner adds content to a repository.

XXXX XXXX XXXX

Content

Metadata for that content is generated in the Repository and pushed, via a Registration Service, into Metadata Registry, creating a digital object.

The Metadata Registry provides Information Management and Discovery Services for users.

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

Information Management Service

Discovery Service

Repository

Metadata Registry

Registration Service

6

Data Type Registry – Example 7

Users

Typed Data

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

Federated Set of Type Registries

Visualization

I Agree

Terms:…

Rights

Services

Data Processing

10100 11010 101….

Data Set Dissemination

Client (process or people) encounter data of an unknown type 1

Resolved the Type to Type Registry 2

Response includes type definitions, relationships, properties, and possibly service pointers. Response can be used locally for processing, or, optionally

3

Typed data or reference to typed data can be sent to service provider 4

1

2

3

4

4

CAP Workflow – Example

#1 #2 #3 #4

Datasets

. . .

Type Registry

Access

Consumer

Handle System

Register Search

Return

PID for Dataset #4

Dataset #4 Definition

Col-1: Temp Col-2: Voltage Col-3: - - - Col-n: Current

Service Provider

Service

Return Type

Access

Metadata Registry

1 2a

2b

3a

3b

3d

3e 3c Type Lookup

-Data -Metadata -Etc…

-Data -Metadata -Etc…

-Data -Metadata -Etc…

-Data -Metadata -Etc…

Manually/ Import JSON

8

CAP Collaborators

Interagency Technical Advisory Group (iTAG) To provide a forum for Federal agency and entity coordination on operational requirements and insights on how to maximize access to scientific and technical data. Members of the iTAG are Federal employees participating in their individual capacity as subject matter experts and providing their own perspectives from a range of agency and entity settings including:

NIST (Chair) Census DOE NARA Smithsonian Treasury Engage with

9

Data Type Registry WG

PID Information Type WG

CAP Reference Architecture Development

Requirements

Ref. Architecture

Implementation (Proof of Concept)

I

T

A

G

Use Cases

Examples A

D

O

P

T

E

R

Prototype

Feedback

Provide VM (pre-configured)/instructions to configure CAP instance: Interface: CAP API, tools, utilities, etc. System: Handle system, DO libraries, etc.

Adopter: Customize CAP instance with operational needs: Forms, applications, PID naming, integration with: Existing environment (PIV, user profile, etc.) Datasets: schemas, type definitions, etc. Tools: curation, analytics, visualization, etc. Others…

10

CAP Development Stack

CAP API for Metadata/DataType Registries

Ex.: http://capserver:8080/CAP/app?<cmd=>

CAP Server: process with doGet and doPost

CNRI Libraries (DO, Repo, Metadata Reg, Type Reg, etc.)

PID Fabric (Handle Resolver)

Web-based Form Adapter Application

Client: Issue GET and POST

CAP Package

11

QUESTIONS? CONTACT: WCHANG@NIST.GOV

12