NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5...

12
NIST Common Access Platform WO CHANG, NIST, NOVEMBER 3, 2014

Transcript of NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5...

Page 1: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

NIST Common Access Platform WO CHANG, NIST, NOVEMBER 3, 2014

Page 2: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Conceptual Model: Problem Space

NIST Public Servers

Other Fed Agency

Repositories

Publications Community Repositories

Cloud

NIST Internal Servers

Other NIST

Storage

Software

Production

Tools

Test, Development, …

Data

Reference

Resource

Research

Publications

Peer Reviewed

Gray Literature

White Papers, Talk Slides, …

2

Page 3: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Logical Model (PIDs)

Data. Extended

Pub.Extended Extended Metadata

HDL: 11429/PDO###,

ExtMetadata

Specialized Metadata

Minimum Metadata

Primary Digital Objects

HDL: 11429/PDO###, SpecialMetadata

HDL: 11429/PDO###,

Metadata

HDL: 11429/PDO###

Software. Extended

Software. Metadata

Software. SpecialMeta

Pub. SpecialMeta

Pub. Metadata

Pub

Software

Data

Data. Metadata

Data. SpecialMeta

3

Page 4: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Specialized Knowledge

Shared Understanding

Core Metadata

Domain Metadata

Relationship Metadata

Data Consumer

(1) Discover (2) Map

(3) Access

Type Registry Service

Metadata Registry Service

Types

Properties

Other Fed. MR

Data Service

Data Service

Data Service

Harvest Harvest Harvest

NIST Fed. MR

Data Service

Data Service

Data Service

Fedora DSpace CKAN

CAP Testbed

NIST CAP Conceptual Architectural Diagram Fed. MR – Federated Metadata Registry

- Supplier - Enricher

- Aggregator - Developer

PID

Infr

astr

uct

ure

4

Page 5: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Persistent Identifiers (e.g. Handle System) 5

11429/12345.C4F

1 PK publickey

2 IP rights data

3 Publisher NIST

4 GUID a8-0c-22-7f-c1-00

5 URL http://pubmed.nih..

6 HDL 11429/789

… … …

In this example the Handle System maps a persistent

identifier to a set of metadata.

hdl:11429/12345.C4F protocol prefix identifier

http://hdl.handle.net/11429/12345.C4F

via PKI optionally

PID Client PID Resolver

Page 6: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Metadata Registry – Example

Content owner adds content to a repository.

XXXX XXXX XXXX

Content

Metadata for that content is generated in the Repository and pushed, via a Registration Service, into Metadata Registry, creating a digital object.

The Metadata Registry provides Information Management and Discovery Services for users.

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

XXXX XXXX XXXX

Content

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

------- ------- -------

Metadata

Information Management Service

Discovery Service

Repository

Metadata Registry

Registration Service

6

Page 7: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

Data Type Registry – Example 7

Users

Typed Data

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

ID

Type

Payload

Federated Set of Type Registries

Visualization

I Agree

Terms:…

Rights

Services

Data Processing

10100 11010 101….

Data Set Dissemination

Client (process or people) encounter data of an unknown type 1

Resolved the Type to Type Registry 2

Response includes type definitions, relationships, properties, and possibly service pointers. Response can be used locally for processing, or, optionally

3

Typed data or reference to typed data can be sent to service provider 4

1

2

3

4

4

Page 8: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

CAP Workflow – Example

#1 #2 #3 #4

Datasets

. . .

Type Registry

Access

Consumer

Handle System

Register Search

Return

PID for Dataset #4

Dataset #4 Definition

Col-1: Temp Col-2: Voltage Col-3: - - - Col-n: Current

Service Provider

Service

Return Type

Access

Metadata Registry

1 2a

2b

3a

3b

3d

3e 3c Type Lookup

-Data -Metadata -Etc…

-Data -Metadata -Etc…

-Data -Metadata -Etc…

-Data -Metadata -Etc…

Manually/ Import JSON

8

Page 9: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

CAP Collaborators

Interagency Technical Advisory Group (iTAG) To provide a forum for Federal agency and entity coordination on operational requirements and insights on how to maximize access to scientific and technical data. Members of the iTAG are Federal employees participating in their individual capacity as subject matter experts and providing their own perspectives from a range of agency and entity settings including:

NIST (Chair) Census DOE NARA Smithsonian Treasury Engage with

9

Data Type Registry WG

PID Information Type WG

Page 10: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

CAP Reference Architecture Development

Requirements

Ref. Architecture

Implementation (Proof of Concept)

I

T

A

G

Use Cases

Examples A

D

O

P

T

E

R

Prototype

Feedback

Provide VM (pre-configured)/instructions to configure CAP instance: Interface: CAP API, tools, utilities, etc. System: Handle system, DO libraries, etc.

Adopter: Customize CAP instance with operational needs: Forms, applications, PID naming, integration with: Existing environment (PIV, user profile, etc.) Datasets: schemas, type definitions, etc. Tools: curation, analytics, visualization, etc. Others…

10

Page 11: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

CAP Development Stack

CAP API for Metadata/DataType Registries

Ex.: http://capserver:8080/CAP/app?<cmd=>

CAP Server: process with doGet and doPost

CNRI Libraries (DO, Repo, Metadata Reg, Type Reg, etc.)

PID Fabric (Handle Resolver)

Web-based Form Adapter Application

Client: Issue GET and POST

CAP Package

11

Page 12: NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5 11429/12345.C4F 1 PK publickey 2 IP rights data 3 Publisher NIST 4 GUID a8-0c-22-7f-c1-00

QUESTIONS? CONTACT: [email protected]

12