NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5...
Transcript of NIST Common Access Platform - NITRD€¦ · Persistent Identifiers (e.g. Handle System) 5...
NIST Common Access Platform WO CHANG, NIST, NOVEMBER 3, 2014
Conceptual Model: Problem Space
NIST Public Servers
Other Fed Agency
Repositories
Publications Community Repositories
Cloud
NIST Internal Servers
Other NIST
Storage
Software
Production
Tools
Test, Development, …
Data
Reference
Resource
Research
Publications
Peer Reviewed
Gray Literature
White Papers, Talk Slides, …
2
Logical Model (PIDs)
Data. Extended
Pub.Extended Extended Metadata
HDL: 11429/PDO###,
ExtMetadata
Specialized Metadata
Minimum Metadata
Primary Digital Objects
HDL: 11429/PDO###, SpecialMetadata
HDL: 11429/PDO###,
Metadata
HDL: 11429/PDO###
Software. Extended
Software. Metadata
Software. SpecialMeta
Pub. SpecialMeta
Pub. Metadata
Pub
Software
Data
Data. Metadata
Data. SpecialMeta
3
Specialized Knowledge
Shared Understanding
Core Metadata
Domain Metadata
Relationship Metadata
Data Consumer
(1) Discover (2) Map
(3) Access
Type Registry Service
Metadata Registry Service
Types
Properties
Other Fed. MR
Data Service
Data Service
Data Service
Harvest Harvest Harvest
NIST Fed. MR
Data Service
Data Service
Data Service
Fedora DSpace CKAN
CAP Testbed
NIST CAP Conceptual Architectural Diagram Fed. MR – Federated Metadata Registry
- Supplier - Enricher
- Aggregator - Developer
PID
Infr
astr
uct
ure
4
Persistent Identifiers (e.g. Handle System) 5
11429/12345.C4F
1 PK publickey
2 IP rights data
3 Publisher NIST
4 GUID a8-0c-22-7f-c1-00
5 URL http://pubmed.nih..
6 HDL 11429/789
… … …
In this example the Handle System maps a persistent
identifier to a set of metadata.
hdl:11429/12345.C4F protocol prefix identifier
http://hdl.handle.net/11429/12345.C4F
via PKI optionally
PID Client PID Resolver
Metadata Registry – Example
Content owner adds content to a repository.
XXXX XXXX XXXX
Content
Metadata for that content is generated in the Repository and pushed, via a Registration Service, into Metadata Registry, creating a digital object.
The Metadata Registry provides Information Management and Discovery Services for users.
XXXX XXXX XXXX
Content
XXXX XXXX XXXX
Content
XXXX XXXX XXXX
Content
XXXX XXXX XXXX
Content
------- ------- -------
Metadata
------- ------- -------
Metadata
------- ------- -------
Metadata
------- ------- -------
Metadata
------- ------- -------
Metadata
Information Management Service
Discovery Service
Repository
Metadata Registry
Registration Service
6
Data Type Registry – Example 7
Users
Typed Data
ID
Type
Payload
ID
Type
Payload
ID
Type
Payload
ID
Type
Payload
ID
Type
Payload
ID
Type
Payload
Federated Set of Type Registries
Visualization
I Agree
Terms:…
Rights
Services
Data Processing
10100 11010 101….
Data Set Dissemination
Client (process or people) encounter data of an unknown type 1
Resolved the Type to Type Registry 2
Response includes type definitions, relationships, properties, and possibly service pointers. Response can be used locally for processing, or, optionally
3
Typed data or reference to typed data can be sent to service provider 4
1
2
3
4
4
CAP Workflow – Example
#1 #2 #3 #4
Datasets
. . .
Type Registry
Access
Consumer
Handle System
Register Search
Return
PID for Dataset #4
Dataset #4 Definition
Col-1: Temp Col-2: Voltage Col-3: - - - Col-n: Current
Service Provider
Service
Return Type
Access
Metadata Registry
1 2a
2b
3a
3b
3d
3e 3c Type Lookup
-Data -Metadata -Etc…
-Data -Metadata -Etc…
-Data -Metadata -Etc…
-Data -Metadata -Etc…
Manually/ Import JSON
8
CAP Collaborators
Interagency Technical Advisory Group (iTAG) To provide a forum for Federal agency and entity coordination on operational requirements and insights on how to maximize access to scientific and technical data. Members of the iTAG are Federal employees participating in their individual capacity as subject matter experts and providing their own perspectives from a range of agency and entity settings including:
NIST (Chair) Census DOE NARA Smithsonian Treasury Engage with
9
Data Type Registry WG
PID Information Type WG
CAP Reference Architecture Development
Requirements
Ref. Architecture
Implementation (Proof of Concept)
I
T
A
G
Use Cases
Examples A
D
O
P
T
E
R
Prototype
Feedback
Provide VM (pre-configured)/instructions to configure CAP instance: Interface: CAP API, tools, utilities, etc. System: Handle system, DO libraries, etc.
Adopter: Customize CAP instance with operational needs: Forms, applications, PID naming, integration with: Existing environment (PIV, user profile, etc.) Datasets: schemas, type definitions, etc. Tools: curation, analytics, visualization, etc. Others…
10
CAP Development Stack
CAP API for Metadata/DataType Registries
Ex.: http://capserver:8080/CAP/app?<cmd=>
CAP Server: process with doGet and doPost
CNRI Libraries (DO, Repo, Metadata Reg, Type Reg, etc.)
PID Fabric (Handle Resolver)
Web-based Form Adapter Application
Client: Issue GET and POST
CAP Package
11
QUESTIONS? CONTACT: [email protected]
12