NIF Data Ingest

6

Click here to load reader

Transcript of NIF Data Ingest

Page 1: NIF Data Ingest

NIF-DISCO

• Overview

• Information Workflow

• Databases

• Template scripting language

Page 2: NIF Data Ingest

DISCO - Overview

Customized Internet based ETL+ system that

• Extracts and populates data into a RDB system

• Data workflow management

• Integrated CVS system

• Allows ontological annotations

• Extensible

Documentation: http://disco.neuinfo.org/docs/manual

Page 3: NIF Data Ingest

DISCO – Information workflow

Page 4: NIF Data Ingest

DISCO – Information workflow

Page 5: NIF Data Ingest

DISCO - Databases

• DISCO

• DISCO_CRAWLER

• DISCO_CRAWLER_CVS

Page 6: NIF Data Ingest

DISCO – Scripting Language

• XML formatted templates for different purposes

• Manifest “disco.xml” file that points to DISCO services

– Interoperability templates: Interop, news, linkout

– Other files in different formats: RDF, etc.

• Tools to assist creating scripts:

– DISCO dashboard: http://disco.neuinfo.org

– XML Schemas: http://disco.neuinfo.org/schemas

– Developer dashboardhttp://disco.neuinfo.org/webportal/dataResourceInfoDashboard.do