NIF Data Ingest

Post on 08-Jul-2015

736 views 0 download

Transcript of NIF Data Ingest

NIF-DISCO

• Overview

• Information Workflow

• Databases

• Template scripting language

DISCO - Overview

Customized Internet based ETL+ system that

• Extracts and populates data into a RDB system

• Data workflow management

• Integrated CVS system

• Allows ontological annotations

• Extensible

Documentation: http://disco.neuinfo.org/docs/manual

DISCO – Information workflow

DISCO – Information workflow

DISCO - Databases

• DISCO

• DISCO_CRAWLER

• DISCO_CRAWLER_CVS

DISCO – Scripting Language

• XML formatted templates for different purposes

• Manifest “disco.xml” file that points to DISCO services

– Interoperability templates: Interop, news, linkout

– Other files in different formats: RDF, etc.

• Tools to assist creating scripts:

– DISCO dashboard: http://disco.neuinfo.org

– XML Schemas: http://disco.neuinfo.org/schemas

– Developer dashboardhttp://disco.neuinfo.org/webportal/dataResourceInfoDashboard.do