GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO...

18
www.vlaanderen.be/informatievlaanderen Mathias De Schrijver Dirk De Baere Geraldine Nolf GeoDCAT-AP in Flanders ISA² webinar: GeoDCAT-AP July 16 th , 2019

Transcript of GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO...

Page 1: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

www.vlaanderen.be/informatievlaanderen

Mathias De SchrijverDirk De BaereGeraldine Nolf

GeoDCAT-AP in Flanders

ISA² webinar: GeoDCAT-APJuly 16th, 2019

Page 2: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

2

LOTS OF METADATA STANDARDS, PORTALS AND SYSTEMS

GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 3: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

3

BRINGING MISS WORLD AND MISTER CUBE TOGETHER AND OPEN UP DATA

GeoDCAT-AP webinar ISA² – July 16th, 2019

Copyright Miss Globe & Mr Cube: Frans Knibbe, Geodan

Page 4: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

4

Geospatial dataISO/INSPIRE

SDI-Flanders Best Practices

Profile: Geo MD ISO “19XXX”

Export:

ISO “19XXX” XML

Geopunt(Sitecore & MapApps)

Open data

DCAT-AP

Profile: Open MD “DCAT-AP XML”

Export:

DCAT-AP RDF

Vlaams Open data Portaal (CKAN)

Metadata standard

Metadata

management system

Metadata portal

Export: GeoDCAT-AP

BRIDGING THE GAP USING GEONETWORK

GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 5: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

5

Geospatial dataISO/INSPIRE

SDI-Flanders Best Practices

Profile: Geo MD ISO “19XXX”

Export:

ISO “19XXX” XML

Geopunt(Sitecore & MapApps)

Open data

DCAT-AP

Profile: Open MD “DCAT-AP XML”

Export:

DCAT-AP RDF

Vlaams Open data Portaal (CKAN)

Metadata standard

Metadata

management system

Metadata portal

Export: GeoDCAT-AP

BRIDGING THE GAP USING GEONETWORK

GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 6: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

6

Geospatial dataISO/INSPIRE

SDI-Flanders Best Practices

Profile: Geo MD ISO “19XXX”

Export:

ISO “19XXX” XML

Geopunt(Sitecore & MapApps)

Open data

DCAT-AP

Profile: Open MD “DCAT-AP XML”

Export:

DCAT-AP RDF

Vlaams Open data Portaal (CKAN)

Metadata standard

Metadata

management system

Metadata portal

Export: GeoDCAT-AP

BRIDGING THE GAP USING GEONETWORK

DCAT-AP plug-in to be

build

Upgrade to GeoNetwork 3.4 or higher

GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 7: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> GeoNetwork can only process XML-based metadata

▪ So, an XML Schema plug-in must be defined

> Based on DCAT-AP v1.1

> Developed by GIM, funded by Informatie Vlaanderen

> Beta environment:http://beta.metadata.vlaanderen.be/

> Available as open-source software (GPLv2 license):https://github.com/metadata101/dcat-ap1.1

XML SCHEMA PLUG-IN FOR DCAT-AP

7GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 8: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> XML Schema: The plug-in defines its own XML Schema. The XML Schema was designed to fully resemble an XML/RDF syntax of DCAT-AP.

> Harvester: A DCAT-AP harvester was written to "normalize" the RDF metadata, such that it fits in the XML Schema for DCAT-AP.

> Editor: A custom form was created that uses the controlled vocabularies required by DCAT-AP.

> Adding licenses: Sample licenses templates can be imported via the custom form for editing.

> Multilingual: The editor, view, and search benefit from the already existing multilingual capabilities of GeoNetwork.

> Validator: Validation steps are XSD validation followed by the schematronvalidation.

> RDF endpoint: The plug-in exports DCAT-AP RDF metadata using the GeoNetwork API, which can in turn be harvested by e.g. CKAN.

DCAT-AP PLUG-IN FEATURES

8GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 9: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

DCAT-AP HARVESTER

➢ XML is a nested data structure that can be queried with Xpath➢ RDF is a graph-based data structure in different formats and

arbitrarily structured that can be queried with SPARQL

➢ On import, DCAT-RDF metadata must be “normalised”

9GeoDCAT-AP webinar ISA² – July 16th, 2019

DCAT-XML

DCAT-RDF

XSLT (trivial)

SPARQL SELECT +XSLT

harvesting

SPARQL CONSTRUCT XSLT

DCAT-AP records

normalisedDCAT-XML

Page 10: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> Input: Turtle, RDF/XML, N3, JSON-LD

DCAT-AP HARVESTER

10GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 11: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> Simple and advanced form for editing DCAT-AP records

> Multilingual

> Controlled vocabulariesrequired by DCAT-AP as thesauri

> Reuse (with modification) of existing controls (e.g. spatial extent)

DCAT-AP EDITOR

11GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 12: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> DCAT-AP constraints have been transformed into threeschematron rulesets:

▪ DCAT-AP v1.1 mandatory rules

▪ DCAT-AP v1.1 recommendations

▪ DCAT-AP-VL (additional) mandatory rules for publishingopen data

DCAT-AP VALIDATOR

12GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 13: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> Exports DCAT-AP RDF using standard GeoNetwork API

> Supports W3C LDP paging and hydra paging

> Output: RDF/XML

DCAT-AP RDF ENDPOINT

13GeoDCAT-AP webinar ISA² – July 16th, 2019

DCAT-XML

DCAT-RDF

XSLT (trivial)

SPARQL SELECT +XSLT

via RDF endpoint

SPARQL CONSTRUCT XSLT

DCAT-AP records

normalisedDCAT-XML

Page 14: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

> Usability of validator (link with fields)

> Harvester with paging support

> RDF endpoint: multiple formats

> Schema.org integration (JSON.LD on HTML pages)

ROOM FOR IMPROVEMENT

14GeoDCAT-AP webinar ISA² – July 16th, 2019

Page 15: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

TOWARDS ONE CATALOGUE

GeoDCAT-AP webinar ISA² – July 16th, 2019 15

Page 16: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

INFORMATION CATALOGUE (1)

GeoDCAT-AP webinar ISA² – July 16th, 2019 16

Geograficdata &

services

ISO/INSPIRE

GeoNetwork

Geopunt

Data/Services

Open data

DCAT-AP

CKAN/TDT GeoNetwork

Vlaams Open data Portaal

Data

Data concerning

naturalpersons &

enterprises

(to be –DCAT-AP ?)

(to be –GeoNetwork ?)

MAGDA-online

Data/Services

API’s

(to be –DCAT-AP?)

(to be – Apigee / GeoNetwork?)

(to be)

ServicesAPI’s

Statisticdata &

services

SDMX / StatDCAT ?

(to be –GeoNetwork ?)

(to be)

Statistics/Services

ArchivalInformation

EAD

(to be –GeoNetwork ?)

(to be)

Documents

Metadata Standard

Sco

pe

1

Scope Information Catalogue

Metadata Management System

Publication via Portal / Catalogue

Data / Information

Page 17: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

Information Catalogue

Page 18: GeoDCAT-AP in Flanders - Joinup · 2019-07-16 · SDI-Flanders Best Practices Profile: Geo MD ISO “19XXX” Export: ISO “19XXX” XML Geopunt (Sitecore & MapApps) Open data DCAT-AP

www.vlaanderen.be/informatievlaanderen

Thank you for yourattention!

Contact?

[email protected]@[email protected]