ELF download services - INSPIREinspire.gov.sk/Upload/documents/20160216_SK_BA_ELF_WS/06...2016/02/16...

the Competitiveness and Innovation framework Programme (CIP) ICT Policy Support Programme (PSP) Call 6 (Grant 325140) EUROPEAN LOCATION FRAMEWORK

Presentation to:

Author:

Date:

ELF workshop in Bratislava

Marcin Grudzień

16th February 2016

10 May, 2016

ELF download services


Plan

Introduction

ELF data model

Specification documents

The envisaged production process


Introduction


Main principles

ELF Download services provide data published in ELF data model

Themes: AD, AU, BU, CP, EL, GN, HY, LC, PS, SR, SU, TN

For some themes like CP the ELF and INSPIRE data models are identical

Download services published in INSPIRE data model are also acceptable during transitional period

ELF data model extends INSPIRE data model

Data created in ELF data model is conformant to NSPIRE data model

Implementation of ELF data model = implementation of INSPIRE data model

However, implementation of INSPIRE data model <> implementation of ELF data model

Geographic extend : geographic Europe

Main ELF use cases

Cascade services

Oscari

WP6 use cases

CRS: pseudo Mercator (EPSG:3857) and Lambert Azimuthal Equal-Area (LAEA) (EPSG:3035)


ELF data model


Why extending INSPIRE?

ELF delivers authoritative, interoperable, cross-border reference data

Seamless and consistent across borders enabling spatial analysis in a global, European and regional cross-border context;

Consistent between themes, so that different themes can be used together;

Consistent between resolutions, so that a feature present on national level is present at European regional and global level if it should be present according to selection criteria;

Up-to-date, maintained and quality ensured enabling users to meet their requirements.


General requirements Provide ELF specifications built on INSPIRE specifications

Adhere to INSPIRE Generic Conceptual Model

Migration of existing EG products into INSPIRE framework

Re-use of INSPIRE concepts as much as possible

Long term data maintenance of the pan-European products maintained under the umbrella of the EuroGeographics

Generalisation vision: to derive ELF Regional/Global from Master LoD

Extension of INSPIRE in identified areas

Without loosing INSPIRE conformance


Analysis of INSPIRE concepts:

themes, application schema, feature types, data types, attributes, code lists

Modelling approach

Start

Matching tables

INSPIRE Specifications Annexes I - III

National data models

User requirements

(EuroStat contract)

EG products specifications

ELF WP7 requirements

ESDIN specifications

ELF data specifications

Aggregation


ELF Modelling guidelines (1)

To achieve INSPIRE compliancy in data modelling the following principles should be followed

Extensions shall not

Change the specification but normatively reference it with all its requirements

Set any additional requirements that break any requirement of the INSPIRE data specification

Add concepts that overlap with existing INSPIRE concepts.

Make a pure INSPIRE implementation non-conformant to the ELF specifications.

Extensions may

Add new application schemas importing INSPIRE or other schemas as needed

Add new types and constraints in the new application schemas

Extend INSPIRE code lists if not centrally managed


ELF Modelling guidelines (2)

ELF modelling guidelines document can be downloaded form https://service.projectplace.com/pp/pp.cgi/0/840402665

Document gives a short introduction to modelling of application schemas for the ELF specifications


Generalisation

class Addresses ov erv iew

«featureType»

Addresses::Address

+ inspireId :Identifier

+ position :GeographicPosition [1..*]

+ locator :AddressLocator [1..*] {ordered}

«voidable»

+ alternativeIdentifier :CharacterString [0..1]

+ status :StatusValue [0..1]

+ validFrom :DateTime

+ validTo :DateTime [0..1]

«voidable, l ifeCycleInfo»

+ beginLifespanVersion :DateTime

+ endLifespanVersion :DateTime [0..1]

«featureType»

Address

+parentAddress

«voidable» 0..1


Additional attributes

class Geographical Names ov erv iew

«featureType»

NamedPlace

«voidable»

+ populationNumber :PopulationRange [0..1]

constraints

{geometryIsPointOrSurface}

{nameDataType}

{populationNumberPopulatedPlace}

«dataType»

PopulationRange

«voidable»

+ population :Integer [0..1]

+ lower :Integer [0..1]

+ upper :Integer [0..1]

constraints

{GEO05}

{GEO06}

{GEO07}

{GEO08}

{GEO09}

{GEO10}

«featureType»

NamedPlace

+ geometry :GM_Object


+ name :GeographicalName [1..*]




«voidable»

+ leastDetailedViewingResolution :MD_Resolution [0..1]

+ localType :LocalisedCharacterString [1..*]

+ mostDetailedViewingResolution :MD_Resolution [0..1]

+ relatedSpatialObject :Identifier [0..*]

+ type :NamedPlaceTypeValue [1..*]

(from ELF Model::INSPIRE Consolidated UML Model::Themes::

Annex I::Geographical Names::Geographical Names)


New data types class Geographical Names ov erv iew

«featureType»

NamedPlace

«voidable»


constraints


{nameDataType}


«dataType»

PopulationRange

«voidable»

+ population :Integer [0..1]

+ lower :Integer [0..1]

+ upper :Integer [0..1]

constraints

{GEO05}

{GEO06}

{GEO07}

{GEO08}

{GEO09}

{GEO10}

«featureType»

NamedPlace







«voidable»









New constraints class Protected Sites ov erv iew

«featureType»

Protected Sites Simple::ProtectedSite


+ inspireID :Identifier

«voidable»

+ legalFoundationDate :DateTime

+ legalFoundationDocument :CI_Citation

+ siteDesignation :DesignationType [1..*]

+ siteName :GeographicalName [0..*]

+ siteProtectionClassification :ProtectionClassificationValue [1..*]

«featureType»

ProtectedSite

constraints

{geometry is GM_Surface}

class Geographical Names ov erv iew

«featureType»

NamedPlace

«voidable»


constraints


{nameDataType}


«featureType»

NamedPlace







«voidable»








6 listopada 2014


New constraints of associations class Administrativ e Units ov erv iew

«featureType»

Administrativ eUnits::

Administrativ eUnit

«featureType»

Condominium

::Condominium

+ geometry :GM_MultiSurface



::Condominium



«voidable»

::Condominium


constraints

{association:adminUnit not voidable}

«featureType»


Condominium

+condominium

«voidable»

0..*

+admUnit

«voidable»

1..*

+/administeredBy

«voidable» 0..*

+coAdminister

«voidable» 0..*

+lowerLevelUnit

«voidable» 0..*+upperLevelUnit

«voidable» 0..1

6 listopada 2014


New feature types and associations class Administrativ e Units ov erv iew

«featureType»

Administrativ eUnit

::AdministrativeUnit

+ country :CountryCode

+ geometry :GM_MultiSurface



+ nationalCode :CharacterString

+ nationalLevel :AdministrativeHierarchyLevel

«voidable»

+ SHNCode :ThematicIdentifier

+ validFrom :DateTime


+ nationalLevelName :LocalisedCharacterString [1..*]

+ residenceOfAuthority :ResidenceOfAuthority [1..*]





«featureType»


Administrativ eUnit

«featureType»

Administrativ eUnitArea

+ geometry :GM_Surface

+ inspireID :Identifier

+ landCoverType :LandCoverTypeValue




+adminUnitArea

«voidable»

1..*

+adminUnit

«voidable»0..6

+/administeredBy

«voidable» 0..*

+coAdminister

«voidable» 0..*

+lowerLevelUnit

«voidable» 0..*

+upperLevelUnit

«voidable» 0..1

6 listopada 2014

the Competitiveness and Innovation framework Programme (CIP) ICT Policy Support Programme (PSP) Call 6 (Grant 325140) EUROPEAN LOCATION FRAMEWORK 6 listopada 2014

Theme Application schema No of feature types in INSPIRE

No of feature types in ELF

No of feature types NOT

from INSPIRE

Attributes not in INSPIRE

Addresses Addresses 6 5 0 0 Adminsitrative Units

Administrative Units 3 4 1 7

Buildings Buildings 7 7 2 19 Cadastral Parcels Cadastral Parcels 4 4 0 0

Elevation Elevation Grid Coverage 1 1 0 0 Geographical Names

Geographical Names 1 1 0 1

Hydrography Physical Waters 20 TODO TODO TODO Hydro Network 4 4 0 0

Land Cover Land Cover 2 2 0 0 Miscellaneous Miscellaneous 0 11 11 49 Statistical Units NUTS 2 2 0 0 Protected Sites Protected Sites 1 1 0 0 Sea Regions Sea Regions 11 TODO TODO TODO Transport Network

Air Transport Network 29 17 0 10 Cable Transport Network 4 4 0 0 Common Transport Network 17 10 0 1 Railway Transport Network 16 15 0 4 Road Transport Network 16 17 1 2 Water Transport Network 24 18 0 6


Specification documents


Technical Guidance for the implementation of INSPIRE Download Services Contains

Requirements for ATOM services implementation

Requirements for WFS pre-defined services implementation

Requirements for WFS direct access services implementation

Quality of service requirements

http://inspire.jrc.ec.europa.eu/documents/Network_Services/Technical_Guidance_Download_Services_v3.1.pdf





INSPIRE Data Specifications Provide

harmonised data specification for the spatial data themes form Annexes I, II and III of the INSPIRE Directive (AD, AU, BU, CP, EL, GN, HY, LC, PS, SR, SU, TN)

Contains

Data content and structure description

Information about reference systems

Data Quality requirements

Metadata requirements

Delivery requirements

Portrayal requirements (for view services)

http://inspire.ec.europa.eu/index.cfm/pageid/2




ELF Data Model

Provides

Extensions to the INSPIRE data models

Contains

Dependencies between theme packages

Overviews of UML models

Feature types

Data types

Code lists

Attributes

Associations

Code lists values

Only specific to ELF


ELF specification document

Draft versions available

https://service.projectplace.com/pp/pp.cgi/0/955486213

– Folder for whole project

– WP2 Deliverables

– D2.2 Data Specification Master

See also


– WP2 workspace folder containing recent versions of documentation




ELF Application Schemas

http://www.locationframework.eu/schemas/

In general use last available version – 1.0

If there is not ELF schema available than use INSPIRE v4.0 schema



Other documents

Feature Catalogue

Mapping tables templates

Enterprise Architect models


Production process


Source data for ELF download services: transform existing data to ELF/INSPIRE data model (recommended option)

NMCA data

NMCA data

Transformation process Harmonised

(format xxx)

ELF WFS

ELF ATOM feeds

Cascading WFS

NMCA data


Should be conformant to INSPIRE network services, follow Technical guidelines

Download services

View services – not required but, relatively easy to setup

Must support the two projections

EPSG 3857(Web Mercator) and EPSG 3035(ETRS-LAEA)

General requirements to National services


ELF National services must be well documented:

Metadata according to INSPIRE. Discovery service and Metadata IR

Capabilities file. INSPIRE Technical Guidance

For publication on the ELF platform - use the ELF service information spreadsheet on Projectplace.

and

For users of the ELF platform. Documentation for services and data - On www.elfproject.eu.


http://www.elfproject.eu/


WFS direct access strongly recommended

WFS 2.0.0, GML 3.2.1

Optional Atom feeds as supplement to WFSs

Data should

Be harmonized, Edge-matched, quality controlled

Use/validate vs. the ELF and INSPIRE application schemas www.locationframework.eu/schemas


http://www.locationframework.eu/schemas


Production process

Design phase :

Work Package 2

– Data model

– Application schemas

Production phase

Harmonisation of national data to ELF/INSPIRE data models

– Matching tables : NMCAs

– Master data : NMCAs

Set up WFS and/or ATOM national services using ELF/INSPIRE application schemas

– Master data : NMCAs

– Documentation of services : NMCAs

Connection to cascaded services and Oscari: NLS – Finland (FGI)


HARMONISATION PROCESS

National data

ELF/INSPIRE data

Extraction

Transformation

Loading

ETL Tools


HARMONISATION PROCESS

4 – choose ETL tool

ELF WP4 provides following ETL tools:

Snowflake – GO publisher

Delft University – HALE (open source)

However, you can use any other ETL tool available


SERVICE INFRASTRUCTURE

NATIONAL

DATA

EUROPE

NATIONAL

DATA

NATIONAL

DATA

WEB

Cascading WFS Query

distribution Content

aggregation

WFS

WFS

WFS



1 – Prepare Data

ELF (recommended)

INSPIRE (acceptable)



2a – Create service

Software

Use what you already have

Strong GeoServer community in ELF project

ESRI – ArcGIS Server and ArcGIS for INSPIRE

• YouTube webinar https://www.youtube.com/watch?v=9-Z9yx4fdoU&feature=youtu.be

https://www.youtube.com/watch?v=9-Z9yx4fdoU&feature=youtu.be







2b – Create service

ELF Data Model

INSPIRE Data

Specifications

DOCUMENTS STRUCTURE

Technical Guidance

for the

implementation of

INSPIRE Download

Services

ELF applications

schemas

INSPIRE application

schemas

SERVICE



3 – Set Service in production

PERFORMANCE SUPPORT AVAILABILITY



4 – Document

HTTP://THISISMYDOWNLOADSERV

ICE/WFS?

• Authentication

• Feature and data type(s)

• BBOXS

http://thisismydownloadservice/WFS?

http://thisismydownloadservice/WFS?


WFS TECHNICAL REQUIREMENTS

CRS EPSG:3035 EPSG:3857

Formats WFS 2.0.0, GML 3.2.1 (ELF v1.0

and INSPIRE v4.0)

Extent

We must have an extent at the

service level to be used in the

cascading service.


WFS TECHNICAL REQUIREMENTS

Data

Extent

Only data within the land

boundary of the country.

Authentication

Service must be open or

available through

standard authentication.

Performance Follow the INSPIRE

requirements.


SERVICE QUALITY

Testing has to be done internally

Data has to be validated against ELF/INSPIRE application schemas

Service have to be validated using at least one of the following validators:

Inspire validator : http://inspire-geoportal.ec.europa.eu/validator2/

OGC cite : http://cite.opengeospatial.org

ELF ETF tool : http://services.interactive-instruments.de/etf-demo-1-e/ login: elf pass: prime

Additional external performance test

Spatineo Performance http://54.247.162.180/Performance/

http://inspire-geoportal.ec.europa.eu/validator2/



http://cite.opengeospatial.org/

http://services.interactive-instruments.de/etf-demo-1-e/









http://54.247.162.180/Performance/


UPDATE

UPDATE FREQUENCY

• One time job for project

• No decisions made

regarding updates after

the lifetime of the

project.


ELF Dataset-level Metadata

05 February, 2016

ELF Data

ELF Dataset-

level metadata


ELF metadata for discovery purposes

05 February, 2016

INSPIRE IR Section

Metadata element Multiplicity in ELF (INSPIRE)

Condition

1.1 Resource title 1 (1)

1.2 Resource abstract 1 (1)

1.3 Resource type 1 (1)

1.4 Resource locator 1..* (0..*) Mandatory. (In INSPIRE mandatory if a URL is available to obtain more information on the resources and/or access related services.) See 8.1.1

1.5 Unique resource identifier 1..* (1..*)

1.7 Resource language 1..* (0..*) Mandatory. (In INSPIRE mandatory if resource includes textual information.) See 8.1.2

2.1 Topic Category 1..* (1..*)

3 Keyword 1..* (1..*)

4.1 Geographic bounding box 1..* (1..*)

5 Temporal reference 1..* (1..*)



05 February, 2016

INSPIRE IR Section


Condition

6.1 Lineage 1 (1) Mandatory. In ELF also information about the source and process steps are recommended.

6.2 Spatial resolution 1..* (0..*) Mandatory. (In INSPIRE mandatory for data sets and data set series if an equivalent scale or a resolution distance can be specified)

7 Conformity 2..* (1..*) Mandatory to indicate the conformity to both ELF and INSPIRE data specifications.

8.1 Conditions for access and use 1..* (1..*) M

8.2 Limitations on public access 1..* (1..*) M

9 Responsible organisation 1..* (1..*) M

10.1 Metadata point of contact 1..* (1..*) M

10.2 Metadata date 1 (1) M

10.3 Metadata language 1..* (1) English is recommended language for ELF metadata.


ELF metadata for evaluation

05 February, 2016

INSPIRE TG Section


Condition

8.2.1 Coordinate Reference System 1..*

8.2.2 Temporal Reference System 0..* Mandatory, if the spatial data set or one of its feature types contains temporal information that does not refer to the Gregorian Calendar or the Coordinated Universal Time.

8.2.3 Encoding 1

8.2.4 Character Encoding 0..* Mandatory if an encoding is used that is not based on UTF-8

8.2.5 Spatial representation type 1..* M

8.2.6 Data Quality – Logical Consistency – Topological Consistency

0..* The results of ELF quality evaluations should be reported in the ELF Metadata. See chapter 8.2.1.

8.3.1 Maintenance Information 1 (0..1) Mandatory in ELF. See chapter 8.2.2.


Data Quality

Results of additional data quality evaluations

05 February, 2016

INSPIRE TG Section


Condition

8.3.2 Positional Accuracy – Absolute or external Accuracy

1..* (0..*) Mandatory in ELF. See chapter 7.1.1

8.3.2 Logical Consistency – Conceptual Consistency

1..* (0..*) Mandatory in ELF. See chapter 7.2

8.3.2 Logical Consistency – Domain Consistency


8.3.2 Logical Consistency – Format Consistency


8.3.2 Logical Consistency – Topological Consistency

0..* Mandatory if the dataset is a vector dataset (only exception is ELF elevation) See chapter 7.1.3 and 7.2

8.3.2 Completeness – Commission 0..* INSPIRE themes : AD, AU, EL, HY, LC, PS, SU, TN

8.3.2 Completeness – Omission 0..* INSPIRE themes : AD, AU, CP, GN, HY, EL, LC, PS, SU, TN


Data Quality

Results of additional data quality evaluations

05 February, 2016

INSPIRE TG Section


Condition

8.3.2 Thematic Accuracy – Classification Correctness

0..* INSPIRE themes : LC, SU, TN

8.3.2 Positional Accuracy – Relative or Internal Accuracy

0..* INSPIRE themes : EL, LC

8.3.2 Positional Accuracy – Gridded Data Position Accuracy

0..* INSPIRE themes : EL – if spatial representation type is grid

8.3.2 Temporal Accuracy – Temporal Consistency

INSPIRE themes : LC

8.3.2 Temporal Accuracy – Temporal Validity INSPIRE themes : LC, SU

8.3.2 Thematic Accuracy – Non-quantitative Attribute Accuracy

INSPIRE themes : AD, HY, LC, TN

8.3.2 Temporal Accuracy – Quantitative Attribute Accuracy

INSPIRE themes : HY, LC

8.3.3 Content information 0..1 INSPIRE themes : BU


ELF metadata for National Services

05 February, 2016

NATIONAL DATA

WFS

ELF National

Services

ELF National Service

metadata



05 February, 2016

INSPIRE IR Section


Condition

1.1 Resource title 1 (1) M

1.2 Resource abstract 1 (1) M

1.3 Resource type 1 (1) M

1.4 Resource locator 1..* (0..*) Mandatory. (GetCapabilities url – ELF platform url, additional National url may be provided.)

1.5 Unique resource identifier 1..* (1..*)

1.7 Resource language 1..* (0..*) Mandatory.(Recommended in ELF, minimum English also native language.) See 8.1.2

2.1 Topic Category 1..* (1..*) M

3 Keyword 1..* (1..*) M

4.1 Geographic bounding box 1..* (1..*) M

5 Temporal reference 1..* (1..*) M



05 February, 2016

INSPIRE IR Section


Condition

6.1 Lineage 1 (1) M

6.2 Spatial resolution 1..* (0..*) Mandatory. (In INSPIRE mandatory for data sets and data set series if an equivalent scale or a resolution distance can be specified)

7 Conformity 2..* (1..*) Mandatory to indicate the conformity to both ELF and INSPIRE data specifications.

8.1 Conditions for access and use 1..* (1..*) M

8.2 Limitations on public access 1..* (1..*) M

9 Responsible organisation 1..* (1..*) M

10.1 Metadata point of contact 1..* (1..*) M

10.2 Metadata date 1 (1) M

10.3 Metadata language 1..* (1) English is recommended language for ELF metadata, also native language may be provided.)


Metadata language for ELF National services

English is recommended and is for ELF required for at least these 4 metadata elements

• Resource Title

• Resource Abstract

• Responsible Organisation

• Keyword(s)

A template (XML file) will be posted on Projectplace

05 February, 2016


How to deliver ELF metadata?

05 February, 2016


How to deliver ELF metadata?

ELF delivery D2.3.6_Quality_v0.6_AnnexB

Harvesting from the national INSPIRE geoportal CSW API

For all NMCAs

Sending the metadata as a valid ISO 19139 XML file to the platform manager

Other data producers (e.g. EuroGeographics)

Metadata editor tools

INSPIRE MD editor

National MD editor -> make sure that the MD profile meets the INSPIRE/ELF profile

GeoNetwork MD editor

05 February, 2016

https://service.projectplace.com/pp/pp.cgi/r1084890728

http://inspire-geoportal.ec.europa.eu/editor/

http://geonetwork-opensource.org/


Summary

NMCAs should provide download WFS services for ELF themes

Services should provide the data in ELF (recommended) or INSPIRE (acceptable) data model

Datasets and services should be documented

Quality of services and datasets should be tested


Examples

Data


ProjectPlace

Services

http://elfproject.eu/documentation/service/platform





Conclusions : possible help

[email protected] (general)

[email protected] (general)

mailto:[email protected]

mailto:[email protected]

ELF download services - INSPIREinspire.gov.sk/Upload/documents/20160216_SK_BA_ELF_WS/06...2016/02/16...

Documents

Transcript of ELF download services - INSPIREinspire.gov.sk/Upload/documents/20160216_SK_BA_ELF_WS/06...2016/02/16...