Minerals4EU - The EU-MKDP (Minerals Knowledge Data Platform)

13
Minerals4EU - WP5 The EU-MKDP (Minerals Knowledge Data Platform) System architecture, objectives, services 1st MINCE Conference, Espoo, November 26-27, 2014 Daniel Cassard and the WP5 Team BRGM, CGS, GeoZS, GEUS, GTK, JRC and TNO

Transcript of Minerals4EU - The EU-MKDP (Minerals Knowledge Data Platform)

Minerals4EU - WP5

The EU-MKDP (Minerals Knowledge Data Platform)

System architecture, objectives, services

1st MINCE Conference, Espoo, November 26-27, 2014

Daniel Cassard and the WP5 Team

BRGM, CGS, GeoZS, GEUS, GTK, JRC and TNO

Content

The objectives, the technical choices, our contribution, the future…

The project and the EU-MKDP objectives

The technical choices: why?

What do we bring to the community? Are we in competition with other

Internet data providers?

The EU-MKDP is a first step. Other projects currently running and the very near

future

Concluding remark

The project

Minerals4EU – the European

Intelligence Network on the Supply

of Raw Materials will provide tools

and expertise to enhance

resource efficiency, minerals

supply security and support

sustainable minerals development

for Europe.

Minerals4EU will thus set up:

- A permanent EU Mineral Intelligence network;

- The most comprehensive European Minerals Yearbook;

- An INSPIRE compliant EU Minerals Knowledge Data Platform;

- Foresight studies on minerals supply and demand in Europe.

www.minerals4eu.eu

The EU-MKDP objectives

The EU-MKDP represents one of the first bricks of the future European geological

data infrastructure. The proposed technical solutions assure an effective and sustainable system designed for facilitating data updates and maintenance, and

for offering a full and seamless access to information related to the whole mineral

resources value chain.

The system is thus designed to accommodate:

- Structured data from national databases and

- Semi- and non-structured information: syntheses and statistics (graph charts and time-series), related to primary and secondary resources ( exploration,

production, reserves and resources), exploitation technologies, end-product

development and waste management practices, European market survey

and raw material demand… in various formats (text files, PDF files, images…).

Web

Services

REEInfo

MR

Info

Web

Services

Non-, semi- & structured /

standardized information related to

MR & wastes: knowledge extraction,

indexation…

EU-MKDP Web Portal

Ne

w k

now

ledg

ep

rod

uced

by p

art

ners

fro

m

oth

er

wo

rkp

acka

ge

s

Information Factorydata filtering, advanced search,

statistics computing,

report generation

Layers

Web

Services

Pertinent available layers

from geological surveys

and EU projects and

other institutions (e.g.,

geographic, geological,

geophysical,

geochemical maps)

…YX

…YYXX

Web

ServicesWeb

Services

Web

ServicesWeb

ServicesWeb

Services

Web Services

General simplified architecture of the EU-MKDP

Other agencies, institutes,

professional associations…, able to

provide structured data

Documents & Metadata

Structured data provided by geological surveys

Based on OGC/

INSPIRE

Implementing

Rules for

Services and

Data

A sustainable system

always kept up to date: adoption

and development of

a distributed architecture.

A system fully

INSPIRE compliant:

based on INSPIRE

v.3 and

EarthResourceML

(ERML) v.2 data

models.

Web

Services

REEInfo

MR

Info

Web

Services

Non-, semi- & structured /

standardized information related to

MR & wastes: knowledge extraction,

indexation…

EU-MKDP Web Portal

Ne

w k

now

ledg

ep

rod

uced

by p

art

ners

fro

m

oth

er

wo

rkp

acka

ge

s

Information Factorydata filtering, advanced search,

statistics computing,

report generation

Layers

Web

Services

Pertinent available layers

from geological surveys

and EU projects and

other institutions (e.g.,

geographic, geological,

geophysical,

geochemical maps)

…YX

…YYXX

Web

ServicesWeb

Services

Web

ServicesWeb

ServicesWeb

Services

Web Services

General simplified architecture of the EU-MKDP

Other agencies, institutes,

professional associations…, able to

provide structured data

Documents & Metadata

Structured data provided by geological surveys

Based on OGC/

INSPIRE

Implementing

Rules for

Services and

Data

Management of:

- Non-structured

data, always

accompanied by

their metadata

- Structured data

A Central

Database to

minimize the

drawbacks of the

distributed architecture:

improves the

performance,

reduces the risk

in case of server

crash

Provider’s own format

Mapping (ETL process and code lists)

Harvesting DB(+ quality control)

Project DB

Diffusion DB(+ diffusion optimizations)

Documents & Metadata

Web Services(WMS/WFS)

Web Services(Search engine)

Web Services(Stats, auto report, filtering…)

DB SYNCHRONIZATION

Standardized data models

(INSPIRE MR, ERML)

Harvesting

mechanism

(ETL process)

INFORMATION FACTORY

EU-MKDP detailed architectureBased on a « production-diffusion schema »

EU-MKDP Web Portal

WebServices

National DB

Provider DB

National DB

Provider DB

Indexation

Provider DB

Deegree 3

MICKA Catalog(CS/W)

A professional architecture: A

Central Harvesting

Database

synchronized with

a Central Diffusion

Database. The first

one controls data

quality and the

second one is

optimized for

diffusion.

Synchronization is

made using SQL

scripts.

EU level

Country

levelWeb

ServicesWeb

Services

Technical choices – the diffusion system

The EU-MKDP Web Portal

An Editorial: latest news of the EU-MKDP and information on the use of the web portal.

A Map Viewer will present the data inside the Diffusion Database, and will allow the user to combine them with other data (geological map, consumption area...). This Map Viewer will support INSPIRE View Services, will propose a predefined layers list, a metadata catalogue dedicated to Minerals4EU (MICKA), a connection to other catalogues (One Geology-Europe, INSPIRE...) and external layers (OGC WMS). Some of the basic (statistics, reports...) and dedicated services will be integrated in the Map Viewer.

The Search facilities will allow the user to search in the Diffusion Database, in some other databases (manually plugged into the Indexation Engine) and in documents added to the EU-MKDP using a dedicated interface. The user will be able to search (i) using full text or (ii) using a specific interface dedicated to the concept he is looking for. It will be possible to refine all these searches by adding a location (Diffusion Database, documents or both).

The diffusion system: overview

4 parts (front office)

Editorial (1)

Map Viewer (2)

Search (3)

Services (in progress)

1 part (back office)

Documents management

(1)

(2)

(3)(3)

(+ a dedicated viewer for

a dynamic presentation of

the e-Mineral Yearbook

and foresight studies)

http://minerals4eu.brgm-rec.fr

Technical choices – the services

Services on top of the Central Diffusion Database, accessible through the EU-

MKDP

‘Basic’ services: data filtering, advanced search, statistics computing, automatic

report generation.

Dedicated services, some answering to the most common/frequent queries (with possible storage of results in the Central Diffusion Database): e.g., LREE/HREE computation, extraction - using mineralogy - of all deposits containing REE (indicated or NOT in the commodity list) for a better definition of mining districts/provinces.

‘On request’ services based on Geological Surveys’ know-how/expertise

Services with a substantial added-value, not automated, tailored to meet specific

demands from industry, EC, governmental agencies and other potential end users (e.g., dedicated metallogenic /potential maps, predictive maps…).

What do we bring? Are we in competition with

other Internet data providers?

Most of the Internet data providers collect, standardize and disseminate all

relevant corporate, financial, market and M&A data — plus news and analysis

— for industries like metals & mining.

We are partly dealing with the same data (e.g., project/mine status,

exploration, production and grades, reserves and resources…) but our goal is

to provide the investor, the decision-maker or the stakeholder with the

capability (i) to produce in a seamless way his own analysis combining several

types of data and (ii) to search for and exploit pertinent syntheses (e.g., the e-

Minerals Yearbook [WP4] and foresight studies [WP6]).

We are covering the whole value chain, putting notably at the end user

disposal all the geological and metallogenic knowledge necessary to

evaluate ongoing mining projects (potential of the area, potential of

development…)

No competition, but complementarity

EURAREIKMS (REE)

Minerals4EUEU-MKDP

Raw materials intelligence capacity: Database of models &

tools (MFA, LCA, 3D-4D…), ontology-based selection tool

ProSUMThe EU-UMKDP: Mining

wastes, WEEE, ELVs, Batteries

EUMINETEuropean Minerals

Information Network

REMINDResponsible Mining

Demonstrations

H2020

EIP-RM

COMMITMENTS

Strongsynergy

One of the first bricks of the EGDI

Building on Minerals4EU

and extendingthe EU-MKDP

Looking toward

the near future

Addresses EIP-SIPII.C Priority Area –

Action area II.8: The EURMKB

Adding new bricks

Thanks a lot for your attention!

Developing the EU-MKDP

architecture will contribute to

lay the foundations of an

effective and lasting system

designed to accommodate

various data sets related to

raw materials, make easier

their visualization and their use

and facilitate data updates and maintenance.