Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D...

57
Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme Gensel, Benoit Le Rubrus, Anton Telechev, Marlène Villanova- Oliver

Transcript of Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D...

Page 1: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Workshop 1.4: ESPON Database

ESPON Internal Seminar29-30 November 2011

Kraków,Poland

ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme Gensel, Benoit Le Rubrus, Anton Telechev, Marlène Villanova-Oliver

Page 2: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Outline

2

1. ESPON Data Base v1: Status

1. On the way to ESPON Data Base v2

1. First Results

1. Agenda

Page 3: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Outline

3

1. ESPON Data Base v1: Status

1. On the way to ESPON Data Base v2

1. First Results

1. Agenda

Page 4: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

4

The ESPON DB Workflow

ESPON DB file repository

External World

ESPON Projects

INPUTDATA

ESPON Database

Data and metadata search

Filling the metadata and uploading data

Data checking, correction and harmonization

Data and metadata exportation

Page 5: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

5

Access to the ESPON DB v1ESPON Web Site -> Scientific tools

http://www.espon.eu/main/Menu_ScientificTools/ESPON2013Database/

Page 6: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

ESPON Web Site -> Scientific tools -> Applicationhttp://database.espon.eu

6

Access to the ESPON DB v1

Page 7: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

7

Access to the ESPON Data Sets

Page 8: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

8

Access to Regional (NUTS) Data

3 steps1. Query2. Select3. Download

Page 9: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

9

1. Query

Query Regional (NUTS) Data

Page 10: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

10

Query Regional (NUTS) Data

2. Select

Page 11: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

11

Query Regional (NUTS) Data

3.Download

Page 12: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

12

Query Regional (NUTS) Data

3.Download

Page 13: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

13

Access to Other Data

2 steps1. List all2. Download one

Page 14: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

14

List then Download Local Data

1. List all

Page 15: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

15

Download Local Data

2. Download one

Page 16: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

16

To Sum Up

Query, Select,Then Download

ListThen Download

Page 17: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

17

Difficult Questions

What is available?

What can I expect as results?

How to get the result of such a question: What is the

population of Kraków region?

Page 18: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

18

Some Metadata Shortcomings

Missing Keywords

The 0/1 Theme Problematic

No Precise Codification for Indicators Names

No Precise Indication for Units of Measure

No Full INSPIRE Compliance

Page 19: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Outline

19

1. ESPON Data Base v1: Status

1. On the way to ESPON Data Base v2

1. First Results

1. Agenda

Page 20: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

1. INSPIRE Compliance

2. Integration of New Geographical Objects

3. User Friendliness

Three (Main) Requirements

20

Page 21: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

1. INSPIRE Compliance

2. Integration of New Geographical Objects

3. User Friendliness

Three (Main) Requirements

21

Page 22: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Why New Metadata Specifications?• When producing a dataset and its metadata, a data

provider is required to follow some rules about the information layout…

• These rules help us to process (parse and syntactically check) these data and metadata files automatically

• To overcome the limitations (incomplete, lack of explicitness, not always used…) of the existing Metadata Specifications

22

Page 23: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Why New Metadata Specifications?• Create a “legal” reference frame for data exchange

• Explain each detail of data/metadata structures for data providers

• Prepare a solid basis for the creation of automatic database integration tools

• Create a public and official interface for data exchange for any interested party

23

Page 24: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Evolution of the Specifications• The core is the same as before, with

several evolutions:• Compatibility with INSPIRE Directive

has been reached• New fields and properties have

been added• to describe more precisely data• to improve automatic checking

24

Page 25: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Evolution of the SpecificationsThe New Specifications cover:

• the rules for data layout• the rules for metadata layout• the rules for statistical units integration (new!)

They hold in a 150 page document…… Available also in HTML

25

Page 26: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

New Model: a Brief Introduction• The Abstract Metadata Model is very simple

• It is almost the same as before, except:• Many elements have new fixed names• A new element Spatial Binding

• to ensure compatibility with INSPIRE• to check the spatial references

26

Page 27: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

New Model: a Brief Introduction• Each element or property described by

the Specifications is now represented homogeneously

Page 28: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

28

Example: the Indicator Identification Element

V 1

Page 29: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

29

Example: the Indicator Identification Element

V 1V 2

INSPIR

E

COMPLI

ANT

Page 30: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

30

Specifications Metadata v2

The Metadata v2 SpecificationsReference Document:

http://database.espon.eu/metaspecif(on-line in December 2011)

Page 31: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

31

Metadata v2 Excel FileGuidelines/examples: please consult the

Chapter 3 of the “Metadata v2 Specifications”

Page 32: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

32

Some Metadata Shortcomings

Missing Keywords

The 0/1 Theme Problematic

No Precise Codification for Indicators Names

No Precise Indication for Units of Measure

No Full INSPIRE Compliance

Page 33: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

33

New Metadata Specifications…

Consequences• Metadata v1 Editor is now

disabled…• We will upgrade the existing

metadata to comply with the new specifications

From now on…• Please, use our Excel temporary

Solution

…Until June 2012• Metadata v2 Editor Delivery

Page 34: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

1. INSPIRE Compliance

2. Integration of New Geographical Objects

3. User Friendliness

Three (Main) Requirements

34

Page 35: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

35

ESPON Data Base SchemaNeeds to be Updated

• To store the New Metadata

Needs to be Extended• To store New Geographical Objects

and Nomenclatures• WUTS (World NUTS 0)• Urban Objects (UMZ, FUA…)

Page 36: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

1. INSPIRE Compliance

2. Integration of New Geographical Objects

3. User Friendliness

Three (Main) Requirements

36

Page 37: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

37

Research Criteria UsefulnessResults of ESPON Database Survey – March 2011

Page 38: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

38

Query Interface v2 (Prototype)

Where?

What?

When?

Page 39: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

39

The Spatial View

Where?

Page 40: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

40

Where? At European Scale

Page 41: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

41

Where? At Urban Scale

Page 42: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

42

Where? At Global Scale

Page 43: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

43

The Thematic View

What?

Page 44: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

44

Search by Indicator Name

Page 45: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

45

Search by Theme

Page 46: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

46

Indicators of the Selected Theme

Page 47: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

47

The Temporal View

When?

Page 48: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

48

Temporal Selector

Page 49: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Outline

49

1. ESPON Data Base v1: Status

1. On the way to ESPON Data Base v2

1. First Results

1. Agenda

Page 50: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

50

Work Done since June 2011

• A Critical Analysis of the ESPON DB v1• Lessons Learned and Experience from

the Phase 1• Remarks of the ESPON CU

• Metadata Specifications

• Nomenclature Integration Specifications

• Database Schema upgrade

Page 51: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

51

Interface Updates (Dec. 2011) Overview of indicators

Page 52: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

52

Interface Updates (Dec. 2011) Disabled

• Metadata Editor v1… replaced temporarily by an Excel file compliant with the Metadata Specifications reference document… before the delivery of the Metadata Editor v2

• Not so useful search criteria• Selection by geographical objects (only

NUTS)• Selection by publication date

Page 53: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

Outline

53

1. ESPON Data Base v1: Status

1. On the way to ESPON Data Base v2

1. First Results

1. Agenda

Page 54: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

54

AgendaDecember 2011:

• Interface Updates: overview of indicators, selection criteria…

Spring 2012:

• Draft Metadata Editor v2

June 2012:

• Draft Query Interface v2 (for NUTS geographical objects)

Page 55: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

55

Thanks from the M4D Partners

Page 56: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

56

Thanks from the M4D Partners

Page 57: Workshop 1.4: ESPON Database ESPON Internal Seminar 29-30 November 2011 Kraków,Poland ESPON M4D Project - LIG (Grenoble Computer Science Lab) Partner Jérôme.

57

Jérôme Gensel ([email protected])- Coordination

Benoit Le Rubrus ([email protected])- Logistics Management and Development

Anton Telechev ([email protected])- Development

Marlène Villanova-Oliver ([email protected])- DB and Interface Design and Financial Management

http://steamer.imag.fr

UJF LIG STeamer M4D Staff