Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July...

29
1 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva Standardized data sharing through an open-source Spatial Data Infrastructure: the Afromaison project Yaniss Guigoz - University of Geneva/GRID-Geneva

Transcript of Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July...

Page 1: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

1 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

Standardized data sharing through an open-source Spatial Data

Infrastructure: the Afromaison project

Yaniss Guigoz - University of Geneva/GRID-Geneva

Page 2: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

2 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

EcoARM2ERA and AFROMAISON

Why Afromaison in this workshop? • Concrete example of spatial data management

• Demonstration of geographic standards and tools that can be useful to other projects

• Our Armenian partners know these tools and standards through the ARPEGEO project

• ARPEGEO = National scale whereas Afromaison = Continental scale => same tools and standards work at all scales

Page 3: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

3 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - CONTEXT

- 3 years project (2011-2014), financed by the European Commission (FP7 projects)

- 15 partners, including 6 from Africa

- Theme: Integrated Natural Resources Management (INRM) in 5 different eco-regions of Africa => 5 case studies

- Afromaison: Afro Africa Maison “house” in French => landscape should be managed like a household (several people with different roles and interests under a same roof)

Page 4: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

4 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - CONTEXT

- Integrated Natural Resources Management: natural resources management must take into account interests of all the actors (population, water managers, farmers, …) by bringing technical solutions and using local knowledge

- Meso-scale: • Scale where decisions taken • Sub-national, between local and national • Ecosystem, administrative unit, watershed, …

- Goal: to produce a manual and a toolbox gathering results of the 3 years research for a better INRM, usable in all environmental and socio-economic conditions of Africa

Page 5: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

5 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - CONTEXT

South Africa

Uganda

Ethiopia

Mali

Tunisia

5 case study 5 different contexts: - Environmental - Socio-political - Economic

Page 6: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

6 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - CONTEXT

- INRM: • need of existing base data: climate, population, land

cover, … • Need to share available + created data with partners • Later need to share data with public to avoid redundancy Data need to be discoverable, accessible and usable Principle of Spatial Data Infrastructure (SDI)

Data needs to follow standards to be used in SDI tools

Page 7: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

7 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - STANDARDS

We are concerned by 2 families of standards:

• Open Geospatial Consortium (OGC): responsible for open standards for geospatial content and services, GIS data processing and data sharing. Ex: WMS, WFS, WCS, WPS, KML, …

• International Standards Organisation (ISO): responsible for the ISO19115/ISO19139 describing geographic information (metadata)

Page 8: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

8 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - CONTEXT

African context for SDI and GIS: - Weaknesses: • Internet connectivity • Electrical network • Hardware • Budget • GIS skills slowly increasing compared to other places

- Strengths/Opportunities: • Local willingness of capacity building for being able to

locally address issues • Strongly SDI committed continental institution: UNECA • Several European projects linked to Africa

Page 9: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

9 Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - SOLUTIONS - TOOLS

- Only Open Source solutions for Afromaison - Has all technical solutions needed - It allows to address some of the difficulties

such as budget

Server (unige/GRID)

FTP server OpenGEO Suite Geonetwork GI-Cat (broker)

Afromaison SDI:

Page 10: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

10

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

FTP server: • Main system to store & access Afromaison geospatial data

physical files • Advantages:

- Easy access to big files => ideal to store and exchange big data (vector, raster) between partners

- Login dependant access => allows restricted access

Page 11: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

11

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

OpenGEO suite: • Suite of integrated Java modules forming a web mapping

platform • Allows to easily control the whole chain of geodata on the

web (import publication) • Compliant with OGC standards • Modules:

Page 12: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

12

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

PostGIS Extension of the PostgreSQL database to allow the management of geographic functionalities and queries

Page 13: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

13

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

GeoServer • Cartographic server • Core element of the OpenGEO Suite, that

allows to import, manage and publish spatial data (vector or raster)

• Can read many formats

- Files (shapefiles, geoTIFF, …) - Databases (PostGIS, ArcSDE, Oracle, …)

• Publishes imported maps in a standardized way (OGC standards) as web services (WMS, WFS, …)

Page 14: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

14

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Afromaison layers in geoserver http://afromaison.grid.unep.ch:8080/geoserver

Page 15: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

15

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Afromaison webservices published from geoserver

WMS: http://afromaison.grid.unep.ch/geoserver/wms WFS: http://afromaison.grid.unep.ch/geoserver/wfs WCS: http://afromaison.grid.unep.ch/geoserver/wcs

Page 16: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

16

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

WFS display in QGIS => possible to save the WFS as a local shapefile

Page 17: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

17

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

GeoWebCache • Helps to accelerate images and

data display • Uses some other OGC standards:

- WMTS: Web Map Tiling Service - WMS-C: Web Map Service Caching - TMS: Tiled Map Service

Page 18: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

18

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

OpenLayers • Javascript library allowing to display

maps and linked functions in a web browser • Can display image formats such as WMS, WMTS,

TMS, WMS-C, WMTS, Google Maps, Bing Maps, Yahoo Maps, OpenStreetMap, ArcGIS Server, ArcIMS

• Can display the following vector formats: KML,

GeoJSON, WKT, GML, WFS, GeoRSS

Page 19: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

19

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

GeoExt • Javascript library providing the

necessary tools to build web mapping applications

• Example: GeoExplorer, vizualisation tool coming with the suite

Page 20: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

20

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

http://afromaison.grid.unep.ch/geoexplorer/composer#maps/4

Use of GeoExplorer in AfroMaison:

Page 21: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

21

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Integration of a GeoExplorer composition in a web page:

http://www.afromaison.net/index.php?option=com_content&view=article&id=9&Itemid=107

Page 22: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

22

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Geonetwork

- Metadata = necessity to describe geographic data - Spatial data on the web metadata must be on the web => metadata catalog - Geonetwork = metadata catalog - Allows to search and access data - ISO19139 standard - CSW requests on metadata

Page 23: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

23

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Afromaison geonetwork node: http://afromaison.grid.unep.ch:8080/geonetwork

Page 24: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

24

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Afromaison broker -Need to be able to discover and expose as much african geodata

as possible - Problem: they might be published in different formats (WMS, WFS, CSW, THREDDS, NetCDF, Hydro, WaterML, …) - Solution: a broker (or connector) that allows to transform the result of heterogeneous queries into an homogeneous interface - Developed in the EuroGEOSS project by ESSI-Lab - installation of GI-Cat for Afromaison => 15 African resources at the moment - will be transferred to UNECA in November as a federator of African resources

Page 25: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

25

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - TOOLS

Afromaison broker http://afromaison.grid.unep.ch:8080/gi-cat/gi-portal/index.jsp

- Source - Metadata Access to

data

Page 26: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

26

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - GEOSS

- Global Earth Observation System of Systems (GEOSS) = Google for geodata

- Developed by the Group on Earth Observation (GEO)

- allows to connect users to existing databases and portals by registering them

- GEOportal available at http://www.geoportal.org

- Afromaison services registered and accessible directly from the portal

- Important to register there all your services linked to geodata to improve available data

Page 27: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

27

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - GEOSS

Page 28: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

28

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

AFROMAISON - Conclusion

- This project shows a successful example of participation to better data sharing in Africa Hope to save time for real work instead of re-create existing data

- Knowledge about use of these tools will be transmitted soon to local partners => African geodata managed by Africans

- Same principles and tools have been used in Armenia through ARPEGEO and same success!

Page 29: Standardized data sharing through an open-source Spatial ... · -Geneva Workshop Dublin 12 July 2013University of Geneva & UNEP/GRID 7 AFROMAISON - STANDARDS We are concerned by 2

29

Workshop Dublin 12 July 2013 University of Geneva & UNEP/GRID-Geneva

Thank you