Geo-referencing concepts for fisheries data interoperability

24
Geo-referencing concepts for fisheries data interoperability Emmanuel Blondel Food & Agriculture Organization of the UN Fisheries & Aquaculture Department [email protected] RDA 9th Plenary meeting 06/04/2017 – Barcelone, Spain

Transcript of Geo-referencing concepts for fisheries data interoperability

Page 1: Geo-referencing concepts for fisheries data interoperability

Geo-referencing concepts for fisheries data interoperabilityEmmanuel BlondelFood & Agriculture Organization of the UNFisheries & Aquaculture Department

[email protected] RDA 9th Plenary meeting06/04/2017 – Barcelone, Spain

Page 2: Geo-referencing concepts for fisheries data interoperability

Geo-referencing concepts for fisheries data interoperability

• Synergy between RDA Fisheries Data interoperability WG and Coordinating Working Party on Fishery Statistics

• Scope and definitions• Scope of “Fisheries data”?• Geo-referencing / geographic dimension

• Geo-referencing for fisheries data• Levels of geo-referencing• Data and Metadata standards

RDA 9th Plenary, April 2017, Barcelona, Spain

Page 3: Geo-referencing concepts for fisheries data interoperability

CWP GIS task group

CWP: Coordinating Working Party on Fishery Statistics (http://www.fao.org/fishery/cwp/en), comprising several international organizations with responsibilities in fishery statistics Format

GIS task group: 3 activities1- Provide recommendations on spatial gridded systems for

fisheries data reporting2- Strengthening promotion and implementation of

geographic information standards & best practices3- Inventory GIS reference datasets and layers relevant for

fishery & aquaculture

RDA 9th Plenary, April 2017, Barcelona, Spain

Page 4: Geo-referencing concepts for fisheries data interoperability

Scope and DefinitionsFisheries data?

Fishery(-dependent) dataCommercial / recreational sources

Amount (catch, landings), Effort By-catch, Discarded species

Fishery(-independent) dataScientific surveys

Biological data, Acoustic data, Environmental data

Fishery information & knowledge managementReference geographic datasetsDerivate datasets & information

RDA 9th Plenary, April 2017, Barcelona, Spain

Page 5: Geo-referencing concepts for fisheries data interoperability

Scope and DefinitionsGeo-referencing levels

1- Geo-coordinates (raw)2- Classification systems

Spatial locations / sitesGridded systems

(aggregated)Area systems (aggregated)

3- Coding systems Grid Encoding/Decoding

systemsCode lists (Area types, Areas)Registries

RDA 9th Plenary, April 2017, Barcelona, Spain

Page 6: Geo-referencing concepts for fisheries data interoperability

Scope and DefinitionsGeo-referencing levels

4- (Meta)data Formats in support to geo-referencing

Standard vs. Non-standardGIS orientedStatistics oriented

5- Web-Services in support to geo-referencing

Standard vs. Non-standardGIS orientedStatistics oriented

1- Geo-coordinates (raw)2- Classification systems

Spatial locations / sitesGridded systems

(aggregated)Area systems (aggregated)

3- Coding systems Grid Encoding/Decoding

systemsCode lists (Area types, Areas)Registries

RDA 9th Plenary, April 2017, Barcelona, Spain

Page 7: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsGeographic coordinates

Raw locations (finest resolution), Longitude / LatitudeWriting conventions

Decimal Degrees (DD) – preferredDegrees, Minutes, Seconds (DMS)Standards & best practices:

OGC Simple Feature Specification + WKTIntegrated formats

CSV (non-standard, combined with WKT)OGC GeoJSONOGC GML

Metadata requirementsPositioning System (e.g. GPS), Material, Precision Geographic Reference System / RS, projected systems WGS84, North American, ED50, OSGB36

Standards & best practices: EPSG code & URN notation

urn:ogc:def:crs:EPSG::4326

OGC WKT CRSAxis Ordering: Lon/Lat (x/y) or Lat/Lon

OGC Axis ordering policy http://www.ogcnetwork.net/node/491

RDA 9th Plenary, April 2017, Barcelona, Spain

Source: GeoServer

Page 8: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsClassification and Coding systems

Classification systemsArea Grid systems (polygon)

RegularType of unit(square, rectangle)Grid resolution

RDA 9th Plenary, April 2017, Barcelona, Spain

Coding systemsEncoding/Decoding mechanismsPros:

Bridge to/from Statistics domain(and other standards)Coding systems InteroperabilityFacilitated by data management tools (e.g. i-Marine/BlueBridge)Flexibility for data managersSuitable for aggregated and summarized public data

Cons:Aggregated dataInteroperability is partial (depends on coding systems characteristics, resolution).

• Areal Grid coding systemCurrently recommended by the CWP on Fishery Statisticshttp://www.fao.org/fishery/cwp/handbook/G/enOnly used by IOTC (Tuna RFMO), FAO (for Tuna Atlas)

• C-squares coding systemhttp://www.cmar.csiro.au/csquares/about-csquares.htm

• ICES rectangleshttp://www.ices.dk/marine-data/maps/Pages/ICES-statistical-rectangles.aspx

Page 9: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsClassification and Coding systems

RDA 9th Plenary, April 2017, Barcelona, Spain

Source: FAO / CWP

Page 10: Geo-referencing concepts for fisheries data interoperability

RDA 9th Plenary, April 2017, Barcelona, Spain

Geo-referencing levelsClassification and Coding systems

8.20 (lon) 38.77 (lat)

6134005 (Areal grid system – 5deg)1300:4 (C-squares – 5deg)

06F8 (ICES rectangle)1300:488 (C-squares – 1deg)

Page 11: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsClassification and Coding systems

Classification systemsArea systems (polygon)

AggregatedIrregularPossible hierarchies / breakdown

Statistical areas, Reporting areas,Jurisdictional areas, Competence areasManagement areas (protected, restrictions,closures) / units, etc.

Locations / Sites (point)Ports, landing sites, sampling sites, etc.

Transects (line)

RDA 9th Plenary, April 2017, Barcelona, Spain

Coding systems

Geo-codelists

Registries

Page 12: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsArea system classification for fisheries data?

RDA 9th Plenary, April 2017, Barcelona, Spain

No Fisheries data area types common vocabulary Towards building fisheries data vocabularies

(definitions, code list)?

ISO 19115 Topic categories

? ?

?

Fishery Statistical area

Reporting area

Competence area

Jurisdiction areaManagement unit

Asssessment / Distribution area Fishing area

Page 13: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsGIS & Integrated Fisheries data formats

RDA 9th Plenary, April 2017, Barcelona, Spain

Geometry formats fishery dataIn the GIS domain

OGC Simple Feature / WKTOGC GML / GeoJSON

In the Statistics domainSDMX: No support for geometry. Requires geo-classification systems (grid coding systems, codelists / registries)

Integrated fishery data formats (combining geographic data with other concepts and dimensions, and statistical values)

In the GIS domainCSV (+WKT)OGC GML / GeoJSONNo real support for Data Structure Definition (DSD)e.g. GML FeatureType description is incompleteNeed for enriching data with DSD

In the Statistics domainSDMX formatsSupport for Data Structure Definitions

Page 14: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsGIS Metadata standards in support to fisheries data

RDA 9th Plenary, April 2017, Barcelona, Spain

ISO/OGC geographic metadata standardsISO 19115 – Geographic metadata19115:2003, 19115:2014 revision, ISO 19139 – XMLRelevant metadata elements in support to fisheries data discovery(non-exhaustive list)

Fisheries data vocabularies / global attributesTopic Categories: limited (too general)Keywords Set / Thesaurus: flexible

• possibility to handle custom and multiple thesaurus for data geographic dimension (fishery area types) or other concepts (species, gear, etc.)• simple keywords or URIsData extents: Geographic, Temporal, Vertical

ISO 19110 – Feature CataloguingExtending ISO 19115 geographic metadata

Usable for fishery data structure definitions?NetCDF-CF: metadata & data structure elements, mapping to ISO metadata

Page 15: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levelsStandard services in support to fisheries data

RDA 9th Plenary, April 2017, Barcelona, Spain

GIS domainData access/discovery services

OGC Web Feature/Map Service (WFS/WMS)Data as GML, GeoJSON, CSVOGC Web Coverage Service (WCS)?Unidata / OpenDAPData/Metadata as NetCDFOGC Catalogue Service for the Web (CSW)ISO/OGC 19115-19119 Metadata, 19139 (XML)(+ ISO 19110 – Feature Cataloguing)

Statistical domainData access/discovery services

SDMX APIs

Data retrieval (client) services available for users and machines

Page 16: Geo-referencing concepts for fisheries data interoperability

Geo-referencing levels

RDA 9th Plenary, April 2017, Barcelona, Spain

DAT

AM

ETAD

ATA

Geo-coordinates Classif. systems Coding systems GISformats

Webservices

• Reporting spatial Reference System(s)• Positioning system, material, precision

Geographic coordinates• Raw locations• Decimal Degrees • Deg/Minutes/Seconds (as “text” information)

Location / Sites Transects

Area systemsAggregated - Irregular

Grid systemsAggregated - Regular

Registries Landing sites

Area code listsStat. areas, admin. units,Fishing area, jurisdiction,

Square-based systemsAreal grid, C-squareRectangle-based systemsICES rectangles

Registry of Reference systems

• Registry / code list management metadata• Grid coding systems- definition, methodogy- grid resolution- Encoding/decoding rules

• SRS EPSG registry

OGC GML, GeoJSON, KML

OpenDAPThredds

ISO/OGC 19115/19119, 19139 XMLISO 19110 – Feature Cataloguing,for data structures

SDMX -ML,SDMX JSONData, Data Structure

OGC

WFS (data)WMS (maps)

OGC SFS/WKT

OGC WKT CRS

Unidata / OGCnetCDF –CF

OGC CSW

SDMX APIs

ESRI Shapefile

CSV, JSON

Integrated formats

Other GIS formats & services?

Other Stat. formats & services?

SDMX APIs?

Page 17: Geo-referencing concepts for fisheries data interoperability

FAO Fisheries knowledge base

Aquatic Species distributions

Vulnerable Marine Ecosystems

FIRMS Stocks & Fisheries

Regional Fishery Bodies

Vulnerable Marine Ecosystems

Sharks conservation/ management measures

Port State measures

FIRMS Stocks & Fisheries

Regional Fishery Bodies

Aquatic species

Thematic Map Viewers

Factsheet Maps

FAO Fisheries & AquacultureGeo-referenced Knowledge Base

Page 18: Geo-referencing concepts for fisheries data interoperability

OGC/ISO 19115-19139 INSPIREOGC / CSW

OGC GeoAPI

OGC / WMS

OGC / WFS

Metadata enforcing

Page 19: Geo-referencing concepts for fisheries data interoperability

Metadata enforcing

ASFIS

WoRMS

OGC/ISO 19115-19139 INSPIREOGC / CSW

OGC GeoAPI

Standard Vocabularies(species names & codes)

Link to other domain systems Statistics, Linked Open Data

Interoperability with other Search Engines

OGC / WMS

OGC / WFS

Page 20: Geo-referencing concepts for fisheries data interoperability

Metadata enforcing

OGC/ISO 19115-19139 INSPIREOGC / CSW

Page 21: Geo-referencing concepts for fisheries data interoperability

RDA 9th Plenary, April 2017, Barcelona, Spain

Metadata enforcingData & Metadata publication flows

GIS fishery reference data collectionsGIS Enforcing Metadata and Semantics (GEMS)

Built on standardsOGC GeoAPI, OGC WMS/WFS, ISO/OGC 19115/19139 metadata

Java technology:Apache SIS / Geotoolkit for ISO Metadata productionAPI Client libraries: GeoServer / GeoNetwork managers

Supported by

Page 22: Geo-referencing concepts for fisheries data interoperability

RDA 9th Plenary, April 2017, Barcelona, Spain

Metadata enforcing – Emerging needsIncreasing Need to create, publish, update metadata in flexible way

Mapping metadata:To data harmonization/processings/models outputs From existing metadata sources NetCDF-CF

Generating metadata through easy-to-use scripting approach.Pushing on R open solutions (packages) for:

ISO/OGC 19139 metadata model (read, write)Interfaces to GIS Data / Metadata publication APIs

Building metadata templating solutions, relying on common fisheries data vocabularies (for spatial and other data dimensions)

Page 23: Geo-referencing concepts for fisheries data interoperability

RDA 9th Plenary, April 2017, Barcelona, Spain

Metadata enforcing – Emerging needsRDA Use Case – Tuna fisheries data Atlas

Mainly supported by i-Marine/BlueBridge, and building on shared FAO GIS knowledge & practices.

Work with BlueBridge partners (FAO, IRD, CNR, etc.)

Objectives: Building on CWP and RDA recommandations: Standardized, transparent and sustainable data ingestion flow from Tuna RFMOs into a common Tuna fisheries database.Standard public access & discovery of Tuna regional and global fishery geo-referenced datasets, annotated with harmonized fisheries data vocabularies, through complementary Geospatial (OGC) and Statistical approachesEnhanced Tuna fisheries data portal

Page 24: Geo-referencing concepts for fisheries data interoperability

Thanks for your attention