Mastering Geospatial Metadata with FME

48
FME and Metadata Mastering Metadata with FME 2012 Don Murray Dean Hintz FME ® Desktop 2012 Version

Transcript of Mastering Geospatial Metadata with FME

Page 1: Mastering Geospatial Metadata with FME

FME and MetadataMastering Metadata with FME 2012

Don MurrayDean Hintz

FME ® Desktop 2012 Version

Page 2: Mastering Geospatial Metadata with FME

Agenda

FMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing

Page 3: Mastering Geospatial Metadata with FME

Safe Software Facts

Private company Founded in 1993 Headquarters in

Vancouver, BC, Canada 90+ employees

50+ value-added resellers &system integrators in 35 countries

~100 FME Certified Professionals & Trainers around the globe

Thousands of customersacross 116 countries

Page 4: Mastering Geospatial Metadata with FME

IT Service Case Distribution

4

Page 5: Mastering Geospatial Metadata with FME

Introduction to FME

What is FME?

How Does FME Work? Centralized Semantic Transformational

Data Translation Basics FME Desktop Training 2012

Page 6: Mastering Geospatial Metadata with FME

FME Moves Data

Page 7: Mastering Geospatial Metadata with FME

FME is all about …

Page 8: Mastering Geospatial Metadata with FME

Barriers to Interoperability

Web

Data Types

Data Translation Basics FME Desktop Training 2012

Page 9: Mastering Geospatial Metadata with FME

Translation

FME supports reading from a wide array of data formats and types 275+ formats, with more added each year CAD, GIS, XML, raster, database, non-spatial, 3D

9

Page 10: Mastering Geospatial Metadata with FME

Poll Question #1: FME

How long have you been using FME?

?

Page 11: Mastering Geospatial Metadata with FME

Metadata – What is it?

Page 12: Mastering Geospatial Metadata with FME

Metadata – What it is

Metadata provides information about whatever types of data you have:

12

Page 13: Mastering Geospatial Metadata with FME

Metadata – Data about data

Describes data structures• tables• geometry types• data types• fields

Describes data content• coordinate system• extent• modification date• quality, ownership, etc.

Page 14: Mastering Geospatial Metadata with FME

Metadata - Purpose

Page 15: Mastering Geospatial Metadata with FME

Common Metadata Questions

What does the data set describe?Who produced the data set?Why was the data set created?How was the data set created?How reliable are the data; what problems remain

in the data set?How can someone get a copy of the data set?Who wrote the metadata?

geology.usgs.gov/tools/metadata/tools/doc/ctc/

?

Page 16: Mastering Geospatial Metadata with FME

Poll Question 2: Metadata

How often do you work with metadata?

?

Page 17: Mastering Geospatial Metadata with FME

Metadata Standards

FGDC & ISO 19115 • describes geographical

information and services

• contents, spatial-temporal, data quality, access and rights to use

• 400 metadata elements, 20 core

Page 18: Mastering Geospatial Metadata with FME

ISO / OGC Standards

ISO/TS 19139• defines Geographic Meta Data XML (gmd) • XML Schema implementation derived from ISO

19115• Version "2007-04-17" uses GML 3.2.1

(http://www.opengis.net/gml/3.2)• Version "2006-06-04" use GML 3.2.0 (http://

www.opengis.net/gml)• ISO 19119 – web services

Bottom line: need to know what GML version and what ISO standard you need to comply with

Page 19: Mastering Geospatial Metadata with FME

Poll Question #3: Standards

Which metadata standards/types are interested in?

?

Page 20: Mastering Geospatial Metadata with FME

Key FME Metadata Capabilities

• Reading

• Writing

• Updating

• Harvesting

• Validating

• Integration with web services

Page 21: Mastering Geospatial Metadata with FME

Demos

Reading

Writing

Updating

Harvesting

Validation (Syntax, Schema)

Page 22: Mastering Geospatial Metadata with FME

Demo: Reading

Metadata attributes

XML Reader / Fragmenter with Feature Paths and flattening

HTTPFetcher

Reading from database

Page 23: Mastering Geospatial Metadata with FME

Demo: Reading Metadata Attributes

Page 24: Mastering Geospatial Metadata with FME

Demo: Reading Geodatabase Metadata

expose the geodb_metadata_string attribute

Page 25: Mastering Geospatial Metadata with FME

Demo: Writing

XMLTemplaterTemplates for • FGDC• ISO 19115

Database write mode: geodatabase

Page 26: Mastering Geospatial Metadata with FME

Demo: Harvesting and Writing

Page 27: Mastering Geospatial Metadata with FME

Demo: Writing Geodatabase Metadata

Geometry:geodb_metadataExpose: geodb_metadata_string

Page 28: Mastering Geospatial Metadata with FME

Demo: Updating

XMLUpdater, XQueryTimeStamperXMLFormatter

Page 29: Mastering Geospatial Metadata with FME

Demo: Updating

XMLUpdater: Insert, Delete, Replace, Replace Contents

Page 30: Mastering Geospatial Metadata with FME

Poll Question 4: XML

What XML tools do you use?

?

Page 31: Mastering Geospatial Metadata with FME

Validation – What to validate against?

ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsd

To Validate XML against ISO 19139 with GML 3.2.1:http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/

See page 13 of:http://

inspire.jrc.ec.europa.eu/reports/ImplementingRules/metadata/MD_IR_and_ISO_20090218.pdf

Or Google and click top link: “inspire metadata implementing rules technical guidelines”

Key takeaway: to validate gmd:MD_Metadata you need to validate against gmd.xsd

Page 32: Mastering Geospatial Metadata with FME

Demo: Validation

XMLValidator• Syntax• Schema

Page 33: Mastering Geospatial Metadata with FME

Validation Report – Bad Syntax

Page 34: Mastering Geospatial Metadata with FME

Validation Report – Bad Schema

Page 35: Mastering Geospatial Metadata with FME

Validation Report – Good Metadata

Page 36: Mastering Geospatial Metadata with FME

Validation Workspace

Page 37: Mastering Geospatial Metadata with FME

Other Validation Options

• Tester• Field names• Data types (numeric, date etc)• IDs

• CoordinateSystemExtractor• GeometryFilter• GeometryOGCvalidator• SpatialFilter (check extents)

Page 38: Mastering Geospatial Metadata with FME

CSW: Catalog Service for the Web

• Deegree

• GeoNetwork

• OpenGIS

• TerraCatalog

Page 39: Mastering Geospatial Metadata with FME

Metadata Services: CSW

• Reading• Writing / Publishing• Updating

Page 40: Mastering Geospatial Metadata with FME

Poll Question #5: CSW

What CSW tools do you use?

?

Page 41: Mastering Geospatial Metadata with FME
Page 42: Mastering Geospatial Metadata with FME

Arkansas Geostor: Download

Page 43: Mastering Geospatial Metadata with FME

Customer Implementations: LGII – Lithuania Geospatial Portal

File Formats: AutoCAD DXF / DWG ESRI Personal Geodatabase Shape MapInfo TAB Microstation Design V8 GML GIF / PNG JPEG TIFF ERDAS IMG ECW

Coordinate systems: LKS94 WGS84 ETRS89 1963 Pulkovo 1942 UTM (34, 35 zones)

Other data sources: WFS SDE Files

Page 44: Mastering Geospatial Metadata with FME

Summary

Metadata describes your dataHelps with searches and

managementFME can help drive your metadata: • Read / write and update• Harvest• Validate• Automate maintenance tasks• Integrate with CSWSwitch from manual to automatic by

using FME to power your metadata

Page 45: Mastering Geospatial Metadata with FME

Online Training

Upcoming Online Courses in 2012 Online FME Desktop:

May 16/17 June 20/21 Sept 19/20 Oct 17/18 Dec 5/6

FME Server Authoring: May 24 Sept 27

Online Advanced FME Desktop: XML Reading May 16 or 17 XML Writing May

23 or 24 Oracle Spatial June 7 or Sept

26 Esri (demo only) Sept 6 KML Nov

14 Raster Nov

29

Page 46: Mastering Geospatial Metadata with FME

Poll Question 6: Training

Would you like to enter for a chance to win a free seat of online FME training?

?

Page 47: Mastering Geospatial Metadata with FME

FME 2012 World Tour

http://fme.safe.com/content/FME-2012-World-Tour

Twitter Hashtag: #FMEWT