Geographic Information Systems and Geospatial Metadata CSCI 373: Advanced Database UNC Asheville...
Transcript of Geographic Information Systems and Geospatial Metadata CSCI 373: Advanced Database UNC Asheville...
Geographic Information Systems and Geospatial Metadata
CSCI 373: Advanced Database • UNC Asheville • April 27, 2006
Lynda Wayne US Federal Geographic Data Committee / GeoMaxim
CSCI 373 GIS and Geospatial Metadata 20060424
What so special about spatial?
Geospatial Data Components:
entities and attributes
CSCI 373 GIS and Geospatial Metadata 20060424
What so special about spatial?
Geospatial Data Components:
location
CSCI 373 GIS and Geospatial Metadata 20060424
What so special about spatial?
Geospatial Data Components:
extent
or
‘geographic footprint’
most data IS geospatial….
CSCI 373 GIS and Geospatial Metadata 20060424
How does GIS enable geospatial data?
Geographic Information Systems: capture
display
analyze
manage
geospatial data
esri.com
CSCI 373 GIS and Geospatial Metadata 20060424
GIS Functions
Geospatial data capture and display:entities/attributes via a database
location via a coordinate/referencing system
extent via graphic objectsarcs
nodes/points
polygons
grids
esri.com
CSCI 373 GIS and Geospatial Metadata 20060424
GIS Functions
Geospatial data analysislocation and extent enable entity/attribute:
Multi-level analysis:coincidence
deviation
proximity
temporal patterns
Graphic developed by Kenneth E. Foote and Margaret Lynch, Department of Geography, University of Texas
CSCI 373 GIS and Geospatial Metadata 20060424
GIS Functions
Geospatial data analysislocation and extent enable entity/attribute:
Single-level (feature) analysiscontiguity
dispersion
spatial patterns
CSCI 373 GIS and Geospatial Metadata 20060424
GIS Functions
Geospatial data analysis
location and extent enable entity/attribute:
Feature characterizationsize
shape
smoothness
salient points
CSCI 373 GIS and Geospatial Metadata 20060424
GIS Functions
Geospatial data management access
share
assess
use
update
organize
geospatial data
CSCI 373 GIS and Geospatial Metadata 20060424
What is geospatial metadata?
Data ‘reporting’ WHO created the data?
WHAT is the content of the data?
WHEN was it created?
WHERE is it geographically?
HOW was the data developed?
WHY was the data developed?
CSCI 373 GIS and Geospatial Metadata 20060424
What is geospatial metadata?
title
supplemental information
abstract
time period
author
sources
(file) size
CSCI 373 GIS and Geospatial Metadata 20060424
What is geospatial metadata?
entity
attributes
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata as a Data Component
MetadataTitleOriginatorPurposeAbstractGeographic ExtentTime Period of ContentSources UsedProcess DescriptionPositional AccuracyEntities and Attributes…….
phenomenaphenomena map / image / databasemap / image / database metadatametadata
abstraction abstraction
content context
DATA
CSCI 373 GIS and Geospatial Metadata 20060424
DATA
map
(con
tent
)m
etadata
(context)
Metadata as a Data Component
access
share
use
• search• download
• describe• publish
• assess• apply
Data Management
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata the Awful
Geospatial Data Producers perceive metadata as:
time consumingexcessivefor the benefits of others
Geospatial Managers perceive metadata as:
non-productivecostly (time, training, software)
derive classify
collect
planimetric imagery
analysis
alternativecommittee
review
PLAN
charette
metadata?
metadata?
metadata?
metadata?
metadata?
metadata?
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata the Magnificent
Metadata can support:data management
project management
If it is:considered a component of the data
created during data development
populated with rich content
derive classify
collect
planimetric imagery
analysis
alternativecommittee
review
PLAN
charette
meta
meta
meta
meta
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management via Metadata
DataAccountability
Discovery
& Re-use
Maintenance
& Update
DataLiability
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Maintenance and Update
MaintenanceAre the data current?
• older than?• prior to significant change?
Are the data valid?• newer sources?• better methods?
UpdateContact informationDistribution policies, availability, pricingURLSNew derivations
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Discovery and Re-use
Marketing metadata in the past…
If you create metadata, other people can discover your data
If you create metadata, you can find your own data
New and improved message…
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Discovery and Re-use
Data discovery bythemes / attributes
geographic extent
temporal character
methods
sources
quality
Discoverable data is usable data
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Accountability
Exercise in data comprehension:
What do you know?
What don’t you know?
What should you know?
Are you willing to associate yourself with the metadata record?
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Accountability
Repeatable process:methodsvariablesparameters
Defensible process:public participationdecision-making
GIS-savvy public
Metadata can be crafted to preserve individual accountability in team projects
CSCI 373 GIS and Geospatial Metadata 20060424
Data Management:Data Liability
Metadata is declaration of:Purpose
originator’s application of the data? ontological pedigree ?
Use Constraintsappropriate and inappropriate utility of the data
Completenesswhat is missing from the data
Distribution Liabilityexplicit liability of the producer and assumed liability of
the consumer
What to do…
What not to do…
CSCI 373 GIS and Geospatial Metadata 20060424
Project Management via Metadata
PROJECTPLANNING
DELIVERABLES
COMMON LANGUAGE
PROJECT MONITORING
CSCI 373 GIS and Geospatial Metadata 20060424
Project Management:Project Planning
Project design document:description / intentgeo & temporal extentsource dataattribute requirements
Benefits:expectations outlinedintegrated into processprovide medium to record progress
CSCI 373 GIS and Geospatial Metadata 20060424
Project Management:Project Monitoring
Monitor:
status
QA/QC measures
changes
Requires that the metadata be actively maintained and reviewed.
time
mile
ston
es
CSCI 373 GIS and Geospatial Metadata 20060424
Project Management:Common Language for Multi-participants
Common reference for:descriptors & parameterskeywords, vocabularies & thesauricontact informationattributesdistribution information
If reviewed regularly by all participants,improved opportunity for coordinating:
source dataanalytical methodsnew information
tem
plat
e
CSCI 373 GIS and Geospatial Metadata 20060424
Project Management:Contract Deliverables
Metadata is a data component therefore part of any data deliverable
Clearly specify your metadata requirement via a metadata:
classification/validation schema, e.g. ‘level’ of metadata
template
specification manual
Provide a sample record if possible
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Roles
If created with utility in mind, metadata can serve multiple roles:
and this is only human utility of metadata…
archivist preserve lineage
accountant preserve investment
developer document process
manager track progress
contributors communicate
consumer locate, assess, access data
CSCI 373 GIS and Geospatial Metadata 20060424
How do I create geospatial metadata?
To create geospatial metadata you must:
1. make metadata part of the process
2. be familiar with the US metadata standard
3. utilize a metadata editor tool
CSCI 373 GIS and Geospatial Metadata 20060424
Make Metadata Part of the Process
New tools enable us to better integrate metadata creation into the data development process
CSCI 373 GIS and Geospatial Metadata 20060424
If metadata were collected throughout the data process…
1. more accurate (no guessing)
2. more details
3. better decision-making.
Make Metadata Part of the Process
CSCI 373 GIS and Geospatial Metadata 20060424
Build templatesidentify pertinent fieldspopulate fixed fields
standardized languagedistribution methodsstandards used
build source and contact libraries
templates can be built at multiple levels: organization, project, themes….
Make Metadata Part of the Process
CSCI 373 GIS and Geospatial Metadata 20060424
Iden
tific
atio
n In
form
atio
n
• title
• abs
tract
• pur
pose
• tim
e pe
riod
of c
onte
nt
• key
words
• com
plet
enes
s
Attrib
ute
Info
rmat
ion
• attr
ibut
e la
bels/
dom
ains
Data
Qua
lity
Attrib
ute
Info
rmat
ion
• com
pila
tion
accu
racie
s
• com
pila
tion
proc
esse
s
• sou
rce
files
• fie
ld c
heck
acc
urac
ies
• ana
lytica
l pro
cess
es• a
ttrib
ute
valu
es
Data Processing Data Planning Data Analysis
manager technicians analysts
Map metadata to the workflow
Make Metadata Part of the Process
CSCI 373 GIS and Geospatial Metadata 20060424
Establish policiesmandate use of standards and templates
develop boilerplate metadata deliverable language for data contractors
include metadata as a performance measure
require units to publish their metadata
publish metadata SOP to document policies and procedures
Make Metadata Part of the Process
CSCI 373 GIS and Geospatial Metadata 20060424
Content Standard for Digital Geospatial Metadata (CSDGM)imagery digital land surveys
GIS files geographic databases
required for use by:federal agenciesfederally-sponsored researchsome state/county/city governments
info at:http://www.fgdc.gov/metadata/
US Federal Metadata Standard
CSCI 373 GIS and Geospatial Metadata 20060424
CSDGM Overview
Organized into seven primary sections:
1. Identification InformationGeneral bibliographic information including:
title, originator, data contact, status, date, time period of content, abstract, purpose, keywords, geographic location
2. Data Quality InformationLineage and data assessments
sources, process methods, accuracy, data processing contact
CSCI 373 GIS and Geospatial Metadata 20060424
CSDGM Overview
3. Spatial Data OrganizationData format:
vector, point, raster
4. Spatial Reference InformationCoordinate system parameters:
horizontal / vertical coordinate system, projection, datum
CSCI 373 GIS and Geospatial Metadata 20060424
5. Entity and Attribute InformationDatabase design
entities, attributes, domains, description of data values
6. Distribution InformationHow to acquire the data
distribution contact, available formats, online distribution website, costs
CSDGM Overview
CSCI 373 GIS and Geospatial Metadata 20060424
CSDGM Overview
7. Metadata Reference InformationGeneral information about the metadata record itself
metadata contact, metadata standard used, metadata creation date, metadata review date
CSCI 373 GIS and Geospatial Metadata 20060424
CSDGM Overview
But that wasn’t enough for some people...
Extensions:added elements to the CSDGM
• Remote Sensing Extension
Profilescontent requirements for specific elements
may included added elements as well• Biological Profile
• Shoreline Profile
CSCI 373 GIS and Geospatial Metadata 20060424
Transition to ISO Metadata
Standardized Metadata
Content Standard for Digital Geospatial Metadata (CSDGM) Vers. 2.0
remains current US standard
International Geospatial Metadata Standard (ISO 19115)
standard completed
US (ANSI) adoption in progress
CSCI 373 GIS and Geospatial Metadata 20060424
1. Content
CSDGM similar and new elements
Domains and conditionality
Essential or core metadata
2. Format
UML / XML
Multi-level metadata
What’s new with ISO metadata?
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Tools
How do I determine the best metadata tool?Does your organization provide a tool?Does your GIS software provide an internal editor?Do you use a CSDGM Profile or Extension? Do you need to document data resource beyond those managed within your GIS? Do you need a tool that is easily distributed to partners? What features are most important to you?
auto-capture of information bundling of metadata with data creation and use of templates easy to use interface robust help systems and tutorials
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Tools
What metadata editors are available?Freeware
tkme/xtmeUSGS, supports all profiles/extensions, well-maintained
MetaVistUSFS, desktop, supports biological profile
MERMAidNOAA CSC, online utility supports biological and shoreline profiles
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Tools
What metadata editors are available?Commercial
SMMS (Intergraph GeoMedia and stand-alone)
auto capture from multiple file types, contact/source libraries, data exploration utilities
ArcCatalogmetadata ‘synchronized’ w/data, ability to enclose
documents, metadata bundled with data export
Blue Angelhighly customizable, supports non-geospatial metadata
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Tools
What other metadata tools are available?Parsing and Validation
Metadata Parser (mp)checks for conformance to CSDGM specified:
• conditionality (are all mandatory elements are populated?) • data formats • element domains
mp batchbatch processor shareware from Intergraph
Chew N Spit (cns)• Rectifies indentation• Inserts capitalization and underbars
FGDC ‘compliant’ metadata must pass mp!
CSCI 373 GIS and Geospatial Metadata 20060424
Metadata Tools
What other metadata tools are available?Conversion
error2htmprovides user-friendly interpretation of mp error report
dbfmetaconverts dbase to CSDGM Entity Attribute elements
mq provides interface for editing large, diverse collections of
metadata
CSCI 373 GIS and Geospatial Metadata 20060424
How is metadata used to distribute geospatial data?
Geospatial data portals, online systems and catalogs:Geospatial One-Stop US Federal geospatial data portal
NC OneMapState geospatial data portal
Buncombe County GISCounty GIS
National Biological Information InfrastructureThematic Metadata Catalog
CSCI 373 GIS and Geospatial Metadata 20060424
Geospatial OneStop http://www.geodata.gov
CSCI 373 GIS and Geospatial Metadata 20060424
NC OneMap http://www.NCOneMap.org
CSCI 373 GIS and Geospatial Metadata 20060424
Buncombe County GIS http://www.buncombecounty.org/governing/depts/GIS
CSCI 373 GIS and Geospatial Metadata 20060424
NBII Metadata Catalog http://mercury.ornl.gov/nbii/
CSCI 373 GIS and Geospatial Metadata 20060424
Future Role of Metadata
External Utility
distribution role will be limited to exact vs. general queries with improvements to context-based search utilities (MetaCarta)
Internal Utility
management role will increase with shift to OOP-based GIS (hierarchy, relations, etc.)
Geospatial Metadata is a GIS Best Practice
CSCI 373 GIS and Geospatial Metadata 20060424
Questions?
Lynda [email protected]
FGDC Metadata Website www.fgdc.gov/metadata
ESRI GIS Primer http://www.gis.com/whatisgis/