Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center...

15
Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center [email protected] AGU, Spring 2008

Transcript of Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center...

Page 1: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Metadata forData Understandability

Ted HabermannNOAA National Geophysical Data Center

[email protected], Spring 2008

Page 2: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Mandatory Responsibilities for an Archive1. Negotiate with Producers.2. Obtain control of the information.3. Define Designated Community.4. Ensure that the information to be preserved is

Independently Understandable to the Designated Community. In other words, the community should be able to understand the information without needing the assistance of the experts who produced the information.

5. Document preservation policies and procedures.

6. Make information available.

CCSDS Open Archival Information System Reference Model (now an ISO Standard)

Page 3: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Role of Documentation

WWW - 1990's

Discovery

Understanding

Discovery

Understanding

Discovery

Understanding

Before 2000's

Role of Metadata

Page 4: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Metadata Gap

ID Q SO SR E/A D M0

100

200

300

400

500

600

# M

eta

data MetadataGap

Page 5: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

FGDC with Remote Sensing Extensions

Spatial Reference

DistributionInformation

Metadata ReferenceInformation

Metadata

Base Standard

IdentificationInformation

Data Quality

Spatial DataOrganization

Entity & Attribute

Information

RSE Standard

InstrumentInformation

Mission &Platform

Information

RSE RSE

RSERSERSE

Page 6: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Question #1

New Standard Emerges:

What is the minimum that I need to do to conform to this standard?

What is the most that this standard can do for me?

Essentially a yes/no answer, a list of metadata elements.

Depends on 1) understanding of the standard and 2) ingenuity..

Page 7: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Metadata Team

Data Provider

Direct Users

MetadataManager

DesignatedCommunity

(ArchiveUsers)

Partnership DataManager

Archive

High quality metadata involves active partnerships between many team members.

Partnership

Page 8: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Lamont Multibeam Data at NGDC:Identifying Scientific Papers & Cruise

References to Scientific Papers

Cruise = Platform & Mission

Page 9: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Lamont Multibeam Data at NGDC:Survey Parameters

Detailed Entity and Attributeinformation aboutMultibeam Bathymetry,Multibeam Amplitude, Multibeam Sidescan

Page 10: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Lamont Multibeam Data at NGDC:Instrumentation Information

Metadata section that describesinstrumentation.

Page 11: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

DART Data at NGDC:Instrumentation Information

Metadata section that describesinstrumentation.

Page 12: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Atmospheric Pathfinder at CLASS:Mission History

Metadata for platforms and mission

Page 13: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Generating ISO Metadata

RichInventory

MADIS TrackingNMMR

Existing Quality Resources

Existing Metadata Resources

ISO Generator

ISOMetadata

RESTViews

Existing quality resources are queried using a web service (REST) for the “beef” of the quality report. The “bun” is provided from views into existing FGDC or new ISO sources. These two are combined into a complete ISO report.

The “Beef”

The “Bun”

Page 14: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

Metadata for UnderstandabilityRequires an Active Partnership

Data Provider

Direct Users

MetadataManager

DesignatedCommunity

PartnershipData

Manager

Archive

Partnership

Data Providers

+ Archives

+ Users

= Understandability

Page 15: Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center Ted.Habermann@noaa.gov AGU, Spring 2008.

More Information

More Examples http://www.ngdc.noaa.gov/metadata/published

ISO Ideas: http://www.ngdc.noaa.gov/presentations

[email protected]