U.S. Climate Reference NetworkU.S. Climate Reference NetworkPart 4: MetadataPart 4: Metadata

Jeff ArnfieldNational Climatic Data CenterAsheville, NC

CRN Metadata: the authorsCRN Metadata: the authors

Jeffrey D. Arnfield National Climatic Data Center

Claude E. Duchon University of Oklahoma

C. Bruce Baker National Climatic Data Center

Robert G. Quayle National Climatic Data Center

Richard R. Heim Jr. National Climatic Data Center

Kevin D. Robbins Southern Regional Climate Center

Michael J. JanisSoutheast Regional Climate Center

Andrew H. Horvitz National Weather Service

CRN Goals

Leading edge climate monitoring for 21st century

Improve quantification & detection of climate change

Place climate anomalies and extreme events into historical perspective

ApproachApproach Build on experience from current observation and

analysis systems and climate research

Take best advantage of modern equipment and methods

High quality data records are central

Detailed metadata are crucial to establishing and interpreting data records

What else do you need to know?What else do you need to know?

42.000

The information chainThe information chain

Information requirementsSpecifications & procedures

Installation &

MaintenanceSampling & Averaging

Network Administration Observations

Transmission

Data Handling Product Creation Information access

Learning from the pastLearning from the past Need a precise, comprehensive view of every link in the

information chain at any point in time, and previous versions of information and their effective dates must be accessible

Every aspect of an observing system can change over time

Seemingly small changes can be significant

Information system requirements evolve

Key system characteristicsKey system characteristics

Flexible, extensible design to accommodate changing information requirements

Oracle relational database engine to manage the data and business rules

Metadata available via the WebUser interface should require minimal

training, installation and administration

Metadata of interestMetadata of interest

Traditional Metadata Station identity Latitude, Longitude,

Elevation Instrumentation Equipment exposure

information Observer

Expanded Metadata Digital images Instrument specifications Calibration and service

procedures and history Sampling and validation

procedures Processing and quality control

algorithms Network administration

information Historical versions of values

Metadata subject areasMetadata subject areas Station identification,

location & operation Station equipment

and maintenance Equipment

specifications and service procedures

Pre-transmission sampling and averaging procedures

Data transmission system and procedures

Data handling procedures & systems

Derivative data products

Network administration information

Names Identifiers from various

networks Latitude & longitude in

decimal degrees from GPS GPS model, PDOP,

observation date & time Elevation above mean sea

level Geopolitical location

– State, county, MSA, city... Driving instructions

Station identification & locationStation identification & location

Soil type Vegetation types & condition Exposure Digital images, including

– Digital photos– LANDSAT imagery– Aerial Imagery– Maps of area– Station layout diagram

Involved parties, with contact information

Neighboring stations

Installed equipmentInstalled equipment

Instrument make and model

Serial number Firmware version Date of purchase Horizontal location Height above

ground

Exposure details, including images as appropriate

Phenomena observed Priority

– primary, backup, etc Units & scale reported Sampling interval Reporting frequency

Installed equipment:Installed equipment: maintenancemaintenance

Scheduled maintenance and calibration Performed maintenance and calibration log

– Date & time of service– Instruments serviced– Service type– Agency & technician name– Procedures used– Results, readings & other objective measurements– Technician’s notes

Equipment specifications & proceduresEquipment specifications & procedures

Manufacturer Model Phenomena measured How the instrument

functions Sampling interval range Measurement range Resolution Accuracy Siting and installation

requirements

Digital images– Photos– Diagrams– Copy of spec sheets

Service schedule & details– Service type– Procedure description– Standard values– Schedule / frequency– Required equipment– Required expertise

Pre-transmission sampling & averagingPre-transmission sampling & averaging

Procedure description Frequency Algorithms Software & hardware used

– Version– Firmware

Input source Special notes

Data transmission system & proceduresData transmission system & procedures

Method of transmission

External communication identifiers needed– SHEF, WMO, etc

Data format transmitted

Time standard Transmission time Hardware &

software used Involved parties &

agencies

Data handling procedures & systemsData handling procedures & systems

Ingest, quality control and conversion procedures & algorithms

Constants & parameter values usedSignificant changes to observationsProcessing & storage systemsData inventory and catalog creationInvolved parties & agencies

Derivative data productsDerivative data products

Systems, procedures, algorithms usedDescriptionPeriod of recordGeographic coveragePhenomena (elements) includedProduct media and format(s)Access systems

Network administration informationNetwork administration information

Controlling agency Supporting agencies Program manager(s) Contact information, including DB manager Defining documentation Legislative authorizations Manuals Training material Standards used

Current StatusCurrent Status

Metadata requirements definedLogical system design in progressInitial station implementation underwayValidating metadata requirements and

specificationsRequirements are influencing other metadata

system development at NCDChttp://www.ncdc.noaa.gov/crn.html

How does it all fit?How does it all fit?

S tation Identifie r

LocationS erv ice R ecord

Ins talledIns trum entation N am eequ ipm ent

T ransm iss ionP ro tocol

S erv iceP rocedures

N etw ork

O pera tingP rocedures

Invo lved P arty/ Agency

D ata P roductP henom ena

conta ins

hasass igned

has

has

hasnoted

has

has

assigns

hasrecom m ende

dhas

basedon

is an

reportsus ing

m easures

usesreports

observations

from

has a

hasstandard

inc ludes

hasrela ted

has

has