CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD...

25
CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16

Transcript of CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD...

Page 1: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

CBS Ext(2014) / RA III-16TECO / RECO

WIGOS MetadataSteve Foreman, WIGOS Secretariat

For TT-WMD

WMO; CBS Ext(2014) / RA III-16

Page 2: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

2

WIGOS metadata

Context High level contents Next step

CBS Ext(2014) / RA III-16

Page 3: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Context

Page 4: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

WMO Integrated Observing System - Metadata

Aims to support Use of observations Planning observation networks

Constraints Applicable to all types of observations Acceptable to governments of all countries

WIGOS metadata

Page 5: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Principles for WIGOS Metadata

Include the information that enables users to make adequate use of observational data [also for climate applications]

Every piece of metadata shall have date/time information associated with it

All metadata associated with internationally exchanged data shall be made available

Metadata shall be updated in a timely manner to support adequate interpretation of data

Standard should be applicable to all disciplines Standard should be forward-looking but also respect legacy

(e.g., Vol. A) Standard should be acceptable to all Members Standard should be applicable for all Members

WIGOS metadata

Page 6: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Principles for WIGOS Metadata

Include the information that enables users to make adequate use of observational data [also for climate applications]

Every piece of metadata shall have date/time information associated with it

All metadata associated with internationally exchanged data shall be made available

Metadata shall be updated in a timely manner to support adequate interpretation of data

Standard should be applicable to all disciplines Standard should be forward-looking but also respect legacy

(e.g., Vol. A) Standard should be acceptable to all Members Standard should be applicable for all Members

WIGOS metadata

Explain observations

Over time

For all exchanged observations

In time to be useful

For all types of observation

Expand what we record

Achievable

Relevant

Page 7: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Page 8: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

Observed quantity

Atmospheric:

Temperature (F)

Humidity (%)

Wind (mph)

Rainfall (inches)

Visibility (miles)

High level content

Page 9: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Purpose

Urban meteorology

US domestic stations

Page 10: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Data quality

Quality flags

Page 11: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Environment

In a screen

On a rooftop platform

Page 12: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Data processing

Hourly reporting

Pressure tendency derived from manual interpretation of

barograph trace.

Hand written logs

Page 13: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Sampling and analysis

Winds averaged over ten minutes

Page 14: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Station platform

Region: IV

Country: USA

Name: New York Roof 10

Type: Land station

Id: int.wmo.wigos-0-153-3-157

Location: 40°44′54.36″N 73°59′08.36″W

Data comms: Telephone

Page 15: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Purpose

Urban meteorology

US domestic stationsEnvironment

In a screen

On a rooftop platform

Data quality

Quality flags

Method (visibility)

Visual

Standard reference landmarks

Obs Range: not available

Page 16: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Ownership

Responsible: NWS

Data policy: WMO Essential

Page 17: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

1. Observed Quantity

2. Purpose of Observation

3. Data Quality

4. Environment

5. Data Processing and Reporting

6. Sampling and Analysis

7. Station/Platform

8. Method of Observation

9. Ownership and Data Policy

10. Contact

High level content

Contact

USA Focal Point for Observations

Page 18: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

18

Tailoring the standard

Each element marked as: Mandatory

Required for all WIGOS metadata records Conditional

Required only in specified circumstances instrument calibration makes little sense for a human

observer

Optional Extremely useful, but too challenging to make

compulsory

CBS Ext(2014) / RA III-16

Page 19: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Next step

Page 20: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Considerations for WIGOS Metadata

Creating metadata Levels of detail

Transmission Various intervals for

(incremental) update

Access and use By humans (researchers,

managers, the public) By machines (services)

Rather invariant

Very dynamic

intermediate

WIGOS metadata

Page 21: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

21

Next steps

Task Team on WIGOS Metadata Development Develop data representations

Members Review systems

To capture metadata To retain existing metadata

WMO Co-ordinate sharing mechanisms

CBS Ext(2014) / RA III-16

Page 22: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

22

Phased implementation

2016 2017-18 2019-2020

Mandatory and straightforward

Conditional and straightforward

Optional and straightforward

Likely to need more data gathering or to need changes to procedures

All remaining elements

CBS Ext(2014) / RA III-16

See Doc 3.3(1) – Recommendation 3, Appendix 24

(in the file -Annex-2-…)

All WMO-No 9 Vol A elements are required in 2016

Page 23: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

Summary

Page 24: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

24

WIGOS Metadata - summary

CBS Ext(2014) / RA III-16

Explain observations

Over time

For all exchanged observations

In time to be useful

For all types of observation

Expand what we record

Achievable

Relevant

Page 25: CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16.

www.wmo.int 25

Thank you for your [email protected]

CBS Ext(2014) / RA III-16