WMO 1 WMO Regional Association V Fifteenth Session Bali, Indonesia 30 April – 6 May 2010 Proper...
85
WMO 1 WMO Regional Association V Fifteenth Session Bali, Indonesia 30 April – 6 May 2010 Proper Data Management Responsibilities to Meet the Global Ocean Observing System (GOOS) Requirements Dr. William Burnett Data Management and Communications U.S. NOAA/National Data Buoy Center Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
-
Upload
lily-kelley -
Category
Documents
-
view
212 -
download
0
Transcript of WMO 1 WMO Regional Association V Fifteenth Session Bali, Indonesia 30 April – 6 May 2010 Proper...
WMO
1
WMO Regional Association VFifteenth Session
Bali, Indonesia30 April – 6 May 2010
Proper Data Management Responsibilities to Meet the Global Ocean Observing System (GOOS) Requirements
Dr. William Burnett
Data Management and Communications
U.S. NOAA/National Data Buoy Center
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
2
NOAA and Climate/Ocean ObservationsNOAA and Climate/Ocean Observations
• There is an increasing demand for global climate change & ocean information, There is an increasing demand for global climate change & ocean information, services and products – this includes observations from the Indonesian GOOS services and products – this includes observations from the Indonesian GOOS (InaGOOS) and the Indian Ocean equatorial array (RAMA),(InaGOOS) and the Indian Ocean equatorial array (RAMA),
• Partnerships enhance ocean observations in the region and also build the regional Partnerships enhance ocean observations in the region and also build the regional capacity to apply these observations to understand climate risk management, coastal capacity to apply these observations to understand climate risk management, coastal resilience, ecosystems, MPAs, and other socio-economic benefits,resilience, ecosystems, MPAs, and other socio-economic benefits,
• NOAA is interested in advancing a strong, equitable and mutually beneficial NOAA is interested in advancing a strong, equitable and mutually beneficial collaboration with Region V for capacity building, socio-economic applications and collaboration with Region V for capacity building, socio-economic applications and ocean observations in the region, andocean observations in the region, and
• Training & education is important for countries building the next generation ocean Training & education is important for countries building the next generation ocean observatories. NOAA is pleased to be able to provide USA training & educational observatories. NOAA is pleased to be able to provide USA training & educational opportunities through Memorandums Of Understanding or Agreements.opportunities through Memorandums Of Understanding or Agreements.
WMO
3
International Cooperation
Formal bilateral agreements between NOAA and agencies in: Indonesia--signed in 2007
India--signed in 2008
Japan--signed in 2008
France--planned in 2009
ASCLME (9 East African countries)
Tsunami/RAMA cruise
RV Baruna Jaya III Sept 2007
WMO
4
87%
Total in situ networks October 200761%
59%
81%
62%73%34%48%
The Initial Global Ocean Observing System for Climate Status against the GCOS Implementation Plan and JCOMM targets
100%
100%
MilestonesDrifters 2005
Argo 2007
WMO
5
RAMA: Implementation Status
Resource Formula:
Partners provide ship time
NOAA provides most equipment
57% of sites occupied by March 2010 (26 of 46)
WMO
6
NOAA’s Contributions to Indonesian GOOS (InaGOOS)
NOAA is developing a replacement for the ATLAS system Measurements comparable to ATLAS Use more commercially available components Prototype deployment targeted for October 2010 Deploy near existing ATLAS RAMA moorings for comparison As per IA, 2 systems would eventually serve InaGOOS and RAMA
15-20 Days
WMO
7
Indonesia MMAF Visit to Indonesia MMAF Visit to NDBC July 2008NDBC July 2008
WMO
11
Proper Data Management
• More than just placing a meteorological, oceanographic or geophysical instrument in the water or on the land,
• More that just collecting an observation, and• More than just disseminating the data via a data portal
WMO
12
WMO Strategic Thrusts
1.Strategic Thrust –
Improving Service Quality and Service Delivery
2. Organization-Wide Expected Results –
Enhanced capabilities of Members to deliver and improve access to high quality weather, climate and water and related environmental predictions, information and services in response to user’s needs and to enable their use in decision-making by all relevant societal sectors.
WMO
13
Conclusion
Any and all atmospheric, oceanographic and geophysical observations will be considered as a “climate” or high-quality observations – and should be treated as such.
WMO
14
GCOS Climate Monitoring Principles
1. Assess impact of new systems or changes to existing systems prior to implementation. 2. Ensure a suitable period of overlap for new and old observing systems. 3. The details and history of local conditions, instruments, operating procedures, data processing
algorithms and other factors pertinent to interpreting data (i.e., metadata) should be documented and treated with the same care as the data themselves.
4. Regularly assess quality and homogeneity of data as a part of routine operations. 5. Integrate into national, regional and global observing priorities the needs for environmental
and climate-monitoring products and assessments, such as IPCC assessments.6. Maintain operation of historically-uninterrupted stations and observing systems.7. Focus on data-poor regions, poorly observed parameters, regions sensitive to change, and
key measurements with inadequate temporal resolution as high priorities for additional observations.
8. Specify to network designers, operators and instrument engineers at the outset of system design and implementation the long-term requirements, including appropriate sampling frequencies.
9. Promote the conversion of research observing systems to long-term operations in a carefully-planned manner.
10. Data management systems that facilitate access, use and interpretation of data and products should be included as essential elements of climate monitoring systems.
WMO
15
1. A quality descriptor will accompany every real-time observation distributed to the ocean community.
2. Subject all observations to some level of automated real-time quality test.3. Sufficiently describe the quality flags and quality test descriptions in the
accompanying metadata.4. Observers should independently verify or calibrate a sensor before
deployment.5. Observers should describe their method / calibration in the real-time
metadata.6. Observers should quantify the level of calibration accuracy and the
associated expected error bounds.7. Manual checks on the automated procedures, the real-time data collected
and the status of the observing system must be provided by the observer on a time-scale appropriate to ensure the integrity of the observing system.
Seven Data Management LawsSeven Data Management Laws
WMO
16
Recommendation
Region V should begin to implement proper data quality techniques into their newly developed marine observation platforms - now – before the instruments are placed in the water.
WMO
17
National Data Buoy Center
Weather Forecast Offices/River Forecast Centers
EmergencyManagers
Public
National Environmental Satellite,
Data, and Information Service
(NCDC, NODC, NGDC)
National Centers for
Environmental Prediction
NDBCData Assembly
Center
NWS Global Telecommunication
System (GTS) Operational
Bulletins
DATA COLLECTION DATA DELIVERY
IOOS PartnersPlatforms
HF Radars
Oil & Gas Platforms
NDBC& other NOAAobservations
Electrolyte to Satellite to Website
To provide a real-time, end-to-end capability beginning with the collection of marine atmospheric and oceanographic data and ending with its transmission, quality control and distribution.
Tsunami Warning Centers
Voluntary Observing Ships
WMO
19
NWS/NDBC Ocean Observing System of Systems
Weather Buoys that have in place for > 30 Years
WMO
20
NDBC’s Ocean Observing Systems
111 met/ocean buoys
4 ocean/waves buoys
49 C-MAN stations
39 DART stations
55 TAO buoys + 4 current profiler moorings
1000+ Voluntary Observing Ship vesselsRegional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
21
Standard 3m & 6m Buoys
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
22
Other NDBC Platforms: DART®
• Deep-ocean Assessment and Reporting of Tsunamis (DART)
• 39 Stations Since March 2008• ~230 Ship Days - Contract or
NOAA Vessel
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
23
Other NDBC Platforms: TAO
• Tropical Atmosphere Ocean (TAO) Climate Buoys
• 55 equatorial Pacific buoys• 4 Ocean Current Profilers• 234-278 ship days a year• Typically a NOAA vessel
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
24
24
TAO
DART
C-MAN
Weather& Hurric.
1980 1990 2000 2002 2004 2006 2008 2010
0
50
100
150
200
250
300
Growth of NDBC Observing Systems
• 49 CMAN Stations• 96 Weather Buoys• 15 Supplemental Hurricane Buoys• 55 TAO Climate Buoy Systems• 39 DART Tsunami Systems
254 Observing Systems 5 system Types with diverse sensors
~ 25 % in Severe Environments• Challenge Obtaining Ship Days
101 Observing Systems 2 system Types with similar sensors
~ 12 % in Severe Environments• USCG Provided all Ship Days
• 51 CMAN Stations• 50 Weather Buoys
1999 to 2009 - The Era of Explosive Growth
+ 300%
Tsunami
Katrina
WMO
25
• Mooring, power system, station design• System validation, analysis, evaluation• Technology refresh, prototype testing
Engineering
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
26
• Buoy repair• Mounts, cable fabrication• Sensor repair, refurbishment and calibration• System integration and testing
Station/Equipment Prep
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
27
• Field service planning• Arranging ship support• Providing dockside services• Shipping equipment worldwide• Inventory management
Logistics
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
28
• Multi-disciplined team – technicians, engineers, USCG, NOAA Corps• Worldwide dockside and at-sea repairs and testing• Buoy deployment, retrieval, exchange• Vessels of opportunity – USCG, OMAO, Commercial
Field and At-Sea Maintenance
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
29
• Oceanographers, meteorologists, IT specialists, programmers • Observations ingest, processing, analysis• Data processing and QC algorithm development for new systems• Observation dissemination and web display• Management of station configuration and metadata
Data Assembly Center
WMO
30
NDBC WIS / WIGOSData Assembly Center
• 24/7/365 support of– Data Quality Control– Communications– Operations
• Daily Operations Brief• More than 700 stations
currently supported– NDBC Buoys– NDBC C-MAN Stations– NOS Stations– DART– TAO– VOS– Partner Stations
WMO
31
Hurricane/DART Cruise 2010 M/V HOS MYSTIQUE
Team: Artalona, Kendrick, Obenhaus, Stinson, Tretbar
Winds: WNW 15-25 kt Scattered Showers
Wind waves: 3-5 ft Swell: Negligible
23 Apr23 Apr Service 41048Service 41048
Winds: VAR 5-10 kt
Wind waves: 1-2 ft Swell: N 5-7 ft @ 8-9 sec
24 Apr24 Apr En route to 41047En route to 41047
Winds: S 10-15 kt
Wind waves: 2-3 ft Swell: NNE 3-4 ft @ 9-10 sec
25 Apr25 Apr En route to 41047En route to 41047
Winds: SW 15-20 kt
Wind waves: 3-5 ft Swell: NNE 3-4 ft @ 9-10 sec
26-27 26-27 AprApr
Service 41047Service 41047En route to 41046En route to 41046
WMO
32
22%
3%
25%
50%
Mission
Reimbursable
NWLON
IOOS Partners
Active reimbursable partnersNational Marine Sanctuary Program Kennedy Space CenterU.S. Marine Corps Goddard Space Flight CenterArmy Corps of Engineers U.S. Coast Guard
NOS/NWLON and other NOAA Obs Independent IOOS observing partners
Gulf of Maine Ocean Observing System Stevens Institute (NJ) International SeaKeepers Society Long Island Ferry Boat University of South Florida Louisiana State University Texas General Land Office University of Connecticut Louisiana Universities Marine Consortium UNC and UNC-W Skidaway Institute of Oceanography Caro-COOPS Scripps Institution of Oceanography Forrest Oil Chesapeake Bay Observing System Shell Oil Monterey Bay Aquarium Research Inst Oregon State University University of Southern Mississippi
NOAA/NDBC Data Assembly Center
0
2
4
6
8
10
2003 2004 2005 2006 2007 2008 2009
Mil
lio
n o
f O
bs
erv
ati
on
s Total Observations flowing through DAC
WMO
33
Number of IOOS Number of IOOS Partner Stations Partner Stations ReportingReporting
NOS Availability
Reporting 207
Missing 15
0
5
10
15
20
25
30
35
40
45
50
GoM
OO
SM
YSO
UN
DLI
S F
ER
RY
STEV
ENS
DC
PU
SAC
E
CB
Inte
rpra
tive
CBO
SC
ORM
P
CAR
O-C
OO
PSU
SCN
MS
CO
MPS
DAU
PHI
N SE
A LA
BU
SMLU
MC
ON
LSU
WAV
CIS
MA
RINE
R E
NER
GY
TABS
TCO
ON
SHE
LL O
ILN
WS
Cen
tral
NW
S E
aste
rnG
LER
LU
MIC
HM
BAR
IC
ICO
REO
R-C
OO
SU
HAW
AII
SCR
IPPS
CD
IPN
ERR
S W
QN
ERR
S M
et
PR S
eism
ic N
etIC
ON
NW
S A
lask
anW
oods
Hol
eD
IMA
R/CC
CP
MA
REX
Ever
glad
es N
.P.
KAU
STBP
Inc.
EPA
/ Gov
t. of
Mex
ico
Petro
bras
USA
Exp
ecte
d N
um
ber
of
Sta
tio
ns
Reporting Missing
WMO
34
U.S. IOOS Partner Support
Providing real-time quality control information to IOOS Partner Platforms... Including QC flags and analyst comments via the website.
http://www.ndbc.noaa.gov/pstat.shtml
WMO
353535
Web Pages ViewedWeb Pages Viewed Apr 2010 - June 2010 Web Pages ViewedApr 2009 - June 2009 Web Pages Viewed
0
500000
1000000
1500000
2000000
2500000
3000000
3500000
4000000
4500000
`
WMO
36
WIGOSRegional Marine Instrument Center
Joint WMO-IOC Technical Commission for Oceanography and Marine Meteorology (JCOMM) Regional Marine Instrument Center (RMIC) Training Workshop on April 13-15, 2010 for WMO Regional Association IV (RA-IV) at NDBC. Representatives from ten countries participated in this first Workshop. Countries represented were: Bahamas, Costa Rica, NL Antilles, Guatemala, Belize, Canada, France, Barbados, Morocco, and China.
WMO
38
OceanSITES Data Management
Cronin Send Pattabhi McPhaden
WHOIMBARI
PI
DA
C
UserRequests
Observations in any format – may or may not be quality controlled
IFremer
GD
AC
Provides access to data, checks formats
EuroSITES
Formats observations and provides QC
NDBC
•Maintains specific OceanSITES platforms,•Determines what observations are released to GTS, •Assures that the platform is available and provides reliable information, •Provides the DAC with the observations in any format the DAC is willing to take, and the metadata necessary to serve as an OceanSITES platform, and•QC post-recovery data according to OceanSITES agreed procedures.
•Sets up the OceanSITES server according to the approved specifications,•Guarantees data availability from the PI,•Translates the data to the OceanSITES format,•Quality Controls real-time data according to the minimum OceanSITES agreed procedures,•Provides the observations via the GTS (if requested by the PI),•Provides the data on a FTP server for access by the GDACs
•Provides centralized access to the DAC data•Ensures no data are excluded at the GDAC level, and full high-frequency data sets are available, •Keeps only the best version of the data. Additional products like interpolated data are separate optional sets,•Check all files daily using the “File Checker” software, •Maintains the OceanSITES catalogue, and •Synchronizes the catalogues with the second GDAC periodically ( at least daily).
FTP, Flash Drive, CD
FTP
FTP
Technical Coordinator
WMO
39
“WIS-Data Discovery, Access and Retrieval (DAR)” Overview
SOS(Sensor
ObservationService)
Table ofContents
Metadata
Data ValuesData
Provider
Metadata
QualityControl
Observations
WMO
40
International Tsunameter Data Assembly Center
The worldwide tsunami observation network also requires a real-time, data assembly center to provide continual monitoring and quality control of Deep-ocean Assessment and Reporting of Tsunamis (DART®) water pressure/height observations. The Data Assembly Center monitors the various real-time transmission of DART® messages depending on the operating mode of the bottom pressure recorder.
Transmission of real-time water level heights occurs when the tsunami detection algorithm is triggered by a seismic event, when interrogated by the NOAA Tsunami Warning Centers (TWCs) or NDBC, or at pre-scheduled intervals.
http://www.ndbc.noaa.gov/dart.shtml
WMO
41
Tropical Atmosphere Ocean Data Assembly Center
•Processing of Automated Distribution Service messages from Service Argos. It uses both the TAO calibration database and calibration files to convert raw data to engineering units and also calculates buoy positions. An automated real-time QC is performed for gross error checking and then the TAO database is updated with the corrected data.
•The TAO Real-time Data Monitoring Subsystem supports daily, weekly, and monthly QA/QC activities by providing on-demand data checking functionality to the DAC. In addition to the automated gross error checking, the real-time data monitoring subsystem provides on-demand reports for once-daily, thorough examination of all current buoy data and detailed review of the real-time data.
http://tao.noaa.gov
WMO
42
U.S. Voluntary Observing Ship (VOS)The United States Voluntary Observing Ship Project MissionThe mission of the Voluntary Observing Ship (VOS) project is two-fold: (1) to collect and disseminate critical real-time maritime weather observations through the recruitment and support of ships to fulfill National needs and International agreements supporting commerce, forecasts and warning programs, and the Safety Of Life At Sea (SOLAS) worldwide, and (2) to define the global climate and help measure extreme weather events, climate variability, and long-term climate changes. VOS operates at no cost to the vessel, with communication charges, observing equipment and reporting supplies furnished by the National Weather Service.
Port Meteorological Officers
Port Meteorological Officers (PMOs) support observing programs aboard Voluntary Observing
Ships. They are responsible for recruitment of new vessels as observers, and also for ensuring the
quality of observations from vessels actively participating in the program.
http://www.vos.noaa.gov
WMO
43
NDBC became the National HF Radar Node on 28 February 2007. NDBC will receive HF Radar radials from all HF radar sites and generate vectors.
High Frequency Radar
http://hfradar.ndbc.noaa.gov
WMO
44
Apply quality control to real-time ADCP data from deep-water oil platforms and rigs.
Oil and Gas Partners
http://www.ndbc.noaa.gov/maps/ADCP_WestGulf.shtml
WMO
46
NDBC High Level Data Flow
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
47
• 10 Gigabit Ethernet technology that delivers multi-gigabit bandwidth to all resources while maintaining a 100% uptime status. • Designed around high-end enterprise class systems. Minimum standards include Dual-Core 1.8Ghz systems, 4GB RAM, redundant Gigabit network interface cards, and redundant power.
NDBC Data Center
WMO
48
Primary Data Sources
Data Feed Type Data Received
Geostationary Operational Environmental Satellites (GOES)
Weather Buoy, C-MAN, Forecast and VOS
IRIDIUM Satellite System/Router Based Unrestricted Digital Interworking Connectivity Solution (RUDICS)
DART Data
IRIDIUM Satellite System/Department of Defense (DoD)/Short Burst Data service
Hurricane buoys, TAO refresh, AIS data, limited weather buoy
Service ARGOS, Inc. (ARGOS) satellite system Buoy positioning via LUT, TAO legacy data
Integrated Ocean Observing System Participants (IOOS)
Partner data via FTP and XML
HF Radar High Frequency Radar Data
GTS/GODAE Non-NDBC marine observation data in support of the web and OSMC
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
49
Basic Real-time Processing and Web System
Silver Spring, MD
NWSTG at Silver Spring, MD
INTERNET
NDBC at Stennis Space Center, MS
RT01
GATECOMMS02
SS01 SS02
WEB03-04DODS
WEB01
DB01
NOAANet
NDBC-LOAD
NDBC DMZ
NDBC LAN
The Basic Real-time Processing and Web System
COMMS01
NESDIS
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
50
Tsunameter Data Flow
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
51
Iridium SBD Argos ADS NWSTG GTS
Real-time Data Ingest and Dissemination
Database and File Management
Public Web Presentation
De
laye
d M
od
e A
na
lysis
Co
nso
le In
terfa
ces
DA
C A
na
lysts
Public Users
Automated QC and Alerts
Scie
ntists
TAO Data System Architecture
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
52
Ocean Surface Currents- speed and direction
HF Radar Stations located along US Coast
NDBC processes FTP transmissions and displays vectors on NDBC Web site via the WWW
http://hfradar.ndbc.noaa.gov/
WMO
53
RegionalObservatories
Public
ftp*
* Via XML formatted files or the NDBC Meteorological and Oceanographic Data Exchange Module (MODEM) Kit - request from [email protected]
Partner Data Processing
NDBCDial-A-Buoy
NDBCDial-A-Buoy
Wx. ChannelLocal MediaWx. ChannelLocal Media
WMO
54
Data Quality at NDBC 1970s - 2005
• Started with NDBC in 1970s• Focus on “Top Five” Wind Direction, Wind Speed, Atmospheric Surface Pressure, Air Temperature and Waves
• Algorithms perform check at NWS Gateway• Quality Assurance Group at NDBC provided daily check ofmarine observations – usually8 hours to two days afterdissemination• Approx. 110 platforms
WMO
55
Data Quality Control:The Last Line of Defense, after…
• Sensor Evaluations
• Individual Sensor Calibrations
• Payload Software Testing
• Burn-In
• Data Evaluation at deployment
• Partner Data?
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
56
Quality Control of Observations• No QC Done Onboard the Buoy or C-MAN• Automated QC Done in Real-Time at NWSTG• Hard-flags:
– Stop the Release and Archive of Data unless Analyst Overrides.
• Override in advance – Storm Limits, or• Remove before archive
• Soft-flags: Climatology-based, Advisory• Handbook of Automated Quality Control Checks and
Procedures of the National Data Buoy Center• http://www.ndbc.noaa.gov/
NDBCHandbookofAutomatedDataQualityControl2009.pdf
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
57
Moored Buoy Observations
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
58
Quality Control Process Flow
• Real-Time:– System Parameters (e.g., power)– Message Integrity – Automated Hard-Flag– Automated Soft-Flag
• Post-Release, Pre-Archive: Data Analyst
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
59
Hard-Flagsby hierarchy - highest to lowest:
• T Transmission parity error• M Missing sensor data• W Wave message is short, checksum or parity errors.• E Spectral Density are exceeded or are in error • D Delete measurement (“permanent failure”)• S Invalid statistical parameter (e.g., mean > max)• V Failed time continuity. • L Failed range (climatological) limits• R Related measurement has failed a hard QC check
(e.g., WVHGT fails → Periods failed).
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
60
Soft-flags for Waves
• a: Measurement is above monthly, regional limit.• b: Measurement is below monthly, regional limit.• c: Measurement has been adjusted, or corrected. • f: Measurement failed hourly time continuity. • m: High frequency spikes detected in the wave spectrum.• p: Failed wave height to wave period comparison test.• q: Swell direction is from an improbable direction. • w: Failed wind direction verses wave direction check.• x: Wind wave energy is too high for prevailing wind
speed.• y: Wind wave energy is too low for prevailing wind speed.
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
61
It all happens at the NWSTG
Most other organizations: NWSTG is a big router
For up to5 minutes
WMO
62
Why we halt the data at NWSTG
• Needed to process waves • Data can be corrected:
– Can recover incorrect payload parameters– Sensor offset or position drift
• Quality Control• Add computed fields • Assign WMO code forms, routing
identifiers
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
63
Configuration Control Filefor Each Station:
• GOES ID
• Codes and Routing Identifiers
• Test or Operational Mode
• Sensors Failed
• Sensor Hierarchy
• Sensor Scaling
• Station and Sensor Elevations
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
64
Derived Measurements
• Pressure Tendency & Trace Characteristic
• Extrapolated 10- and 20-m wind speeds
• Swell and wind wave estimates
• Wind Chill
• Ice Accretion
• Heat Index
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
65
Output Formats• FM-13 for moored buoys
• C-MAN code for coastal stations:– National code, but well-suited for coastal
obs.– Contains water level & waves– Based on FM-12 land synoptic code
• FM-64 TESAC (temp., salinity, current profiles)
• FM-65 WAVEOB (spectral wave data)
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
66
Real-Time Quality Control
• Purpose: Remove gross errors • Data rejected: Virtually certain to be degraded• Typical causes: Transmission errors, power
degradations, broken cables• Limitations: Won’t detect minor errors, biases
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
68
Limit Checks
• Classic way of catching a sensor that “pegs”.• However, extreme, but valid, data has been
withheld.• Climatology based• Can be overridden before expected storm
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
69
Time Continuity Check
• Dependent on time since last valid observation.• Max. allowed value = 0.58*Std.dev.*SQRT(TimeDiff)• Works well for normally distributed measurements• Std. dev. Chosen 50% higher climatic standard dev.
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
71
Time Continuity Check
• Maximum allowable values in one hour:– Sea level pressure 12.2 hPa– Air Temperature 6.4 deg. C– Water Temperature 5.0 deg. C – Wind Speed 14.5 m/s– Wave Height 3.5 m
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
72
If data fails time continuity,it may still be released if:
• Pressure: Both pressures < 1000 hPa• Wind Speed: Both pressures < 995 hPa or it
agrees within 2 m/s of duplicate• Air Temperature: Either wind speed > 7 m/s or
wind direction change > 40 deg.• Wave Height: Current wind speed > 15 m/s• Manually disabled in front of a hurricane
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
73
Internal Consistency Checks
• If battery voltage < 10.5 V, pressure not released.• Significant wave height and dominant period set to
zero if significant wave height < 0.25m. Without this, large periods can result from nearly calm seas.
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
74
Internal Consistency Checks
• If dew pt. > air temp, set dew pt. = air temp. (RH can read slightly more than 100%)
• If ratio of gust to wind speed > 4, don’t send wind speed or gust.
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
75
Post Release Man-Machine Mix• Pre-done Graphics produced:
– Flagged data first– Then all data
• Tools:– Time series plots– Spectral Wave Curves– Wind Wave scatterplots– Surface weather plots
Regional Association V, Fifteenth Session, Bali, 30 April – 6 May 2010
WMO
84
Data MonitoringWhat does the future hold?
• Implementing new Unidata WX analysis software with improved vis. tools
• Look at only suspect or bad data - real time QC associated with a database - more sophisticated logic in algorithms,
extended trend analysis - model fields used in real met and wave QC• Flags assigned based on quality score• Distribute and archive data with flags
