Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005...

70
Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier (REC) for clutter detection in ORDA Mike Dixon NCAR

Transcript of Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005...

Page 1: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Technical Interchange Meeting – ROC / NSSL / NCAR

ROC / NSSL / NCAR TIM

Boulder CO

11 May 2005

Real-time time-series implementationof the Radar Echo Classifier (REC)

for clutter detection in ORDA

Mike Dixon

NCAR

Page 2: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Goal

The goal was to develop and test a version of the REC with the following properties:

• Fast and efficient for real-time operation, suitable for use in the

ORDA.

• Works with time series data, so that the algorithm has access to the

spectral domain.

• Is suitable for detecting clutter and AP.

Page 3: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Beam processing sequence

Beam 1 Beam 2 Beam3 Beam 4 Beam 5

IN

OutBeam Queue

ComputeMoments

ComputeMoments

ComputeMoments

ComputeMoments

ComputeMoments

ComputeREC

FilterClutter

FilteredMoments out

Page 4: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

REC for clutter or AP detection

• Kernel: 5 deg wide, 2 km along the beam.

• Uses the following fields:

– TDBZ - DBZ texture: squared change in dBZ from one gate to the next,

in range, averaged over the kernel.

– SPIN - DBZ ‘spin’: measure of how frequently the trend in reflectivity

along a beam changes with range. Averaged over the kernel.

– VEL: velocity at the gate.

– SDVE: standard deviation of velocity over the kernel.

– WIDTH: spectrum width at the gate.

– CLUTPROB: clutter probability, based on ratios of power near 0 m/s to

power in rest of spectrum.

Page 5: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Membership functions

0 45 1000

1

0

TDBZ SPIN

0 50 100

0

1

0 3.2

1

0

WIDTH

0 0.7

SDVE

0

1

VEL

-2.3 0 2.3

0

1

0 3 15

CLUTPROB

0

1

Page 6: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Data sets

This implementation of the REC was developed to handle time-series data in LIRP format. It was tested on the following data sets:

• KJIM, stratiform situation, non-phase-coded.

• SPOL at Boulder, convective situation, phase-coded.

• SPOL at NAME, Mexico, convective situation, non-phase-coded,

alternating-pulse dual-polarization.

Page 7: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM Case

• Non-phase-coded data

• Stratiform rain to NW

• Ground clutter

Page 8: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM dBZ

Page 9: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM Vel

Page 10: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM WIDTH

Page 11: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM TDBZ

Page 12: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM SPIN

Page 13: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM SDVE

Page 14: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM Clutter Probability

Page 15: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM REC

Page 16: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM Clutter Flag

Page 17: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM dBZ

Page 18: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM dBZ filtered

Page 19: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM VEL

Page 20: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM VEL filtered

Page 21: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM WIDTH

Page 22: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM WIDTH filtered

Page 23: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM filter everywhere

Page 24: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM dBZ

Page 25: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM dBZ filtered everywhere

Page 26: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM vel

Page 27: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

KJIM vel filtered everywhere

Page 28: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ Case - SPOL

• SZ864 decoding

• Strong mountain ground clutter

• Convective weather situation

Page 29: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ dBZ

Page 30: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ VEL

Page 31: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ WIDTH

Page 32: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ Trip flags

Page 33: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ TDBZ

Page 34: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ SPIN

Page 35: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ SDVE

Page 36: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ REC

Page 37: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ REC Clutter Flag

Page 38: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ Clutter found

Page 39: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ dBZ

Page 40: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ dBZ filtered

Page 41: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ VEL

Page 42: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ VEL filtered

Page 43: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ WIDTH

Page 44: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

SZ WIDTH filtered

Page 45: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual Polarization Case – SPOL at NAME

• Alternate-pulse dual polarization

• Strong ground clutter

• Some sea clutter at times

• Convective weather situation

Page 46: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Additional REC fields for Dual Pol

The following fields were added to the REC for the dual

polarization case:

– RHOHV – value at the gate.

– SD-ZDR – standard deviation of ZDR in range,

computed for the single beam only, no azimuth

averaging.

– SD-RHOHV – standard deviation of RHOHV in range,

computed for the single beam only, no azimuth

averaging.

Page 47: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Membership functions – Dual Pol

0 0.8 0.95

1

0

RHOHV

0 2 3

1

0

SD-ZDR

0 0.02 0.03

1

0

SD-RHOHV

Page 48: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol dBZ

Page 49: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol VEL

Page 50: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol WIDTH

Page 51: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol TDBZ

Page 52: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol SPIN

Page 53: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol SDVE

Page 54: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol ZDR

Page 55: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol SDZDR

Page 56: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol RHOHV

Page 57: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol SD-RHOHV

Page 58: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

REC – no dual-pol fields

Page 59: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

REC with dual pol fields

Page 60: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

REC FLAG – no dual-pol fields

Page 61: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

REC FLAG with dual pol fields

Page 62: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol Clutter found

Page 63: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol dBZ

Page 64: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol dBZ filtered

Page 65: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol VEL

Page 66: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol Vel filtered

Page 67: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol WIDTH

Page 68: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Dual-pol WIDTH filtered

Page 69: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Relative performance considerations

Some tests were carried out on the computer time taken by the REC and clutter filtering as compared to moments estimation.

The following table shows the number of seconds taken to compute moments, REC and filter clutter for a single PPI for each of the cases. The test machine was a 2.8GHz Pentium IV.

These numbers are useful to show the relative costs of each operation.

KJIM, filter only where

REC > thresh

KJIM, filter clutter everywhere

SZ, filteronly where REC > thresh

Dual Pol, filter only where REC > thresh

Moments estimation

3.18 3.18 9.58 8.23

REC computation

0.53 0.53 1.16 0.54

Clutter filtering

2.37 9.89 2.89 1.35

Page 70: Technical Interchange Meeting – ROC / NSSL / NCAR ROC / NSSL / NCAR TIM Boulder CO 11 May 2005 Real-time time-series implementation of the Radar Echo Classifier.

Further work

• Clutter filtering – handling residual power.• SZ clutter filtering.• Tuning the REC for dual polarization data.• Pattern matching for spectra in range (NESPA,

NIMA).

Thank you