NON PARAMETRIC METHOD

45
BY: RUPAK KUMAR GUPTA (M.TECH 1 ST YEAR STUDENT) R.NO 15304020 PONDICHERRY UNIVERSITY DEPARTMENT OF ELECTRONICS AND COMMUNICATION

Transcript of NON PARAMETRIC METHOD

Page 1: NON PARAMETRIC METHOD

BY:

RUPAK KUMAR GUPTA

(M.TECH 1ST YEAR STUDENT)

R.NO 15304020

PONDICHERRY UNIVERSITY DEPARTMENT OF ELECTRONICS AND

COMMUNICATION

Page 2: NON PARAMETRIC METHOD
Page 3: NON PARAMETRIC METHOD

To convert the analog signals into samples of digital signals is called the DSP.

In this Subject, we will study the power spectrum estimation of DSP.

In metrological phenomena Fluctuation in air due to

change the pressure and temperature, that is the good

characterized by Spectral estimation aims at extracting

information about the system, from its observed

output (in the absence of the input) and a signal ,

when it is associated with noise characterized by

statistics as Random process.

Page 4: NON PARAMETRIC METHOD

For attempting to estimation, based on a finite length

because of size of any image is finite (available of data).

Even with a large image, in order to make the assumption

of stationary but in contrast to parametric methods, non-

parametric methods do not make any assumptions on the

data-generating process or model (e.g. autoregressive

model).

Page 5: NON PARAMETRIC METHOD

The ideal power spectrum of a signal x (n) can be

computed by first finding the ideal autocorrelation r(x) � � k = lim→∞[ � + � � + � � � ]�=

Even with a large image, in order to make the assumption of

stationary, often only a small window of the image is

considered at a time. � � k = [� � � + � � � ]− −��=

Page 6: NON PARAMETRIC METHOD

Now length of data that record that we select is determined by

the rapidly of the time variation in the signal statistics.

The autocorrelation function of a random process (selected finite

window) is the appropriate statistics average, after that we will

apply Fourier Transform because random signal is in the Time

Domain. Hence that results yield the power Density Spectrum.

Also, the ideal power spectrum is “blurred” or “smoothened” by the low pass filter, and the amount of blurring is mainly determined by the width of the main lobe. Power spectrum at any particular frequency is “leaking” into the side lobes, possibly “masking” the power spectra at the nearby frequencies

Page 7: NON PARAMETRIC METHOD
Page 8: NON PARAMETRIC METHOD

By choosing a different types of window, the width

of the main lobe and the amplitudes of the side lobes

of the low pass filtered can be varied.

Page 9: NON PARAMETRIC METHOD

On one hand, the width of main lobe determines

the spectral resolution.

The larger the width of the main lobe, the more blurring

effect the low pass filter has on the power spectrum.

On the other hand, the amplitudes of the side lobes

determine the spectral masking effect.

The higher the amplitudes of the side lobes, the more

masking effect of the power spectrum at a given frequency

has on the nearby frequencies.

Page 10: NON PARAMETRIC METHOD
Page 11: NON PARAMETRIC METHOD

A best spectral estimator, provides an estimate

which has as high a resolution and as

low a bias and variance as possible, a given length of data.

These factors depend on the associated noise, data length,

window etc (that means signal scenario).

This variance reduction is due to smearing of the signal

spectrum with the broad main lobe of the spectrum of the

window and this results in a poor resolution

Page 12: NON PARAMETRIC METHOD

Parametric method we assume that signal is output of a system having white noise as an input. We model the system and get its parameters

i.e. coloring filter coefficients and predict the power spectrum.

Here we compare the Yule-Walker method & Burg method for Power spectrum estimation.

Application of Power Spectrum estimation WIENER FILTER FEATURE EXTRACTION

Page 13: NON PARAMETRIC METHOD

In this topic, analyzes five common non-parametric

PSE methods

They are:

Periodogram Method,

Modified Periodogram Method,

Bartlett’s Method,

Welch’s Method,

Blackman-Tukey Method.

All these above methods has no assumption (estimation )about how the data were generated so it is called nonparametric methods.

Page 14: NON PARAMETRIC METHOD
Page 15: NON PARAMETRIC METHOD

1. PERIODOGRAM A simple-minded method of estimating the

autocorrelation of a signal of finite length is called the

Periodogram Method.

The well known form of power density spectrum estimation is

called Periodogram

The classic method for estimation of the power spectral

density of an N sample record is the periodogram.

periodogram doesn’t converge to the True Power Density

That means it is not a

consistent estimation of true power density spectrum.

Page 16: NON PARAMETRIC METHOD

So the emphasis of classical Non-parametric method is

on obtaining a consistent estimate of power spectrum

through some averaging and smoothing operations

performed directly on the periodogram or directly on the

autocorrelation.

The variance of the basic periodogram is large, though it

has good resolution, low bias and good signal detectability

even at high noise levels

Page 17: NON PARAMETRIC METHOD
Page 18: NON PARAMETRIC METHOD
Page 19: NON PARAMETRIC METHOD

2. MODIFIED PERIODOGRAM Modified periodogram method is used for power Spectrum

density estimation purpose.

The main difference between periodogram method and

modified periodogram method is window technique.

For smoothing purpose of periodogram, the window technique

is used in Modified periodogram method.

Page 20: NON PARAMETRIC METHOD

3. Bartlett Method (Averaging Periodograms Method)

Both the Periodogram Method and Modified Periodogram

Method do not give zero variances as the data length

approaches infinity.

One way to enforce zero variance by Bartlett method we

divide the signal into blocks, find their period grams and

average them to get the Power spectrum.

Example The Bartlett’s Method divides the signal of length N into

K segments, with each segment having length L = N /K . The

Periodogram Method is then applied to each of the K segments.

The average of the resulting estimated power spectra is taken as

the estimated power spectrum of the Bartlett’s Method.

(as K ∞ variance approaches zero.)

Page 21: NON PARAMETRIC METHOD

only at the cost of resolution, the averaged PSE provides a

lower variance, depending upon the number of segments

averaged and the window used, for a given length of data.

Bartlett based method is used for reducing the variance and

frequency resolution values in the noise spectrum.

Therefore the value of K can be used to design the trade-off

between spectral resolution and variance. With a larger number

of segments, the variance is reduced but at the expense of

spectral resolution. Conversely, with a smaller number of

segments, the spectral resolution (i.e. the bandwidth of the

main lobe) is reduced at expense of larger variance.

Page 22: NON PARAMETRIC METHOD

Performance characteristics of BARTLETT Method for PSE

We observe that the Bartlett PSE is asymptotically unbiased &

if K is allowed to increase with an increase in N, the estimate

is also consistent.

Hence, asymptotically, this estimate is characterized by the

quality factor.

Page 23: NON PARAMETRIC METHOD
Page 24: NON PARAMETRIC METHOD
Page 25: NON PARAMETRIC METHOD

��= K= N/M The frequency resolution of the Bartlett estimation,

measured by taking the 3-dB width of the main loab

of the rectangular is

f = .

M= 0.9/Δf

Hence ��= 0.9/Δf = 1.1N Δf

Page 26: NON PARAMETRIC METHOD

4. Welch Method: Averaging the Modified periodogram

Welch method is the similar to Bartlett Method but only some

modifications data segments can be overlapping in welch

method.

And second thing is to window the data segments prior to

computing the periodogram

When data length is short Blackman tuckey method is better

than Welch method but as the data length increase Welch

Method gives excellent results.

Page 27: NON PARAMETRIC METHOD

Welch method got better precision but less frequency

resolution as compare to Bartlett method.

Therefore this method is used to calculate the PSD of a signal

with reducing the effect of noise in DSP .

The Welch’s Method eliminates the trade off between spectral resolution and variance in the Bartlett’s Method by allowing

the segments to overlap.

However, overlapping introduces correlations between

segments. In practice, the amount of overlapping is typically

between 50% to 75%.

Page 28: NON PARAMETRIC METHOD

Performance characteristics of WELCH Method for PSE

Under the two conditions given by the

quality factor is:

L = N/M for no overlap

8L/9 16N/9M for 50 % overlap.

Page 29: NON PARAMETRIC METHOD

The spectral width of triangular window

at the 3-db points is

��=

f = .

Q factor in term of N & Δf

0.78 NΔf

1.39N NΔf

Page 30: NON PARAMETRIC METHOD

5. BLACKMAN-TUKEY METHOD:

Black man turkey method is also known as

smoothing periodograms.

In this method we windowed the auto-correlation sequence

and take Fourier transform to get power spectrum estimate

(Periodogram) in effect we smooth out the Periodogram.

For values of data points of m approaching N, the variance of

these estimation is very high.

Page 31: NON PARAMETRIC METHOD

Performance characteristics of BLACKMAN & TUKEY Method for PSE Following equation shows that the value of

estimate is asymptotically unbiased

Page 32: NON PARAMETRIC METHOD

MATHEMETICAL RELATED TO THESE

THREE METHODS.. S.NO

ESTIMATE

QUALITY FACTOR

FREQ RESOLUTION

(Δf)

QUALITY FACTOR

1.

BARLETT

Q= K= N/M

0.9/M

1.11NΔf

2.

WELCH METHOD

L=N/M (for no overlap)

8L/9=16N/9M (for 50% overlap and Triangular window)

1.28/M

1.39NΔf

3.

BLACKMAN & TUKEY METHOD

1.5N/M

0.64/M

2.34NΔf

Page 33: NON PARAMETRIC METHOD

APPLICATION OF POWER SPECTRUM For Feature Extraction, we calculate the ‘mean square error’ in order to calculate the performance of above five methods.

Another purpose is to analyze how power spectrum can be used for feature extraction

to detect cancer in an ultrasound image of a prostate. Feature extraction does not

depend much on the the variance of the power spectrum and spectral resolution.

Because of the Periodogram Method is best for feature extraction

The feature extraction is depends mainly on the overall shape, described

by the slope and the y-intercept, of the linearized power spectrum. Since

it does not closely depend on the local characteristics of the power

spectrum, such as spectral resolution and variance, the complexity

becomes the critical factor in choosing the best estimation method for this

feature extraction. It was found that the the Periodogram Method is the

simplest and one of the most accurate estimation method for this feature

extraction

Page 34: NON PARAMETRIC METHOD
Page 35: NON PARAMETRIC METHOD
Page 36: NON PARAMETRIC METHOD
Page 37: NON PARAMETRIC METHOD

CONCLUSION

Frequency resolution is low in Bartlett method because of

windowing(that means leakage frequency due to side lobes), instead of

Frequency resolution of Bartlett method is more than Welch Method and

Blackman-Tukey Method.

Welch Method has got better precision but less frequency resolution

than Bartlett method

Blackman-tukey methods better precision than Bartlett & Welch Method

methods

Blackman-Tukey Method has better variance (even at large lags).

Quality factor of Blackman-Tukey more than Bartlett & Welch Method

Page 38: NON PARAMETRIC METHOD

When data length is short Blackman tuckey method is better

than Welch method but as the data length increase Welch

Method gives excellent results.

Page 39: NON PARAMETRIC METHOD

Analysis of signals in the frequency domain with non uniform

sampling times is efficient for estimation of random signals.

In future it can be extended to estimation of communication

signals like audio signals, speech signals and video signals.

Page 40: NON PARAMETRIC METHOD
Page 41: NON PARAMETRIC METHOD
Page 42: NON PARAMETRIC METHOD
Page 43: NON PARAMETRIC METHOD
Page 44: NON PARAMETRIC METHOD
Page 45: NON PARAMETRIC METHOD