20091107 Stochastics 3.9 TransformMethods

17
Tr ansform Methods  Chapter 3: Random Variables College of Electrical & Mechanical Engineering National University of ciences & Technology !NUT" EE#$%3 tochastic ystems

Transcript of 20091107 Stochastics 3.9 TransformMethods

Page 1: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 1/17

Transform Methods Chapter 3: Random Variables

College of Electrical & Mechanical EngineeringNational University of ciences & Technology !NUT"

EE#$%3 tochastic ystems

Page 2: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 2/17

 

Random Variables ' Transform Methods

Transform Methods

[ ]1 2 1 2( ) ( ) ( ) ( ) f x f x   ω ω ∗ =F F F

(ogarithms are )sef)l comp)tational aids for performingm)ltiplications* )sing additions only

Transform methods held red)ce comp)tational effort e+g+

convol)tion may be performed in transform domain

Page 3: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 3/17

3

 

Random Variables ' Transform Methods

Characteristic Function

Page 4: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 4/17

,

 

Random Variables ' Transform Methods

Characteristic Function: Definition

( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ 

E-pected val)e of af)nction of .

 pdf  and its characteristic f)nction form a )ni/)e 0o)rier

transform pair 

 pdf  and its characteristic f)nction form a )ni/)e 0o)rier

transform pair 

0o)rier Transform ofthe pdf 

1nverse 0o)rier Transform of

Characteristic 0)nction gives pdf 

Page 5: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 5/17

2

 

Random Variables ' Transform Methods

Example 3.47 (Exponential Random

aria!le"( )

( )

 j X  X 

 j x

 X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

=

∫ 

 pdf of e-ponential

random variable

Page 6: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 6/17

%

 

Random Variables ' Transform Methods

Characteristic Function for Discrete

Random aria!le( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ iscrete random variable X 

0o)rier Transform of the se/)ence0o)rier Transform of the se/)ence

1nteger#val)ed random variable X 

Page 7: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 7/174

 

Random Variables ' Transform Methods

#eriodicit$ of Characteristic Function

( 2 ) 2 .1 j k j k j k j k j k e e e e eω π ω π ω ω  += = =

5eriodicity of discrete variable5eriodicity of discrete variable

0o)rier Transform of the se/)ence

periodic 6ith period pi

0o)rier Transform of the se/)ence

periodic 6ith period pi

1nteger#val)ed random variable X 

Page 8: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 8/17$

 

Random Variables ' Transform Methods

Reco%erin& #ro!a!ilities from

Characteristic Function

0o)rier Transform of the se/)ence

periodic 6ith period pi

0o)rier Transform of the se/)ence

periodic 6ith period pi

1nverse 0o)rier transform

5robabilities5robabilities

Coefficients of 0o)rier eries of

periodic f)nction

Page 9: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 9/177

 

Random Variables ' Transform Methods

Moment Theorem

( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ Moments can be comp)tedfrom Characteristic 0)nction

5roof:5roof: E-pand into po6er series j xe

  ω 

If power series converges, pdf  and characteristic f)nction are completely

determined by moments of .

If power series converges, pdf  and characteristic f)nction are completely

determined by moments of .

Page 10: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 10/1789

 

Random Variables ' Transform Methods

Example 3.4' (Computin& Mean and

ariance usin& Moment Theorem"( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ Characteristic f)nction

of e-ponential random

variableifferentiating once

Mean

ifferentiating once again

Mean#s/)are

Variance

Page 11: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 11/1788

 

Random Variables ' Transform Methods

#ro!a!ilit$ eneratin& Function

Page 12: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 12/178

 

Random Variables ' Transform Methods

#ro!a!ilit$ eneratin& Function:

Definition

0

( )

( )

 N  N 

k  N 

G z E z  

 p k z ∞

=

=

= ∑

E-pected val)e of af)nction of N 

#Transform of the pmf 

Relation bet6een Characteristic0)nction and 5robability

;enerating 0)nction

( ) ( ) j N N G e   ω ω Φ =

 j z e

  ω =

Page 13: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 13/17

83

 

Random Variables ' Transform Methods

Moment Theorem (#F"( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ Moments can be comp)tedfrom 5robability ;enerating

0)nction !5;0"

0irst derivative of 5;0

econd derivative of 5;0

Page 14: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 14/17

8,

 

Random Variables ' Transform Methods

Moment Theorem (#F" ) continued( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫  Mean

Variance'' ' ' 2

[ ] (1) (1) ( (1)) N N N VAR N G G G= + −

Page 15: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 15/17

82

 

Random Variables ' Transform Methods

Example 3.*+ (Computin& Mean and

ariance usin& Moment Theorem"

( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ 

5robability ;enerating

0)nction of 5oisson

Random Variable

ifferentiating once

Mean

ifferentiating once again

Variance

 pmf of poisson random variable

Page 16: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 16/17

8%

 

Random Variables ' Transform Methods

,aplace Transform of pdf 

Page 17: 20091107 Stochastics 3.9 TransformMethods

8/18/2019 20091107 Stochastics 3.9 TransformMethods

http://slidepdf.com/reader/full/20091107-stochastics-39-transformmethods 17/17

84

 

Random Variables ' Transform Methods

,aplace Transform of  pdf 

( )

( )

 j X  X 

 j x X 

 E e

 f x e dx

ω 

ω 

ω 

−∞

Φ =

= ∫ 

E-pected val)e of a

f)nction of .

Moment TheoremMoment Theorem

(aplace Transform of

the pdf