ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class...

69
1 ME 233 Advanced Control II Continuous time results 1 Random processes (ME233 Class Notes pp. PR6-PR13)

Transcript of ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class...

Page 1: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

1

ME 233 Advanced Control II

Continuous time results 1

Random processes

(ME233 Class Notes pp. PR6-PR13)

Page 2: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

2

Such that for any time ,

Random Process

A random processes is a continuous function

of time

Is a random variable defined over the same probability space

Page 3: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

3

ExampleE

nse

mb

le

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x1(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x2(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x3(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x4(t

)

tt

Page 4: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

4

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x1(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x2(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x3(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x4(t

)

tt

ExampleE

nse

mb

le

sample function

process realization

Page 5: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

5

Random process

Let be a collection of times

This is often a huge amount of redundant information

is the joint PDF of

Let be a random process

Page 6: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

6

2nd order statistics

Expected value or mean of X(t),

Let be a random vector process

Auto-covariance function:

Page 7: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

7

Auto-covariance function

Define:

Page 8: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

8

Strict Sense Stationary random sequence

is Strict Sense Stationary (SSS) if the joint probability, is

invariant with time

A random process

for any time shift T,

Page 9: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

9

Ergodicity

is ergodic if we can recover an ensemble average

from the time average of any realization:

A Strict Sense Stationary random process

with probability 1

(almost surely)

Page 10: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

10

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x1(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x2(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x3(t

)

0 0.5 1 1.5 2 2.5 3-0.1

0

0.1

x4(t

)

tt

En

se

mb

le

Page 11: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

11

Wide Sense Stationarity

is Wide Sense Stationary (WSS) if:

A random sequence

1) Its mean is time invariant

Page 12: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

12

Wide Sense Stationarity

is Wide Sense Stationary (WSS) if:

A random sequence

2) Its covariance only depends on the correlation

shift

Page 13: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

13

Wide Sense Stationarity

The auto-covariance function can be defined only as

a function of the correlation time shift

Notice that:

Page 14: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

14

Cross-covariance function

The cross-covariance function:

Let and

be two WSS random vector processes

for any time t

Page 15: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

15

Cross-covariance function

Page 16: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

16

Power Spectral Density FunctionFor WSS random process, the power spectral density

function is the Fourier transform of the auto-

covariance function:

Page 17: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

17

Power Spectral Density FunctionSince,

Page 18: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

18

White noise

A WSS random process is white if:

Where is the Dirac delta impulse

white noise is zero mean if

Page 19: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

19

White noise

The power spectral density function for white noise

is:

Proof:

1

Page 20: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

20

White noise

0

WW ()

w0

WW (w)

Infinite bandwidth

Page 21: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

21

White noise vector process

A WSS random vector sequence is

white if:

where

and is the Dirac delta impulse

Page 22: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

22

MIMO Linear Time Invariant Systems

Let

be the impulse response of an LTI SISO system

with transfer function

Page 23: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

23

MIMO Linear Time Invariant Systems

Let be WSS

Then the forced response (zero initial state)

is also WSS

Page 24: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

24

MIMO Linear Time Invariant Systems

We will assume that

• The WSS random process

is zero mean, I.e.

Thus, the output random process is also zero mean

Page 25: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

25

MIMO Linear Time Invariant Systems

If

Let be WSS

Then:

G(t)

G()

Page 26: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

26

MIMO Linear Time Invariant Systems

Let be a WSS random process

G(w)

G(s)

Page 27: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

27

MIMO Linear Time Invariant Systems

Let be a WSS random process

G(s)

Page 28: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

28

MIMO Linear Time Invariant Systems

If

Let be a WSS vector random

process

Then:

Page 29: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

29

MIMO Linear Time Invariant Systems

Proof:

Then:

Page 30: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

30

MIMO Linear Time Invariant Systems

If

Let be WSS

Then:

G(t)

G()

Page 31: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

31

MIMO Linear Time Invariant Systems

Let be a WSS random process

G(s)

Page 32: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

32

MIMO Linear Time Invariant Systems

Proof: Remember that

Page 33: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

33

MIMO Linear Time Invariant Systems

If

Let be WSS

Then:

Page 34: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

34

MIMO Linear Time Invariant Systems

Proof: Use

and

then

Page 35: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

35

White noise driven state space systems

Consider a LTI system driven by white noise:

Page 36: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

36

White noise driven state space systems

Assume that W(t) is white, but not stationary

Page 37: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

37

White noise driven state space systems

Assume state Initial Conditions (IC):

Page 38: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

38

White noise driven state space systems

Taking expectations on the equations above, we obtain:

Page 39: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

39

White noise driven state space systems

Subtracting the means,

Page 40: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

40

White noise driven covariance propagation

with

Page 41: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

41

White noise driven covariance propagation

Also,

where:

Page 42: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

42

White noise driven covariance propagation

Also,

where:

Page 43: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

43

Stationary covariance equation

For W(t) WSS,

and A Hurwitz,

Page 44: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

44

Stationary covariance equation

For W(t) WSS,

Satisfies:

and A Hurwitz,

Page 45: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

45

The next section contains

some Proofs of the CT

results

Please go over them by

yourselves…

Page 46: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

46

Proof of continuous time results – Method 1

We first prove that:

By starting from the Discrete Time (DT) results

Page 47: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

47

Proof of continuous time results – Method 1

Approximate the state equation ODE

using the Euler numerical integration method.

• We have to be careful in dealing with white

noise

Page 48: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

48

Approximate

1. Define as the time average of

Similarly, taking expectations

Page 49: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

49

Approximate for W(t) white

Page 50: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

50

Approximate for W(t) white

since for W(t) white Dirac impulse

Page 51: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

51

Approximate for W(t) white

Page 52: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

52

Approximate for W(t) white

Page 53: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

53

Where is the time average of

Approximate for W(t) white

Page 54: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

54

Numerical Integration

The state equation

By the discrete time state equation

where

Page 55: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

55

1. Obtain DT state equations by approximating the CT state equation solution:

Thus,

where

Proof of continuous time results – Method 1

Page 56: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

56

Proof of continuous time results – M1

2. Obtain the CT covariance propagation equation from from the DT covariance propagation, using the approximated DT state equation:

Page 57: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

57

Proof of continuous time results – M1

3. Take the limit as of

and noticing that

Page 58: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

58

Proof of continuous time results – M1

3. Take the limit as of

Thus,

t t

Page 59: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

59

Proof of continuous time results – Method 2

We now proof that:

Directly from continuous time (CT) results

Page 60: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

60

Proof of continuous time results – M2

1) Lets calculate

using

Page 61: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

61

Proof of continuous time results – M2

2) We now need to calculate

using

Page 62: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

62

Proof of continuous time results – M2

2) We now need to calculate

using

(notice that the Dirac impulse occurs at the edge t)

Page 63: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

63

Proof of continuous time results – M2

2) Continuing,

(make integral symmetrical w/r 0)

0

ΔT

ΔT1

Page 64: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

64

Proof of continuous time results – M2

2) A similar calculation for

yields

(notice that the Dirac impulse occurs at the edge t)

Page 65: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

65

Proof of continuous time results – M2

2) Continuing,

(make integral symmetrical w/r 0)

Page 66: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

66

Proof of continuous time results – M2

2) Thus

and

Page 67: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

67

Proof of continuous time results – M2

Now we proof that:

Notice that:

where,

Page 68: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

68

Proof of continuous time results – M2

Therefore,

Notice that and are uncorrelated for

0

Page 69: ME 233 Review - ME233 Advanced Control Systems II, UC …€¦ · Random processes (ME233 Class Notes pp. PR6-PR13) 2 Such that for any time , Random Process A ... is the joint PDF

69

Proof of continuous time results – M2

Thus,