Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf,...
-
Upload
charleen-austin -
Category
Documents
-
view
217 -
download
1
Transcript of Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf,...
![Page 1: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/1.jpg)
Pairs of Random Variables
Random Process
![Page 2: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/2.jpg)
Introduction In this lecture you will study:
Joint pmf, cdf, and pdf Joint moments The degree of “correlation” between two random
variables Conditional probabilities of a pair of random
variables
![Page 3: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/3.jpg)
Two Random Variables The mapping is written as to
each outcome is S
![Page 4: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/4.jpg)
Example 1
![Page 5: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/5.jpg)
Example 2
![Page 6: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/6.jpg)
Two Random Variables The events evolving a pair of random
variables (X, Y) can be represented by regions in the plane
![Page 7: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/7.jpg)
Two Random Variables To determine the probability that the pair
is in some region B in the plane, we have
Thus, the probability is
The joint pmf, cdf, and pdf provide approaches to specifying the probability law that governs the behavior of the pair (X, Y)
Firstly, we have to determine what we call product form
where Ak is one-dimensional event
![Page 8: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/8.jpg)
Two Random Variables The probability of product-form events is
Some two-dimensional product-form events are shown below
![Page 9: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/9.jpg)
Pairs of Discrete Random Variables Let the vector random variable
assume values from some countable set The joint pmf of X specifies the probabilities of
event
The values of the pmf on the set SX,Y provide
![Page 10: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/10.jpg)
Pairs of Discrete Random Variables
![Page 11: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/11.jpg)
Pairs of Discrete Random Variables The probability of any event B is the sum of
the pmf over the outcomes in B
When the event B is the entire sample space SX,Y, we have
![Page 12: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/12.jpg)
Marginal Probability Mass Function The joint pmf provides the information about
the joint behavior of X and Y The marginal probability mass function shows
the random variables in isolation
similarly
![Page 13: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/13.jpg)
Example 3
![Page 14: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/14.jpg)
The Joint Cdf of X and Y The joint cumulative distribution function of X
and Y is defined as the probability of the event
The properties are
![Page 15: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/15.jpg)
The Joint Cdf of X and Y
![Page 16: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/16.jpg)
Example 4
![Page 17: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/17.jpg)
The Joint Pdf of Two Continuous Random Variables Generally, the probability of events in any
shape can be approximated by rctangles of infinitesimal width that leads to integral operation
Random variables X and Y are jointly continuous if the probability of events involving (X, Y) can be expressed as an integral of probability density function
The joint probability density function is given by
![Page 18: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/18.jpg)
The Joint Pdf of Two Continuous Random Variables
![Page 19: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/19.jpg)
The Joint Pdf of Two Continuous Random Variables The joint cdf can be obtained by using this
equation
It follows
The probability of rectangular region is obtained by letting
![Page 20: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/20.jpg)
The Joint Pdf of Two Continuous Random Variables We can, then, prove that the probability of an
infinitesimal rectangle is
The marginal pdf’s can be obtained by
![Page 21: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/21.jpg)
The Joint Pdf of Two Continuous Random Variables
![Page 22: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/22.jpg)
Example 5
![Page 23: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/23.jpg)
Example 5
![Page 24: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/24.jpg)
Example 6
![Page 25: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/25.jpg)
Independence of Two Random Variables X and Y are independent random variable if
any event A1 defined in terms of X is independent of any event A2 defined in terms of Y
If X and Y are independent discrete random variables, then the joint pmf is equal to the product of the marginal pmf’s
![Page 26: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/26.jpg)
Independence of Two Random Variables If the joint pmf of X and Y equals the product of
the marginal pmf’s, then X and Y are independent
Discrete random variables X and Y are independent iff the joint pmf is equal to the product of the marginal pmf’s for all xj, yk
![Page 27: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/27.jpg)
Independence of Two Random Variables In general, the random variables X and Y are
independent iff their joint cdf is equal to the product of its marginal cdf’s
In continuous case, X and Y are independent iff their joint pdf’s is equal to the product of the marginal pdf’s
![Page 28: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/28.jpg)
Joint Moments and Expected Values The expected value of is given by
Sum of random variable
![Page 29: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/29.jpg)
Joint Moments and Expected Values In general, the expected value of a sum of n
random variables is equal to the sum of the expected values
Suppose that , we can get
![Page 30: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/30.jpg)
Joint Moments and Expected Values The jk-th joint moment of X and Y is given by
When j = 1 and k = 1, we can say that as correlation of X and Y
And when E[XY] = 0, then we say that X and Y are orthogonal
![Page 31: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/31.jpg)
Conditional ProbabilityCase 1: X is a Discrete Random Variable For X and Y discrete random variables, the
conditional pmf of Y given X = x is given by
The probability of an event A given X = xk is found by using
If X and Y are independent, we have
![Page 32: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/32.jpg)
Conditional Probability The joint pmf can be expressed as the product
of a conditional pmf and marginal pmf
The probability that Y is in A can be given by
![Page 33: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/33.jpg)
Conditional Probability Example:
![Page 34: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/34.jpg)
Conditional Probability Suppose Y is a continuous random variable,
the conditional cdf of Y given X = xk is
We, therefore, can get the conditional pdf of Y given X = xk
If X and Y are independent, then The probability of event A given X = xk is
obtained by
![Page 35: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/35.jpg)
Conditional Probability Example: binary communications system
![Page 36: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/36.jpg)
Conditional ProbabilityCase 2: X is a continuous random variable If X is a continuous random variable then P[X
= x] = 0 If X and Y have a joint pdf that is continuous
and nonzero over some region of the plane, we have conditional cdf of Y given X = x
![Page 37: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/37.jpg)
Conditional Probability The conditional pdf of Y given X = x is
The probability of event A given X = x is obtained by
If X and Y are independent, then and
The probability Y in A is
![Page 38: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/38.jpg)
Conditional Probability Example
![Page 39: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/39.jpg)
Conditional Expectation The conditional expectation of Y given X = x is
given by
When X and Y are both discrete random variables
![Page 40: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/40.jpg)
Conditional Expectation In particular we have
where
![Page 41: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/41.jpg)
Pairs of Jointly Gaussian Random Variables The random variables X and Y are said to be
jointly Gaussian if their joint pdf has form
![Page 42: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/42.jpg)
Lab assignment In group of 2 (for international class: do it personally),
refer to Garcia’s book, example 5.49, page 285 Run the program in MATLAB and analyze the result Your analysis should contain:
The purpose of the program Line by line explanation of the program (do not copy from
the book, remember NO PLAGIARISM is allowed) The explanation of Fig. 5.28 and 5.29 The relationship between the purpose of the program and
the content of chaper 5 (i.e. It answers the question: why do we study Gaussian distribution in this chapter?)
Try using different parameter’s values, such as 100 observation, 10000 observation, etc and analyze it
Due date: next week
![Page 43: Pairs of Random Variables Random Process. Introduction In this lecture you will study: Joint pmf, cdf, and pdf Joint moments The degree of “correlation”](https://reader035.fdocuments.in/reader035/viewer/2022062421/56649ddb5503460f94ad2278/html5/thumbnails/43.jpg)
Regular Class:
NEXT WEEK: QUIZ 1
Material: Chapter 1 to 5, Garcia’s book
Duration: max 1 hour