Professional Documents
Culture Documents
CHAPTER SEVEN
TWO DIMENSIONAL RANDOM VARIABLES
5.1 Definition of two dimensional random variables
Perhaps, it is advantageous to borrow a concept from mathematics to explain the idea of two-
dimensional random variables. In mathematics, whenever we talk of the real number system we
are referring to the real number line, which is one-dimensional involving only the X-axis. On the
other hand, whenever we talk of a set of ordered pairs, relations, we are referring to the
coordinate plane, which is two-dimensional involving both the X and Y-axes.
In the case of random variables as well one can furnish the same analogy as in the one stated
above. Whenever we talk of a random variable whose possible values are subsets of the set of
real numbers it is called a one-dimensional random variable. Likewise, when a given random
variable assumes values that are subsets of the Cartesian product of real numbers, set of ordered
pairs (points) in a plane, that random variable is referred to as two-dimensional random variable.
By extending the analogy one can also have other higher order dimensional random variables.
The amount of precipitate P and volume V of a gas from controlled experiment (P,V)
Page 1 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
The total rain fall R and the average temperature T off locality during a specified period
(R,T)
Note that: – the range space of ( , ), the set of all possible value of ( , ).
1. , ≥ 0 ( , )
2. ( , ) = 1
Example 1: A fair coin is tossed three times. Lat X denotes 0 or 1 according as a head or tail
occurs on the first toss, and let Y denotes the number of heads which occur. Determine
Solution
0 1 0 1 2 3
( ) 0.5 0.5 ( ) 1/8 3/8 3/8 1/8
Page 2 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Y 0 1 2 3
X
O 0 1/8 2/8 1/8
1 1/8 2/8 1/8 0
Example2: Two production lines manufacture a certain type of item. Suppose that the capacity
per day is 5 items for line I, and 3 items for line II. Assume that the number of items actually
produced by either production line is a random variable. Let (X,Y) represents the two-
dimensional random variable yielding the number of items produced by line I and II,
respectively.
X
Total
0 1 2 3 4 5
Y
0. 25
0 0 0. 01 0. 03 0. 05 0. 07 0. 09
0. 26
1 0. 01 0. 02 0. 04 0. 05 0. 06 0. 08
0. 25
2 0. 01 0. 03 0. 05 0. 05 0. 05 0. 06
0. 24
3 0. 01 0. 02 0. 04 0. 06 0. 06 0. 05
Total
0. 03 0. 08 0. 16 0. 21 0. 24 0. 28 1
Solution:
a) To show the legitimacy of the given probability distribution, we are expected to show the
two conditions that a probability distribution should satisfy. As can be seen from the given table
all the values P(xi,yj) are non-negative. Therefore, the first condition P(xi,yj)>0 is satisfied.
Moreover, the second condition is also satisfied because
P X x , Y y 1 =0+0.01+…+0.05=1
x y
i j
=0.01+0.01+0.01+0.03+0.03+0.02+0.04=0.15
Page 3 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Example 2 Let (X,Y) be a two-dimensio nal rando m variable with probabilit y distribut ion
f(x, y)=2-(x+y) x, y=1,2,3,…
a) This amounts to checking the two condit ions for a probabilit y distribution
i) Clearly, f(x, y)> 0 for all (x, y) because f is an exponent ial funct ion, whose range is non-
negat ive
f X , Y 1 Implies 2
x y x y
( x y )
1
1 1 1 1
x y
( x y) x y 1 1 1
But 2 x y
2 2
x 1 y 1
x 1 2
y 1 2 2 1 2 1
1 1
2 2
Thus since both condit ions are fulfilled, we conclude that f(x, y) is a probabilit y distribut ion.
x
( x y ) y x 1 y
b) P(X>Y)= 2
y 1 x y 1
2
y 1
2
x y 1
2
y 1 x y 1 2
x
Now let’s consider the term (1 / 2)
x y 1
x y 1 y 2 y 3
1 1 1 1
x y 1 2 2
2
2
...
y y 2 y
1 1 1 1 1 1 1 2 1 3 1 y y
.... ... 2
2 2 2 2 2 2 2 2
2
x
( x y ) y x 1
y
Thus P(X>Y) = 2
y 1 x y 1
2
y 1
2
x y 1
2
y 1 x y 1 2
Page 4 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
y
y y 2 y 1 1/ 4
=
2 2 2 1/ 3
y 1 y 1 y 1 4 1 1/ 4
Exercise 1: Two tablets are selected at random for a bottle containing three aspirin, two sedative
and four laxatives. If X and Y are, respectively the number of aspirin tablets and the number
sedative tablets included among the tablets drawn from the bottle. Find joint probability
distribution of (X, Y).
Solution: The possible pairs are (0, 0), (0, 1), (1, 0), (1, 1), (0, 2) and (2, 0).
( , )=
Y 0 1 2
X
O
0 0
1 0 0
2 0 0
i) f ( xi , y j ) 0 i, j
ii) f ( x, y) dxdy 1
R
Remark:
f ( x, y) dxdy 1 indicates that the volume under the surface f(x, y) is one.
R
Page 5 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( )= ( , )
c, o x 2 , 0 y 4
f ( x, y )
o, elsewhere
a) To determine the constant c we make use one of the properties o f a P.d.f namely
2 4
2 4 2
4 2
But 0 c y x 0 0 0 4cx 4cx 0 8c
cy x
0
2 x
c) P( X Y ) 1 / 8 yx 1 / 4
0 0
Example 2: Suppose that a two-dimensio nal random variable (X,Y) has jo int P.d.f given by
e ( x y ) 0 x ,0 y
f ( x, y )
0 Otherwise
a) Two show that the above function is a P.d.f we check whether or not the two condit ions are
fulfilled or not
Page 6 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
x y 1 x 1
ii) f ( x, y ) xy 0 e e yx e y 0 0 e x (1) e x 0 (1)(1) 1
R 0
b) Find ( ≤ , < )
Solution:
a) ( , ) ∫ ∫ ( , ) =1
√
This implies that ∫ ∫ =1
= 12
. .
b) ≤ , < =∫ ∫ 12 =
Definition: CDF: Let (X, Y) be a two-dimensional random variable. The cumulative distribution
function F of (X, Y) is defined as F(x, y) = P(X < , < )
F ( x, y ) P( X x, Y y ) P( X xi , Y y j ) xi x, y j y
x y
Case 2: If (X,Y) is continuous then F ( x, y ) F ( x, y ) P ( X x, Y y ) f ( s, t ) st
Page 7 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Properties of a CDF
i) 0 F ( x, y ) 1
ii) P ( a X b, Y y ) F (b, y ) F ( a, y )
iii) P ( X x, c Y d ) F ( x , d ) F ( x , c )
iv) P ( a X b, c Y d ) F (b, d ) F ( a, d ) F (b, c) F ( a, c)
v) F ( x, y ) is non-decreasing function
vi) F ( , y ) 0; F ( x, ) 0
vii) F ( , ) 1
2 F ( x, y )
viii) f ( x, y )
xy
Example1: Consider the example on the two production lines, given previously, and find F(1,2)
Solution
+ ( = 1 = 0) + ( = 1, = 1) + ( = 1, = 2)
= 0.08
Solution:
( , )=0
1
( , )= ( + ) = ( + )
2
Page 8 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
1
( , )= ( + ) = ( + 1)
2
1
( , )= ( + ) = ( + 1)
2
( , )= ( + ) =1
Since the joint distribution function is every where continuous, the boundaries between any two
of these can be included in either one, and we can write
0 < 0 < 0
⎧1
⎪ ( + ) for 0 < < 1 0 < < 1
⎪2
1
( , )= ( + 1) > 0 0 < < 1
⎨2
⎪1 (
+ 1) 0 < < 1 > 0
⎪2
⎩1 > 1 > 1
( , ) = (2 + 3 ); = 0,1,2; = 1,2,3
Page 9 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Exercise 2: Suppose that the joint cdf of a two dimensional continuous random variable is given
by
( , )= 1− − + ( ) > 0, > 0
0 ℎ
Then compute a) ( ≤ 1; ≤ 1)
b) ( + ≤ 1)
1 / 8 , 0 x 2 , 0 y 4
f ( x, y ) Find F(1, 2)
0 elsewhere
1 2
Solution: F (1,2) P( X 1, Y 2) 1 / 8 yx 1 / 4
0 0
How do you find the P.d.f of a random variable X or Y from the given joint P.d.f ?
The answer is simple! You simply find the Marginal Probability Distributions.
Page 10 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
X 0 1 2
Y
0 0. 25 0. 15 0. 10
1 0. 10 0. 08 0. 10
2 0. 05 0. 07 0. 10
Find the marginal distribution of X and Y
Solution
3
P( X 0) P( X 0 , Y y i ) 0.25 0.10 0.05 0.4
i 1
3
P( X 1) P( X 1, Y y i ) 0.15 0.08 0.07 0.3
i 1
2
P( X 2) P( X 2, Y y i ) 0.10 0.10 .010 0.3
i 1
X 0 1 2
P(X=x) 0.4 0.3 0.3
In a similar manner the marginal distribution of Y is as follows:
3
P(Y 0) P( X x i , Y 0) 0.25 0.15 .10 0.50
i 1
3
P(Y 1) P( X xi , Y 1) 0.10 0.08 0.10 0.28
i 1
3
P( X 2) P( X xi , Y 2) 0.05 0.07 0.10 0.22
i 1
Y 0 1 2
P(Y=y) 0.5 0.28 0.22
Example 2: Let (X,Y) be a two-dimensional discrete random variable with P.d.f
x y
; if x 1,2,3 and y 1,2
f ( x, y ) 21
0, else where
Find the respective P.d.f s of X and Y.
Page 11 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Solution:
X 1 2 3 Total
Y
1 2/21 3/21 4/21 9/21
2 3/21 4/21 5/21 12/21
Total 5/21 7/21 9/21 1
The marginal distribution of X is
2
2 3 5
P ( X 1) f (1, y i ) P ( X 1, Y 1) P ( X 1, Y 2)
i 1 21 21 21
2
3 4 7
P ( X 2) f (2, yi ) P ( X 2, Y 1) P ( X 2, Y 2)
i 1 21 21 21
2
4 5 9
P ( X 3) f (3, yi ) P ( X 3, Y 1) P ( X 3, Y 2)
i 1 21 21 21
x 1 2 3
P(X=x) 5/21 7/21 9/21
On the other hand the marginal distribution of Y is given by
3
2 3 4 9
P(Y 1) f ( xi ,1) P( X 1, Y 1) P( X 2, Y 1) P( X 3, Y 1)
i 1 21 21 21 21
3
3 4 5 12
P(Y 2) f ( xi ,2) P( X 1, Y 2) P( X 2, Y 2) P( X 3, Y 2)
i 1 21 21 21 21
y 1 2
P(Y=y) 9/21 12/21
Page 12 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( ) ( , ) ( ) ( , )
= =
( , )
Note: -To find the marginal P.d.f of X, integrate the joint P.d.f with respect to y and
evaluate it for all values of y in R.
( , )
- To find the marginal P.d.f of Y, integrate the joint P.d.f with respect to x and
evaluate it for all values of x in R.
Example 1: Two characteristics of a rocket engine’s performance are thrust X and mixture ratio
Y. Suppose that ( , ) is a two-dimensional continuous random variable with joint P.d.f given
by
( ) ( , )
= = 2( + −2 ) =[ + − ] =1
2
( ) 1 0 < <1
=
0 ℎ
In a similar manner the marginal P.d.f of Y is given as follows:
( ) ( , )
= = 2( + −2 ) =[ + +− ] =1
2
( ) 1 0 < <1
=
0 ℎ
Example 2: Consider the following joint P.d.f of X and Y.
( x, y ) 12 x ; 0 y x 1 , 0 x 2 y 1
f XY
Find the marginal P.d.f for X and Y.
0, else where
Page 13 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( ) ( )
Solution: Let and be the marginal P.d.f’s of X and Y, respectively
x
( x) x
Then f X
12 x y 12 xy
x 2
12 x 2 12 x 3
x2
(x) 12 x 2 12 x 3 0 x 1
f X
0 , elsewhere
y
( y) y
f Y
12 x x 6 x 2
y
6( y y 2 )
y
( y) 6( y y 2 ) 0 y 1
Thus f Y
0 , else where
( x, y ) 2 ; if 0 x y 1
f Find the respective P.d.f s of X and Y.
XY
0, else where
( x) 2 2 x if 0 x 1
f
X
0 elsewhere
( y) 2 y if 0 y 1
f
Y
0 elsewhere
Page 14 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
P ( X xi , Y y j ) P ( X xi ,Y y j )
P ( xi y j ) P ( X x i Y y j ) , q( y j ) 0
P (Y y j ) q( y j )
P ( X xi , Y y j ) P ( X xi ,Y y j )
P ( y j xi ) P (Y y j X xi ) , p( xi ) 0
p( X xi ) p( x i )
Note: For given j, ( / ) satisfies all the conditions for a probability distribution. We have
⁄ ≥ 0
, ( )
⁄ = = =1
( ) ( )
Solution
P( X 1 , Y 2) 0.03
P( X 1Y 2) 0.12
P(Y 2) 0.25
Page 15 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( , )
( ⁄ ) ( )
= ( )
; >0
Remarks:
( ⁄ )
=1
( ⁄ )
=1
( x, y ) 2 0 x y 1
f
XY
0 , elsewhere
Solution
( x) 2 2 x , 0 x 1
f
X
0 , elsewhere
y
( y) y
f Y
2 x 2 x
0
2y
0
( y) 2 y , 0 y 1
f
Y
0 , elsewhere
Page 16 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( x, y ) 2 , x 0 , y 0 , x y 1
f
XY
0, elsewhere
Solution
( x, y )
( x y) f 1
f X
XY
( y)
1 y
, 0 x 1 y
f Y
( x, y )
( y x) f 1
f Y
XY
( x)
1 x
, 0 y 1 x
f X
(x y 1 ) 1
f X
4
1
4 / 3 , 0 x 3/ 4
1
4
Then
1/ 2
4x 1/ 2
P( X 1 / 2 / Y 1 / 4) 4 / 3 x 2/3
0
3 0
( y x 12 )
Similarly, f Y
2, 0 y 1 / 2
Then
Page 17 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
1/ 2
1/ 2
P(Y 1 / 2 / X 1 / 2) 2y 2 y 1 / 3 1 / 3
1/ 3
P( X xi , Y y j ) P(X xi ) . P(Y y j )
for all .
Theorem: Let ( , ) be a two-dimensional continuous random variable .We say X and Y are
( ⁄ ) ( ) ( ⁄ ) ( )
independent random variables iff = or equivalently iff =
Example: Suppose
2 (i j ) , i. j 1,2,...
P( X i, Y j )
0 , elsewhere . Are X and Y independent?
Solution
P( X i) 2 ( i j ) 2 i 2 j 2 i 2 j 2 i
j 1 j 1 j 1
Similarly
P (Y j ) 2 (i j ) 2 j
i 1
P ( X i, Y j ) 2 (i j ) 2 i 2 j P ( X i).P (Y j )
Example: Suppose the joint distribution of X and Y is given as follows. Are X and Y
independent?
Page 18 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( x, y ) 4 xy, 0 x 1 0 y 1
f
XY
0 , elsewhere
Solution:
1
( x) 1
f X
4 xyy 2 xy 2
0
2x
0
1
( y) 1
f Y
4 xyx 2 x 2 y 2 y
0
0
( x, y )
f XY
4 xy (2 x ).(2 y ) g ( x ).h( y )
Exercise: Suppose that the joint cumulative distribution of two-dimensional random variable
( , ) is given as:
( , )= 1− − + ( ) > 0, > 0
0 ℎ
Then compute
a) ( ≤ 1, ≤ 1)
b) ( + ≤ 1)
Let us now consider = ( , ), a function of two random variables X and Y. It should be clear
that Z is again a random variable. Consider the following sequence of steps:
The value of Z clearly depends on s, the original outcome of the experiment. Given the
distribution of ( , ), what is the probability distribution of = ( , )?
Page 19 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
= min( , ) ; = max( , ) ; = +
( , )= (2 + 3 ); = 0,1,2; = 1,2,3
i. =( + )
ii. = ( , )
iii. = ( , )
Solution:
a) To determine the constant we make use one of the properties of a P.d.f name ly
∑ ∑ ( , )=1
⇒ 72 =1
1
⇒ =
72
b) . = {1,2,3,4,5}
1 2 3 4 5
( = ) 3 11 24 21 13
72 72 72 72 72
3
( = 1) = (0,1) =
72
6 5 11
( = 2) = (0,2) + (1,1) = + =
72 72 72
7 8 9 24
( = 3) = (0,3) + (1,2) + (2,1) = + + =
72 72 72 72
11 10 21
( = 4) = (1,3) + (2,2) = + =
72 72 72
Page 20 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
13
( = 5) = (2,3) =
72
ii. = {0,1,2,3}
0 1 2
( = ) 18 25 23
72 72 72
3 6 9 18
( = 0) = (0,1) + (0,2) + (0,3) = + + =
72 72 72 72
3 6 7 9 25
( = 1) = (1,1) + (1,2) + (2,1) + (1,3) = + + + =
72 72 72 72 72
10 13 23
( = 2) = (2,2) + (2,3) = + =
72 72 72
Theorem: Suppose that (X,Y) is a two-dimensional continuous random variable with joint pdf
( , ). Let = ( , ) = ( , ), and assume that satisfy the following
conditions:
( , ), ( , )
( , )= | ( , )|
Page 21 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
( , )=
Among the most important functions of X and Y, we will consider the sum = +
, ℎ = , ℎ = .
Theorem: Let (X,Y) is a two-dimensional continuous random variable and assume that X and Y
are independent. Hence the joint pdf may be written as ( , )= ( ) ( ). let = .
Then the pdf of W, say ( ), is given by
1
( )= ( )
Proof:
Theorem: Let (X,Y) is a two-dimensional continuous random variable and assume that X and Y
are independent. Hence the joint pdf may be written as ( , )= ( ) ( ). let = . Then
( )= ( ) ( )| |
Proof:
Solution:
Page 22 of 23
Introduction to probability and Statistics (Stat 276) Department of Statistics (AAU)
Page 23 of 23