SCHOOL OF ADVANCED SCIENCES

DEPARTMENT OF MATHEMATICS
FALL SEMESTER – 2020~2021

MAT2001 – Statistics for Engineers

(Embedded Theory Component)

COURSE MATERIAL
Module 2
Random Variables
Syllabus:
Introduction – Random Variables – Probability Mass Function,
Distribution and Density Functions – Joint Probability Distribution
and Joint Density Functions – Marginal, Conditional Distributions and
Density Functions – Mathematical Expectation and its Properties –
Covariance – Moment Generating Function – Characteristic Function.

Prepared By: Prof. M. Mubashir Unnissa (In-charge)

Prof. S. Dinesh Kumar
Prof. Rajesh Bhatt

The course in-charges thankfully acknowledge the course materials preparation

committee in-charge and members for their significant contribution in bringing
out of this course material.

************************************
Dr. D. Easwaramoorthy
Dr. A. Manimaran
Course In-charges – MAT2001-SE,
Fall Semester 2020~2021,
Department of Mathematics,
SAS, VIT, Vellore.
************************************
 MAT2001- MODULE 2 – RANDOM VARIABLES

Random Variable

A random variable is a function that associates a real number with each element in the
sample space. That is, the function X (s)  x that maps the elements of the sample space S into
real numbers is called the random variable associated with the concerned experiment.

Example:
Let the sample space S consisting of the numbers on die i.e. S = {1,2,3,4,5,6}.We define a R.V
X(s)=s 2 (Square of number of points on a die).
The points in S now map onto the real line as the {1,4,9,16,25,36}.
Solution: A mapping of S = {HH, HT, TH, TT} into the real line

{1,2,3,4,5,6}

-1 0 1 2 3… 36
S

DISCRETE RANDOM VARIABLES

Probability function (or) Probability Mass Function (p.m.f):
If X is a discrete R.V. which can take the values x1 , x2 , x3 ,... such that P( X  xi )  pi
then pi is called the probability mass function and it satisfies the following conditions:

i) pi  0

ii)  pi  1
i

Probability distribution function

The collection of pairs {xi , pi } is called the probability distribution of the R.V. X.

X  xi x1 …………. xi
pi p1 …………. pi

Example:
CONTINUOUS RANDOM VARIABLES
A random variable X is said to be a continuous random variable if it takes all possible values
between certain limits or in an interval which may be finite or infinite.

Example: operating time between two failures of a computer

Probability density function (p.d.f):
dx dx
If X is a continuous R.V. such that P( x   X  x  )  f ( x)dx then f (x) is
2 2
called the probability density function and it satisfies the following conditions:
i) f ( x)  0 ,    x  


ii)  f ( x)dx  1


Distribution Function (or) Cumulative Distribution Function (cdf)

If X is a R.V, discrete or continuous, then F ( x)  P( X  x) is called the cumulative
distribution function of X.

i) If X is discrete then F ( x)   p j
j
x
ii) If X is continuous then F ( x)  P(  X  x)   f ( x)dx

Relationship between cumulative distribution function and probability distribution
dF ( x)
function f ( x) 
dx
If p(x) is the p.m.f of a random variable ‘X’ then 𝑀𝑒𝑎𝑛 = ∑∞
𝑛=0 𝑥𝑝(𝑥)

Variance =∑∞ 2
𝑛=0(𝑥 − 𝑚𝑒𝑎𝑛) 𝑝(𝑥)

Moment about the mean = ∑∞ 𝑟

𝑛=0(𝑥 − 𝑚𝑒𝑎𝑛) 𝑝(𝑥)
If f (x) is the p.d.f of a random variable ‘X’ which defined in the interval (a, b) then

b b
(i) Mean =  xf ( x ) dx (ii) Variance =  ( x  mean) 2 f ( x)dx
a a

b
(iii) Moment about mean =  ( x  mean) r f ( x)dx
a

Problem 1:
If the random variable takes the values 1,2,3 and 4 such that
2P( X  1)  3P( X  2)  P( X  3)  5P( X  4) , find the probability distribution and the
cumulative distribution function of X.

Solution:
Let 2P( X  1)  3P( X  2)  P( X  3)  5P( X  4)  k

k k k
That is, P( X  1)  , P( X  2)  , P( X  3)  k , P( X  4) 
2 3 5
We know that,  pi  1
i

k k k 30
That is,   k  1  k 
2 3 5 61

The probability distribution of X is given by

xi 1 2 3 4
P( xi ) 15 10 30 6
61 61 61 61

The c.d.f. F(x) is defined as F ( x)  P( X  x) .

When x  1, F ( x)  0

15
When 1  x  2, F ( x)  P( X  1) =
61
25
When 2  x  3, F ( x)  P( X  1)  P( X  2) 
61
55
When 3  x  4, F ( x)  P( X  1)  P( X  2)  P( X  3) =
61
When x  4, F ( x)  P( X  1)  P( X  2)  P( X  3)  P( X  4)  1
Problem 2:
A random variable X has the following probability function.

Values of X 0 1 2 3 4 5 6 7 8
P( X  x) a 3a 5a 7a 9a 11a 13a 15a 17a

(i) Find the value of a (ii) Find P( X  3) , P(0  X  3) , P( X  3)

(iii) Find the distribution function of X.

Solution:
i) We know that ,  pi  1
i
a + 3a + 5a + 7a + 9a + 11a + 13a + 15a + 17a = 1
1
81a = 1  a
81
ii) P( X  3) = P( X  0) + P( X  1) + P( X  2) = a + 3a + 5a
1
= 9a =
9
8
P(0  X  3) = P( X  1) + P( X  2) = 3a + 5a = 8a =
81
1 8
P( X  3) = 1  P( X  3) = 1 =
9 9
iii) Distribution function F(x) of X
Values of X 0 1 2 3 4 5 6 7 8
F ( x)  P( X  x) a 4a 9a 16a 25a 36a 49a 64a 81a
1 4 9 16 25 36 49 64 1
81 81 81 81 81 81 81 81
Problem 3:
Problem 4:
Problem 5:

Problem 6
Problem 7:

 ( x  1)
,1  x  1
If a random variable ‘X’ has the p.d.f. f ( x)   2 Then find the mean and variance.
 0 , otherwise

Solution:

1 1 ( x  1) 11 1
We know that, Mean =  xf ( x)dx =  x dx =  ( x 2  x)dx =
1 1 2 2 1 3

1 1 1 ( x  1)
Variance =  ( x  mean) 2 f ( x)dx =  ( x  ) 2 dx
1 1 3 2

1 2
=  (9 x 2  1  6 x)( x  1)dx =
1 9
Cumulative distribution function:

If ( X , Y ) is a two dimensional R.V (discrete or continuous), then

F ( x, y)  P( X  x and Y  y) is called the cumulative distribution function of ( X , Y ) .

i) In discrete case, F ( x, y )    pij

j i
y x
ii) In continuous case, F ( x, y )    f ( x, y )dxdy
 
Mathematical Expectations:

Let X be a random variable with probability density function f (x) or probability mass function p(x)
.Then the mathematical expectation of ‘X’ is denoted by E(X)

Mean (or) expectation is a significant number representing the behavior of a random variable.

If 𝑋 is a discrete random variable then

∞

𝐸[𝑋] = ∑ 𝑥𝑝(𝑥)
𝑖=0

∞
2]
𝐸[𝑋 = ∑ 𝑥 2 𝑝(𝑥)
𝑖=0

𝐸[𝑋𝑌] = ∑ ∑ 𝑥𝑦𝑝(𝑥, 𝑦)

If 𝑋 is a continuous random variable then

∞

𝐸[𝑋] = ∫ 𝑥𝑓(𝑥)𝑑𝑥
−∞
∞

𝐸[𝑋 2 ] = ∫ 𝑥 2 𝑓(𝑥)𝑑𝑥
−∞
∞ ∞

𝐸[𝑥𝑦] = ∫ ∫ 𝑥𝑦𝑓(𝑥, 𝑦)𝑑𝑥𝑑𝑦

−∞ −∞
𝑉𝑎𝑟(𝑥) = 𝐸[𝑋 2 ] − (𝐸[𝑋])2

Note : 𝑀𝑒𝑎𝑛 = 𝐸[𝑋]; 𝑀𝑒𝑎𝑛 𝑠𝑞𝑢𝑎𝑟𝑒 = 𝐸[𝑋 2 ]

𝑪𝒐𝒗(𝑿, 𝒀) = 𝑬[𝑿𝒀] − 𝑬[𝑿]𝑬[𝒀]

𝑪𝒐𝒗(𝑿,𝒀)
𝒓(𝑿, 𝒀) =
√𝒗𝒂𝒓(𝒙)√𝒗𝒂𝒓(𝒀)

Note: If 𝑿 𝒂𝒏𝒅 𝒀 are independent random variables then 𝑬[𝑿𝒀] = 𝑬[𝑿]𝑬[𝒀]

Conditional Probability Function of X and Y (Discrete)

i) The conditional probability function of X given Y  y j is given by

P{ X  xi , Y  y j } pij
P{ X  xi Y  y j }  
P{Y  y j } p j

ii) The conditional probability function of Y given X  xi is given by

P{ X  xi , Y  y j } pij
P{Y  y j X  xi }  
P{ X  xi } pi 

Note:

The two R.V’s ofX and Y are said to be independent if

P{ X  xi Y  y j }  P( X  xi ) P(Y  y j )

That is, pij  pi   p j

Conditional density function of X and Y : (Continuos)

i) The conditional density of X given Y is given by

f ( x, y )
f ( x y) 
fY ( y )

ii) The conditional probability function of Y given X is given by

f ( x, y )
f ( y x) 
f X ( x)

Note: If X and Y are independent the 𝒇(𝒙, 𝒚) = f X ( y) . fY (y)

Properties of Expectation :
1. 𝑬[𝑿 + 𝒀] = 𝑬[𝑿] + 𝑬[𝒀]
2. 𝑬[𝑿𝒀] = 𝑬[𝑿]𝑬[𝒀] 𝑿 𝒂𝒏𝒅 𝒀 𝒂𝒓𝒆 𝒊𝒏𝒅𝒆𝒑𝒆𝒏𝒅𝒆𝒏𝒕
3. 𝑬[𝒂} = 𝒂 𝒘𝒉𝒆𝒓𝒆 𝒂 𝒊𝒔 𝒄𝒐𝒏𝒔𝒕𝒂𝒏𝒕
4. 𝑬[𝒂𝑿 + 𝒃] = 𝒂𝑬[𝑿] + 𝒃 where 𝒂 𝒂𝒏𝒅 𝒃 are constants
5. 𝑬[𝒂 + 𝒇(𝒙)] = 𝒂 + 𝑬[𝒇(𝒙)]
6. 𝑬[∑ 𝒂𝒊 𝑿𝒊 ] = ∑ 𝒂𝒊 𝑬[𝑿𝒊 ] i=1,2,3…n
Properties of variance:
 𝑽𝒂𝒓(𝒂) = 𝟎 𝒘𝒉𝒆𝒓𝒆 𝒂 𝒊𝒔 𝒄𝒐𝒏𝒔𝒕𝒂𝒏𝒕

Properties of covariance
Prob 1:

Problem 2:

Problem 3:
Suppose that 𝑿 and 𝒀 are independent random variables having density function
𝒇(𝒙, 𝒚) = 𝒆−(𝒙+𝒚) , 𝒙 > 𝟎, 𝒚 > 𝟎 find the density function of the random variable
𝑿⁄𝒀

Problem 4
Problem 5

Problem 6:
Problem 7
Problem 8

Problem 9

Problem 10
Problem 11
Problem 12
Problem 13
Problem 15

 xy
 ,0  x  4,1  y  5
Two R.V’s X and Y have joint pdf f ( x, y )   96
 0 , elsewhere
Find (i) E(X) (ii) E(Y) (iii) E(XY) (iv) E(2X + 3Y) (v) Var(X)

(vi) Cov(X,Y).

Solution:

 
i) E ( X )    xf ( x, y )dxdy
 

54  xy 
=   x dxdy
1 0  96 

8
=
3
 
ii) E (Y )    yf ( x, y )dxdy
 

54  xy 
=   y dxdy
1 0  96 

31
=
9
 
iii) E ( XY )    xyf ( x, y )dxdy
 

54  xy 
=   xy  dxdy
10  96 

248
=
27
8 31 47
iv) E[2 X  3Y ]  2 E ( X )  3E (Y ) = 2. + 3. =
3 9 3
v) We know that, Var( X )  E ( X 2 )  [ E ( X )]2

 
Now, E ( X 2 )   2
 x f ( x, y )dxdy
 

2 xy 
54
= x  dxdy
10  96 

=8

 Var( X )  E ( X 2 )  [ E ( X )]2
2
8 8
=8-   =
3 9
vi) Cov( X , Y )  E ( XY )  E ( X ).E (Y )

248  8  31 
= -   
27  3  9 

=0
Moment generating function (M.G.F.)

The m.g.f of a random variable X(about origin) whose probability function f (x) is given by

M X (t )  E (e tX )

  e tx f ( x)dx , for a continuous probabilit y distributi on

=


 
=

e x
tx
p( x), for a discrete probabilit y distributi on

Where t is real parameter and the integration or summation being extended to the entire range of x.

To find the rth moment of X about origin,


tr
M X (t )    ' r [ using  ' r  E ( X r )
r 0 r!

tr
This gives the m.g.f interms of moments. Thus the coefficient of in M X (t ) gives the rth moment
r!
of the r.v.’X’ about origin(  'r ).

Since M X (t ) generates moments, it is known as moment generating function.

Characteristic Function
In few cases the m.g.f. does not exist. In this case we use characteristic function which is more
serviceable function than m.g.f.

The characteristic function of a random variable X whose probability function f (x) is given by

 X (t )  E (e itX )

  e itx f ( x)dx , for a continuous probabilit y distributi on

= 


 
= 

e x
itx
p( x), for a discrete probabilit y distributi on
Properties of Characteristic Functions:

Property:1

 X (0)  1

2.  X (t )  1   X (0)

3.  X (t )   X (t ) where  X (t ) is the complex conjugate of  X (t ) .

Problems:

1. Find the m.g.f of the R.V. with the probability law P(X=x)= q x 1 p , x=1,2,3…..Find the Mean
and Variance.

Solution:

We know that,

M X (t )  E (e tX )

= e
x
tx
P( x) [ by definition


  e tx q x 1 . p
x 1

  e tx q x q 1 . p
x 1

 q 1 . p  (e t q) x .
x 1

p t  t x 1
 .qe  (e q)
q x 1

 pet [1  qet  (qet ) 2  ...]

 pet (1  qet ) 1
pet
 ..............................(1)
(1  qet )

Mean:
 Differentiating (1) w.r.t. ‘t’, we get

d pet
{M X (t )}  M ' X (t ) 
dx (1  qet ) 2
p 1
1 ' (about origin)  M ' X (0)  
(1  q ) 2
p

Variance:

  2 ' 1 ' 2
d2 pet (1  qet )
{M (t )}  M ' ' (t ) 
(1  qet ) 3
X X
dx 2
p(1  q)
 2 ' (about origin)  M ' ' X (0) 
(1  q ) 32
q
 2
p

2. Find the m.g.f. of the R.V. whose moments are  r '  (r  1)! 2 r .
Solution:

We know that the m.g.f interms of moments is given by


tr
M X (t )    ' r
r  0 r!

tr
  (r  1)!2 r
r  0 r!


(2t ) r (r  1)!

r 0 r!
 1  2(2t )  3(2t ) 2  ....
1
 (1  2t )  2 
(1  2t ) 2
Problem: