Random Variables: Instructor: Shahrokh Farahmand

Random Variables
INSTRUCTOR: SHAHROKH FARAHMAND

Basic Definitions
A RV is a mapping from the set of events to the real line
2
SLIDES BY: SHAHROKH FARAHMAND
Basic Definitions 2
Remember: We have certain non-measurable sets on the real line
 These sets are of mathematical importance only
 All sets of scientific and engineering importance are measurable
 They are of one of the forms
3
Cumulative distribution function (CDF)
F(x) is nondecreasing
4
Properties of CDF
CDF is continuous for continuous RVs, that is P[X=a]=0 for every a
5
Example 1. Uniform distribution
6
Example 2. Binomial distribution
7
Example 3. Some binomial probabilities
8
Probability density function (PDF)
For continuous distributions
9
Properties of PDF
10
Gaussian distribution
Tail probability:
11
Various probabilities for Gaussian
12
Rayleigh distribution
Example. Amplitude of NLOS fading channels
13
Exponential distribution
Example. Power of NLOS fading channels
14
Uniform distribution
Used in cases that we do not have much info on

parameter X
Ex. Reception time of a random call on a [0,T]
Remember number of calls were modelled as
Poisson
Ex. Position of a cellular user in BS coverage area
15
Laplacian distribution
Main differences with Gaussian:

1) Heavier tail
2) Sharp raise in origin
Applications:
1) Modelling outliers
2) Prior for sparse recovery
16
Chi-Squared distribution
Applications and properties
17
Maximum ratio combining
Consider a single antenna Tx transmitting to a m antenna Base
Station (BS)
Channel gain between Tx and i’th antenna:
NLOS model (known at Rx):
Tx symbol: Received at antenna i:
Noise:
18
MRC 2
Equivalent channel Equivalent noise
Equivalent channel is chi-squared with m degrees of freedom

MRC is the optimum combiner for fading AWGN channels in terms of
maximizing the SNR
19
Probability of error in support recovery
Consider the following problem
Vector x has two zeros and a one, but we do not know which entry is
one. Want to find the one entry from knowledge of y,A. We apply the
following decision rule
Suppose WLOG that first element is nonzero
20
Probability of error in support recovery 2
A common practice is to use random matrices A with IID entries
21
Discrete RVs
Examples. Bernoulli, Binomial, Poisson
 For Bernoulli: P[X=0]=P[f], P[X=1]=P[s]
 For Binomial
 For Poisson,
The PDF for discrete RVs is called

probability mass function (PMF)
Unified framework:
22
Mixed RVs
A mix of continuous/discrete RVs.
23
Geometric distribution
Repeat Bernoulli trials until first success is observed
Applications:
1) MAC layer Tx with ARQ (Remember Erasure channel)
2) Random Access: Slotted Aloha
3) End-t—End transport layer protocols (e.g., TCP)
24
Example. Mixed RVs
25
Example. Mixed RV 2
26
Example. Mixed RV 3
27
Conditional PDF Examples
28
Conditional PDF Examples 2
29
30
31
32
33
Joint CDFs/PDFs
Just integrate over the region that you want to compute its probability
How do we compute marginal from joint?
34
Joint PDF/CDFs
Two ways to compute F(x):
For any set A
35
Independent RVs
How do we obtain joint from marginal?
If X,Y are independent
 Subsequently
For example
36
Examples for joint distribution 1
Question. Structure of PDF?

Question. Can we integrate separately?
37
Example for joint distribution 2
38
Examples for joint distribution 3
39
Further examples 1
40
Further examples 2
41
Further examples 3
42
Further examples 4
43
Further examples 5
44
Further examples 6
45
Further examples 6
46
Further examples 7
47
Jointly Gaussian distribution
48
Conditional PDF for continuous RVs
49
Conditional JG distribution
50
Conditional density of exponential
This conditional distribution is a shift exponential. It begins at t

instead of zero.
Interpretation. Suppose arrival time of a packet at a node has an
exponential distribution, provided that packet has not arrived till
time t, the arrival distribution remains exponential. This is referred to
as the memoryless property of exponential distribution.
51
Thank You!
52

Random Variables: Instructor: Shahrokh Farahmand

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Random Variables: Instructor: Shahrokh Farahmand

Uploaded by

Copyright:

Available Formats

Random Variables

INSTRUCTOR: SHAHROKH FARAHMAND

For continuous distributions

Example. Amplitude of NLOS fading channels

Example. Power of NLOS fading channels

Used in cases that we do not have much info on

Main differences with Gaussian:

Applications and properties

Equivalent channel Equivalent noise

Equivalent channel is chi-squared with m degrees of freedom

Suppose WLOG that first element is nonzero

A common practice is to use random matrices A with IID entries

The PDF for discrete RVs is called

For any set A

Question. Structure of PDF?

This conditional distribution is a shift exponential. It begins at t

You might also like