Attribution Non-Commercial (BY-NC)

16 views

Attribution Non-Commercial (BY-NC)

- Report Prob&Stat
- Poisson
- LAB4
- probabilitycs
- Degrees of Freedom: A Correction to Chi-Square for Physical Hypotheses
- CEM_Part-VI_Chap-6
- Uniform
- 10.1.1.133
- 2.5_tsikalakis
- Handout
- Fall 2009 Final
- D09TE5-EXTC-rsana
- Ch3_examples From Mecha
- jurnal multivariate normal test.pdf
- Label in Spss
- Lyon Normal Distributions
- nwdg Prblm Sts
- SPE-84372-PA
- Ex3AS
- Statistics for Engineers

You are on page 1of 2

Gaussian Random Variables and Vectors

The Gaussian Probability Density Function

This is the most important pdf for this course. It also called a normal pdf.

" #

1 (x − m)2

fX (x) = √ exp − .

σ 2π 2σ 2

It can be shown this fX integrates to 1 (i.e., it is a valid pdf), and that the mean of the random

variable X with the above pdf is m and the variance is σ 2 .

The statement “X is Gaussian with mean m and variance σ 2 ” is compactly written as “X ∼

N (m, σ 2 ).”

The cdf corresponding to the Gaussian pdf is given by

" #

x x

1 (u − m)2

Z Z

FX (x) = fX (u)du = √ exp − du.

−∞ −∞ σ 2π 2σ 2

u−m

This integral cannot be computed in closed-form, but if we make the change of variabe =v

σ

we get

Z x−m 2

σ 1 v x−m

FX (x) = √ exp − dv = Φ ,

−∞ 2π 2 σ

where Φ is the cdf of a N (0, 1) random variable, i.e.,

Z x 2

1 u

Φ(x) = √ exp − du.

−∞ 2π 2

Φ(−x) = 1 − Φ(x).

Z ∞ 2

1 u

Q(x) = 1 − Φ(x) = √ exp − du.

x 2π 2

For computing the Q function in Matlab, we may use the Matlab functions erf or erfc after

modifying them appropriately.

c

V.V. Veeravalli, 2006 1

Jointly Gaussian Random Variables

Two random variables X and Y are said to be jointly Gaussian if their joint density satisfies the

equation

(x − mX )2 2ρ(x − mX )(y − mY ) (y − mY )2

1 1

fX,Y (x, y) = exp − 2 − + .

2(1 − ρ2 ) σY2

p

2πσX σY 1 − ρ2 σX σX σY

Note that the following properties hold:

2

• X is Gaussian with mean mX and variance σX

• Y is Gaussian with mean mY and variance σY2

• The conditional densities fX|Y (x|y) and fY |X (y|x) are also Gaussian

• ρ is the correlation coefficient between X and Y . If ρ = 0, then X and Y are independent.

• Z = aX + bY is also Gaussian (what are the mean and variance of Z?)

The definition of jointly Gaussian random variables extends quite naturally to n variables X1 , X2 , . . . , Xn .

Let the vectors X and m, and matrix Σ be defined by

X1 m1 Σ11 Σ12 . . . Σ1n

X2 m2 Σ21 Σ22 . . . Σ2n

X = . m = E[X] = . Σ = E[(X − m)(X − m)⊤ ] = . .. .. ..

.. .. .. . . .

Xn mn Σn1 Σn2 . . . Σnn

where mi = E[Xi ] and Σij = cov(Xi , Xj ). Then the random variables X1 , X2 , . . . , Xn are jointly

Gaussian if their joint density is given by

1 1 ⊤ −1

f (x) = p exp − (x − m) Σ (x − m) .

(2π)n det(Σ) 2

The statement “X1 , X2 , . . . , Xn are jointly Gaussian with mean m and covariance matrix Σ” can

be compactly written as “X ∼ N (m, Σ)”.

Properties of jointly Gaussian random variables include:

• Any subset of jointly Gaussian random variables conditioned on any other subset of the

original random variables is also jointly Gaussian.

• Jointly Gaussian random variables that are uncorrelated are also independent.

• Linear combinations of jointly Gaussian random variables are also jointly Gaussian. In par-

ticular, suppose we produce the vector Y = [Y1 Y2 . . . Ym ]⊤ using the linear transformation

Y = AX, where A is an m × n matrix. Then,

Y ∼ N AmX , AΣX A⊤

i.e., Y is jointly Gaussian with mean mY = AmX , and covariance matrix ΣY = AΣX A⊤ .

c

V.V. Veeravalli, 2006 2

- Report Prob&StatUploaded byvinz926
- PoissonUploaded byVincent Vetter
- LAB4Uploaded byAditya Dev
- probabilitycsUploaded byMohammed Farouk Agamy
- Degrees of Freedom: A Correction to Chi-Square for Physical HypothesesUploaded byJohn Michael Williams
- CEM_Part-VI_Chap-6Uploaded bysherasa
- UniformUploaded byJaph Dee
- 10.1.1.133Uploaded byAnbumani Balakrishnan
- 2.5_tsikalakisUploaded byYugandhar Pasham
- HandoutUploaded byFariza Makhay
- Fall 2009 FinalUploaded byAndrew Zeller
- D09TE5-EXTC-rsanaUploaded byNikhil Hosur
- Ch3_examples From MechaUploaded byJames Thee
- jurnal multivariate normal test.pdfUploaded byNurlita Kusuma Dewi
- Label in SpssUploaded byAnonymous XR7iq7
- Lyon Normal DistributionsUploaded byNav Sahi
- nwdg Prblm StsUploaded byalonsooo_
- SPE-84372-PAUploaded bySamantha Davidson
- Ex3ASUploaded byHoàng Long
- Statistics for EngineersUploaded byLakshmi Vennela
- Convex Recovery of a Structured SignalUploaded byYen Sin
- Joint SheetUploaded byharshit
- 11_MANOVAUploaded bySunil Kamat
- Chat Zi Diamantis 2011Uploaded bycakisa82
- S241 Lecture 22Uploaded byCarlos Alban
- CompleteNote.pdfUploaded byRichard Ding
- 2016CSTAT111Uploaded byAnonymous Ui8W8pexGO
- Exponent Lifting Sol 2Uploaded byjohnson
- Introduction to manufacturing systems Probability CompactUploaded byoscar
- Chapter 6 slides 1 per page.pdfUploaded byLexa Esor

- Rtos ComparisonUploaded byAnand Patra
- verisitySOCverifyUploaded byHarsha
- Implementation of MACUploaded byHarsha
- Intro 80211 AcUploaded byHarsha
- EMF NOTESUploaded byTaimur Musharraf
- Linear Convolution Program in c Language Using CCStudioUploaded byHarsha
- 802.11acUploaded byHarsha
- Electric Circuits and Electron DevicesUploaded byHarsha
- IEEE 802.11 wireless LANUploaded byHarsha
- UDPUploaded byHarsha
- SegmentationUploaded byHarsha
- Mobile CommunicationsUploaded byHarsha
- MAC LayerUploaded byHarsha
- Internet ProtocolUploaded byHarsha
- Edge DetectionUploaded byHarsha
- Data Compression BasicsUploaded byHarsha
- Antenna System in Cellular Mobile CommunicationUploaded bybilalkhan107
- X Band OscillatorUploaded byHarsha
- Gunn DiodesUploaded byAr-Jay O Panoy
- 11 Gunn DiodesUploaded byHarsha
- Serial Comm in 8051Uploaded byHarsha
- Microprocessors and MicrocontrollersUploaded bygauravprataprana
- ARM Instruction SetUploaded byHarsha
- 8051 Timer and CounterUploaded byHarsha
- 8051 Core SpecificationUploaded byHarsha
- 05 ThumbUploaded bypavankrishnat
- Linear ConvolutionUploaded byHarsha
- Lecture09 TransmissionUploaded by23wings
- Network LayerUploaded byHarsha
- Computer NetworksUploaded by23wings

- tincion corneal.pdfUploaded bypitbullsaw
- Masters - ASMUploaded byCizenando Morello Bonfá
- 1. Proj Rdg. Event Study OverviewUploaded byArathi Sundarram
- Bayesian Econometric MethodsUploaded byAlex Din
- Psychoeducational Assessment-2013-Epistemic Belief Inventory (EBI).pdfUploaded byLisa
- Jurnal implementasi package MVN di RUploaded byMARTINA SARI
- A Fast, Decentralized Covariance Selection-based Approach to Detect Cyber Attacks in Smart GridsUploaded byHgoglez
- 5 (1)Uploaded byJhalin Gutierrez
- Wireless CommunicationUploaded byLucio Bianchi
- 10.1098@rspa.2016.0263.pdfUploaded byDaniela Jara
- Probability and Statistics_CookbookUploaded bySubhashish Sarkar
- Ml BenchUploaded byducpro2811
- Manly_Caps1-3.pdfUploaded byAndressa Lima
- Introduction to the Mathematical and Statistical Foundations of EconometricsUploaded byRiccardo Taruschio
- BaayenDavidsonBates2008MixedModels_CrossedRandomUploaded byDebilcina
- 03. CSEUploaded byThanuambika
- Risk AggregationUploaded byKostas
- Robust Speech Recognition on Intelligent Mobile Devices with Dual-MicrophoneUploaded byiloes
- Pattern classification and scene analysis.pdfUploaded byjameelahmad
- Machine Learning AssignmentUploaded byNikhilesh Rajaraman
- LN_0.pdfUploaded byRakesh Kota
- 133Uploaded byPraveen Krishna
- Gaussian Conjugate Prior Cheat SheetUploaded byHirdesh Kumar
- Gp TutorialUploaded byJorge Eliecer Loaiza
- Statistics 2008Uploaded byAmeer Bakhsh
- PE_Teoria e SimulaçãoUploaded byLuiz Soneghet
- Design of Experiments Notes_IIT DelhiUploaded byvicksgeorge
- Maximum LikelihoodUploaded byAkolgo Paulina
- Testing for Segregation Distortion in Genetic Scoring-NATUREUploaded byvahidvashar
- Econometrics Notes - University of Utah (370 Pages)Uploaded byJustin_C_R

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.