0 Up votes0 Down votes

6 views7 pagesecen303

Jun 22, 2013

© Attribution Non-Commercial (BY-NC)

PDF, TXT or read online from Scribd

ecen303

Attribution Non-Commercial (BY-NC)

6 views

ecen303

Attribution Non-Commercial (BY-NC)

- Neuromancer
- The E-Myth Revisited: Why Most Small Businesses Don't Work and
- How Not to Be Wrong: The Power of Mathematical Thinking
- Drive: The Surprising Truth About What Motivates Us
- Chaos: Making a New Science
- The Joy of x: A Guided Tour of Math, from One to Infinity
- How to Read a Person Like a Book
- Moonwalking with Einstein: The Art and Science of Remembering Everything
- The Wright Brothers
- The Other Einstein: A Novel
- The 6th Extinction
- The Housekeeper and the Professor: A Novel
- The Power of Discipline: 7 Ways it Can Change Your Life
- The 10X Rule: The Only Difference Between Success and Failure
- A Short History of Nearly Everything
- The Kiss Quotient: A Novel
- The End of Average: How We Succeed in a World That Values Sameness
- Made to Stick: Why Some Ideas Survive and Others Die
- Algorithms to Live By: The Computer Science of Human Decisions
- The Universe in a Nutshell

You are on page 1of 7

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

Solutions to Quiz 2: Spring 2006 Problem 1: (30 points) Each of the following statements is either True or False. There will be no partial credit given for the True False questions, thus any explanations will not be graded. Please clearly indicate True or False in the below, ambiguous marks will receive zero credit. All parts have equal weight. Points breakdown: Each question carries 3 points

(a) X and Y are independent random variables. X is uniformly distributed on the interval [2, 2], while Y is uniformly distributed on the interval [1, 5]. If Z = X + Y , then fZ (3) = 1/6. True Since Z = X + Y and X,Y are independent, the PDF of Z (fZ (z )) can be obtained by convolving the PDFs of X (fX (x)) and Y (fY (y )). That is, fZ (z ) =

fX (u)fY (z u) du =

fY (u)fX (z u) du.

However, since we are interested in only fZ (3), we need to evaluate the convolution integral at only one point (z = 3). The convolution sum and the corresponding gure are shown below. fZ (3) =

u=5 u=1

fY (u)fX (3 u) du =

u=5

u=1

1 1 1 1 ( )( ) du = 4= 6 4 24 6

fz(u)

u 1 0 1 (z2) 3 5 (z+2)

(b) If X is a Gaussian random variable with zero mean and variance equal to 1, then the density function of Z = |X | is equal to 2fX (z ), z 0. True Here Z is a derived random variable dened by Z = |X |. We can obtain the PDF of Z using the standard technique of nding the CDF of Z and then obtaining the PDF by dierentiating the CDF. We have (for z 0) FZ (z ) = P(Z z ) = P(|X | z ) = P(z X z ) = FX (z ) FX (z ).

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

Taking derivatives, fZ (z ) = fX (z ) + fX (z ) = 2fX (z ) since the standard Gaussian PDF is symmetric (c) The sum of a random number of independent Gaussian random variables with zero mean and unit variance results in a Gaussian random variable regardless of the distribution of N (the number of sums). False This can be veried by taking the transform of the new random variable. If X1 , X2 . . . XN are IID Gaussian random variables and N is also a random variable independent of the Xi s, then the transform of the sum Y = X1 + X2 . . . XN is given by MY (s) = MN (s)|es =MX (s) . This does not take the form es e

s2 2 2

(d) If X and Y are independent random variables, both exponentially distributed with parameters 1 and 2 respectively. Then the random variable Z = min{X, Y } is also exponentially distributed. True Here Z is a derived random variable dened as Z = min{X, Y }. We can obtain the PDF of Z by rst determining its CDF and then taking the derivative. The CDF of Z is given by FZ (z ) = P(Z z ) = P(min{X, Y } z ). It is not very straight forward to determine this probability. Instead, we can easily obtain P(Z z ). Since this is equivalent to 1 FZ (z ), we have 1 FZ (z ) = P(Z > z ) = P(min{X, Y } > z ) = P(X > z, Y > z ) = P(X > z )P (Y > z ) since X,Y are independent = exp(1 z ) exp(2 z ) = exp((1 + 2 )z ) Taking the derivative, we have fZ (z ) = (1 + 2 ) exp((1 + 2 )z ). This is the pdf of an exponential random variable with parameter (1 + 2 ). (e) Let the transform associated with a random variable X be MX (s) =

es 1s

15

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

Then E[X ] is equal to 30. True A straight forward way to conrm this fact is to compute the expected value by taking the derivative of MX (s) and then evaluating it at s = 0. We have dMX (s) es 15 (1 s)es es (1) = 15 ds 1s (1 s)2 dMX (s) = 15 2 = 30 E[X ] = ds s=0

The next set of questions are concerned with two independent random variables: Y is normal with mean 0 and variance 1, and X is uniform between [0, 1]. Z = X + Y . (f) The conditional density of Z given X , fZ |X (z |x), is normal with mean x and variance 1. True Given the value of x, the random variable Z is a derived random variable given by Z = x + Y . This is a normal random variable with mean x + E[Y ] and variance var(Y ). (g) var(Z ) = 2. False var(Z ) = var(X ) + var(Y ) since X and Y are independent 1 = + 1 = 2 12 (h) E[X | Z = 1] = 1. False Since X is uniformly distributed between 0 and 1, the expected value cannot take on negative values. (i) cov(X, Z ) = var(X ) True By denition, we have cov(X, Z ) = E[XZ ] E[X ]E[Z ]. Using Z = X + Y , we have cov(X, Z ) = E[X (X + Y )] E[X ]E[X + Y ] = E[X 2 ] + E[XY ] E[X ](E[X ] + E[Y ]) = E[X 2 ] (E[X ])2 + E[XY ] E[X ]E[Y ] = var(X ) + cov(X, Y ) Since X and Y are independent, cov(X, Y ) = 0. (j) Z = E[X | Z ] + E[Y | Z ]

True

Since Z = X + Y , we have E[Z |Z ] = E[X + Y |Z ] conditional expectation is linear Z = E[X |Z ] + E[Y |Z ] since E[Z |Z ] = Z

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

Problem 2: (25 points) Points breakdown: (a) 7 points; (b)(d) 6 points each The continuous random variables X and Y have a joint pdf given by

y 2

fX,Y (x, y ) =

In class we have shown the minimum least squares estimate of Y is given by E[Y | X = x] (a) Find the least squares estimate of Y given that X = x, for all possible values of x. For full credit write the functional form, as opposed to a graph.

The least square estimate of Y based on X is given by E[Y | X ]. In order to determine this

quantity, we need to evaluate the conditional density fY |X (y |x), for all values of x and y .

Since the joint density is uniform through out the specied region, the conditional density

will also be uniform and is given by fY |X (y |x) =

1, 0 y 1, x1 1, x 1 y x, 1 < x 2

(1)

1 2

1 2

0X1 1 < X 2

(b) Let g(x) be the estimate from part (a). Find E[g(X )] and var(g(X )). g(X ) is a derived random variable that is dened as g(X ) =

0 X 1

1 , 1<X2 X2

1 2,

The expected value of g(X ) is given by E[g(X )] = g(x)fX (x) dx. The marginal density of X (fX (x)) can be obtained by integrating the joint density. (It is easy to show that c = 0.5,

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

since the total volume 2c should be unity).

y=1 =0 c dy fX (x) = y y =x

1

=1 2 , 0 < x 1

1

y =x1 c dy = 2 , 1 < x 2

Thus we have

E[g(X )] =

1 1 ( )( ) dx + x=0 2 2

1

1 3 ( )(x ) dx = 2 4

x=1 2

1 1 ( )( )2 dx + x=0 2 2

1 1

2

( )(x )2 dx = 2 3

x=1 2

2 2

2 = 3

3 4

5

0.104 48

(c) Find the mean square error E[(Y g(X ))2 ]. Is it the same as E[var(Y |X )]? The mean square error E[(Y g(X ))2 ] is a function of both Y and X . In general, we have to evaluate this quantity by evaluating the mean of h(X, Y ) = (Y g(X ))2 over the joint density fX,Y (x, y ). However, we can simplify this by using iterated expectation. E[(Y g(X ))2 ] = E[E[(Y g(X ))2 | X ]] = E[E[(Y E[Y |X ])2 | X ]] = E[var(Y |X )] since g(X ) = E[Y |X ] since E[(Y E[Y |X ])2 | X ] = var(Y |X )

1

12 , 0

Since fY |X is uniform for all values of X as seen before, we have var(Y |X ) = Furthermore, we know that fX (x) is also uniform in this interval. Thus, E[var(Y |X )] = (d) Find var(Y ). Using total variance theorem, we have var(Y ) = E[var(Y |X )] + var[E[Y |X ]]

1

= E[ ] + var[g(X )] from part (b) 12

1 5 3

= + = = 0.1875 12 48 16

< X < 2.

x=0

1 1 1

dx = 2 12 12

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

Problem 3: (42 points)

Points breakdown: (a-g) 6 points each

Please write all work for Problem 3 in your second blue book . No work recorded below will be graded. All parts have approximately the same weight. Each year, a publisher sends Professor MD a random number of text books to review. The number of books Professor MD receives each year can be modeled as a Poisson random variable N , with mean . Each book contains a random number of typos, where the number of typos in one book can be modeled as a Poisson random variable with mean . Let Bi denote the number of typos in book i. Assume N is independent of Bi for all i, and Bi is independent of Bj for all i = j . Professor MD is an expert in the eld of typo identication, but even experts arent perfect. Assume Professor MD nds any existing typo with probability p, independent of nding any other typos as well as N and Bi . The publisher oers Professor MD two dierent annual salary options for reviewing the text books. The two options are: Option 1: 1 dollar for each typo found. Option 2: 1 dollar for each book where at least one typo is found. Let Xi be the amount of money Professor MD receives for book i, and let T be be the total amount of money Professor MD receives in any given year. (a) Find and correctly state the PMF of Xi under option 1. For full credit reduce this expression to a well known PMF. Whats the name of this PMF?

Let Yi be a Bernoulli random variable,

Yi = Then, the pdf of Yi is pYi (y ) =

p If y = 1, 1 p if y = 0.

Now, note that Xi = Y1 + Y2 + . . . + YBi . So, MXi (s) = MBi (s)|es =MY (s) , where MY (s) = s 1 p + pes and MBi (s) = e(e 1) . And, substituting yields: MXi (s) = MBi (s)|es =MY (s) = e(1p+pe Thus, Xi is Poisson with parameter p and its pmf is (p)x ep x!

s 1)

= ep(e

s 1)

pXi (x) =

x = 0, 1, 2, . . .

Department of Electrical Engineering & Computer Science 6.041/6.431: Probabilistic Systems Analysis (Spring 2006)

(b) Find MT (s) under option 1. (b) T = X1 +X2 +. . . +XN . Again, we use MT (s) = MN (s)|es =MX (s) , where MX (s) = ep(e and MN (s) = e(e

s 1) s 1)

p(es 1) 1)

(c) Find P(T = 2) under option 1. Because T is a discrete R.V. that takes nonegative integer values, P(T = 2) = We have,

1 d2 s 2! d(es )2 MT (s)|e =0 .

s d p(e

s 1) (ep(e 1) 1) M ( s ) = pe e , T d(es )

s s d2 2 p(es 1) (ep(e 1) 1) p(es 1) 2 (ep(e 1) 1) e . M ( s ) = ( p ) e e + pe T d(es )2

p 1)

(1 + ep ).

(d) Find E[T ] under option 1. E[T ] = E[Bi ]E[Y ]E[N ] = p. (e) Find var(T ) under option 1. Var(T ) = Var(Xi )E[N ] + Var(N )(E[Xi ])2 , where E[Xi ] = p, Var(Xi ) = p, E[N ] = , and Var(N ) = . So, Var(T ) = p(1 + p). (f) Find and correctly state the PMF of Xi under option 2. For full credit reduce this expression to a well known PMF. Whats the name of this PMF? Let Xi be a Bernoulli random variable that is dened as follows, Xi =

Note that Xi is also the amount of money MD receives for book i under option 2. Let Zi be the number of typos found in book Bi . From part a, we know that Zi is a possion random variable with parameter p. Now, P (Xi = 1) = P (Zi > 0) and, P(Xi = 0) = P (Zi = 0) = ep ,. So, the pmf of Xi is, pXi (xi ) =

1 ep If xi = 1, ep if xi = 0.

It is to be noted that Xi is a Bernoulli random variable with parameter 1 ep . (g) Find E[T ] under option 2. Hint: Fully reduce your answer in (f) before attempting. Under option 2, T = X1 + X2 + . . . + XN . So, E[T ] = E[Xi ]E[N ] = (1 ep ).

- Noise Models in Image processingUploaded bypi194043
- MidtermUploaded bytesfaye
- Prime - Cpm - Unit 5Uploaded bysalman
- NASSIM NICHOLAS TALEB ON BOTTLE NECK AND NOISE EFFECTUploaded byzendome
- Elementary Concepts in StatisticsUploaded byRahul Pratap Singh Kaurav
- saket.docxUploaded byLusiana
- lecture6.pdfUploaded byvinayak11111
- chapter6probability-100121073847-phpapp01Uploaded byNeetu Bhat
- Romine Masters Thesis_Coastal ErosionUploaded byOhio Correct
- Mod 5 05 Basic Statistics March 02Uploaded byDeepak Rustagi
- Section+#+4Uploaded byMarwa Adel
- Chapter 4 Some Basic Concepts on ProbabilityUploaded byChia Yin Teh
- Bab III BaruUploaded byrickypasaribu
- Textbook TablesUploaded bybaf75
- aKuliahStat1 IntroBr2Uploaded byMia Audina Miyanoshita
- 1112 Mpf m Review StatsUploaded bykterink007
- Chapter 3 SolutionsUploaded byalkalkia
- Lecture Continuous (Math)Uploaded byG M
- evaluation of time seriesUploaded byKarina Cerda Oñate
- Theory of Probability .Uploaded byHarsimranjeet Singh
- Normal Distribution Pp tUploaded byHafiz95 Reacts
- Chapter 6 Process Capability AnalysisUploaded byAP Singh
- Foreign direct investment and manufacturing sector performance in NigeriaUploaded byGustavo Cieza
- BMCC MAT 150 Review ProjectUploaded byKenneth Blaney
- Nickell - 1999 - Ratings- Versus Equity-Based Credit Risk MUploaded byMarc Gian
- Exponential Distribution Cdf PDFUploaded byCraig
- Exponential Distribution PDF CdfUploaded byErica
- SI417-Tut11-2017Uploaded byarjunvenugopalachary
- Basic Prob Stats WorshopUploaded bySameer Yadav
- notes-10Uploaded byAditya Bhutra

- Spring 2006 Test 1 SolutionUploaded byAndrew Zeller
- Intech Micro 2400 A16 Sales BrochureUploaded byAndrew Zeller
- IntelliBox IO PBUploaded byAndrew Zeller
- flex 31xUploaded byAndrew Zeller
- Spring 2006 FinalUploaded byAndrew Zeller
- dgh_d17mUploaded byAndrew Zeller
- GW 7472cutsheetUploaded byAndrew Zeller
- Fieldbusmodule Flyer Esco e 13c22060Uploaded byAndrew Zeller
- AM3-SM RTUUploaded byAndrew Zeller
- ADAM-6052_DS20140613100542Uploaded bymirko
- et_6060d_hwUploaded byAndrew Zeller
- D6000 Serial Data SheetUploaded byAndrew Zeller
- BAS-700 Hardware User GuideUploaded byAndrew Zeller
- AdvantechPCM-9375Uploaded byAndrew Zeller
- 1997808_ADVANTECH_93626A1Uploaded byAndrew Zeller
- 1005503_ADVANTECH_93750A1Uploaded byAndrew Zeller
- Marine Signal Lights – Part 4 - Determination and Calculation of Effective Intensity 200Uploaded byAndrew Zeller
- ELEN 325 Lab 1 PrelabUploaded byAndrew Zeller
- QuizUploaded bySerge Mandhev Swamotz
- Spring 2009 Test 1 SolutionUploaded byAndrew Zeller
- Sping 2009 FinalUploaded byAndrew Zeller
- Spring 2008 Test 2Uploaded byAndrew Zeller
- Spring 2008 Test 2 SolutionUploaded byAndrew Zeller
- Spring 2006 Test 2Uploaded byAndrew Zeller
- Spring 2006 Final SolutionUploaded byAndrew Zeller
- Fall 2010 Test 2Uploaded byAndrew Zeller
- fall 2010 Test 1Uploaded byAndrew Zeller

- IDI Consulting Appoints New Regional Business Development ExecutiveUploaded byPR.com
- MQSeries - Publish SubscrbeUploaded bysalilsiva
- ReadMe-2.0.0-b1Uploaded byAl Manshuri
- Substitution CipherUploaded bymerlin664
- tiketUploaded byRikza Nur Faqih
- Burson-Marsteller PRWeek: CEOs Share Their Opinion of Social MediaUploaded byDavid Strassel
- Dbms Basic Concepts Data Models Formal Relational Query Languages Record Based Data Models Database Constraints Functional Dependency and NormalizationUploaded byEttika Sharma
- 1999-07 the Computer Paper - BC EditionUploaded bykafralal
- InstructionsUploaded byMarian Ion
- FTDI D3XX Driver Installation GuideUploaded byben
- ODE_Midterm1_v2_Solns.pdfUploaded byAnkim Nguyen
- Intro to GentooUploaded byL4loSky
- AdReady Display Eco WPUploaded byAmit Suneja
- DevInfo 7 0 - Deployment Guide en - r7Uploaded byCésar Andrés Cristancho Fajardo
- Bpsm NotesUploaded byankit1844
- Oracle Database 12C SQL WORKSHOP 2 - Student Guide Volume 2.pdfUploaded byKuldeep Singh
- Web Security - From viruses,worms to botnetsUploaded bybharaths7
- Data CentreUploaded byRahul Upadhyaya
- Introduction to Statistical Learning: with Applications in RUploaded byAnuar Yeraliyev
- SUMMER INTERNSHIP PROJECT gopalUploaded byDheeraj Singhal
- SQLUploaded byNaveen Reddy
- All MATLAB Books CollectionUploaded bySrinivas Karatlapelli
- Lab InstructionUploaded byemilio_serrano_7
- 2. Attach and Detach (2016!10!07)Uploaded byLuu Trong Cuong
- RubyfuUploaded bybono
- Sdv Guia Practica-01Uploaded byIrma Fernández
- CV SachinSDeshpandeUploaded byapi-3800762
- 5. Capacitated Planned MaintenanceUploaded byMarcelo Ziulkoski
- Adex Ls Kill Ref 610Uploaded byAditya Mitra
- A TechXpress Guide Zabbix for IT MonitoringUploaded byAbhishekKr

## Much more than documents.

Discover everything Scribd has to offer, including books and audiobooks from major publishers.

Cancel anytime.