# Welcome back

## Find a book, put up your feet, stay awhile

Sign in with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

Welcome to Scribd. Sign in or start your free trial to enjoy unlimited e-books, audiobooks & documents.Find out more

Download

Standard view

Full view

of .

Look up keyword or section

Like this

Share on social networks

9Activity

×

0 of .

Results for: No results containing your search query

P. 1

Principles of CommunicationRatings: (0)|Views: 111|Likes: 12

Published by ngpvn

See more

See less

https://www.scribd.com/doc/22565800/Principles-of-Communication

02/02/2015

text

original

2.1

2

UU

CHAPTER 2

Probability and Random Variables

2.1 Introduction

At the start of Sec. 1.1.2, we had indicated that one of the possible waysof classifying the signals is: deterministic or random. By

random

we mean

unpredictable

; that is, in the case of a random signal, we cannot with certaintypredict its future value, even if the entire past history of the signal is known. If thesignal is of the deterministic type, no such uncertainty exists.Consider the signal

( ) ( )

1

cos2

x t A f t

= π + θ

. If

A

,

θ

and

1

f

are known,then (we are assuming them to be constants) we know the value of

( )

x t

for all

t

.(

A

,

θ

and

1

f

can be calculated by observing the signal over a short period oftime).Now, assume that

( )

x t

is the output of an oscillator with very poorfrequency stability and calibration. Though, it was set to produce a sinusoid offrequency

1

f f

=

, frequency actually put out maybe

f

1

'where

( )

f f f

111

'

∈ ± ∆

.Even this value may not remain constant and could vary with time. Then,observing the output of such a source over a long period of time would not be ofmuch use in predicting the future values. We say that the source output varies ina random manner.Another example of a random signal is the voltage at the terminals of areceiving antenna of a radio communication scheme. Even if the transmitted

2.2(radio) signal is from a highly stable source, the voltage at the terminals of areceiving antenna varies in an unpredictable fashion. This is because theconditions of propagation of the radio waves are not under our control.But

randomness is the essence of communication.

Communicationtheory involves the assumption that the transmitter is connected to a source,whose output, the receiver is not able to predict with certainty. If the studentsknow ahead of time what is the teacher (source + transmitter) is going to say(and what jokes he is going to crack), then there is no need for the students (thereceivers) to attend the class!Although less obvious, it is also true that there is no communicationproblem unless the transmitted signal is disturbed during propagation orreception by unwanted (random) signals, usually termed as

noise

and

interference.

(We shall take up the statistical characterization of noise inChapter 3.)However, quite a few random signals, though their exact behavior isunpredictable, do exhibit statistical regularity. Consider again the reception ofradio signals propagating through the atmosphere. Though it would be difficult toknow the exact value of the voltage at the terminals of the receiving antenna atany given instant, we do find that the

average values

of the antenna output overtwo successive one minute intervals do not differ significantly. If the conditions ofpropagation do not change very much, it would be true of any two averages (overone minute) even if they are well spaced out in time. Consider even a simplerexperiment, namely, that of tossing an unbiased coin (by a person without anymagical powers). It is true that we do not know in advance whether the outcomeon a particular toss would be a head or tail (otherwise, we stop tossing the coinat the start of a cricket match!). But, we know for sure that in a long sequence oftosses, about half of the outcomes would be heads (If this does not happen, wesuspect either the coin or tosser (or both!)).

2.3Statistical regularity of averages is an experimentally verifiablephenomenon in many cases involving random quantities. Hence, we are temptedto develop mathematical tools for the analysis and quantitative characterizationof random signals. To be able to analyze random signals, we need to understand

random variables.

The resulting mathematical topics are: probability theory,random variables and random (stochastic) processes. In this chapter, we shalldevelop the probabilistic characterization of random variables. In chapter 3, weshall extend these concepts to the characterization of random processes.

2.2 Basics of Probability

We shall introduce some of the basic concepts of probability theory bydefining some terminology relating to

random experiments

(i.e., experimentswhose outcomes are not predictable).

2.2.1. Terminology

Def. 2.1:

Outcome

The end result of an experiment. For example, if the experiment consistsof throwing a die, the outcome would be anyone of the six faces,

16

,........,

F F

Def. 2.2: Random experiment

An experiment whose outcomes are not known in advance. (e.g. tossing acoin, throwing a die, measuring the noise voltage at the terminals of a resistoretc.)

Def. 2.3: Random event

A random event is an outcome or set of outcomes of a random experimentthat share a common attribute. For example, considering the experiment ofthrowing a die, an event could be the 'face

1

F

' or 'even indexed faces'(

246

,,

F F F

). We denote the events by upper case letters such as

A

,

B

or

A A

12

,

⋅⋅⋅⋅

You've already reviewed this. Edit your review.

1 thousand reads

1 hundred reads

Mohammad Itawi liked this

atmadeep09 liked this

Ong Potranun liked this

asokant liked this

Mbah Ung liked this

STIJU liked this

asokkrishna liked this

- Read and print without ads
- Download to keep your version
- Edit, email or read offline

Sign in with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

Password Reset Email Sent

Join with Facebook

Sorry, we are unable to log you in via Facebook at this time. Please try again later.

or

By joining, you agree to our

read free for two weeks

Unlimited access to more than

one million books

one million books

Personalized recommendations

based on books you love

based on books you love

Syncing across all your devices

Join with Facebook

or Join with emailSorry, we are unable to log you in via Facebook at this time. Please try again later.

Already a member? Sign in.

By joining, you agree to our

to download

Unlimited access to more than

one million books

one million books

Personalized recommendations

based on books you love

based on books you love

Syncing across all your devices

Continue with Facebook

Sign inJoin with emailSorry, we are unable to log you in via Facebook at this time. Please try again later.

By joining, you agree to our

Are you sure?

This action might not be possible to undo. Are you sure you want to continue?

CANCEL

OK

You've been reading!

NO, THANKS

OK

scribd