## Are you sure?

This action might not be possible to undo. Are you sure you want to continue?

REPRESENTATION

By- Saurabh Shukla

R.No-ICE2012005

M.Tech

TOPICS COVERED SO FAR

1. Factorization and Innovations

2. Finite Order System and Variables

1. Series representation of Stochastic Process

2. Spectral representation of Random Process

TOPICS TO BE COVERED

1. SERIES REPRESENTATION OF

STOCHASTIC PROCESS

a) Fourier series

b) Mean Square Periodicity

c) Representation of ACF in Fourier series

d) Fourier series representation of periodic stochastic

process

e) Karhunen-Loeve expansion

2. FOURIER SERIES

a) What is Fourier Series?

b) How it decomposes the periodic signals?

c) What is Periodicity?

d) What is Orthogonality relationship?

e) What are the existence condition of Fourier

Series?

3. MEAN SQAURE PERIODICITY

a) Let we have a stochastic process X(t) in

b) can this continuous information be represented in terms of a

countable set of random variables whose relative importance

decrease under some arrangement?

c) To get to know this it is best to start with Mean-Square periodic

process.

d) A stochastic process X(t) is said to be mean square (M.S) periodic,

if for some T > 0

i.e

e) Proof: suppose X(t) is M.S. periodic. Then

, 0 T t s s

. all for 0 ] ) ( ) ( [

2

t t X T t X E = ÷ +

( ) ( ) with 1 for all . X t X t T probability t = +

--(1)

But from Schwarz’ inequality

Thus the left side equals

or

i.e.,

i.e., X(t) is mean square periodic.

. period with periodic is ) ( T R t

2

2 2

*

1 2 2 1 2 2

0

[ ( ){ ( ) ( )} ] [ ( ) ] [ ( ) ( ) ] E X t X t T X t E X t E X t T X t + ÷ s + ÷

* *

1 2 1 2 2 1 2 1

[ ( ) ( )] [ ( ) ( )] ( ) ( ) E X t X t T E X t X t R t t T R t t + = ¬ ÷ + = ÷

Then periodic. is ) ( Suppose ) ( t R :

0 ) ( ) ( ) 0 ( 2 ] | ) ( ) ( [|

* 2

= ÷ ÷ = ÷ + t t t R R R t X t X E

( ) ( ) for any R T R t t t ¬ + =

. 0 ] ) ( ) ( [

2

= ÷ + t X T t X E --(2)

--(3)

*

1 2 2

[ ( ){ ( ) ( )} ] 0 E X t X t T X t + ÷ =

4. REPRESENTATION OF ACF IN FOURIER

SERIES

Thus if X(t) is mean square periodic, then is periodic and let

represent its Fourier series expansion. Here

In a similar manner define

Notice that are random variables, and

0

0

1

( ) .

T

jn

n

R e d

T

e t

¸ t t

÷

=

}

0

0

1

( )

T

jk t

k

c X t e dt

T

e

=

}

+· ÷ ÷· = k c

k

,

--(5)

--(6)

) (t R

0

0

2

( ) ,

jn

n

R e

T

e t

t

t ¸ e

+·

÷·

= =

¿

--(4)

0 1 0 2

0 1 0 2

0 2 1 0 1

* *

1 1 2 2

2

0 0

2 1 1 2

2

0 0

( ) ( )

2 1 2 1 1

0 0

1

[ ] [ ( ) ( ) ]

1

( )

1 1

[ ( ) ( )]

m

T T

jk t jm t

k m

T T

jk t jm t

T T

jm t t j m k t

E c c E X t e dt X t e dt

T

R t t e e dt dt

T

R t t e d t t e dt

T T

t

e e

e e

e e

t t

¸

÷

÷

÷ ÷ ÷ ÷

=

= ÷

= ÷ ÷

} }

} }

} }

i.e., form a sequence of uncorrelated random variables.

0 1

,

1 ( ) *

1

0

0,

[ ] { }

0 .

m k

T

m j m k t

k m m

T

k m

E c c e dt

k m

e

o

¸

¸

÷ ÷

> =

¦

= =

´

=

¹

}

--(7)

+· =

÷· =

n

n n

c } {

5. REPRESENTATION OF M.S. PERIODIC

PROCESS IN FOURIER SERIES

Now on considering the partial sum-

Theorem- We shall show that in the mean square

sense as

i.e.,

Proof:

0

( ) .

N

jk t

N k

K N

X t c e

e ÷

=÷

=

¿

) ( ) (

~

t X t X

N

=

--(8)

. · ÷ N

. as 0 ] ) (

~

) ( [

2

· ÷ ÷ ÷ N t X t X E

N

--(9)

2

2

*

2

[ ( ) ( ) ] [ ( ) ] 2Re[ ( ( ) ( )]

[ ( ) ].

N N

N

E X t X t E X t E X t X t

E X t

÷ = ÷

+

--(10)

0

0

0

2

* *

( ) *

0

( )

0

[ ( ) ] (0) ,

[ ( ) ( )] [ ( )]

1

[ ( ) ( ) ]

1

[ ( ) ( )] .

k

k

k

N

jk t

N k

k N

N

T

jk t

k N

N N

T

jk t

k

k N k N

E X t R

E X t X t E c e X t

E X e X t d

T

R t e d t

T

e

e o

e o

¸

¸

o o

o o ¸

+·

=÷·

÷

=÷

÷ ÷

=÷

÷ ÷

=÷ =÷

= =

=

=

= ÷ ÷ =

¿

¿

¿

}

¿ ¿

}

--(12)

Similarly

i.e.,

0 0

2

( ) ( ) * *

2

[ ( ) ] [ [ ] .

[ ( ) ( ) ] 2( ) 0 as

N

j k m t j k m t

N k m k m k

k m k m k N

N

N k k

k k N

E X t E c c e E c c e

E X t X t N

e e

¸

¸ ¸

÷ ÷

=÷

+·

=÷· =÷

= = =

¬ ÷ = ÷ ÷ ÷ ·

¿¿ ¿¿ ¿

¿ ¿ --(13)

0

( ) , .

jk t

k

k

X t c e t

e

+·

÷

=÷·

÷·< < +·

¿

--(14)

and

But,

CONCLUSION DRAWN FROM

EQUATION -14

a) Thus mean square periodic processes can be represented in the form

of a series as in (14).

b) The stochastic information is contained in the random variables

c) Further these random variables are uncorrelated

and their variances

i.e

d) Thus if the power P of the stochastic process is finite, then the

positive sequence converges, and hence

e) This implies that the random variables in (14) are of relatively less

importance as and a finite approximation of the series in

(14) is indeed meaningful.

*

,

( { } )

k m k k m

E c c ¸ o =

0 as .

k

k ¸ ÷ ÷·

. , +· ÷ ÷· = k c

k

2

(0) [ ( ) ] .

k

k

R E X t P ¸

+·

=÷·

= = = < ·

¿

k

k

¸

+·

=÷·

¿

0 as .

k

k ¸ ÷ ÷·

, k ÷·

6-KARHUNEN-LOEVE EXPANSION

a) QUES-What about a general stochastic process, that is not

mean square periodic? Can it be represented in a similar

series fashion as in (14),

b) if not in the whole interval then take in finite

support of

c) Suppose that it is indeed possible to do so for any arbitrary

process X(t) in terms of a certain sequence of orthonormal

functions

, · < < · ÷ t

0 ? t T s s

i.e.,

where

and in the mean square sense

Further, as before, we would like the c

k

s to be uncorrelated random

variables. If that should be the case, then we must have

Now

¿

·

=

=

1

) ( ) (

~

n

k k

t c t X ¢

--(15)

--(16)

--(17)

( ) ( ) in 0 . X t X t t T s s

*

,

[ ] .

k m m k m

E c c ì o =

--(18)

* * *

1 1 1 2 2 2

0 0

* *

1 1 2 2 2 1

0 0

*

1 1 2 2 2 1

0 0

[ ] [ ( ) ( ) ( ) ( ) ]

( ) { ( ) ( )} ( )

( ){ ( , ) ( ) }

T T

k m k m

T T

k m

T T

k XX m

E c c E X t t dt X t t dt

t E X t X t t dt dt

t R t t t dt dt

¢ ¢

¢ ¢

¢ ¢

=

=

=

} }

} }

} }

--(19)

*

0

*

,

0

( ) ( )

( ) ( ) ,

T

k k

T

k n k n

c X t t dt

t t dt

¢

¢ ¢ o

=

=

}

}

A

and

Substituting (19) and (20) into (18), we get

Since (21) should be true for every we must have

or

*

1 1 2 2 2 1 1

0 0

( ){ ( , ) ( ) ( )} 0.

XX

T T

k m m m

t R t t t dt t dt ¢ ¢ ì ¢ ÷ =

} }

1 2 2 2 1

0

( , ) ( ) ( ) 0,

XX

T

m m m

R t t t dt t ¢ ì ¢ ÷ ÷

}

( ), 1 ,

k

t k ¢ = ÷·

*

, 1 1 1

0

( ) ( ) .

T

m k m m k m

t t dt ì o ì ¢ ¢ =

}

--(20)

--(21)

1 2 2 2 1 1

0

( , ) ( ) ( ), 0 , 1 .

XX

T

m m m

R t t t dt t t T m ¢ ì ¢ = < < = ÷·

}

--(22)

a) This is the desired uncorrelated condition in (18) which is

translated into the integral equation in (22) and it is known

as the Karhunen-Loeve or K-L. integral equation

b) The functions are not arbitrary and they must be

obtained by solving the integral equation in (22).They are

known as the eigenvectors of the autocorrelation function

of

c) Similarly the set represent the eigenvalues of the

autocorrelation function.

·

=1

)} ( {

k k

t ¢

1 2

( , ).

XX

R t t

1

{ }

k k

ì

·

=

END OF

“SERIES REPRESNTATION

OF

STOCHASTIC PROCESS”

THANK YOU

By- Saurabh Shukla

R.No-ICE2012005

M.Tech

- Charles Fourier - Passions Of The Human Soul [Volume I].Aleksandar Simonovski
- chickenGoldenSinX
- Syllabus for Electrical Engineering (EE) _ GATE 2013Shahnawaz Ahmad
- 8120326504_waveletskmohanadasse
- 620-332aleong1
- markets90_interest.pdfLester Ingber
- Formalized Musicluketansx
- Automobile Engg Syllabusmenilanjan89nL
- Signals and systems question bankEdward Harvey
- wbut electrical engineering syllabusBarun Ghorai
- MAP5345_Project1_QuestionsRaminShamshiri
- Probability, RandomJordy Grandez Abrigo
- RP1 IntroductionPalash Swarnakar
- Unit IvqbnewEdward Harvey
- CERajesh Viswanadham
- probabilitydvdmega
- DESIGN_AND_IMPLEMENTATION_OF_RADIX-4Sravani Reddy Beemidi
- Chi square distributionsLetsogile Baloi
- STA_5325_HW_2_Ramin_ShamshiriRaminShamshiri
- 04103146Abdallah Omar Al Ayoubi
- coding theoryAbhishek Sharma
- path00_exp.pdfLester Ingber
- Some Applications of Martingales to Probability TheoryJordy Grandez Abrigo
- Statistical mechanics lecture notes (2006), L11OmegaUser
- Probability and Statistics Book SolutionsLieke Lokin
- MATHEMATICAL STATISTICS (Keith Knight).pdfvictor_chung_23
- markets91_interest.pdfLester Ingber
- markets07_rops.pdfLester Ingber
- Convergence in DistributionJordy Grandez Abrigo
- ciao ciaoRichter Belmont

- UT Dallas Syllabus for ee6349.501.08s taught by Mohammad Saquib (saquib)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for ee6349.501 06f taught by Kamran Kiasaleh (kamran)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for ee6349.001.07f taught by Kamran Kiasaleh (kamran)UT Dallas Provost's Technology Group
- tmpAAE7.tmpFrontiers
- UT Dallas Syllabus for ee6349.501.09f taught by Hlaing Minn (hxm025000)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for taught by Hlaing Minn (hxm025000)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for ee6349.501 05f taught by Kamran Kiasaleh (kamran)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for ee6349.521.07u taught by Mohammad Saquib (saquib)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for eesc6349.501.11f taught by Hlaing Minn (hxm025000)UT Dallas Provost's Technology Group
- tmpE3F8Frontiers
- tmp79F5.tmpFrontiers
- UT Dallas Syllabus for ee6349.001.07s taught by Mohammad Saquib (saquib)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for stat7345.501.09s taught by Robert Serfling (serfling)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for stat7345.501.10f taught by Robert Serfling (serfling)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for stat7345.501 06f taught by Robert Serfling (serfling)UT Dallas Provost's Technology Group
- UT Dallas Syllabus for eesc6349.001.11s taught by Kamran Kiasaleh (kamran)UT Dallas Provost's Technology Group

- compri_pptSaurabh Shukla
- hfss-18Saurabh Shukla
- Revised PG ManualSaurabh Shukla
- WARD-The brochure.pdfSaurabh Shukla
- Widebeam Cp Assym Mstrip AntSaurabh Shukla
- Revised PG ManualSaurabh Shukla
- design of cylinder cavity resonatorSaurabh Shukla
- program of single linked listSaurabh Shukla
- Design and Implementation of IIR FilterSaurabh Shukla
- (www.entrance-exam.net)-TEXAS Instruments Placement Sample Paper 1.pdfSaurabh Shukla
- MIMO RADAR chap 2.pptxSaurabh Shukla
- The TEXAS Instruments.docxSaurabh Shukla
- spectral representationSaurabh Shukla

Sign up to vote on this title

UsefulNot usefulClose Dialog## Are you sure?

This action might not be possible to undo. Are you sure you want to continue?

Loading