3 views

Uploaded by qwerty

vb

save

You are on page 1of 16

**Instructor: Prof. Namrata Vaswani
**

Dept. of Electrical and Computer Engineering

Iowa State University

http://www.ece.iastate.edu/∼namrata

Slide 1

get the “best” estimate of the parameters of the model’s parameters. image registration parameters. – Examples: DC signal in white noise. get the “best” estimate of the “state”. • Parameter Estimation: Given a set of “observations” and given an assumed probabilistic “model”.What is Estimation and Detection • Goal: extract useful information from noisy signals. LPC coefficients of speech. – Equivalent to parameter estimation with a prior (Bayesian estimation) Slide 2 . and given a “prior” model of the state’s pdf (with known parameters). channel model • State Estimation: Given “observations” which are noise-corrupted functions of the “state” (again assume a “model”).

face recognition • In most of this class. – Includes causal and non-causal estimation of a time-sequence of “states” – Examples: all of the above with a prior on the parameter. how to find these best Slide 3 . – Examples: bit or bit sequence detection at the receiver. Kalman filtering for tracking moving objects • Detection (or binary estimation): Estimation among two (or a small number of) possible hypothesis.– Requires parameter estimation to estimate the prior model parameters and some of the likelihood model parameters. Signal/Image denoising/restoration. choose the “best” of two possible hypothesis. radar or image based object detection. we will study the most commonly used optimality criteria to quantify “best”.

estimates or detection decisions. CR-LB).g. and limits on performance (e. Slide 4 .

We will only study parametric. • Bayesian v/s Classical • Online v/s Batch (offline) Estimators Slide 5 .Types of Estimation Problems • Model-based (parametric) v/s Non-parametric.

speech AR model parameter estimation. image). – Meaning. more generally: signal denoising (e. Cramer Rao Lower Bound. frequency and phase of a sine wave in noise. EM algorithm and alternating minimization). speech. Gaussian models – Applications: DC signal in noise. image registration.Syllabus Topics and Examples • Classical Estimation: Min. factorization thorem. Variance Unbiased (MVU) and ML.g. – Least squares estimation: MVUE for linear. communications channel parameter estimation • Bayesian Estimation Slide 6 . R-B theorem. sufficient statistics. ML estimation and its connection to CRLB and efficient estimators – Exact and approximate ML techniques (gradient descent.

state estimation. likelihood computation) – ML state estimation (Viterbi algorithm) – Forward backward algorithm and its use in parameter estimation and likelihood computation – Applications: Speech recognition. Kalman filter (online) – Applications: Restoration/denoising with a prior model on the signal (Wiener filtering). Three problems (parameter estimation. adaptive techniques – State sequences: non-causal Wiener (batch).– Regularized LS. optical flow with a prior (to disallow very large motion). Recursive LS (online estimator). object tracking (Kalman filtering) • Hidden Markov Models (part of Bayesian estimation) – Definition. video-based gesture Slide 7 .

g. Sequential IS. If time permits: Applications in optimization or in computation expectations (or other integrals). face/object/activity classification/recognition. – MAP (Bayesian) detection – Sequence detection – Applications: bit sequence decoding. “optimal” state estimation. Bayesian IS. Slide 8 . e. radar-based object detection. Generalized LRT and Marginalized-LRT for complex hypothesis. Decoding convolutional codes • Detection Theory – LRT.recognition. change detection in sequences • Monte Carlo methods – Importance sampling.

Slide 9 .– All class projects will be on M-C.

p(x.t.Notation and Some Problem Formulations • Notation: θ: parameter.]: expectation w. θ)). Conditional: p(x|θ): PDF of x given θ (correct: fX|Θ (x|θ)) Ex [. θ): PDF of x with parameter(s) θ (correct: fX (x. the PDF of x • Mean Squared Error: ˆ − θ)2 ] arg min Ex [(θ(x) θˆ • Min Variance Unbiased Estimator: arg min ˆ θ(x)]=θ ˆ θ:E[ ˆ − θ)2 ] Ex [(θ(x) Slide 10 .r.

• Bayesian MSE: ˆ − θ)2 ]] arg min Eθ [Ex [(θ(x) θˆ (typically MMSE estimation refers to Min Bayesian MSE) • ML: arg min[− log p(x. )] = arg min[− log(p(x|θ)p(θ))] θ θ Slide 11 . θ)] θ • MAP: arg min[− log p(θ|x.

• Basic linear algebra • Classes that use Estimation and Detection: Advanced Communications (521). Digital Image Processing (528) Slide 12 .v. – Will do a quick recap today or in next class. Mean. Variance. Conditioning. Independence.’s. for vector random variables. PMF of functions of r. PDF. Common distributions (particularly multivariate Gaussian). • Vector calculus (Will recap wherever needed).Background Required • Basic undergraduate probability (at the level of EE 322) – PMF.

Volumes I and II – You should have a copy of Volume 1 (Estimation Theory) • Vincent Poor.M. An Introduction to Signal Detection and Estimation • Kailath.Books • S. Hassibi and Sayed. Kay. Statistical Signal Processing. Slide 13 . Linear Estimation • Other references will be posted.

located on the main floor of the Student Services Building.Disability Accommodation If you have a documented disability and anticipate needing accommodations in this course. Room 1076 or call 515-294-7220. Slide 14 . You will need to provide documentation of your disability to Disability Resources (DR) office. please make arrangements to meet with me soon.

find 3-4 techniques to solve it) • Non-CSP students: can choose a Project-2 for 60% of the grade.Grading Policy • Homeworks: 10% • Exams: 60% (either Midterm + Final or 2 Midterms) • Project: 30% – Survey of 3-4 papers and Simulation of at least 1-2 (typically pick a technique and find 3-4 applications or pick an application. – Survey 5-7 papers (few techniques for a problem + few other applications of those techniques) – Simulations – Application to a real problem (typically from your research) Slide 15 .

– Use that time to answer questions about what is taught or about using the material in other problems or later for project related discussion. Email: namrata At iastate. Phone: 515-294-4012 • Office hours: TBD • Questions/Comments/Your Research • Usually finish 5-10 minutes before time.edu. Slide 16 .Other Issues • My Office: 3121 Coover.

- My Thesis Eviews Code.4_Tables 2,3 Figure 6Uploaded bySotiris Kourdoupalos
- ELISA-RESULTS-OD.docxUploaded byMylene Pral Alayon
- [Springer 2012]-Discretized Bayesian Pursuit a New Scheme for Reinforcement LearningUploaded byyaya
- Chapter 4-Localisation and MappingUploaded byf
- 1Uploaded byhendra lam
- Lecture 8 Statitical InferenceUploaded bySomia Zohaib
- Advanced Control Using MatlabUploaded byboilerqwerty81
- Kalman FilterUploaded bySamuel Tumelero Valduga
- Schmidt - History of Kalman Filter - Nasa ReportUploaded bymandolin wind
- An Indoor Bluetooth PaperUploaded byapi-3734782
- Point EstimationUploaded byAnkit Sinha
- NI InstrumentationNewsletter 1012Uploaded bysantomalavi
- HandoutsUploaded byIan Cronbach
- EstimationUploaded byPrannav Srinivasan
- energies-08-07854.pdfUploaded byGaurang Prajapati
- 05.20219.EHShinUploaded bynassr_ismail
- 00597278Uploaded byRakesh S K
- Markov Random Field Extensions using State Space ModelsUploaded byTao Chen
- An Illuminating Counter ExampleUploaded byf.cordella5397
- RANDOMNESS&OPTIMAL ESTIMATION, by M. Khoshnevisan, S. Saxena, H. P. Singh, S. Singh, F. SmarandacheUploaded bymarinescu
- Ijcas SEO 2006Uploaded byPhạm Ngọc Hòa
- LTKM multinomial logitUploaded byTracey Xiautung
- Chap 005Uploaded bymallick5051rajat
- Monte ClUploaded byIbtehaj Muasser
- Estimation of Weibull Shape Parameter by Shrinkage Towards An Interval Under Failure Censored SamplingUploaded byAnonymous 0U9j6BLllB
- lcleeresume2008Uploaded byaliqpsk
- MP-043-17 lỗi sensorUploaded bytangphamvan
- tt2431.practice.pdfUploaded bySarika Uppal
- Hypothesis TestingUploaded bymohapatra82

- Rp Tip Print NewUploaded byqwerty
- PEA 302Uploaded byqwerty
- Academic Calendar for Fulltime Programmes Except Lsad 1516Uploaded byqwerty
- ee350-23gfhgfUploaded byqwerty
- 13CguihgUploaded byqwerty
- ACADEMIC_ CALENDAR_FOR_FULLTIME_PROGRAMMES_EXCEPT_LSAD_1516.pdfUploaded byqwerty
- 36275_2_Applicable programs for OE SSE polling of Autumn Term 2015-16.xlsUploaded byqwerty