96 views

save

- Strategy Course Outline FCC 2013a
- DATA-MINING-CAP-4 (1)
- Charging Analysis Axe
- Hammer Report
- AM-sln-02(E)
- Chapter 1 - Introduction
- review
- Handout 01
- Frame-2D
- SAMPLE EXAM QUESTIONS #2 1. in a Time-series Forecasting Problem,
- Numerical Integrators Based on Modified Differenti
- Quiz
- Maths problems
- exam2sol
- reviw2
- ANALYSIS OF ALGO
- Sequencing Problems
- W13syl
- APexams85 AB
- CO454 Lecture 1
- Informe Lab 1
- tut3-1
- n Integer
- Chapt03 Cause Effect
- redch2
- q1 Solutions
- Planimeter Notes
- exact equations
- AB349H1 The Contemporary Hospitality Industr1.docx
- 10.1.1.143.8414
- Sapiens: A Brief History of Humankind
- The Unwinding: An Inner History of the New America
- Yes Please
- Dispatches from Pluto: Lost and Found in the Mississippi Delta
- Elon Musk: Tesla, SpaceX, and the Quest for a Fantastic Future
- The Innovators: How a Group of Hackers, Geniuses, and Geeks Created the Digital Revolution
- John Adams
- Devil in the Grove: Thurgood Marshall, the Groveland Boys, and the Dawn of a New America
- A Heartbreaking Work Of Staggering Genius: A Memoir Based on a True Story
- Grand Pursuit: The Story of Economic Genius
- This Changes Everything: Capitalism vs. The Climate
- The Emperor of All Maladies: A Biography of Cancer
- The Prize: The Epic Quest for Oil, Money & Power
- Team of Rivals: The Political Genius of Abraham Lincoln
- The New Confessions of an Economic Hit Man
- The World Is Flat 3.0: A Brief History of the Twenty-first Century
- Rise of ISIS: A Threat We Can't Ignore
- Smart People Should Build Things: How to Restore Our Culture of Achievement, Build a Path for Entrepreneurs, and Create New Jobs in America
- The Hard Thing About Hard Things: Building a Business When There Are No Easy Answers
- How To Win Friends and Influence People
- Angela's Ashes: A Memoir
- Steve Jobs
- Bad Feminist: Essays
- The Light Between Oceans: A Novel
- Leaving Berlin: A Novel
- The Silver Linings Playbook: A Novel
- The Sympathizer: A Novel (Pulitzer Prize for Fiction)
- Extremely Loud and Incredibly Close: A Novel
- You Too Can Have a Body Like Mine: A Novel
- The Incarnations: A Novel
- Life of Pi
- The Love Affairs of Nathaniel P.: A Novel
- A Man Called Ove: A Novel
- Bel Canto
- The Master
- We Are Not Ourselves: A Novel
- The First Bad Man: A Novel
- The Rosie Project: A Novel
- The Blazing World: A Novel
- Brooklyn: A Novel
- The Flamethrowers: A Novel
- The Art of Racing in the Rain: A Novel
- Wolf Hall: A Novel
- The Wallcreeper
- Interpreter of Maladies
- Beautiful Ruins: A Novel
- The Kitchen House: A Novel
- The Perks of Being a Wallflower
- The Bonfire of the Vanities: A Novel
- Lovers at the Chameleon Club, Paris 1932: A Novel
- A Prayer for Owen Meany: A Novel
- The Cider House Rules
- Mislaid: A Novel

**A tutorial for Beginners and Dummies
**

Koredianto Usman

Sekolah Teknik Elektro dan Informatika

8 Mei 2014

Koredianto Usman

Tutorial of Orthogonal Matching Pursuit

Outline 1 Problem Statement 2 The Orthogonal Matching Pursuit 3 Koherensi Basis 2 / 13 .

65 −0.1.8 0 Now.6 −1 Therefore y = A · x gives: −1.65 −0. Given that : y = and A = 0. Problem Statement Consider the following very simple example: Given the following sparse signals −1.8 0 A= 0.707 0.25 0.707 0.6 −1 y= How to find original x? 3 / 13 .707 0.25 −1.2 x = 1 0 The following is the measurement matrix A (2 x 3): −0.707 0.

8 0 b2 = b3 = 0.8 0 A= 0.6 −1 Columns in matrix A are called BASIS (CHEN and DONOHO : ATOMS). Orthogonal Matching Pursuit −1.707 0.6 −1 4 / 13 .707 0. In the example.65 BASIS Previous example: Given : y = and 0.2. we have the following atoms: b1 = −0.25 −0.707 0.707 0.

Orthogonal Matching Pursuit Interpretation of equation Ax = y Since A = [b1 b2 b3 ]. and if we let : x = [a b c].707 0.65 = −1.8 0 −1.707 −0. then A · x = a · b1 + b · b2 + c · b3 A · x is the linear combination of b1 .707 0.2.2 −0.8 0 A·x = · 1 0.707 0. b3 .6 −1 0.6 −1 0 −0. b2 .25 5 / 13 .2 · +1· +0· =y = 0. −1.

2 −0.6 −1 0. b3 that will influence the STRONGEST to y .707 0.707 −0. dan last is b3 .25 From the equation above.707 0.707 0. 6 / 13 .2. ORTHOGONAL MATCHING PURSUIT works reversely: we start finding which of b1 .8 0 −1.8 0 A·x = · 0 0. Orthogonal Matching Pursuit −1. it is clear that atom b1 contribute the biggest influence in y.65 = −1.2 · +1· +0· =y = 0. and so on.6 −1 1 −0. next is b2 . Then the SECOND STRONGEST from the residual. b2 .

y > calculate the residue ri = pi − pi · < pi .707) b2 (0.707 .25) X b3 (0 .2. Orthogonal Matching Pursuit STRONGEST influence is measured using DOT PRODUCT / INNER PRODUCT OMP Algorithm: 1 find atom with has the biggest inner product with y pi = maxj < bj . -1) 7 / 13 . 0. 0. 0.8 .65 .6) y (-1. y > find atom with has the biggest inner product with ri 4 repeat step 2 and 3 until residue achieve a certain threshold Geometrically: 2 3 Y b1 (-0.

17 and < y . Then. We next count the residue: −1. we see b1 gives the biggest inner product.34 < y .34) · 0. b3: < y .34. Orthogonal Matching Pursuit Here the dot product of y to any of b1.25 Taking the absolute value. b1 > = − (−1. b1 >= −1.25 0. b2 >= 1.707 8 / 13 . b1 is chosen as the atom in first step.65 0.707 r1 = y − b1 · < y .2. b2. b3 >= 0. DOT PRODUCT −1.

-1) Next we count the DOT PRODUCT of this residue to b2 and b3 (no need to count with b1 . 0. b3 >= −0.2. we get b2 as the next strongest influence.25) b2 (0. Orthogonal Matching Pursuit Y Residue 1 b1 (-0.6) X b3 (0 . 9 / 13 . < r 1. 0.8 .707 . b1 >= 1 < r 1.7 Taking the absolute value.65 .707) y (-1. since this residue must perpendicular to b1 ). 0.

b3 >= −0.7 0.099 10 / 13 .7 0.6 −0. we finally count the final DOT PRODUCT.2.8 r 2 = r 1− < r 1. between r2 with the last b3 : < r 2. Orthogonal Matching Pursuit Next we count again the residue: −0.099 From residue r2.099 = 0. b2 > b2 = − (1) · 0.

34. Orthogonal Matching Pursuit The following base is in STRONGEST influence in order: b1 . with influence measure from dot product is : −1.34 Therefore. 1. dan −0.2. b3 . the reconstructed x is 1 −0.099 −1. b2 .099 −1.2 Original was : 1 0 11 / 13 .

(C). Koherensi Rendah 12 / 13 . Koherensi Sedang. b2 b2 A3 b2 A3 A3 A2 A2 A2 A1 b1 b1 b1 A1 (A) (B) A1 (C) Figure : Ilustrasi Koherensi Basis. (B).3. Koherensi tinggi. (A). Base Coherency Base Coherency indicate how close one base to the others.

Base Coherency A simple measure for base coherency is INNER PRODUCT. Aj >) Range of Coherency Value µ is : 0 ≤ |µ| ≤ 1 0 : least coherency 1 : full coherent We expect least coherency in our base in order to success in MP. 13 / 13 .j). µ = max(i.i6=j (< Ai .3.

- Strategy Course Outline FCC 2013aUploaded byZee_Shani
- DATA-MINING-CAP-4 (1)Uploaded bykevin
- Charging Analysis AxeUploaded bySayan Roy Chowdhury
- Hammer ReportUploaded byGautham Venugopalan
- AM-sln-02(E)Uploaded byapi-3842687
- Chapter 1 - IntroductionUploaded byIsaac Wong
- reviewUploaded bydfjisfd
- Handout 01Uploaded byAndrea Škarić
- Frame-2DUploaded byhysteresis_
- SAMPLE EXAM QUESTIONS #2 1. in a Time-series Forecasting Problem,Uploaded byapi-25888404
- Numerical Integrators Based on Modified DifferentiUploaded byelene shopova
- QuizUploaded byKshitij Gupta
- Maths problemsUploaded byvijay9677
- exam2solUploaded byspitzersglare
- reviw2Uploaded byHimanshu Pal
- ANALYSIS OF ALGOUploaded byShafaq Khan
- Sequencing ProblemsUploaded byAbu Bashar
- W13sylUploaded byNelson Lai
- APexams85 ABUploaded bymruthyunjayam
- CO454 Lecture 1Uploaded bymissykoh
- Informe Lab 1Uploaded byAlfredo Gualdron
- tut3-1Uploaded bymmaddox
- n IntegerUploaded bypalomaazul2000
- Chapt03 Cause EffectUploaded byTinnysumardi
- redch2Uploaded byleelapeq
- q1 SolutionsUploaded byJohrdan SaAvdr WaLls
- Planimeter NotesUploaded byFahd Hussain
- exact equationsUploaded byNelsonMoseM
- AB349H1 The Contemporary Hospitality Industr1.docxUploaded byDavid Mark
- 10.1.1.143.8414Uploaded byFabio Barbosa