1 views

Uploaded by barabara

save

- 2014s2
- MATH 120-Linear Algebra With Differential Equations-Imran Naeem
- Long-Term Monitoring and Identiﬁcation of Bridge Structural Parameters.pdf
- MIT18_06SCF11_Ses3.5sum.pdf
- dwt-svd-wmg
- Vector 2
- THEORY OF CODES
- Harr Image Compression
- NBCF Approach
- singular value decomposition_MIT.pdf
- A Randomized Algorithm for Principal Component Analysis
- FnT CF Recsys Survey
- dmmw12
- Advanced Adjustment Theory
- academic output
- Marketing Managmeent Retail Analysis
- Chun Sparse Pls Dim Red Var Sel
- GPU CUDA Parallel Hierarchical Clustering Cluster Update Algorithm
- 9th Math(Matrices)
- lec6
- Cap1generalized Method of Analysis of Simultaneous
- Supercomputer Education & Research Centre
- 215-H291
- LASylF08
- lecture in fortran
- Index
- Cs602 Mid Term 1 Www.vu786.Com
- Functional and Operational Statistics
- High Performance Digital Image Watermarking Scheme Using DCT - TheSIS 1
- Course Outline
- vol 15- 1-2016
- Dc 13 Appendix A: Deterministic optimal control.
- Bảo bối nữ nhi (1+2)
- AM32LC4 Stability.pdf
- LTE Small Cell
- Least Squares Full Resume
- antenkhe
- Chapter 6 LQ Control
- Chapter 6 LQ Control
- Reparar Monitor Samsung SyncMaster 740N
- Liu
- QUESTION BANK FOR THEORY OF COMPUTATION REGULATION 2013
- jBASE Dataguard
- how big is my population
- 5_58078_PracticalOptionsforDeployingSmallServerRoomsandMicroDataCenters
- Tesis Final
- TOTEM manual Ecdis User Manual19.7 2016 2017
- Essbase New Features
- VCMDB Gatekeeper _
- Civ v Manual IT Combined
- Final Paper Example 2
- A Video Upgradation of Low Vision AVI Video by Individual Pixel Channel Intensity Measurement and Its Enhancement
- HW5
- SiTE FiLE Updated
- Unit 4& 5
- Tesira Ex-mod Manual May14-1
- p2.pdf
- CCNA Labs Commands
- cme_cr
- CompTIA A+ Training Kit.pdf
- animating with stop motion pro
- eBook - Windows Server 2016 Licensing
- Optimate User Guide
- Samsung Electronics Case Study
- Math exercises
- Simple CPU Design
- Resumen Ejecutivo
- M257 TMA
- Clase 2 - Elementos Básicos de la Administración en el siglo XXI

You are on page 1of 5

**The singular value decomposition of a matrix is usually referred to as the SVD.
**

This is the ﬁnal and best factorization of a matrix:

A = UΣV T

where U is orthogonal, Σ is diagonal, and V is orthogonal.

In the decomoposition A = UΣV T , A can be any matrix. We know that if A

is symmetric positive deﬁnite its eigenvectors are orthogonal and we can write

A = QΛQ T . This is a special case of a SVD, with U = V = Q. For more general

A, the SVD requires two different matrices U and V.

We’ve also learned how to write A = SΛS−1 , where S is the matrix of n

distinct eigenvectors of A. However, S may not be orthogonal; the matrices U

and V in the SVD will be.

How it works

We can think of A as a linear transformation taking a vector v1 in its row space

to a vector u1 = Av1 in its column space. The SVD arises from ﬁnding an

orthogonal basis for the row space that gets transformed into an orthogonal

basis for the column space: Avi = σi ui .

It’s not hard to ﬁnd an orthogonal basis for the row space – the Gram-

Schmidt process gives us one right away. But in general, there’s no reason

to expect A to transform that basis to another orthogonal basis.

You may be wondering about the vectors in the nullspaces of A and A T .

These are no problem – zeros on the diagonal of Σ will take care of them.

Matrix language

The heart of the problem is to ﬁnd an orthonormal basis v1 , v2 , ...vr for the row

space of A for which

� � � �

A v1 v2 · · · vr = σ1 u1 σ2 u2 · · · σr ur

⎡ ⎤

σ1

� �⎢ σ2 ⎥

= u1 u2 · · · ur ⎢ ⎥,

⎢ ⎥

⎣ . .. ⎦

σr

with u1 , u2 , ...ur an orthonormal basis for the column space of A. Once we

add in the nullspaces, this equation will become AV = UΣ. (We can complete

the orthonormal bases v1 , ...vr and u1 , ...ur to orthonormal bases for the entire

space any way we want. Since vr+1 , ...vn will be in the nullspace of A, the

diagonal entries σr+1 , ...σn will be 0.)

The columns of U and V are bases for the row and column spaces, respec

tively. Usually U �= V, but if A is positive deﬁnite we can use the same basis

for its row and column space!

1

we multiply both sides by A T = VΣ T U T to get: A T A = VΣU −1 UΣV T = VΣ2 V T ⎡ 2 ⎤ σ1 ⎢ σ22 ⎥ ⎥ T =V⎢ ⎥V . 2 . We want to ﬁnd vectors v1 −3 3 and v2 in the row space R2 . ⎦ σn2 This is in the form QΛQ T . u1 and u2 in the column space R2 . (We choose σi to be the positive square root of λi . V and Σ simultaneously. we can now ﬁnd V by diagonalizing the symmetric positive deﬁnite (or semideﬁnite) matrix A T A. we can multiply both sides by V −1 = V T to get: A = UΣV T . We start by computing −3 3 � �� � T 4 −3 4 4 A A = 4 3 −3 3 � � 25 7 = . and the eigenvalues will gives us the numbers σi . This is a big step toward ﬁnding orthonormal matrices V and U and a di agonal matrix Σ for which: AV = UΣ.) To ﬁnd U. Since V is orthogonal. ⎣ . and the σi are the scaling factors for which Avi = σi ui . Rather than solving for U. SVD example � � 4 4 We return to our matrix A = . ⎢ . and positive numbers σ1 and σ2 so that the vi are orthonormal. the ui are orthonormal.. The columns of V are eigenvec tors of A T A and the eigenvalues of A T A are the values σi2 . 7 25 The eigenvectors of this matrix will give us the vectors vi .Calculation � � 4 4 Suppose A is the invertible matrix . we do the same thing with AA T .

Thus. −3 3 0 3 2 1/ 2 −1/ 2 We could solve this for U. � �� � T 4 4 4 −3 AA = −3 3 4 3 � � 32 0 = . This has a one dimensional nullspace and one dimen 8 6 sional row and column spaces. but because Av2 = we 1 −3 2 � � � � 0 1 0 instead have u2 = and U = .8 Unit basis vectors of the row and column spaces are v1 = and u1 = . Note that this also gives us a −1 0 −1 chance to double check our calculation of σ1 and σ2 . but for practice we’ll ﬁnd U by ﬁnding orthonor mal eigenvectors u1 and u2 for AA T = UΣ2 U T . as Professor Strang did in the lecture. AA T happens to be diagonal. 0 18 � � 1 Luckily. let v1 = and v2 = .6 3 . � � 4 The row space of A consists of the multiples of . We now have: √ Σ A U T � � � � � � � √ V √ � 4 4 4 2 √0 1/√2 1/√2 = . The column space � � 3 4 of A is made up of multiples of . � � . To get an or 1 −1 � √ � � √ � 1/√2 1/√2 thonormal basis. −3 3 0 −1 0 3 2 1/ 2 −1/ 2 Example with a nullspace � � 4 3 Now let A = . It’s tempting to let u1 = and u2 = 0 � � � � 0 √ 0 . the SVD of A is: √ Σ A U T � � � � � � � √ V √ � 4 4 1 0 4 2 √0 1/√2 1/√2 = . respectively. These have eigen 1/ 2 −1/ 2 values σ12 = 32 and σ22 = 18. The nullspace and left nullspace are 8 perpendicular to the row and column spaces. � � � � 1 1 Two orthogonal eigenvectors of A T A are and .

.. ur+1 .8 . After ﬁnding unit vectors perpendicular to u1 and v1 (basis vectors for the left nullspace and nullspace. u2 ...vn is an orthonormal basis for the nullspace.. u1 .vr is an orthonormal basis for the row space. 4 . vr+1 . because Avi = σi ui .6 = √1 .um is an orthonormal basis for the left nullspace. one eigenvalue must be 0.8 A U Σ VT The singular value decomposition combines topics in linear algebra rang ing from positive deﬁnite matrices to the four fundamental subspaces. These are the “right” bases to use. To compute σ1 we ﬁnd the nonzero eigenvalue of A T A.� √ � 1/√5 . respectively) we see that the SVD of A is: � � � � � √ � � � 4 3 1 2 125 0 . v1 ..6 −. . 8 6 5 2 −1 0 0 . .. 2/ 5 � �� � 4 8 4 3 A T A = 3 6 8 6 � � 80 60 = . 60 45 Because this is a rank 1 matrix.. ..ur is an orthonormal basis for the column space. v2 . The other must equal the trace. so σ12 = 125.

visit: http://ocw.edu/terms.edu 18.mit. .mit.MIT OpenCourseWare http://ocw.06SC Linear Algebra Fall 2011 For information about citing these materials or our Terms of Use.

- 2014s2Uploaded byChung Chee Yuen
- MATH 120-Linear Algebra With Differential Equations-Imran NaeemUploaded byAbdullahIsmail
- Long-Term Monitoring and Identiﬁcation of Bridge Structural Parameters.pdfUploaded bybaba97k
- MIT18_06SCF11_Ses3.5sum.pdfUploaded byFilozófus Önjelölt
- dwt-svd-wmgUploaded bypriyavasanth
- Vector 2Uploaded byStefan Lucian
- THEORY OF CODESUploaded byWayan Bentar
- Harr Image CompressionUploaded byAliasghar Kazemi Nasab
- NBCF ApproachUploaded byRano Reno
- singular value decomposition_MIT.pdfUploaded byFayazKhanPathan
- A Randomized Algorithm for Principal Component AnalysisUploaded bySergio Pinheiro
- FnT CF Recsys SurveyUploaded byaloksahu1
- dmmw12Uploaded bynz0ptk
- Advanced Adjustment TheoryUploaded byLindaBravo
- academic outputUploaded byapi-341345447
- Marketing Managmeent Retail AnalysisUploaded byvadlapatis
- Chun Sparse Pls Dim Red Var SelUploaded byrrosipal
- GPU CUDA Parallel Hierarchical Clustering Cluster Update AlgorithmUploaded bydjmj
- 9th Math(Matrices)Uploaded byAftab Ahmad
- lec6Uploaded byPoornima Athikari
- Cap1generalized Method of Analysis of SimultaneousUploaded byailsonmoura
- Supercomputer Education & Research CentreUploaded bySridhar Pranatharthiharan
- 215-H291Uploaded byPhanikumar Sistla
- LASylF08Uploaded byanon-681268
- lecture in fortranUploaded byMuhammad Al-Baghdady
- IndexUploaded bymadhur123456789
- Cs602 Mid Term 1 Www.vu786.ComUploaded byESNA678
- Functional and Operational StatisticsUploaded byususususu
- High Performance Digital Image Watermarking Scheme Using DCT - TheSIS 1Uploaded byKishore Kumar
- Course OutlineUploaded byWaqas Zaki

- vol 15- 1-2016Uploaded bybarabara
- Dc 13 Appendix A: Deterministic optimal control.Uploaded bybenyfirst
- Bảo bối nữ nhi (1+2)Uploaded bybarabara
- AM32LC4 Stability.pdfUploaded bybarabara
- LTE Small CellUploaded bybarabara
- Least Squares Full ResumeUploaded byseñalesuis
- antenkheUploaded bybarabara
- Chapter 6 LQ ControlUploaded byAnonymous vufRo6H
- Chapter 6 LQ ControlUploaded byAnonymous vufRo6H

- Reparar Monitor Samsung SyncMaster 740NUploaded byHugo Armando Garzón Quiroga
- LiuUploaded bynanoteraCH
- QUESTION BANK FOR THEORY OF COMPUTATION REGULATION 2013Uploaded byPRIYA RAJI
- jBASE DataguardUploaded bysulimankareem
- how big is my populationUploaded byapi-236697820
- 5_58078_PracticalOptionsforDeployingSmallServerRoomsandMicroDataCentersUploaded byFELIXDEJ
- Tesis FinalUploaded bypepebp
- TOTEM manual Ecdis User Manual19.7 2016 2017Uploaded byCapt
- Essbase New FeaturesUploaded byLeo
- VCMDB Gatekeeper _Uploaded bybhagavanraju
- Civ v Manual IT CombinedUploaded bydotrh
- Final Paper Example 2Uploaded byAnonymous E9ySJLqs
- A Video Upgradation of Low Vision AVI Video by Individual Pixel Channel Intensity Measurement and Its EnhancementUploaded byEditor IJRITCC
- HW5Uploaded byprakash_shr
- SiTE FiLE UpdatedUploaded byDesriani Sari
- Unit 4& 5Uploaded byhariharanbook
- Tesira Ex-mod Manual May14-1Uploaded byRachmat Guntur Dwi Putra
- p2.pdfUploaded bymiguel
- CCNA Labs CommandsUploaded byrocous2000
- cme_crUploaded bycgn04
- CompTIA A+ Training Kit.pdfUploaded byChristian Campos
- animating with stop motion proUploaded byapi-112098111
- eBook - Windows Server 2016 LicensingUploaded bykukucz
- Optimate User GuideUploaded bysb ali
- Samsung Electronics Case StudyUploaded byAhsan Shahid
- Math exercisesUploaded byfres7451
- Simple CPU DesignUploaded byanshulchauhan007
- Resumen EjecutivoUploaded byGaby Uchuypoma Lanazca
- M257 TMAUploaded byNuha Lutfi
- Clase 2 - Elementos Básicos de la Administración en el siglo XXIUploaded byGuillermo Yauri