QR algorithm for finding eigenvalues of a matrix

See also https://www.youtube.com/watch?v=TRktLuAktBQ

Given matrix
(

with exact eigenvalues as 3,2.

STEP 1: Q R factorization
First let us Q R factorise this matrix where Q is an orthogonal matrix
=
and
is an upper triangular matrix.
To find Q (orthogonal matrix) we write,
(

Now we have to use Gram Schmidt procedure to orthonormalize the

+
basis *
(
|(

| |

(
(

)
)

= ( )

= (

OR

),

( )=(

= ( )

)
)|

Prove that
(
(

=
)

(
(

)
)
)

It is easy to verify that

STEP 2: ITERATIVE PROCEDURE

Start with
Write
Now write

using the ideas in STEP 1

Again find
Now decompose

using the ideas in STEP 1

and so on ..
till
for some large n itself becomes simple enough to be able to
read off its eigenvalues.
BUT THE CRUCIAL POINT OF THIS ALGORITHM IS
for each value of the index k,
the starting matrix
To see this consider the kth iteration.

has the same eigenvalues as

above, we have used the orthogonality of Q.

But
This means,

This means

and

have the same eigenvalues

Why ?
If

is an eigenvector of
insert

with eigenvalue ,
to get,
multiply with

Call
This means
This means
has the same eigenvalue
though the eigenvector is u instead of v

even

Thus successive iterations lead to A-matrices that all have the same
eigenvalues. Since we started with the original matrix A this means
has the same eigenvalue as A.
After many iterations if
becomes triangular or diagonal then these
diagonal elements are themselves the eigenvalues of the original
matrix A,

STEP 3: EXAMPLE CONTINUED

Start with

Write

= (

) (

)(

Now write

using the ideas in STEP 1

Again find

(
(

(
)

Now decompose

)
(

 using the ideas in STEP 1

AND SO ON ..
The sequence of matrices is
(
(

)
)

(
= (

)
)

and so on .
We see that slowly the matrix
is becoming an upper
triangular matrix. The exact eigenvalues of
are 3,2.