Scribd
Upload
462 views21 pages

Orthogonality in Linear Algebra

This document discusses orthogonality and the inner product in linear algebra. It defines the inner product of two vectors as a scalar number that represents the dot product. Vectors are orthogonal if their inner product is 0. An orthogonal set is a set of vectors where each pair is orthogonal. An orthonormal set is orthogonal and each vector has a length of 1. Finding the coordinates of a vector with respect to an orthonormal basis only requires taking the inner product of the vector with each basis vector.

Uploaded by

hassan IQ
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
462 views21 pages

Orthogonality in Linear Algebra

This document discusses orthogonality and the inner product in linear algebra. It defines the inner product of two vectors as a scalar number that represents the dot product. Vectors are orthogonal if their inner product is 0. An orthogonal set is a set of vectors where each pair is orthogonal. An orthonormal set is orthogonal and each vector has a length of 1. Finding the coordinates of a vector with respect to an orthonormal basis only requires taking the inner product of the vector with each basis vector.

Uploaded by

hassan IQ
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Linear Algebra

Orthogonality
The Inner Product
• If u and v are vectors in , then we regard u and v as matrices.
• The transpose is a matrix, and the matrix product 𝑻 is a 1 × 1 matrix,
which we write as a single real number (a scalar) without brackets.
• The number is called the inner product of u and v, and often it is written as
.
• This inner product, is also referred to as a dot product. if

Prepared by: Dr. Intessar Al-Iedani 2


properties of the inner product

Prepared by: Dr. Intessar Al-Iedani 3


• The Length of a Vector
• If v is in , with entries , then the square root of is
defined because is nonnegative.

A vector whose length is 1 is called a unit vector.


If we divide a nonzero vector v by its length—that is, multiply by — we obtain a unit
vector u
The process of creating u from v is sometimes called normalizing v, and we say that u is in
the same direction as v.

Prepared by: Dr. Intessar Al-Iedani 4


Prepared by: Dr. Intessar Al-Iedani 5
• Distance in
• Recall that if a and b are real numbers, the distance on the number line between a and b
is the number .

Definition

Prepared by: Dr. Intessar Al-Iedani 6


• EXAMPLE Compute the distance between the vectors and
• Solution : Calculate

When the vector is added to , the result is . Notice that the parallelogram in the figure
shows that the distance from to is the same as the distance from to 0.

Prepared by: Dr. Intessar Al-Iedani 7


• EXAMPLE
• if and , then

Prepared by: Dr. Intessar Al-Iedani 8


• Orthogonal Vectors
• Definition:

Observe that the zero vector is orthogonal to every vector in because for all .

Prepared by: Dr. Intessar Al-Iedani 9


Prepared by: Dr. Intessar Al-Iedani 10
• Orthogonal Complements

Prepared by: Dr. Intessar Al-Iedani 11


Theorem

Prepared by: Dr. Intessar Al-Iedani 12


• Orthogonal Sets

Prepared by: Dr. Intessar Al-Iedani 13


• A set of vectors is said to be an orthonormal set if it is an orthogonal set
and if each vector in the set is a unit vector.
• Example

Prepared by: Dr. Intessar Al-Iedani 14


Theorem if 1 2 𝑝 is an orthonormal set of nonzero vectors in
𝑛 , then is is
linearly independent and hence is a basis for the subspace spanned by .

Definition:
An orthogonal basis for a subspace of 𝑛 is a basis for that is also an orthogonal set.

Theorem

Prepared by: Dr. Intessar Al-Iedani 15


• Example
• Let is an orthonormal set of nonzero vectors in

Express the vector

as a linear combination of the vectors in S.

Prepared by: Dr. Intessar Al-Iedani 16


• Coordinates in an Orthonormal Basis
• let be any vector in and suppose we want to find the coordinates of in the basis ,

By definition, the coordinates satisfy the equation

• Taking the inner product of with both sides of the above equation and using the fact that
, , and , we obtain
•
• where is a unit vector. Thus
• Repeating this procedure with , , …., we obtain the remaining coefficients , . . . , :

Prepared by: Dr. Intessar Al-Iedani 17


• computing coordinates with respect to an orthonormal basis can be done without
performing any row operations and all we need to do is compute inner products.

Prepared by: Dr. Intessar Al-Iedani 18


Prepared by: Dr. Intessar Al-Iedani 19
• Example: consider the vectors

Prepared by: Dr. Intessar Al-Iedani 20


Prepared by: Dr. Intessar Al-Iedani 21

You might also like