Professional Documents
Culture Documents
UNIVERSITY OF NAIROBI
SCHOOL OF MATHEMATICS
VECTOR SPACES
We discuss a basic structure in linear Algebra that forms a foundation of solutions to many
problems in diverse fields namely vector spaces.
Definition;
A vector space V is a non-empty set of elements called vectors on which is defined a concept of
equality of vectors and two operation called vector addition and scalar multiplication with the
following properties.
1
SCHOOL OF MATHEMATICS
iii.
a b c a b c
for all vectors a, b,c V .(Associative law).
iv. There exists a vector called zero and written 0 such that 0 a a for all aV.
v. For every vector a V there exists a vector called minus a and denoted by -a such
that a+(-a)=0
vi. a b b a for all vectors a and b in V
k a b ka kb
vii. for all a and b in V and k in R
viii.
p q a pa qa for all vectors a in V and scalars p and q in R
ix.
pq a p qa for all scalars p and q in R and vector a in V
x. 1a a for all a in V
x1
1. The space R2 of all column vectors x= ()
x2
.
Note:
x + y= x 1 + y 1 = x 1+ y 1
i. ( )( ) ( )
x2 y2 x 2+ y 2
( k −x )=k x = kx R 2
ii. ( x ) (kx )
1
2
1
0= 0 ∈ R 2
iii. ()
0
x 1 then−x= −x1
iv. For x=
x2 () −x2 ( )
( x + y ) + z= x + y + z = x + y + z = x + y + z
v. (x ) ( y ) (z ) ( x + y ) (z ) (x + y + y )
1
2
1
2
1
2
1
2
1
2
1
2
1
2
1
2
1
One can verify that the remaining condition for a vector space are satisfied.
x1
n
() n
2. Consider R the space of all column vectors of the type x= x 2 where addition in R is
x3
performed according to corresponding entries, namely
2
SCHOOL OF MATHEMATICS
x1 y1 x1 + y 1
⋮
xn
( )( )( )
x + y= x 2 + y 2 = x2 + y 2
⋮
yn
⋮
xn + yn
kx1
⋮
()
kx = kx 2 for any value k in R
kx n
0
0
The zero in R is the vector with zero entries i.e. 0= ⋮ .
n
0
()
n
One can verify that R is a vector space. This is called the Euclidean vector space
3. Let M(2) be the space of all 2x2 matrices where vector addition is performed by
x11 x 12 y y 21
x + y=
[ x 21 x 22][
+ 11
y 21 ]
= x +y x x + y x + y for all ¿ R .
y 22 [ 11 11, 12+¿ y ¿ 21 21 , 22 22]
12
0 0
The zero vector is 0= [ ]
0 0
The space p n consisting of all polynomial in x of degree n or less is a vector space where addition
and scalar multiplication are defined as follows
a xn
n
a n 1 a1x a 0 b n x n b n 1x n 1 b1x b 0 a n b n x n a n 1 b n 1 x n 1 a 1 b1 x a 0 b 0
And
4. Let be the space of all continuous real valued functions from the interval [0,1]
C 0,1
Addition and scalar multiplication are defined as follows
3
SCHOOL OF MATHEMATICS
f g x f x g x
kf x kf x for all k R and x 0,1
.
C 0,1 C 0,1
The zero in is the constant zero function. is an example of an infinite dimensional
vector space.
In the Euclidean space we have a concept of geometry. A vital tool in this vector space that can be
used to investigate its geometry is called the dot product.
Definition
x.y x1y1 x 2 y 2 x n y n
Example
1 2
( )( )
( i ) −1 . 4 =( 1 x 2 )+ (−1 x 4 )+ ( 2 x 10 )=2−4+ 20=18
2 10
Definition
4
SCHOOL OF MATHEMATICS
Definition
n
In R we define the magnitude of a vector (the norm) to be
x=√ x . x
From the definition of the norm we identify the properties of the norm as follows
Example
1 2
0 () ()
1. Let x= −1 y= 3
−1
1 2 2 6 8
( ) ( ) ( )( ) ( )
2 x+3 y =2 −1 + 3 3 = −2 + 9 = 7 .
0 −1 0 −3 −3
8 8
( )( )
7 .
−3 −3
7 =64+ 49+ 9=122 .
So 2 x+3 y =√122
5
SCHOOL OF MATHEMATICS
2 2
3x 2 4yx 4y 2 =3x.x 4y.y= x y
3. Given that x+2y2=4 and 2x-3y2=9 find x and y if x and y are
Orthogonal
Theorem
Proof
0 0’ 0’(0 is a zero) .
However,
Theorem
0a 0
For all a V .
Proof
It is clear that
0 0 0 .So
6
SCHOOL OF MATHEMATICS
0a 0 0 a 0a 0a
.
0a 0 .
Theorem
Proof
Now,
Theorem
a 1 a
Proof
a+(-1)a=(1 1 )a 0a 0
Theorem
Proof
b b 0 b a b’
b a b’
7
SCHOOL OF MATHEMATICS
0 b’
b’
Therefore –a is unique
Theorem
Proof
If a b then
a c b c ( a c) ( a c) 0
Hence a+ c=b+ c
b-a
b
In the diagram is the angle between the vectors a and b apply the cosine rule in OAB to obtain
8
SCHOOL OF MATHEMATICS
b-a2=a2+b2-2ab cos
But
b a . b a
b-a2
Hence
a2+b2-2a.b=a2+b2-2abcos
i.e.
a.b
cosθ=
ab
a. ka
a . b=
a ka
k a2
= 2 =± 1
ka
i.e cos=±1 so =0 or 180 degrees .This agrees well with the orientation of parallel vectors.
If a and b are perpendicular then 90 and cos 0 .On the other hand, if a and b are
0
0
cos= =0 . Hence =900
ab
Example
9
SCHOOL OF MATHEMATICS
−1 −1
0 () ()
b) a= 2 b= 0
2
Solution
a.b −3+8
a ¿ cos= =
a b √ (1 ¿ ¿ 2+2 )(−3 ¿ ¿ 2+ 4 2)¿ ¿
2
5 5 1 √5
cos= = = =
√5 x 25 5 √ 5 √ 5 5
−1 −1
b) a= 2
0 () ()
b= 0
2
a.b
cos=
ab
−1 −1
0( )( )
a . b= 2 . 0 =1+0+ 0=1
2
1 1 1 1
= 2 2 = = =
√(−1 ¿ ¿ 2+2 + 0 )¿ ¿ ¿ ¿ √5.5 √25 5
1 −1 1
cos= . Hence¿ cos =
5 5
n
2. Prove that x + y ≤ x + y for all vectors x , y in R .
Proof
2 2 2
x y ( x y ).( x y ) x 2 x. y y
2 2 2 2
x 2 x . y cos y x 2 x . y y ( x y ) 2
10
SCHOOL OF MATHEMATICS
b
a
b-a
Example
1. Write the value of the line joining (0,1.-1) and (3,0,2) and hence find the parametric
equation of the line.
Solution
0 3 0 0 3
( ) {( ) ( )} ( ) ( )
1 +t 0 − 1 = 1 +t −1
−1 2 −1 −1 3
x 0 3
()( ) ( )
y = 1 + t −1
z −1 3
2. Find the vector equation and parametric of the line joining the points
A(2 ,−1 ,3) and B(0,5 ,−1)
11
SCHOOL OF MATHEMATICS
Solution
From the equation OP=a+ t(b−a) we have
2 0 2 2
( ) {( ) ( )} ( ) ( )
−2
−1 +t 5 − −1 = −1 +t 6
3 −1 3 3 −4
x 2 −2
()( ) ( )
y
z
= −1
3
+ t 6
−4
The parametric equations are
x=2−2t
y=−1+ 6 t
z=3−4 t
Equation of a plane
The equation of a plane on R3 is of the form ax +by +cz =k where a , b , cand k are constants .
a
()
And vector b is the normal to the plane. To see this fact note that if ( p , q , r ) is particular point
c
on the plane and ( x , y , z ) is a general point on the same plane then
a p−x
( )( )
b . p− y =0
c q−z
On further expansion we have that ap−ax +bp−by +cq−cz =0. Consequently,
ax +bx +cz=ap+bp+ cq=k
Remarks
The equation ax +by +cz =0 is the equation of a plane through the origin.
When a=b=0 then we have the equation of a plane parallel to the X −Y plane.
When b=c=0then we have the equation of a plane parallel to the Y −Zplane.
Finally, when a=c=0 then we have the equation of a plane parallel to the X −Zplane.
Question
1. Find the point of the intersection of the line joining (0 ,−1,1)and (3 ,−1,0)with plane
2 x−3 y+ 5 z =15.
Question
12
SCHOOL OF MATHEMATICS
Vector subspace
Definition:
Given a vector space V, a non-empty subset W of V is called a vector subspace of V if W a vector
space with respect to vector addition and scalar multiplication in V.
Theorem
W is a vector space of V if and only if
i. a b W for all a, b W
13
SCHOOL OF MATHEMATICS
Proof
Suppose that W is a vector space of V then W is a vector space in its own right hence (i) and (ii) will
apply
Conversely
Suppose that (i) and (ii) are satisfied in W then we need to show that the eight remaining
conditions in a vector space apply in W
Since W then a W
1 a a W
by (ii).
Examples
But,
Now
a x 2 b y a x 2b 2y a 2b x 2y 00 0
So,
14
SCHOOL OF MATHEMATICS
k a = ka
() ( )
b kb
Hence k (ab )W
x x + y=1
d) W =
y{( ) }
is not a subspace of R2
Note (11 )W
1 1 2
But ( ) +( )=( ) W since 2≠2 2
1 1 2
Linear combination
Definition
A vector x c1x1 c 2 x 2 c3x 3 c n x n where c1 ,c 2 ,c3 c n are scalars
x1, x 2 .x n
are vectors in a vector space V is called a linear combination of the x i ’s
Example
let x1 = 2 , x 2= 1
( ) ( )
−1 −5
x=3 x 1+ 5 x 2 = 3 2 +5 1 = 11 .
( ) ( )( ) −1 −5 −28
11 2 ∧ 1
( )
−28 ( )( )
is a linear combination of
−1 −5
.
Remark
If the xi’s are orthogonal, the scalars can be found as follows
x c1x1 c 2 x 2 c3x 3 c n x n
We dot both sides by x1 obtain
15
SCHOOL OF MATHEMATICS
Example 1
1 2 7
2 ()
Verify that x 1= ∧x2=
−1 ( )
are orthogonal and hence write
−5 ( )
as a linear combination of the
two vectors.
Solution
1 . 2 =1× 2+2× (−1 )=0
( )( )
2 −1
. So x 1 and x 2are orthogonal.
Let
(−57 )=c ( 12)+c (−12 ) . So that (−57 ) . (12)=c (12 ).( 12)+c (−12 ) . (12) and, hence
1 2 1 2
( 7−10 )=C 1 ¿ ) .
−3 1 19
Hence C 1=
5
and a similar computation using
2 5()
leads to C 2= . Consequently
Example 2
Proof
16
SCHOOL OF MATHEMATICS
Suppose that
0 1 0
() () ()
0
1
=c 1 1
0
+ c 2 2
0
0 c1
() ( )
0
1
= c 1 +2 c 2 ,
0
0 1 0
1 ()
Hence 0 is not a linear combination of 1 and 2
0 0 () ()
Question
0 1 2 4
1 0( )( )( )
0 3 ( )
2. Verify that 0 , 1 , −2 are orthogonal and hence write −2 as a linear combination of the
three vectors.
Definition
The subset W of all linear combinations of the vectors x1 , x 2 ..x n is called the subset generated
We write
W span x1, x 2 ,.x n for the linear span of x1, x 2 ..x n .
Theorem
The linear span of a set of vectors x1 , x 2 ..x n is a vector subspace of the vector space V
Proof
17
SCHOOL OF MATHEMATICS
Note that we have obtained the above by repeated use of the associative and commutative law.
Finally
Remark
Span {0}={0 }
Span V =V
The objective in this chapter is to obtain the least number of vectors that can generate (span) a
vector space
Definition
A set of vectors x1 , x 2 ,.x n in a vector space V is said to be linearly dependent if there exists a
Example
0 , 1 , 1
The set {( ) ( ) ( )}
1 1 0
is linearly dependent since (11 )=(01)+(10)
Note that any set of vector which contain zero is linearly dependent since 0=0x 1+0x2+…+0xn
Theorem
A set of vectors x1 , x 2 ,.x n in a vector space V is linearly dependent if and only if there exists
Proof
18
SCHOOL OF MATHEMATICS
At least one of the vectors is a linear combination of the others. We can assume x 1 is a linear
combination of the others. If not we re-arrange the set so that x1 is a linear combination of the
rest
x1 c 2 x 2 c3x 3 c n x n .
So
Conversely
Suppose c1x1 c2 x 2 c n x n 0 and not all the ci ’s are zero. Assume that c1≠0. If c1=0 re-
arrange the equation so that c1≠0 then
c2 x 2 c3 x x . c n x n c1x1
−c 2 −c c
i.e. x 2+ 3 x 3 +…± n x n =x1
c1 c1 c1
LINEAR INDEPENDENCE
Definition
A set of vectors x1 , x 2 ,.x n is said to be linearly independent if none of the vectors is a linear
combination of the other vectors
Theorem
The vectors x1 , x 2 ,.x n are linearly independent if and only if the equation
c1x1 c2 x 2 c n x n 0 has one and only one solution c1 c 2 c n 0
.
Proof
19
SCHOOL OF MATHEMATICS
Suppose that x1 , x 2 ,.x n are linearly independent and c1x1 c2 x 2 c n x n 0 If any one of
.
the scalars ci’ s is non-zero then x1 , x 2 ,.x n are linearly independent contradicting the initial
Conversely
Suppose that the equation c1x1 c 2 x 2 c n x n 0 has one and only one solution c1=c2=……=cn=0
we must show that the xi’s are independent. Suppose that the xi’s are linearly dependent. There
exist scalars c1, c2 ,c n not all zero such that c1x1 c2 x 2 c n x n 0 . This contradicts the initial
assumption as all such scalars are zero.
Examples
2 c1−c 2 = 0
[ c 1+ 2 c2 ]()
0
c 1 +2 c 2=0………..ii
2 c1 c 2 c2
= c 1=
2 2 2
c 2+ 4 c 2
=0 c 2 +4 c 2=0 5 c 2=0 c 2=0
2
c2 0
c 1= c 1= c 1=0
2 2
20
SCHOOL OF MATHEMATICS
1 0 0
( )( ) ( )
Prove that the vectors 1 , 1 ∧ 1 are linearly independent in R3
0 0 2
1 0 0 0
() () () ()
c 1 1 +c 2 1 +c 3 1 = 0
0 0 2 0
c1 0 0 0
( )( )( )()
c2 + c2 + c 3 = 0
0 0 2 c3 0
c 1 +0+0=0 c 1=0
2. Prove that the functions cos and sinare linearly independent in the space C [0,2] of
continuous functions
Proof
Differentiating
−c 1 sin+c 2 cos=0….ii
21
SCHOOL OF MATHEMATICS
0
c 1= =0
cos
Question
3. Prove that 1−x , x2 −1, x 3+ 2 x−1 are linearly independent in the vector space P3(x)
Question
4. Prove that e− x , e−2 x , e−3 x are linearly independent in the space C [0,1]
Question
4 Prove that if x1 , x 2 ,.x n are orthogonal, then they are linearly independent.
5 Prove that if u , v , w are linearly independent in a vector space V then u , u+w , u−w are
also linearly independent.
We introduce matrices as useful tools of trade as will be evident in the subsequent topics.
Matrix multiplication is computed by the dot product of rows of the first matrix with the columns
of the second matrix. More precisely the dot product of the ith row in Awith the jth column of B
yield the i jthentry in AB .Matrix multiplication is only possible when the number of columns of
the first matrix is the same as the number of rows of the second matrix.
22
SCHOOL OF MATHEMATICS
Echelon form
A matrix A is said to be in echelon form if for each non-zero row , the first nonzero element a ij has
all the element below it as zero ,unless the row is the last row in the matrix.
Example
2 −1 1 −1 0
[ ][
0 3 , 0 3
0 0
5
0 0 −1 ]
Each matrix can be reduced to echelon form by use of elementary row operations
Example
[2 3
−1 3 −1 ]
2 to echelon form.
Solution
Replace the second row with the sum of -2 times the first row and the second row. Also replace
the third row with the sum of the first row and the third row. Secondly Replace the third row with
the sum of -2times the third row and the second row . Finally replace the third row with the sum
of -5times the third row to the second row
1 −1 0 1 −1 0 1 −1 0 1 −1 0
[ 2 3
−1 3 −1 ][
0 2 1 0 1 0 ][
2 ≡ 0 5 2 ≡ 0 5 2 ≡ 0 5 2
0 0 −3 ][ ]
The final Matrix is in echelon form
23
SCHOOL OF MATHEMATICS
2 1
[ ]
3 2
1 −1
3 Show that the rows of the matrix below are linearly independent
a b c
[ ]
0 d e
0 0 f
4
Theorem
The nonzero rows of a matrix when reduced to echelon form are linearly independent
The above theorem can be used to provide an alternative method of investigating independence
of vectors in Rn . The vectors are written as the rows of a matrix and then an equivalent matrix is
obtained that is in echelon form. If the echelon form does not contain a zero row the vectors are
linearly independent. If on the other hand the echelon form does contain a zero row then the
vectors are linearly dependent
Example
−1 0 −4
1) Investigate the vectors
( )( )( )
2 , 1 , 3 for linear independence
3 5 0
Solution
−1 2 3 −1 2 3 −1 2 3
[ ]
Let the matrix A= 0 1 5 then A ≡ 0
−4 3 0
1
[
5 ≡ 0 1 5
0 −5 −12 0 0 13 ][ ]
The echelon form does not contain a Zero row so the three vectors are linearly independent
−1 0 −5
3 ( )( )( )
2) Show that the vectors 2 , 1 , 12 , , are linearly dependent and show clearly how one of
5 25
the vectors is a linear combination of the other vectors
Solution
24
SCHOOL OF MATHEMATICS
−1 2 3 −1 2 3 −1 2 3
Let A= 0
[
−5 12 25 0 2 10 ][ 0 0 0 ]' '
1 5 ≡ 0 1 5 (−5 R1 + R3 )≡ 0 1 5 (−2 R 2 + R 3)
[ ]
The echelon form equivalent to A has a zero row so the original vectors are linearly dependent.
Furthermore,
Hence,
−5 −1 0
25 3 ( ) ( ) ()
R3=5 R1 +2 R2 . Clearly 12 =5 2 + 2 1
5
3) Show that the polynomials 1−x , 1−2 x2 , x2 −x+1,1+2 x+ x2 are linearly dependent and clearly
indicate how one of the Polynomials is a linear combination of the other Polynomials
4) Prove that any three non- zero vectors R2 are linearly dependent
Theorem
Given that the vectors x1 , x 2 ,.x n are linearly independent and x c1 x1 c 2 x2 . c n xn then
this representation is unique
Proof
Hence
25
SCHOOL OF MATHEMATICS
Definition
A set of vectors x1 , x 2 ,.x n is called a finite basis of a vector space V if x1 , x 2 ,.x n are linearly
independent and generate (span) the vector space V i.e. span x1 , x 2 ,.x n =V
Definition
Theorem
Every vector space V that is different from the trivial vector space V ={0 } has a basis
Theorem
A set of vectors [ x1 , x 2 ,.x n ] is a basis of V if and only if the set [ x1 , x 2 ,.x n ] is maximal linearly
independent in V
Remark
This means that the vectors x1 , x 2 ,.x n are linearly independent and if a new element is
introduced, the resulting set is linearly dependent.
Proof
Suppose x1 , x 2 ,.x n is a finite basis of vector space V. we show that the set is maximal linearly
independent
Let xV then since x1 , x 2 ,.x n are a basis therefore x is a linear combination of x1 , x 2 ,.x n hence
Conversely
Suppose that { x1 , x 2 ,.x n } is maximal linearly independent. We must show that { x1 , x 2 ,.x n } is a
26
SCHOOL OF MATHEMATICS
Let xV then {x, x1 , x 2 ,.x n } is a linearly independent set. It must be that x is a linear combination
Theorem
A of vectors { x1 , x 2 ,.x n } is a basis for vector space V if and only if { x1 , x 2 ,.x n } is a minimal
generating (spanning) set of vectors for the vector space V
Remark
The set { x1 , x 2 ,.x n } generates the vector space V but if any one of the vectors is deleted from
the list, the remaining vectors do not generate V
Theorem
If a vector space V has a finite basis then each basis of V has the same number of elements
Example
1 0 0
0 () () ()
The vectors i= 0 , j= 1 , k = 0 are a basis for R3
0 1
Let
x1
()
x= x 2 x=x 1 i+ x 2 j+ x3 k
x3
So span{i , j , k }=¿ R3
Definition
If V has a finite basis and that n is the number of elements in a basis of V then the dimension of V
is n
Definition
27
SCHOOL OF MATHEMATICS
x1 , x 2 ,.x n x c1 x1 c 2 x2 . c n xn
If { } is a finite basis for a Vector space V and then define the
c1
x= c 2 .
⋮
cn
()
Example
The Dimension of R4 is 4.
In R4 the vectors
1 0 0 0
() () () ()
i= 0 ,i 2=
0
0
1 ,i =
0 3
0
0 ,i =
1 4
0
0
0
1
has 4 dimensions.
i. w 1={(a , b , 0) a ,b R }
ii. w 2={ ( a , a−b , b ) a , b R }
iii. w 3={ ( a ,b , c ) 2 a+c=b }
Solution
W 1={(a , b ,0)a , b R }
The vector (1,0,0) and (0,1,0) generated W1 since (1,0,0) and (0,1,0)are orthogonal and they are
linearly independent hence form a basis for Dim(W 1 )=2
28
SCHOOL OF MATHEMATICS
The vector (1 , 1, 0) and ( 0 ,−1,1 ) are linearly independent hence they form a basis for W 2 .The
dimension of W 2 is two .
W 3 ={ ( a , b , c ) 2 a+ c=b }
={ a ( 1,2,0 ) + c ( 0,11 ) } .
Hence (1,2,0)and (0,1,1) are linearly independent and forms the basis for W 3
a11 a12 ⋯ a 1n
The matrix
a
A= 21
⋮
[ a22
⋮
a m 1 am 2
⋯ a 2n
⋮ ⋮
⋯ amn ]
is called the coefficient matrix
29
SCHOOL OF MATHEMATICS
b1
b
()
The vector B= 2 is called the constant Matrix. The system can now be summarized in a vector
⋮
bm
x1
x
equation of the type AX=B where X = 2
⋮
xn
() is a solution to the system AX =B , a vector in Rn .So
Operations (i)→(ii) are called elementary row operations. The technique is called the Gauss –
Jordan method and is illustrated below
x +3 y−z=5 ( iii)
Solution
We apply elementary operations on the system to obtain an equivalent system where each
subsequent equation has fewer variables
x−2 y +3 z=3
z=6
−5 y +4 z =−2
30
SCHOOL OF MATHEMATICS
x−2 y +3 z=3
−5 y +4 z =−2
z=6
−5 y +4 ( 6 )=−2
−26 26 52 −23
y= = , x= +3−18=
−5 5 5 5
The same steps can be achieved by use of row operations on the augmented matrix [ A ; B¿ . The
objective is to reduce the augmented matrix to echelon form and the recover a more simple
system
1 2 3 3 1 2 3 3 1 2 3 3
2 4 5 0 2 R1 R2 R2 ; R1 R3 R3 0 0 1 6 R2 R3 0 5 4 2
' ' ' '
1 3 1 5 0 5 4 2 0 0 1 6
From the reduced form we obtain the equations just was found in the earlier method
x−2 y +3 z=3
−5 y +4 z =−2
z=6
Question
2 x−3 y+ z=5
5 x−4 y+ 5 z =1
Solution
2 −3 1 x = 5
[ 5 −4 5
y
z
][ ] [ ]
1
31
SCHOOL OF MATHEMATICS
[ 25 −5 1 5 2 −5 1
= ][ 5
−4 5 1 0 7 5 −23 ]
We replace the equation
2 x−5 y+ z=5
7 y +5 z=−23 .
−5−23
y=
7
−17−11
x= . Here is an arbitrary value, leading to infinity of solutions
7
Question
x−5 y +7 z=5
2 x−3 y+ 5 z =1
4 x− y−z=0
Question
1. x 1+ 2 x 2−x 3=0
2 x1 + 4 x 2−x 5=−4
x 1−2 x3 −x 4=2
2. x 1+ x2=1
x 1+ x2=2
Solve the system below
2 x− y=5
x +3 y=1
4 x−7 y=2
Solution
32
SCHOOL OF MATHEMATICS
2 −1 5 1 3 1
[ 1 3 1=0
][7 3
4 −7 2 0 −17 −2 ]
1 3 1 1 3 1
[0 −133 −14 0
x +3 y=1
][
= 0 −133 57 = 0 −133 57
0 −71 ]
−133 y=57
0=−71
From the equations we obtain 0=−71 .This is a contradiction. Hence the system is
inconsistence
Remark
A linear system either has a unique solution or infinity of solutions or is inconsistent.
The method above be can used to solve a system which has unique solution . The augmented
matrix [ A ; B]is reduced to the form [I ; P].From which the equivalent system is
IX =P Hence X =P
Question
x−5 y +7 z=5
2 x−3 y+ 5 z =1
4 x− y−z=0
33
SCHOOL OF MATHEMATICS
23
5
1 2 3 3 1 2 0 15 1 0 0
0 5 4 2 R 4 R R ' , R 3R R ' 0 5 0 26 1 R R '' , R 2 R R '' 0 1 0 26
2 3 2 1 3 1 5 2 2 1
5
2 1
5
0 0 1 6 0 0 1 6 0 0 1
6
23 26
Leading to the same solution namely, x= , y= , z=6
5 5
Question
1 2 5 6
Solve the matrix equation AX=B where A=
3 4 [ ]
and B=
7 8 [ ]
Solution
1 2 5 6 ≡3 R −R 1 2 5 6 ≡ R −R 1 0 −3 −4 ≡ 1 R 1 0 −3 −4
[ 3 47 8 ] 1 2 [
0 2 8 10 1 2 ] [
0 2 8 10 2 2 0 1 4 5] [ ]
Hence the solution is X = [−34 −45 ]
Definition
If A is a matrix the number of non-zero rows when it is reduced to echelon form is called
the rank of the matrix.
Example
1 −1 0
[
A= 2 3 5
3 2 5 ]
Solution
34
SCHOOL OF MATHEMATICS
1 −1 0
[ 0 5 5
0 5 5 ]
1 −1 0
[ 0 5 5
0 0 0 ]
Rank (A)=2
1 3 5
[
A= 2 −1 3
1 2 4 ]
1 3 5
[ 0 −7 −7
0 1 1 ]
1 3 5
[ 0 −7 −7
0 0 0 ]
The Rank of A is 2 since the reduced matrix equivalent to A has two non- zero rows
A square matrix A is said to be a non-singular matrix if there exists a square matrix B such that
AB=I =BA
i) ( A¿¿−1)−1= A ¿
ii) ( A B)−1=B−1 A−1
iii) AB= AX ↔ B=X
Proof
35
SCHOOL OF MATHEMATICS
The method of reduction to echelon can be used to find the inverse of the square matrix. Actually
we solve the equation AX=I . The augmented matrix [ A ⋮ I ] is reduced to the form [ I ⋮ B ] ; then
IX =X=B . So the matrix B= A−1
Example
1 −1 2
A= 0 2 1
1 2 1[ ]
Solution
1 −1 2 a11 a 12 a13 1 0 0
−1
[ ][
A A =B 0 2 1 a21 a 22 a23 = 0 1 0
1 2 1 a31 a 32 a33 0 0 1][ ]
The augmented matrix is
1 −1 2 ⋮ 1 0 0
[ 0 2 1 ⋮ 0 1 0
1 2 1 ⋮ 0 0 1 ]
1 −1 2 ⋮ 1 0 0
[ 0 2 1 ⋮ 0 1 0
0 3 −1 ⋮ −1 0 1 ]
1 −1 2 ⋮ 1 0 0
[ 0 6 3 ⋮ 0 3 0
0 6 −2 ⋮ −2 0 2 ]
1 −1 2 ⋮ 1 0 0
[ 0 6 3 ⋮ 0 3 0
0 6 −5 ⋮ −2 −3 2 ]
36
SCHOOL OF MATHEMATICS
1 −1 2 ⋮ 1 0 0
[ 0 1
0 0
1
2
1
⋮
⋮
0
2
5
1
2
3
5
0
−2
5
]
1 −6 4
[ ]
1 −1 0 ⋮
5 5 5
−1 1 1
0 1 0 ⋮
5 5 5
2 3 −2
0 0 1 ⋮
5 5 5
1 0 0 ⋮ 0 −1 1
[ 0 1 0 ⋮
0 0 1 ⋮
−1 1
5
2
5
5
5
1
5
3 −2
5
]
Hence
0 −1 1
A−1= 5
5
2 [ ]
−1 1
5
5
1
5
3 −2
5
Question
1 −5 3
1 Find the inverse of the matrix below A= 2 1 1
0 1 4 [ ]
1 −1 1 2 −1 5
2 Solve the matrix equation AX=Bwhere A= 0 1 1
1 0 −1
and B=
[
0 1 1
2 3 −1 ] [ ]
Definition
A square matrix A can be written in the form A=LU where L is a lower triangular matrix and U is
an upper triangular matrix . This is called the LU Decomposition of the Matrix A
37
SCHOOL OF MATHEMATICS
The matrix U can be found by reducing A to echelon form then L can be found by solving the
matrix equation A=XU
1 −5 3
3 Write the matrix below in the form A=LU where A= 2 1 1
0 1 4 [ ]
Solution
1 −5 3 1 −5 3 1 −5 3
[ 0 1 4 ] 0 [
1 4 0 0 ][
2 1 1 ≡(2 R 1−R2) 0 −11 5 ≡ 0 −11 5
49 ]
So let
1 −5 3
0 [
U = 0 −11 5
0 49 ]
a 0 0 1 −5 3 1 −5 3
[ ][
Then We solve the equation A= b c 0 0 −11 5 = 2 1 1
d e f 0 0 49 0 1 4 ][ ]
−1
From which we have that a=1 ,b=2 , c=−1 , d=0 , e= . f =1/11
11
1 0 0 1 −5 3
Hence A= 2
[
−1 0 0 −11 5
0 −1/11 1/11 0 0 ][
49 ]
LINEAR TRANSFORMATIONS
Definition
Remark
The scalar multiplication and vector addition on the left hand side are performed in V while the
ones the right hand side are performed in W.
Theorem
38
SCHOOL OF MATHEMATICS
i. T (0)=0
ii. T ( x+ y)=T (x )+T ¿)
iii. T (−x )=−T ( x )
T (−x +0 y )=−1¿
Example
Proof
T ( 0,0,0 )=(2,0,0) ≠ 0
Proof
( x 1 , y 1 ) + ( x 2 , y2 ) =(x 1 + x 2 , y 1 + y 2)
Then,
T¿
=¿
=( ( x 1− y 1 ) + ( x 2− y 2 ) , ( x 1+ 2 y 1 ) + ( x 2 +2 y 2 ))
However,
T ( x , y )+ T (x 1 , x 2) =( ( x 1− y 1 ) , ( x 1+2 y 1 ) )+( ( x 2− y 2 ) , ( x 2+ 2 y 2 ) )
=( ( x 1− y 1 ) + ( x 2− y 2 ) , ( x 1+ 2 y 1 ) + ( x 2 +2 y 2 ))
=( x 1− y 1 ) , ( x 1−2 y 1 ) + ( x 2 + y 2 ) ,(x 2 +2 y 2 )
=( ( x 1− y 1 ) + ( x 2− y 2 ) , ( x 1+ 2 y 1 ) + ( x 2 +2 ) )
39
SCHOOL OF MATHEMATICS
Example
Proof
Note T(0)=0
Example
Proof
Definition
Let T be a linear transformation of the linear space V into the linear space W then
Theorem
Proof of (i)
So, v1 + v 2 ker ( T )
40
SCHOOL OF MATHEMATICS
Examples
Theorem
A linear transformation T from V into W is injective if and only if the Kernel of T is {0}
Proof
If V is a finite dimensional vector space then to each linear transformation we associate a matrix.
Also a Matrix thus represents a linear transformation from a finite dimensional space
Each vector xV can be written uniquely as a linear combination of the basis vectors
i.e.
Ax=A (c 1 x 1 +c 2 x 2 +…+ c n x n)
¿ c 1 A x 1 +c 2 A x 2 +…+c n A xn
41
SCHOOL OF MATHEMATICS
c1
a11 a 12 ... a1 m
[
a n1 an 2 anm ] ()
A= a21 a 22 … a 2 m and x= c 2 . Note that the basis vectors x 1 , x 2 … … .. x n can be written
⋮
cn
1 0 0
as column vectors namely
⋮ ⋮
0 0
( )( ) ( )
0 , 1 … 0
⋮
1
where it is understood to mean that
1 a11 0 a 12
a11 a12 ... a 1m a11 a12 ...a 1m
So A x 1 =
[
a21 a22 … a2 m
a n 1 an 2 anm ]( ) ( )
0 = a21
⋮
0
⋮
an1
and A x 2 =
[
a21 a22 … a2 m
a n 1 an 2 anm ]( ) ( )
1 = a 22
⋮
0
⋮
a 22
and etc. It is clear the
columns of the Matrix are precisely the images of the basis vectors.
Example
T 1=1
() ()
0 2
T 0 = −1
() ( )
1 −3
T = 1 −1
[
2 −3 ]
2 Find the matrix of transformation if T is defined by
42
SCHOOL OF MATHEMATICS
1 0 0
( )( )( )
B={ 0 , 1 , 0 }
0 0 1
Solution
1 2
() ()
T 0=1
0 1
0 −1
() ( )
T 1= 0
0 −2
0 0
() ()
T 0=3
1 1
2 −1 0
[
T= 1 0 3 .
1 −2 1 ]
Obviously, a change in the basis will result in different matrix representation of a linear function F
3 Write the matrix representation of T ( x , y )=(x−2 y .2 x−3 y ) in the (u) standard basis (ii)
B={ ( 2,1 ) , (−1,2 ) }
Solution
(i) We first find the image of the basis vectors under T as follows
T 1= 1
() ()
0 2
T 0 = −2
() ( )
1 −3
43
SCHOOL OF MATHEMATICS
1
(ii)
2 0
Now T = =
1
1 2
2 + −1 = 5
() () () ( )
1 5 1 5 2 2
5
()
−14
And T
−1
2
= −3
( )( )
−8
=
−14 2
5 1
− −1
2
= 5
−1
()( ) ( )
1 −14
Hence the matrix is
[ ]
5
2
5
5
−1
4 Let D be the differential linear transformation defined on the space V of all polynomials of
degree three. Find the matrix for D in the basis (i) B={1, x , x 2 , x 3 (ii) B' ={1 , 1−x .1−x 2 , 1−x 3 }
5 Let V be the Euclidean space and the linear transformation T be represented by the Matrix
1 0 0
[ −1 1 0
0 −1 1 ]
in the standard basis .(i) Write the transformation T in the Cartesian f form (ii) Hence find matrix
for T using the basis B={ ( 1,1,1 ) , ( 0,1,1 ) , ( 0.0.1 ) }
Proof
Theorem. A linear transformation T :V →W is a one to one mapping if and only if ker (T )={0 }
44
SCHOOL OF MATHEMATICS
Proof
Suppose that ker ( T )={0 } and T ( x )=T ( y ) thenT ( x )−T ( y )=T ( x− y ) =0. So it must be that
x− y =0 leading to x= y.
Conversely, let T be one to one andT ( x )=0 then since T ( 0 )=0 x=0. Soker ( T )={0 }
The identity mapping is a linear transformation that is both one to one and onto.
Definition If T :V →W is a one to one onto mapping then the mappingS :W →V defined such that
for T ( x )= y ,then S( y )=x is called the inverse function of T
Theorem
Proof
−1 −1
Hence from the definition of the inverseT ( y1 + y 2 ) =x1 + x 2=T ( y 1 )+ T −1 ( y 2 )
Definition A vector space V is said to be isomorphic to a vector space W if there exists an
invertible linear transformation T from V onto W
Theorem
If x 1 , x 2 … … .. x n are linearly independent vectors of V and T is a one to one linear map of V into
W then T x 1 ,Tx 2 … ….. T x n are linearly independent in W.
Proof
Then from the linearity of T c1Tx1 c 2Tx 2 c n Tx n T (c1x1 c 2 x 2 ... c n x n ) 0
45
SCHOOL OF MATHEMATICS
c1 =c 2 c n 0
.
Remark. It follows from the above result that Isomorphic spaces have the same dimension
Corollary.
Rn
Proof
Let
Is an isomorphism. The fact that T is linear can be easily verified. Also, note that if
n m
Theorem R is not isomorphic to R for m≠ n
46
SCHOOL OF MATHEMATICS
47