Linear Algebra for Undergraduates

Dr. Krishnendra Shekhawat

BITS PILANI
Department of Mathematics
lecturesks@gmail.com

Krishnendra Shekhawat BITS PILANI Linear Algebra

Chapter 1

1 Introduction to System of Linear Equations

2 Reduced Row Echelon Form (RREF)
3 Solving System of Linear equations using RREF
4 Rank of a Matrix
5 Inverse of a Matrix using RREF

Krishnendra Shekhawat BITS PILANI Linear Algebra

Introduction to System of
Linear Equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

Why do we study System of Equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

Why do we study System of Equations

To solve problems which can be modelled using the

System of Equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

Why do we study System of Equations

To solve problems which can be modelled using the

System of Equations
To simply the problems related to Vector Spaces

Krishnendra Shekhawat BITS PILANI Linear Algebra

Example to Begin with

Krishnendra Shekhawat BITS PILANI Linear Algebra

Example to Begin with

Q: For a 50 marks exam, 13 questions are given. The

exam consists of true/false type questions of 2 marks
each and multiple-choice questions of 5 marks each. How
many true/false type questions are there in the exam?

Krishnendra Shekhawat BITS PILANI Linear Algebra

Example to Begin with

Q: For a 50 marks exam, 13 questions are given. The

exam consists of true/false type questions of 2 marks
each and multiple-choice questions of 5 marks each. How
many true/false type questions are there in the exam?

Sol.
x + y = 13
2x + 5y = 50

Krishnendra Shekhawat BITS PILANI Linear Algebra

Example to Begin with

Q: For a 50 marks exam, 13 questions are given. The

exam consists of true/false type questions of 2 marks
each and multiple-choice questions of 5 marks each. How
many true/false type questions are there in the exam?

Sol.
x + y = 13
2x + 5y = 50
(x = 5, y = 8).
Krishnendra Shekhawat BITS PILANI Linear Algebra
Q: Let us try to solve the following system of equations
and see what they geometrically represent?

Krishnendra Shekhawat BITS PILANI Linear Algebra

Q: Let us try to solve the following system of equations
and see what they geometrically represent?

5x + y = 3
2x − y = 4
x+y = 1
2x + 2y = 6
4x − y = 1
16x − 4y = 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

 5x +y = 3
2x - y = 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

 x + y = 1
x + y = 3

Krishnendra Shekhawat BITS PILANI Linear Algebra

 4x - y = 1
16x - 4y = 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

 5x + y = 3
2x − y = 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

 5x + y = 3
2x − y = 4
(x = 1, y = −2) (Unique solution). Geometrically, there
are two lines intersecting only at (1, −2).

Krishnendra Shekhawat BITS PILANI Linear Algebra

 5x + y = 3
2x − y = 4
(x = 1, y = −2) (Unique solution). Geometrically, there
are two lines intersecting only at (1, −2).
x+y = 1
2x + 2y = 6
No solution. Geometrically, the lines are parallel and
distinct. Thus, they do not intersect at any point.

Krishnendra Shekhawat BITS PILANI Linear Algebra

 4x − y = 1
16x − 4y = 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

 4x − y = 1
16x − 4y = 4

Sol. The given lines coincide, i.e., every point on

4x − y = 1 is a solution of the given system. Hence, the
system has infinitely many solutions.

Krishnendra Shekhawat BITS PILANI Linear Algebra

 4x − y = 1
16x − 4y = 4

Sol. The given lines coincide, i.e., every point on

4x − y = 1 is a solution of the given system. Hence, the
system has infinitely many solutions. The solution set is
( ! )
1 1
+ t, t | t ∈ R
4 4

Krishnendra Shekhawat BITS PILANI Linear Algebra

Q: What is common in all these equations.

Krishnendra Shekhawat BITS PILANI Linear Algebra

Q: What is common in all these equations.

Sol. Linearity

Krishnendra Shekhawat BITS PILANI Linear Algebra

Q: What is common in all these equations.

Sol. Linearity
A linear equation in the n variables x1, x2, . . . , xn is an
equation that can be written in the form
a1 x1 + a2 x2 + · · · + an xn = b
where the coefficients a1, a2, . . . , an and b are (real)
constants.

Krishnendra Shekhawat BITS PILANI Linear Algebra

Q: Which of the following equations are linear?
1 xy − 2z = 9
√
2 2x + π4 y − (sin π5 )z = 1
y +z = 1
3 x

4 sin x − 0.01y + 2z = 0
3z=9
x − 12 y − 15
5
√
6 2x + π4 y − (sin π5 )z = 1
7 3.2x − 0.01y = 4.6
8 x1 + x2 + · · · + xn = 1

Krishnendra Shekhawat BITS PILANI Linear Algebra

Remark.

Thus, linear equations do not contain products,

reciprocals, or other functions of the variables; the
variables occur only to the first power and are
multiplied only by constants.

Krishnendra Shekhawat BITS PILANI Linear Algebra

Solution of a linear equation

Krishnendra Shekhawat BITS PILANI Linear Algebra

Solution of a linear equation

A solution of a linear equation

a1 x1 + a2 x2 + · · · + an xn = b
is a vector (s1, s2, . . . , sn) whose components satisfy the
equation when we substitute
x1 = s1, x2 = s2, . . . , xn = sn.

Krishnendra Shekhawat BITS PILANI Linear Algebra

System of Linear Equations and its Solution

Krishnendra Shekhawat BITS PILANI Linear Algebra

System of Linear Equations and its Solution

A system of linear equation is a finite set of linear

equations, each with the same variables.

Krishnendra Shekhawat BITS PILANI Linear Algebra

System of Linear Equations and its Solution

A system of linear equation is a finite set of linear

equations, each with the same variables.
A solution of a system of linear equations is a vector
that is simultaneously a solution of each equation in the
system.

Krishnendra Shekhawat BITS PILANI Linear Algebra

System of Linear Equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

System of Linear Equations

A system of m linear equations in n unknown variables

x1, x2, . . . , xn is given by
a11 x1 + a12 x2 + · · · + a1n xn = b1
a21 x1 + a22 x2 + · · · + a2n xn = b2
... ... ... ...
am1 x1 + am2 x2 + · · · + amn xn = bm
where ai j, bi ∈ R and 1 6 i 6 m, 1 6 j 6 n.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.
When all bi = 0, the above system of linear equations is
called homogenous linear system.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.
When all bi = 0, the above system of linear equations is
called homogenous linear system.
Q: Is every homogeneous linear system consistent?

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.
When all bi = 0, the above system of linear equations is
called homogenous linear system.
Q: Is every homogeneous linear system consistent?
Yes, because all such systems have (0, 0, . . . , 0) as a
solution.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.
When all bi = 0, the above system of linear equations is
called homogenous linear system.
Q: Is every homogeneous linear system consistent?
Yes, because all such systems have (0, 0, . . . , 0) as a
solution. This solution is called a trivial solution.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A solution of the linear system is an ordered n-tuple
(s1, s2, . . . , sn) such that each equation of the system is
satisfied by substituting si in place of xi.
We say that a linear system is consistent if it has at
least one solution and inconsistent if it has no solution.
When all bi = 0, the above system of linear equations is
called homogenous linear system.
Q: Is every homogeneous linear system consistent?
Yes, because all such systems have (0, 0, . . . , 0) as a
solution. This solution is called a trivial solution. If
there are other solutions, they are called nontrivial
solutions.
Krishnendra Shekhawat BITS PILANI Linear Algebra
The linear system of equations
a11 x1 + a12 x2 + · · · + a1n xn = b1
a21 x1 + a22 x2 + · · · + a2n xn = b2
... ... ... ...
am1 x1 + am2 x2 + · · · + amn xn = bm
can be written in the form Ax = b, where
 a11 a12 . . . a1n 
     
 x1  b1 
 a21 a22 . . . a2n   x2  b2 
     
A =  .. ... ... ...  ,, x =  ...  and b =  ... 
 .     
am1 am2 . . . amn
  
xn bm


Krishnendra Shekhawat BITS PILANI Linear Algebra

The matrix A is called the coefficient matrix.

Krishnendra Shekhawat BITS PILANI Linear Algebra

The matrix A is called the coefficient matrix.
The matrix
. . . a1n b1 
 
 a11 a12
 a21 a22 . . . a2n b2 
 
 ... ... ... ... ... 
 
am1 am2 . . . amn bm
is called the augmented matrix for the system.

Krishnendra Shekhawat BITS PILANI Linear Algebra

For example, the augmented matrix for the system of
equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

For example, the augmented matrix for the system of
equations
x−y−z = 2
3x − 3y + 2z = 16
2x − y + z = 9
is given by

Krishnendra Shekhawat BITS PILANI Linear Algebra

For example, the augmented matrix for the system of
equations
x−y−z = 2
3x − 3y + 2z = 16
2x − y + z = 9
is given by
 
 1 −1 −1 2 
 3 −3 2 16 
 
2 −1 1 9

Krishnendra Shekhawat BITS PILANI Linear Algebra

Towards solving the system of equations

Krishnendra Shekhawat BITS PILANI Linear Algebra

Towards solving the system of equations

Q: Write down the augmented matrix for the solution of

the following system
x−y−z = 2
3x − 3y + 2z = 16
2x − y + z = 9.

Krishnendra Shekhawat BITS PILANI Linear Algebra

 x = 3, y = −1, z = 2
is a solution of the given system of equations,

Krishnendra Shekhawat BITS PILANI Linear Algebra

 x = 3, y = −1, z = 2
is a solution of the given system of equations, which
corresponds to the following augmented matrix
 
 1 0 0 3 
 0 1 0 −1 
 
0 0 1 2

Krishnendra Shekhawat BITS PILANI Linear Algebra

Here problem is to reduce the augmented matrix of given
system into a simplified augmented matrix.
   
 1 −1 −1 2   1 0 0 3 
 3 −3 2 16  →  0 1 0 −1 
   
2 −1 1 9 0 0 1 2

Krishnendra Shekhawat BITS PILANI Linear Algebra

Here problem is to reduce the augmented matrix of given
system into a simplified augmented matrix.
   
 1 −1 −1 2   1 0 0 3 
 3 −3 2 16  →  0 1 0 −1 
   
2 −1 1 9 0 0 1 2
This simplified matrix is known as row echelon form.

Krishnendra Shekhawat BITS PILANI Linear Algebra

A Few Thought Proving Questions

Krishnendra Shekhawat BITS PILANI Linear Algebra

A Few Thought Proving Questions

Q:1 How to define and compute row echelon form?

Krishnendra Shekhawat BITS PILANI Linear Algebra

A Few Thought Proving Questions

Q:1 How to define and compute row echelon form?

Q:2 Why are we introducing row echelon form, not
column echelon form ?

Krishnendra Shekhawat BITS PILANI Linear Algebra

A Few Thought Proving Questions

Q:1 How to define and compute row echelon form?

Q:2 Why are we introducing row echelon form, not
column echelon form ?
Q:3 Based on row echelon form, what can we say about
the nature of the solutions?

Krishnendra Shekhawat BITS PILANI Linear Algebra

 Thank You
Write me at lecturesks@gmail.com

Krishnendra Shekhawat BITS PILANI Linear Algebra