Rank of a Matrix

Prof. Dr. Shailendra R. Bandewar

Definitions
• Consistency: The system is said to be consistent if it has a solution.
• Solution: A system of equations
𝑎11 𝑥1 + 𝑎12 𝑥2 +. . . +𝑎1𝑛 𝑥𝑛 = 𝑏1
𝑎21 𝑥1 + 𝑎22 𝑥2 +. .. . +𝑎2𝑛 𝑥𝑛 = 𝑏2
.
𝑎𝑚1 𝑥1 + 𝑎𝑚2 𝑥2 +. . . +𝑎𝑚𝑛 𝑥𝑛 = 𝑏𝑚

is said to have solution if there exists real numbers

𝑥1 , 𝑥2 , … , 𝑥𝑛 such that it satifies all the above equations simultaneously
 Linear Systems in Two Unknowns
Equations of the type
𝑎1 𝑥 + 𝑏1 𝑦 = 𝑐1
𝑎2 𝑥 + 𝑏2 𝑦 = 𝑐2
are linear equation in 2−Dimension.
Each equation geometrically represents a straight line.
The question arrises is when we have a solution?
and if it has a solution is it really unique?
Geometry of solutions of Linear
Systems in Two Unknowns
𝐶𝑜𝑛𝑠𝑖𝑑𝑒𝑟 𝑡𝑤𝑜 𝑒𝑞𝑢𝑎𝑡𝑖𝑜𝑛𝑠 𝑖𝑛 𝑡𝑤𝑜 𝑢𝑛𝑘𝑛𝑜𝑤𝑛𝑠
𝑎1 𝑥 + 𝑏1 𝑦 = 𝑐1
𝑎2 𝑥 + 𝑏2 𝑦 = 𝑐2
𝑎1 𝑏1 𝑐1
𝑇ℎ𝑒 𝑠𝑦𝑠𝑡𝑒𝑚 𝑖𝑠 𝐢𝐧𝐜𝐨𝐧𝐬𝐢𝐬𝐭𝐞𝐧𝐭 𝑖𝑓 = ≠ .
𝑎2 𝑏2 𝑐2
𝑎1 𝑏1
𝑇ℎ𝑒 𝑠𝑦𝑠𝑡𝑒𝑚 ℎ𝑎𝑠 𝐮𝐧𝐢𝐪𝐮𝐞 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧 𝑖𝑓 ≠ .
𝑎2 𝑏2
𝑎1 𝑏1 𝑐1
𝑇ℎ𝑒 𝑠𝑦𝑠𝑡𝑒𝑚 ℎ𝑎𝑠 𝐢𝐧𝐟𝐢𝐧𝐢𝐭𝐞 𝐧𝐮𝐦𝐛𝐞𝐫 𝐨𝐟 𝐬𝐨𝐥𝐮𝐭𝐢𝐨𝐧𝐬 𝑖𝑓 = = .
𝑎2 𝑏2 𝑐2
 Linear Systems in Three Unknowns
Equations of the type
𝑎1 𝑥 + 𝑏1 𝑦 + 𝑐1 𝑧 = 𝑑1
𝑎2 𝑥 + 𝑏2 𝑦 + 𝑐2 𝑧 = 𝑑2
𝑎3 𝑥 + 𝑏3 𝑦 + 𝑐3 𝑧 = 𝑑3
are linear equation in 3−Dimension.

Each equation geometrically represents a Plane. So the question arrises is

when we have a solution? and if it has a solution is it really unique?
Linear Systems in Three Unknowns
▪ In case of three equations in three unknowns it is really difficult to answer
whether the system is consistent or not and if it is consistent, what kind of
solutions do we have?
▪ Can it be decided just by observing the coefficients ? Which is possible for
two equations in two unknowns.
▪ Geometrically there are 3-distinct ways to have infinite number of solutions
and 4 distinct ways where we have no solution.
▪ How can this be decided?
 Difficulty in analyzing the system
geometrically
• We have experience the difficulty in analyzing the solution of system
of linear equations.
• So, natural question is how to decide weather the system is consistent
or not? if consistent what kind of solution do we have?
• Therefore, I am Introducing the concept of rank of a matrix, and how
it helps to find the answers to the above questions?
Rank of a matrix
• Rank of a Matrix : Let 𝐴𝑚×𝑛 be any matrix, r is said to a rank of the matrix A
denoted by 𝜌(𝐴) , if
1. The matrix has at least one non-zero minor of order r.
2. all the minors of order r+1 are zero.
OR
• The order of highest order non-vanishing minor is the rank of the matrix.

𝑅𝑎𝑛𝑘 𝑜𝑓 𝐴 𝑖𝑠 𝑑𝑒𝑛𝑜𝑡𝑒𝑑 𝑏𝑦 = 𝜌(𝐴)

Next example illustrate the method of finding the rank by using the
definition, before studying examples try to understand the definition of
minor of a matrix
Minor of order r of a matrix of order 𝑚 × 𝑛
Let A be a matrix of order 𝑚 × 𝑛, minor of order 𝑟 of a matrix A is the
determinant of a submatrix of order 𝑟 × 𝑟.
Next question is how many minors of order 𝑟 × 𝑟 ?
𝑛 𝑚
➢ ×
𝑟 𝑟
 1 1 −1 2
Example: Find the rank of the 𝐴 = 2 2 −2 4
2 2 −2 1
➢
There is one non−zero minor of order 1, ρ(A)=1, if

all the minors of order 2 are zero.

There are 18 minors of order 2,

−2 4
but one of the minor =6 ≠ 0, ∴ 𝜌(A) ≠ 1.
−2 1

∴ 𝜌(A)=2 if all the minors of order 3 are zero.

There are 4 minors of order 3

1 1 −1 1 1 2
2 2 −2 = 0, 2 2 4 =0
2 2 −2 2 2 1

1 −1 2 1 −1 2
2 −2 4 = 0, 2 −2 4 = 0
2 −2 1 2 −2 1

∴ 𝜌(𝐴) = 2

It involves too many calculations and it is time consuming to

find rank by using the definition.
Elementary Transformations:
1. Interchange of any two rows or columns
R or ( R  R )
ij i , C or (C  C ) .
j ij i j

2. Multiplying any row or column by a non-zero constant ,

 Ri ,  C j ,   0
3. Adding in i th row a scalar multiple of corresponding elements
of j row (similarly for column) R +  R , C +  C
th
i j i j
Theorem: Elementary transformations do not alter the rank of
the matrix.
Echelon Form (Row reduced form)
(To reduce a matrix into an Echelon form, only row
transformations are permitted.)

1. All the non-zero rows are above any rows of zeros.

2. Each leading entry of a row is in a column of the right of the
leading entry of the row above it.
3. All entries in a column below the leading entry all zeros.

If the matrix in the echelon form satisfies the following

Additional conditions, then it is said to be reduced
echelon form
4. Leading entry in each nonzero row is one
5. Each leading 1 is the nonzero entry in its column.
𝐄𝐱𝐚𝐦𝐩𝐥𝐞: Determine which of the following matrices are in echelon
form and which are reduced echelon form:

1 2 3 4 1 1 −1 0 2
i 0 1 0 2 (ii) 0 0 0 2 7
0 0 0 2 0 0 0 0 0

1 0 3 0 1 1 −1 0 2
𝑖𝑖𝑖 0 1 0 0 (𝑖𝑣) 0 0 0 1 7
0 0 0 1 0 0 0 0 0
5. 𝜌 𝐴 = 𝜌(𝐴𝑇 )
• What is the maximum rank of 𝐴5×7 ?

• Rank of 𝐴5×7 ≤?

• If a 7 × 8 𝑚𝑎𝑡𝑟𝑖𝑥 𝐴 ℎ𝑎𝑣𝑒 4 𝑝𝑖𝑣𝑜𝑡′𝑠 𝑡ℎ𝑒𝑛, 𝑤ℎ𝑎𝑡 𝑖𝑠 𝑡ℎ𝑒 𝑟𝑎𝑛𝑘 𝑜𝑓 𝐴 ?

• If 7 × 8 𝑚𝑎𝑡𝑟𝑖𝑥 𝐴 ℎ𝑎𝑣𝑒 4 𝑝𝑖𝑣𝑜𝑡𝑒𝑠, the how many pivot 𝐴𝑇 will have?

• If A is nonsingular matrix of order 5, then 𝜌 𝐴 =?

• If A is a singular matrix of order 5, then 𝜌 𝐴 = 5 𝑜𝑟 ≤ 5 𝑜𝑟 < 5 or ≥ 5

𝑜𝑟 > 5
Algorithm to reduce the matrix into Echelon Matrix
 a11 a12 . . a1n 
a a22 . . a2 n 
A =  21
 . . . . . 
 
 am1 am 2 . . Amn 

Step 1: Make a11 → 1 by rowtransformation.

Step 2 : Make a21 , a31 ,..., am1 → 0.
Step 3 : If you observed that any two rows
prportionate make one or more rows zero.
Step 3 : Make a22 → 1
step 4 : Make a32 , a42 ,..., am 2 → 0.
continue the procedure till it reduces to echlon form
Examples
𝑬𝑿: 𝐹 in 𝑑 𝑡ℎ𝑒 𝑟𝑎𝑛𝑘 𝑜𝑓 𝑎 𝑚𝑎𝑡𝑟𝑖𝑥 𝑏𝑦 𝑟𝑒𝑑𝑢𝑐𝑖𝑛𝑔 𝑖𝑡 𝑡𝑜 𝑒𝑐ℎ𝑒𝑙𝑜𝑛 𝑓𝑜𝑟𝑚
5 5 5 5
6 7 8 9
𝐴=
11 12 13 14
16 17 18 19

5 5 5 5
6 7 8 9
𝑺𝒐𝒍𝒖𝒕𝒊𝒐𝒏: 𝐴 = (−𝑅1 + 𝑅2 )
11 12 13 14
16 17 18 19

1 2 3 4
6 7 8 9
∼ (𝑅2 − 6𝑅1 , 𝑅3 − 11𝑅1 , 𝑅4 − 16𝑅1 )
11 12 13 14
16 17 18 19
 1 2 3 4
0 5 10 15
∼ 𝑅3 − 2𝑅2 , 𝑅4 − 3𝑅2
0 10 20 30
0 15 30 45

1 2 3 4
0 5 10 15 1
∼ 𝑅2
0 0 0 0 5
0 0 0 0

1 2 3 4
0 1 2 3
∼ ∴ 𝜌(𝐴) = 2
0 0 0 0
0 0 0 0
𝑬𝒙: 𝑅𝑒𝑑𝑢𝑐𝑒 𝑡ℎ𝑒 𝑀𝑎𝑡𝑟𝑖𝑥 𝑡𝑜 𝑖𝑡𝑠 𝑒𝑐ℎ𝑒𝑙𝑜𝑛 𝑓𝑜𝑟𝑚 𝑎𝑛𝑑 ℎ𝑒𝑛𝑐𝑒 𝑓𝑖𝑛𝑑 𝑖𝑡𝑠 𝑟𝑎𝑛𝑘
2 3 −1 −1
1 −1 −2 −4
𝐴= .
3 1 3 −2
6 3 0 −7

2 3 −1 −1
1 −1 −2 −4
𝑺𝒐𝒍𝒖𝒕𝒊𝒐𝒏: 𝐴 = 𝑅1 − 𝑅2 ⇒
3 1 3 −2
6 3 0 −7

1 4 1 3
1 −1 −2 −4
∼ 𝑅2 − 𝑅1 , 𝑅3 − 3𝑅1 , 𝑅4 − 6𝑅1 ⇒
3 1 3 −2
6 3 0 −7
 1 4 1 3
0 −5 −3 −7 −1
∼ 𝑅2 ↔ 𝑅3
0 −11 0 −11 11
0 −21 −6 −25

1 4 1 3
0 1 0 1
∼ 𝑅3 + 5𝑅2 , 𝑅4 + 21𝑅2
0 −5 −3 −7
0 −21 −6 −25

1 4 1 3 1 4 1 3
0 1 0 1 0 1 0 1
∼ 𝑅4 − 2𝑅3 ∼
0 0 −3 −2 0 0 −3 −2
0 0 −6 −4 0 0 0 0

∴ 𝜌(𝐴) = 3
𝐄𝐥𝐞𝐦𝐞𝐧𝐭𝐚𝐫𝐲 𝐌𝐚𝐭𝐫𝐢𝐱
A matrix obtained by a single elementary row transformation on
identity matrix is called Elementary Matrix.

𝐍𝐨𝐭𝐞:
1 An application of Single elementary row transformation is equivalent
to pre multiplication by Corresponding elementary matrix
2 Inverse of an Elementary Matrix is an Elementary Matrix.

Theorem: Every non-singular (invertible) matrix Can be expressed as a

product of elementary matrices.
 1 3
𝑬𝒙𝒂𝒎𝒑𝒍𝒆 𝟏: 𝐸𝑥𝑝𝑟𝑒𝑠𝑠 𝐴 = 𝑎𝑠 𝑝𝑟𝑜𝑑𝑢𝑐𝑡 𝑜𝑓 𝑒𝑙𝑒𝑚𝑒𝑛𝑡𝑎𝑟𝑦 𝑚𝑎𝑡𝑟𝑖𝑐𝑒𝑠
5 7

1 3 𝑅2 −5𝑅1 1 3
➢ 𝐴= ⇒𝐴∼
5 7 0 −8

𝑁𝑜𝑤 𝑎𝑝𝑝𝑙𝑦 𝑡ℎ𝑒 𝑠𝑎𝑚𝑒 𝑡𝑟𝑎𝑛𝑠𝑓𝑜𝑟𝑚𝑎𝑡𝑖𝑜𝑛 𝑜𝑛 𝑖𝑑𝑒𝑛𝑡𝑖𝑡𝑦 𝑚𝑎𝑡𝑟𝑖𝑥

1 0 𝑅2 −5𝑅1 1 0
𝐼= ⇒ 𝐸1 =
0 1 −5 1

1 0 1 3 1 3
𝑂𝑏𝑠𝑒𝑟𝑣𝑒 𝑡ℎ𝑎𝑡 𝐸1 𝐴 = =
−5 1 5 7 0 −8
 1 3 𝑅2 (−1/8) 1 3
𝐴∼ → ⇒𝐴∼
0 −8 0 1

𝑁𝑜𝑤 𝑎𝑝𝑝𝑙𝑦 𝑡ℎ𝑒 𝑠𝑎𝑚𝑒 𝑡𝑟𝑎𝑛𝑠𝑓𝑜𝑟𝑚𝑎𝑡𝑖𝑜𝑛 𝑜𝑛 𝑖𝑑𝑒𝑛𝑡𝑖𝑡𝑦 𝑚𝑎𝑡𝑟𝑖𝑥

1 0 𝑅2 (−1/8) 1 0
𝐼= ⇒ 𝐸2 =
0 1 0 −1/8

𝑂𝑏𝑠𝑒𝑟𝑣𝑒 that
1 0 1 0 1 3 1 3
𝐸2 𝐸1 𝐴 = =
0 −1/8 −5 1 5 7 0 1
 1 3 𝑅1 −3𝑅2 1 0
𝐴∼ → ⇒𝐴∼
0 1 0 1

1 0 𝑅1 −3𝑅2 1 −3
𝐼= ⇒ 𝐸3 =
0 1 0 1

∴ 𝐸3 𝐸2 𝐸1 𝐴

1 −3 1 0 1 0 1 3
=
0 1 0 −1/8 −5 1 5 7

1 0
=
0 1

∴ 𝐴 = 𝐸1−1 𝐸2−1 𝐸3−1 𝐼

𝑬𝒙𝒂𝒎𝒑𝒍𝒆 𝟐: Express the matrix A as a product of elementary matrices,
1 4
where A=
2 9

Solution: A can be reduced to I as follows:

1 4 𝑅2 −2𝑅1 1 4 𝑅1 −4𝑅2 1 0
2 9 0 1 0 1

𝑇ℎ𝑒 𝑡𝑤𝑜 𝑟𝑜𝑤 𝑜𝑝𝑒𝑟𝑎𝑡𝑖𝑜𝑛𝑠 𝑐𝑎𝑛 𝑏𝑒 𝑝𝑒𝑟𝑓𝑜𝑟𝑚𝑒𝑑 𝑜𝑛 𝑡ℎ𝑒 𝑖𝑑𝑒𝑛𝑡𝑖𝑡𝑦 𝑚𝑎𝑡𝑟𝑖𝑥

to 𝑔𝑒𝑡 𝑡𝑤𝑜 𝑒𝑙𝑒𝑚𝑒𝑛𝑡𝑜𝑟𝑦 𝑚𝑎𝑡𝑟𝑖𝑐𝑒𝑠
 1 0 1 −4
𝐸1 = , 𝐸2 =
−2 1 0 1

∴ 𝐸2 𝐸1 𝐴 = 𝐼
1 0 1 4
∴𝐴= 𝐸1−1 𝐸2−1 =
2 1 0 1
Examples :
1. Find the echelon form and the rank of the
following matrices.
(a ) A 3  4 matrix of 1' s.
(b) A 4  4 matrix with aij = ( −1)i + j .
(c) A 4  4 matrix with aij = ( −1) . ij

(d ) A 3  4 matrix with aij = ( −1) . j

2. 𝑓𝑖𝑛𝑑 𝑡ℎ𝑒 𝑐𝑜𝑛𝑑𝑖𝑡𝑖𝑜𝑛 𝑜𝑛 ′𝑎′ 𝑠𝑢𝑐ℎ 𝑡ℎ𝑎𝑡 𝑖𝑓 𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑒 𝐴 ℎ𝑎𝑣𝑒 𝑟𝑎𝑛𝑘
1𝑜𝑟 2 𝑜𝑟 3?

2 4 6
𝐴= 1 2 3 .
3 6 𝑎

3. 𝑓𝑖𝑛𝑑 𝑡ℎ𝑒 𝑐𝑜𝑛𝑑𝑖𝑡𝑖𝑜𝑛 𝑜𝑛 ′𝑎′ 𝑎𝑛𝑑 ′𝑏 ′ 𝑠𝑢𝑐ℎ 𝑡ℎ𝑎𝑡 𝑖𝑓 𝑝𝑜𝑠𝑠𝑖𝑏𝑙𝑒 𝐴 ℎ𝑎𝑣𝑒 𝑟𝑎𝑛𝑘
1𝑜𝑟 2 𝑜𝑟 3?

2 4 6 2 4 6
𝐴= 1 2 𝑏 ,𝐴 = 1 𝑏 3
3 6 𝑎 3 6 𝑎
3. 𝐷𝑒𝑡𝑒𝑟𝑚𝑖𝑛𝑒 𝑡ℎ𝑒 𝑟𝑎𝑛𝑘 𝑜𝑓 𝑡ℎ𝑒 𝑓𝑜𝑙𝑙𝑜𝑤𝑖𝑛𝑔 𝑚𝑎𝑡𝑟𝑖𝑐𝑒𝑠 𝑏𝑦
𝑟𝑒𝑑𝑢𝑐𝑖𝑛𝑔 𝑖𝑡 𝑡𝑜 𝑎𝑛 𝐸𝑐ℎ𝑒𝑙𝑜𝑛 𝑓𝑜𝑟𝑚.

1 2 1 0
3 −2 0 −1 −7
3 2 1 2
0 2 2 1 −5
𝑎 𝐴= 𝑏 𝐴= 1 3 −1 −3
1 −2 −3 −2 1
2 −1 2 5
0 1 2 1 −6
5 6 3 2
4. 𝐹𝑖𝑛𝑑 𝑡ℎ𝑒 𝑟𝑎𝑛𝑘 𝑜𝑓 𝑏𝑦 𝑟𝑒𝑑𝑢𝑐𝑖𝑛𝑔 𝑖𝑡 𝑡𝑜 𝑒𝑐ℎ𝑒𝑙𝑜𝑛 𝑓𝑜𝑟𝑚

1 3 1 3
0 1 1 0
𝐴 = −3 0 6 −1
3 4 −2 1
2 0 −4 −2
 1 𝜔 𝜔2
Example: Find the rank of 𝐴 = 𝜔 𝜔2 1 , where 𝜔 is complex
𝜔2 1 𝜔
cube root of unity.
References
• Linear algebra and its applications, By Gilbert strang, Cengage
Learning India Edition. (Fourth Edition)
• Linear algebra and its applications, By David C. lay, Pearson (Third
Edition).
• Advanced Engineering Mathematics, by Erwin Creyszig,