You are on page 1of 40

Engineering Mathematics II (MTH 102)

Indira Mishra

IIIT Bhopal

Feb 7, 2024

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 1 / 26
Linear Combination

Let us recall that a vector from R3 is if the form x = (x1 , x2 , x3 ) and


also it can be written as

x = (x1 , x2 , x3 ) = x1 (1, 0, 0) + x2 (0, 1, 0) + x3 (0, 0, 1).

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 2 / 26
Linear Combination

Let us recall that a vector from R3 is if the form x = (x1 , x2 , x3 ) and


also it can be written as

x = (x1 , x2 , x3 ) = x1 (1, 0, 0) + x2 (0, 1, 0) + x3 (0, 0, 1).

Thus any vector in R3 can be expressed as sum of scalar multiple of


thee vectors

e1 = (1, 0, 0), e2 = (0, 1, 0) and e3 = (0, 0, 1)

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 2 / 26
Linear Combination

Definition: Let V be a vector space and let {x1 , x2 , . . . xn } be any set


of vectors in V . Then a vector x in V is of the form

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 3 / 26
Linear Combination

Definition: Let V be a vector space and let {x1 , x2 , . . . xn } be any set


of vectors in V . Then a vector x in V is of the form

x = α1 x1 + α2 x2 + · · · + αn xn

(where αi , i = 1, . . . n are scalars), is called a linear combination of


the vectors x1 , x2 , . . . , xn .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 3 / 26
Linear Combination

Definition: Let V be a vector space and let {x1 , x2 , . . . xn } be any set


of vectors in V . Then a vector x in V is of the form

x = α1 x1 + α2 x2 + · · · + αn xn

(where αi , i = 1, . . . n are scalars), is called a linear combination of


the vectors x1 , x2 , . . . , xn .

The scalars α1 , α2 , . . . αn are called the coefficients of the linear


combination.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 3 / 26
Linear Combination

Example: Determine whether the vector x = (2, 1, 5) is a linear


combination of set of vectors {x1 , x2 , x3 }, where x1 = (1, 2, 1)
x2 = (1, 0, 2), and x3 = (1, 1, 0).

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 4 / 26
Linear Combination

Example: Determine whether the vector x = (2, 1, 5) is a linear


combination of set of vectors {x1 , x2 , x3 }, where x1 = (1, 2, 1)
x2 = (1, 0, 2), and x3 = (1, 1, 0).
Solution:
x is a linear combination of x! , x2 , x3 if we find the constants c1 ,
c2 , c3 so that
x = c1 x1 + c2 x2 + c3 x3 .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 4 / 26
Linear Combination

Example: Determine whether the vector x = (2, 1, 5) is a linear


combination of set of vectors {x1 , x2 , x3 }, where x1 = (1, 2, 1)
x2 = (1, 0, 2), and x3 = (1, 1, 0).
Solution:
x is a linear combination of x! , x2 , x3 if we find the constants c1 ,
c2 , c3 so that
x = c1 x1 + c2 x2 + c3 x3 .

Let
c1 (1, 2, 1) + c2 (1, 0, 2) + c3 (1, 1, 0) = (2, 1, 5)

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 4 / 26
Linear Combination


c1 + c2 + c3 = 2 
2c1 + 0c2 + c3 = 1
c1 + 2c2 + 0 · c3 = 5

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 5 / 26
Linear Combination


c1 + c2 + c3 = 2 
2c1 + 0c2 + c3 = 1
c1 + 2c2 + 0 · c3 = 5

⇐⇒
    
1 1 1 c1 2
 2 0 1   c2  =  1 
1 2 0 c3 5

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 5 / 26
Linear Combination


c1 + c2 + c3 = 2 
2c1 + 0c2 + c3 = 1
c1 + 2c2 + 0 · c3 = 5

⇐⇒
    
1 1 1 c1 2
 2 0 1   c2  =  1 
1 2 0 c3 5

⇒ c1 = 1, c2 = 2, c3 = −1
⇒ x = 1 · x1 + 2 · x2 − 1 · x3 .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 5 / 26
Linear Combination


c1 + c2 + c3 = 2 
2c1 + 0c2 + c3 = 1
c1 + 2c2 + 0 · c3 = 5

⇐⇒
    
1 1 1 c1 2
 2 0 1   c2  =  1 
1 2 0 c3 5

⇒ c1 = 1, c2 = 2, c3 = −1
⇒ x = 1 · x1 + 2 · x2 − 1 · x3 .
Or (2, 1, 5) = (1, 2, 1) + 2(1, 0, 2) − 1(1, 1, 0).

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 5 / 26
Linear Combination

The span: Let S := {x1 , x2 , . . . , xn } be a nonempty set of vectors in a


vector space V . Then the set of all vectors in V that are linear
combination of vectors in S, is denoted by span(S) or
span{x1 , x2 , . . . , xn }.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 6 / 26
Linear Combination

The span: Let S := {x1 , x2 , . . . , xn } be a nonempty set of vectors in a


vector space V . Then the set of all vectors in V that are linear
combination of vectors in S, is denoted by span(S) or
span{x1 , x2 , . . . , xn }.

Let S = {x1 , x2 , . . . , xn }

span(S) = {c1 x1 + c2 x2 + . . . cn xn | c1 , c2 , . . . , cn ∈ R}

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 6 / 26
Linear Combination

Example: Let S = {(1, 1, 0, 1), (1, −1, 0, 1), (0, 1, 2, 1)}. Determine
whether.
(a). x = (2, 3, 2, 3) and
(b). y = (0, 1, 2, 3)
belong to span(S) or not.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 7 / 26
Linear Combination

Example: Let S = {(1, 1, 0, 1), (1, −1, 0, 1), (0, 1, 2, 1)}. Determine
whether.
(a). x = (2, 3, 2, 3) and
(b). y = (0, 1, 2, 3)
belong to span(S) or not.
Solution: a). x belong to span(S) if and only if x is a linear
combination of S.
consider the system

c1 (1, 1, 0, 1) + c2 (1, −1, 0, 1) + c3 (0, 1, 2, 1) = (2, 3, 2, 3).

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 7 / 26
Linear Combination

The above system is


   
1 1 0 2 1 1 0 2
 1 −1 1 3  R4 −R1  0 −2 1 1  − 1 ·R2
 −−−−→   −−2−−→
 0 0 2 2  R2 −R1  0 0 2 2 
1 1 1 3 0 0 1 1

   1 5 
1 1 0 2 1 0 2 2
 0 1 −1
2 − 12 
−R1 −R2  0 1 −1
2 − 12  R − 1 R3
 −−1−−4−→

 0 −−−→ 
0 2 2   0 0 2 2  R2 + 14 R3
0 0 1 1 0 0 1 1

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 8 / 26
Linear Combination

   
1 0 0 2 1 0 0 2
 0 1 0 0  R3 −2R4  0 1 0 0 −
 R3 →R4
−− − −−→  0 0 0 0  −−−−→

 0 0 2 2 
0 0 1 1 0 0 1 1
 
1 0 0 2
 0 1 0 0  Thus system has solution:
 
 0 0 1 1  c1 = 2, c2 = 0, c3 = 1.
0 0 0 0
Thus

2 · (1, 1, 0, 1) + 0 · (1, −1, 0, 1) + 1 · (0, 1, 2, 1) = (2, 3, 2, 3)

Hence x ∈ span(S).
Exercise: (b).

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 9 / 26
Linear Combination

Theorem: Let S = {x1 , x2 , . . . , xn } be any nonempty subset of vector


space V . Then span(S) is a subspace of V .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 10 / 26
Linear Combination

Theorem: Let S = {x1 , x2 , . . . , xn } be any nonempty subset of vector


space V . Then span(S) is a subspace of V .

Definition: Let S = {x1 , x2 , . . . , xn } be a set of vectors in a vector


space V ,
if every vector in V is a linear combination of vectors in S,
we say that S spans V , or V is spanned by S.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 10 / 26
Linear Combination

Example 1: Let
S = {e1 = (1, 0, 0), e2 = (0, 1, 0), e3 = (0, 0, 1)} ⊆ R3 .
Any vector x = (x1 , x2 , x3 ) ∈ R3 can be written as

x = x1 · (1, 0, 0) + x2 · (0, 1, 0) + x3 (0, 0, 1)


= x1 · e1 + x2 · e2 + x3 · e3 .

Thus R3 is spanned by {e1 , e2 , e3 }.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 11 / 26
Linear Combination

Example
 2: Let 
 
1 , 0, . . . 0) ⊆ Rn . Then any
S = e1 , e2 , . . . , en | ej = (0, . . . , 0, |{z}
 
j th
x = (x1 , x2 , . . . , xn ) ∈ Rn can be written as

x = x1 e1 + x2 e2 + · · · + xn en .

Thus Rn is spanned by {e1 , e2 , . . . , en }.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 12 / 26
Linear Combination

Example 3: A spanning set for Pn .


Pn = {a0 + a1 x + · · · + an xn | ai ∈ R} is vector space of polynomials of
up to degree n.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 13 / 26
Linear Combination

Example 3: A spanning set for Pn .


Pn = {a0 + a1 x + · · · + an xn | ai ∈ R} is vector space of polynomials of
up to degree n.
Let
S = 1, x, x2 , . . . , xn ⊆ Pn


Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 13 / 26
Linear Combination

Example 3: A spanning set for Pn .


Pn = {a0 + a1 x + · · · + an xn | ai ∈ R} is vector space of polynomials of
up to degree n.
Let
S = 1, x, x2 , . . . , xn ⊆ Pn


Any p(x) ∈ Pn can be written as

p(x) = a0 + a1 x + a2 x2 + · · · + an xn

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 13 / 26
Linear Combination

Example 3: A spanning set for Pn .


Pn = {a0 + a1 x + · · · + an xn | ai ∈ R} is vector space of polynomials of
up to degree n.
Let
S = 1, x, x2 , . . . , xn ⊆ Pn


Any p(x) ∈ Pn can be written as

p(x) = a0 + a1 x + a2 x2 + · · · + an xn

Thus the set S span Pn or Pn is spanned by S.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 13 / 26
Linear Combination

Example 4: Let S = {x1 , x2 , x3 } where x1 = (1, 2, 1), x2 = (1, 0, 2)


and x3 = (1, 1, 0). Does S spans R3 ?

Solution: If S span R3 , then any x = (a, b, c) ∈ R3 can be written as


linear combination of x1 , x2 , x3 , That is

c1 (1, 2, 1) + c2 (1, 0, 2) + c3 (1, 1, 0) = (a, b, c)

have non trivial solution.


   
1 1 1 a 1 1 1 a
R −2R1 R2 /2
 2 0 1 b  −−2−−−→  0 −2 −1 b − 2a  −−−→
R3 −R1
1 2 0 c 0 1 −1 c − a

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 14 / 26
Linear Combination

 
1 1 1 a
b R1 +R2
 0 −1 −1/2 − −−−→
2 −a R3 +R2
0 1 −1 c−a
 b 
1 0 1/2 2 R (− 23 )
 0 −1 −1/2 b
− a  −−3−−− →
2 −R2
0 0 −3/2 2b + c − 2a
1 0 0 2b + c − a
 
 0 1 0 a − 2b 
(4a−b−2c)
0 0 1 3

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 15 / 26
Linear Combination

 
(c+2b−2a)
1 0 0 3
 
R1 −R3 /3
 
−−−−−−→  0 1 0
 (a−c−b) 
3

R2 −R3 /2  
 
4a−b−2c
0 0 1 3
Thus
R3 = span{(1, 2, 1), (1, 0, 2), (1, 1, 0)}.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 16 / 26
Linear Combination

Example 5: Let S = {x1 , x2 }, where x1 = (1, 1, 0), x2 = (1, 1, 1). Does


S span R3 ?
Solution: Let x = (a, b, c) ∈ R3 . Consider

c1 (1, 1, 0) + c2 (1, 1, 1) = (a, b, c).


   
1 1 a 1 1 a
R2 −R1
 1 1 b − −−−→  0 0 b − a  .
0 1 c 0 1 c

The above system has no solution if b − a 6= 0. Thus S does not span


R3 .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 17 / 26
Linearly independent/dependent sets

Linearly independent and Linearly dependent sets

Definition: A set of vectors {x1 , x2 , . . . , xm } in a vector space V is


said to be linearly-independent, if the vector equation

c1 x1 + c2 x2 + . . . + cm xm = 0

has only trivial solution c1 = c2 = · · · = cm = 0, otherwise it is said to


be linearly dependent.

Linearly independent:

c1 x1 + c2 x2 + · · · + cm xm = 0 ⇒ c1 = 0, c2 = 0, · · · cm = 0.

Linearly dependent:

c1 x1 + c2 x2 + · · · + cm xm = 0 ⇒ cj 6= 0, for some j.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 18 / 26
Linearly independent/dependent sets

Remark: Linearly independent means any vector from the set can not
be written as linear combination of other vectors of the set.
Example 1:
a. S = {(1, 2), (2, 4)}

c1 (1, 2) + c2 (2, 4) = (0, 0) ⇒ c1 = 2, c2 = −1

b. S = {(1, 2), (2, 4), (9, 11)}

c1 (1, 2) + c2 (2, 4) + c3 (9, 11) = (0, 0)

⇒ c1 = 2, c2 = −1, c3 = 0.
Thus linearly dependent vectors.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 19 / 26
Linearly independent/dependent sets

Example 2: Determine whether the vectors


{e1 = (1, 0, 0), e2 = (0, 1, 0), e3 = (0, 0, 1)} in R3 are linearly
independent or not?
Solution: Let c1 e1 + c2 e2 + c3 e3 = 0.

c1 · (1, 0, 0) + c2 (0, 1, 0) + c3 (0, 0, 1) = (0, 0, 0).

(c1 , c2 , c3 ) = (0, 0, 0).


This implies that c1 = c2 = c3 = 0. Thus the vectors {e1 , e2 , e3 } are
linearly independent in R3 .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 20 / 26
Linearly independent/dependent sets

Example 3: Determine whether x1 = (1, 0, 1, 2), x2 = (0, 1, 1, 2) and


x3 = (1, 1, 1, 3) in R4 are linearly independent or not? Solution
consider linear combination

c1 · x1 + c2 x2 + c3 x3 = 0.
   
1 0 1 0 1 0 0 0
 0 1 1 0   0 1 0 0 
  → ··· →  .
 1 1 1 0   0 0 1 0 
2 2 3 0 0 0 0 0
Therefore c1 = 0, c2 = 0, c3 = 0, and thus x1 , x2 and x3 are linearly
independent.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 21 / 26
Linearly independent/dependent sets

Example 4: Determine linear dependency of vectors x1 = (1, 2, −1),


x2 = (1, −2, 1), x3 = (−3, 2, −1) and x4 = (2, 0, 0) in a vector space R3 .
Solution: Consider the homogeneous system

c1 x1 + c2 x2 + c3 x3 + c4 x4 = 0.
   
1 1 −3 2 0 1 0 −1 1 0
 2 −2 2 0 0  → · · ·  0 1 −2 1 0  .
−1 1 −1 0 0 0 0 0 0 0

c2 = +2c3 − c4
c1 = c3 − c4 .
let c4 = t, c3 = s, then c2 = 2s − t, c1 = s − t. Thus above system has
nontrivial solutions. Hence {x1 , x2 , x3 , x4 } are linearly dependent.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 22 / 26
Linearly independent/dependent sets

Check that

x3 = −x1 − 2x2 and x4 = x1 + x2 .


| {z } | {z }
from third column from fourth column

Thus in case of linear dependency any vector from the set can be
written as linear combination of other vectors of the set.
Here x3 and x4 can be written as linear combination of x1 and x2 .

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 23 / 26
Linearly independent/dependent sets

Remarks:
Any set containing zero vector is linearly dependent.

The set {φ} is linearly dependent.

Let S1 and S2 be two subsets of vector space V with S1 ⊆ S2 ,


then
1 S1 is linearly dependent ⇒ S2 is linearly dependent.
2 S2 is linearly independent ⇒ S1 is linearly independent.

If n > m any set of n-vectors in m-space Rm is linearly dependent.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 24 / 26
Linearly independent/dependent sets

Exercise 1: For what values of α are the vectors


(−1, 0, −1), (2, 1, 2), (1, 1, α) in R3 , are linearly dependent.

Exercise 2: If {x1 , x2 } are linearly dependent set, then x1 is parallel


to x2 (i.e. x1 kx2 ).

Exercise 3: Let S = {x1 , x2 , . . . xn } be a set of vectors in Rn and let


A be an n × n matrix whose columns are the vectors of S. Then

a). If A is singular, then S is linearly dependent.


b). If A is nonsingular, then S is linearly independent.

Indira Mishra (IIIT Bhopal) Linear Combination and Span Feb 7, 2024 25 / 26
Thank You

You might also like