Linear Combinations, Linear Algebra, Alexandria University

Linear Combinations
and Linear Independence

Dr. Sara Hassan Kamel
Linear Combinations
 Linear Combination
Let’s say we have four vectors x, u, v and w, where
x = 2u + 3v – w
 We say that x is a linear combination of u, v and w
 Similarly, any of the four vectors in this example is a
linear combination of the other three (e.g. u is a linear
combination of x, v and w).
 Linear combination  A combination made using

addition and/or scalar multiplication
2 Dr. Sara Hassan Kamel
Linear Combinations
 If the vectors w, v1, v2, …, vn ∈ a vector space V,
and
where c1, c2, … cn ∈ ℝ, then we say that w is a

linear combination of v1, v2, …, vn
 We can also say that v1 is a linear combination of

w, v2, …, vn
Intro to the next lecture
Remember the vector equation?
Vector
Equation
 We say that if the system has a solution then b is

a linear combination of the columns of A
Linear Combinations
 Example 1: Determine whether x = < 8, 7, -2 >
is a linear combination of the vectors in S = {v1, v2,v3}
If there are values for c1, c2 and c3 that satisfy this equation, then x
can be written as a linear combination of the vectors in S
If not, then x is not a linear combination of the vectors in S

Linear Combinations

Linear Combinations
c1 – c2 + 3c2 = 8
c1 + 2c2 + 4c3 = 7
c1 + c2 – c3 = –2

Linear Combinations
c1 – c2 + 3c2 = 8
c1 + 2c2 + 4c3 = 7
c1 + c2 – c3 = –2

Linear Combinations

Linear Combinations

Linear Combinations

Linear Combinations
The system has a solution

 x is a linear combination of
the vectors in S
The solution is unique

 There is only ONE possible
combination
Linear Combinations
c1 – c2 + 3c2 = 8  c1 = 1
c2 –2c3 = –5  c2 = –1
7c3 = 14  c3 = 2

Linear Combinations
c1 = 1
c2 = –1
x = v1 – v2 + 2v3 c3 = 2

Linear Combinations
 Example 2: Given the vectors
x = <4, 3, 4> and y = <1, 2, 3>
Which of them is a linear combination of the vectors in
the following set?

Linear Combinations
x = <4, 3, 4> and y = <1, 2, 3>
the following set:

Linear Combinations
x = <4, 3, 4> and y = <1, 2, 3>
the following set:

Linear Combinations
x = <4, 3, 4> and y = <1, 2, 3>
the following set:

Linear Combinations
Example 2:
v1 v2 v3 x v1 v2 v3 y
x is a linear combination of v1,v2,v3 y is NOT a linear combination of v1,v2,v3

Linear Combinations
Example 2:
c3  free variable
c2 + 2c3 = 3  c2 = 3 – 2c3
c1 + c2 + c3 = 4  c1 = 4 – c2 – c3 = 1+ c3
For example: c3 = 1, then c2 = 1 and c1 = 2

Linear Combinations
Example 2:
c3  free variable
c2 + 2c3 = 3  c2 = 3 – 2c3
c1 + c2 + c3 = 4  c1 = 4 – c2 – c3 = 1+ c3
For example: c3 = 0, then c2 = 3 and c1 = 1

Linear Independence

Linear Independence
 Linear Independence:
 If we have a set of vectors:
Trivial “zero”solution Infinite number of

c1 = c2 = … = cn = 0 solutions (c1,c2 ,… cn)
 Independent Set  Dependent Set
Linear Independence
 For example, the following three vectors are independent;
it is impossible to form any linear combinations using
these three vectors:
1 0 0

0 2 0
     
0 0 3
Linear Independence
 Example: Is the set S = {v1, v2,v3} linearly independent?
Linearly
Independent

Linear Independence
 Example: Is this set linearly independent?
linearly independent set

NOTE!
If we have only TWO vectors just check if they are scalar
multiples, if they are not, then they are independent.
Linear Independence
 Important note no.1:
 If you want to check whether a set of only
TWO vectors is an independent set, then:
 If  Independent
 If  Dependent

Linear Independence
 independent

Linear Independence
 Dependent

Linear Independence
 Example: Which of the following sets are independent?
Scalar multiples
 Dependent

Linear Independence
 Example: Find the value of k that makes the following
set linearly independent:

Linear Independence

Linear Independence

Linear Independence

Linear Independence
The system has a unique solution

(only the zero solution) if:
k+4≠0
Otherwise the system has an infinite
number of solutions
Linear Independence
For S to be an independent set:

k≠–4
If we take k = – 4 then the set
becomes dependent

Linear Independence

Linear Independence

Linear Independence
 Dependent

Linear Independence
 Free variable

Spanning Set and Basis
of a Vector Space
Dr. Sara Hassan Kamel
Spanning Sets and Bases
 What is a spanning set?
Cover ALL of ℝ3 Cover a plane in ℝ3

If the set S is a spanning set of the vector
space V then any vector in V can be written
as a linear combination of the vectors in S
y
Example:

y
Example:

y
Example:

V  span{v1 , v2 ,...vn }
S  {v1 , v2 ,...vn } is a spanning set for V
V is spanned by S  {v1 , v2 ,...vn }

 What is a basis?
Basis = Spanning + Independent
 A basis is the smallest possible spanning set (with

the least number of vectors to span the space).
 The number of vectors in a basis of a vector space V
is the dimension of the vector space  dim V

independent
Spanning Set Basis

always
 Any basis is also a spanning set

 A spanning set is a basis if it is also an independent set

 Example:
 Is this set a basis or a spanning set of ?
Spanning Set Basis

 Example:
Spanning Set Basis

 Example:
Spanning Set Basis

 Example:
z
Spanning Set Basis

 Example:
Spanning Set Basis

 Theorem:
If S is an independent set, and the

number of vectors in S is equal to
dimV, then S is a basis for V
* Given that the vectors in S ϵ V

 Example:
• 3 vectors in
• independent
Spanning Set Basis

 For any vector space:
 There is more than one spanning set
 The number of vectors in a spanning set can
be ≥ dim V
 There is more than one basis
 The number of vectors in a basis is the
SAME for all bases of V, and is equal to dimV

 Dimension of a Vector Space:
dim V = the number of vectors in a basis of V
 Dimensions of known vector spaces:

Basis of 2x2 (dim =4)
Standard Basis
  Polynomials of degree ≤ 2

Spanning Set and Bases
 Theorem:
If W is a subspace of V, then dimW ≤ dimV
dim=2 (dim=3)
dim=1

 Example 1: Find a suitable basis for the
following subspace of
• Spanning set
• Independent
• Basis

 Example 2: Find a suitable basis for the
following subspace of
• Spanning set
• Independent ?

 Example 3: Find a basis and the dimension of
the solution space of AX= 0 where



the solution space of AX= 0
 The solutions of this homogeneous system are
multiples of the vector <2, -1, 1, 0>
 The spanning set of the solution space is <2, -1, 1, 0>
 It is also the basis
 dim = 1

the solution space of

the solution space of
INDEPENDENT  Basis
Spanning Set of the Solution Space

 Example 5: Find dim W if W = span S and
S = {1 + t, 2 – t2, t2 – 2t – 4}
 S is the spanning set of W, so if it is independent, it is

also a basis
 If not, then the independent polynomials in S form a
basis set
 So: CHECK INDEPENDENCE

S = {1 + t, 2 – t2, t2 – 2t – 4}
k1(1 + t) + k2(2 – t2) + k3(t2 – 2t – 4) = 0

Equations:
t2: – k2 + k3 = 0
t : k1 – 2k3 = 0
t0: k1 + 2k2 – 4k3 = 0
S = {1 + t, 2 – t2, t2 – 2t – 4}
k1(1 + t) + k2(2 – t2) + k3(t2 – 2t – 4) = 0

S = {1 + t, 2 – t2, t2 – 2t – 4}
k1(1 + t) + k2(2 – t2) + k3(t2 – 2t – 4) = 0

S = {1 + t, 2 – t2}
dim W = 2
k1(1 + t) + k2(2 – t2) + k3(t2 – 2t – 4) = 0

Review Questions
 Which of these statements are true?
 Every vector space has only one basis set
 If a homogeneous system has a unique solution,
then the columns of the coefficient matrix are
independent vectors
 Any 4 column vectors with 3 elements form a
spanning set of
 If W is a subspace of V and dimV= 4 then dimW=3

Wrapping up!
 Linear Combination:
 The vectors are independent if this system has only the trivial
solution:
 Spanning Set of V = All linear combinations of the set

form the vector space V
 Basis = A spanning set with independent vectors
 Dimension of V = Number of vectors in a basis set of V
See you next
lecture!

Linear Combinations, Linear Algebra, Alexandria University

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Linear Combinations, Linear Algebra, Alexandria University

Uploaded by

Copyright:

Available Formats

Linear Combinations

and Linear Independence

 Linear combination  A combination made using

where c1, c2, … cn ∈ ℝ, then we say that w is a

 We can also say that v1 is a linear combination of

 We say that if the system has a solution then b is

If not, then x is not a linear combination of the vectors in S

5 Dr. Sara Hassan Kamel

6 Dr. Sara Hassan Kamel

7 Dr. Sara Hassan Kamel

8 Dr. Sara Hassan Kamel

9 Dr. Sara Hassan Kamel

10 Dr. Sara Hassan Kamel

11 Dr. Sara Hassan Kamel

The system has a solution

The solution is unique

13 Dr. Sara Hassan Kamel

14 Dr. Sara Hassan Kamel

15 Dr. Sara Hassan Kamel

16 Dr. Sara Hassan Kamel

17 Dr. Sara Hassan Kamel

18 Dr. Sara Hassan Kamel

x is a linear combination of v1,v2,v3 y is NOT a linear combination of v1,v2,v3

20 Dr. Sara Hassan Kamel

21 Dr. Sara Hassan Kamel

22 Dr. Sara Hassan Kamel

Trivial “zero”solution Infinite number of

1 0 0

25 Dr. Sara Hassan Kamel

linearly independent set

27 Dr. Sara Hassan Kamel

28 Dr. Sara Hassan Kamel

29 Dr. Sara Hassan Kamel

30 Dr. Sara Hassan Kamel

31 Dr. Sara Hassan Kamel

32 Dr. Sara Hassan Kamel

33 Dr. Sara Hassan Kamel

34 Dr. Sara Hassan Kamel

The system has a unique solution

For S to be an independent set:

36 Dr. Sara Hassan Kamel

37 Dr. Sara Hassan Kamel

38 Dr. Sara Hassan Kamel

39 Dr. Sara Hassan Kamel

40 Dr. Sara Hassan Kamel

Cover ALL of ℝ3 Cover a plane in ℝ3

43 Dr. Sara Hassan Kamel

44 Dr. Sara Hassan Kamel

45 Dr. Sara Hassan Kamel

46 Dr. Sara Hassan Kamel

Basis = Spanning + Independent

 A basis is the smallest possible spanning set (with

47 Dr. Sara Hassan Kamel

Spanning Set Basis

 Any basis is also a spanning set

48 Dr. Sara Hassan Kamel

Spanning Set Basis

49 Dr. Sara Hassan Kamel

Spanning Set Basis

50 Dr. Sara Hassan Kamel

Spanning Set Basis

51 Dr. Sara Hassan Kamel