Vector Spaces

Ya-Ju Tsai

Calculus 4 Ya-Ju Tsai

Outline: Vector Spaces
1. Vector Spaces
1. Subspaces
2. Basis and Dimension
1. Linearly Independent and Linearly
Dependent
3. Inner Products
1. Orthonormal Basis
2. Gram-Schmidt Process

Calculus 4 Ya-Ju Tsai

Why Do We Need Linear Algebra?

Calculus 4 Ya-Ju Tsai

Vectors Spaces
 Definition: A vector space over the real
number is a set of elements which can
be added and multiplied by real numbers
with the following properties.
 For all and , we have
 1.
 2.
 3.

Calculus 4 Ya-Ju Tsai

Vector Spaces
 4. There is an element such that for
all , . (There is the additive
identity.)
 5. For all , there is an element in
usually denoted by such that .
 6.
 7.
 8.

Calculus 4 Ya-Ju Tsai

Vector Spaces
 9.
 10. ( is the multiplicative
identity.)
T

g =
EiR " = ( x ,
x
2 Xn ) i 9 . , Yn ) ,
CEIR

 Exercise: Check that vectors in with

vector addition and the scalar
multiplication satisfy the above 10
properties. t 可 ( ty 2 xntYn ) = x .
,
x
2 tY . - .
n

CT = ( cx
, ( x 2
…
CXn )
,

Calculus 4 Ya-Ju Tsai

Ex : show that *
a o for
ll
-

= elemeut ⽂in a vector

pf X *
spae :
0 X 1 X O T+ X ( o + .
区
)

= =
.
-

+
.

= .
=

0 . π+ * =
⽂ 0 .

*+ * + (- * ) =×+ ( * ) =
“

0 ⽂ +σ= 0 .

* 0 .
* =∴

Ex : Show that - ( )
in
* for c
all element ⽗

vector spae

sol : ( -

1 ) ⽂

+ T = ( - H ) .
⽂ + L ⽂ = ( 1 + 1 ) -

T = 0 .
π= f

) (- 1 + ⽂ = 0 ( -
1 ) π+ X + ( - ÷

) =σ+ ( -) ⽂ = ⼀⽀

C -
1
) . 0
π+

丈
"
( -

1 ) .
 More
examples of vector spals :

1 .

V =
Epolynomials fdegree
n with neal wetficents了

wedetineGR
^

[ fP ( t ) =
Ʃ artk q (t) =Ʃ bktr 1
, , ,

K = O
K =

p (t ) + q ( t ) =Ʃnand
caktbr ) t
"
. ct
Cp cant "
=Ʃ )

K = K ⼆

" ( "
= minz )
( "

aararz , A
a

2 .

v =

s Matriesx
2 t
3 o mf . .
)
B

antb

]
defineA
a ztb 1

( fca cair
cA
" z
we + B =
.
=

a b2 ar 2 tb 2 z
7
) ar carr
21 + ,
, ,
Subspaces
 Now we look for subsets in that is still a
vector space (i.e. satisfies 10 properties of vector
space. )
 We call it a subspace of .
 Note that if is a subset of then it
automatically has properties 2, 3, 7, 8, 9, 10.
 Moreover, if it is closed under scalar
multiplication (prop 6), then and
which is the additive inverse of .

Calculus 4 Ya-Ju Tsai

Subspaces
 Hence to determine whether is a
subspace, we only need to check properties 1
and 6.
 Theorem: Let be a subset of the vector
space .If the sum of any two elements of
is still an element of and any scalar
multiple of an element of is still an
element of , then satisfies all properties
of vector space and is a subspace of .

Calculus 4 Ya-Ju Tsai

Subspaces
 Examples:
 1. The plane is a
subspace of .

 2. The plane
is not a subspace of .

 3. Is
a subspace of ?

Calculus 4 Ya-Ju Tsai

 3
Ex :
asubspace
show that {( , ,x 3 tR
) 1x 03 is x x
2
3 =

sol :
Forany ⼜
, 可 t
ω
,
say = ( x ,
xz
,
0 ) ,
可 = ( Y , Y 2
,
0
)
.

.
T 可
了
+ =
( x ty , x 2 tY 2 0 ) Ew
W
,

is
, , =

) a

subspaeofIR
2

F CEIR C T = ( Cx CX 2 O ) EW .
any
,
-

,
,

3
3
that ω= { ( x 2 , x isnotaR
3 . X 2 3
= 2} X
)

Ex ,
+
show
-
x
:

subspaQ
sol : Fo 的
any ⽂ , 可
ε
W,
say
* = (
*
, λ
2
,
* 3
)
, 可
= ( Y

,
Yz
,
Y3 )

X
X X + 3
=
Y - Yz + Ys =
nota
2
-

.
, 2

w is 3
1R
Tt 可 ( x ty x tY x
tY ) AU subspaceof
,

= , .
,
2 2 ,
3 3
= 2t 2

! ( x ty xfY
) ( - Xz + ( - )YrtY
(
xs Y (x
+× 3 )
3 =Ψ
,

) +
-

+ ,
)
, 2 9
=
3
 Ex :
Is W =
{ a( 1 ,
0
,
0
) + b ( o ,
1
, 2
)
G , DER 了 asubspace ?

sol For
any T w . +
GE ) 0 210 . 2
,
,
y
: , = , ) i
x 1 0 x 1

1
可 =
Y .
( 1 ,
0
,
0
) +
Y =
( 0
,
1 ,
2
) ,

Then π+ y =
X .
( 1 ,
0
,
0
) + X 2
( 0 .
1
,
2 )

+ Y ,
cl ,
0
,
0 ) + Yz < o
,
1 ,
2 )
,

= ( x , tY ) .
C 1
,
0
,
0 ) + ( x
2
tY 2 ) ( 0
,
1
, 23 E

2
For CER C X ( x ( , + ,
0 2
)
(
c ,
2
any
=
) x ,
.

. 1 0
) O
1
,

=
CX 、 C 1 ,
0
,
0 ) + CX 2 CO , 1
, 2 ) E

3
Wis a subspae of IR
,
Linearly Independent and Linearly Dependent
 Because that we can apply addition and
scalar multiplication on elements of a
vector space , for elements
and real numbers
we can create a new element
and we call it
a linear combination of .

Calculus 4 Ya-Ju Tsai

Linearly Independent and Linearly Dependent
 Definition: Let

be the collection of all linear combinations

of .. We call the
subspace generated (or spanned) by .

 Exercise: Check that is a

vector space.

Calculus 4 Ya-Ju Tsai

 cr '

Ex :
v
showthat k
forany Vivz spanCv
y , , v
2

is a subspace of V .

say
⼀

sol :
For any TgE spanCu . ,
ur v .
.
)
,

X = X ,
F .
t x2 tz + -
t X : Tr

|
可 =
Y .
F ,
tY 2
tzt - -

tYntk 。

Then + y
= ( x . ty . ) σ , +
( xrtY 2 ) E 2t + ( Xk tYK )
EK .

E
spantviitkf
2 For anyCEIR ,

( X = C ( x ,
τ , + -
.
t *K σ ) r
= Cx .
E ,
+ CX 2 E 2
t . t ( X: K
E spantv… , , tr ]
= ) spanci ,
F 2 tk ] is
subspace
,
-

,
a
Ex : Let F = C 1
, 2 ) ER 2
. Find
span C τ ]

sol : span CE ] =
SaF aE 1 R } =
{ ( a ,
2a ) IaE 1 R } ,

Ex : let τ ( 1
= 2 = 32
, 3 )E
1
2 . Find
spanτ
Co r ( R

. , ,
]

sol anCt
sp . ,
F 2 ]
= { aF . + b = GbE 1 R 了
=

{ ca , a
) + ( 3 b
,
3 b ) a
,
bE 1R }
=
{ ( a + 3 b
,
a + 3 b ) a
, bER 了
span [ o spanC ≈]
=

,
] =
r
 span CE ,
≈ 了
spanCE ]
7
σ2 = ( 3 ,
3
)

^τ ,
= ( 1
,
)

τ=^ ( 1 ,
2 ]
r
^∴
0

Span [ E ,
≈ z ]
Linearly Independent and Linearly Dependent
 Sometimes we can generate
by only part of . This introduces
the concept of “linearly dependent”.
 Definition:
 Let be a vector space and be
elements of . We say that are
linearly dependent if there are
not all equal to such that

Calculus 4 Ya-Ju Tsai

Linearly Independent and Linearly Dependent
 Definition:
 Let be a vector space and be
elements of . We say that are
linearly independent if
implies
.

Calculus 4 Ya-Ju Tsai

Linearly Independent and Linearly Dependent
 Example: and are
linearly dependent.
 Example: Are and
linearly dependent or independent ?
 Theorem:
 are linearly dependent if and
only if one of the vectors can be written as
a linear combination of the remaining
vectors.

Calculus 4 Ya-Ju Tsai

Ex Showthat and fr
:
f
. = l , 1 ) = ( 3
,
3 ) are
inearlydependent .

sol 3 ) τ +τ f . Fr
(
inearly
c 0
:
-

=
,
0 ) , ane
, 2

,
Dp ,

Ex =
livearlyne
2 apendent 2 and F
,
- ) ,
:
( 0 17 (
,
0
,
0 or
=

linearly independent ?
sol :

Suppose at .
+ b σ==Ʃ .

Then ( a2 ,
0
,
a ) + ( -

b ,
0
,
0
) = c 0
,
0
,
0
)
2 a b =
0

{
-

( 2a b ( 0 0 0 =
0 a ) )
-

= ,
,
, ,

a
=
0

b , and Fcane
) a 0 f lnearly
indep
= = = )

.
Thm : E . f
, . . Tr ane linearlydependent if and
only if there is
,

some T
:, 1
≤ : Ek ,
such thatVcis alinean combination of
the Frre
st of r , .
Ex show that if tkis alinear combination of E . 2, k

-
,
: , σ …
1

then span IE ,. 2 Er
.
ik ] =
span ( E , , 了
. .
,

, … τ r

- 2 ∴
EX EX :
Basis and Dimension
 Definition:
 If elements of generate
(i.e. ) and they are
linearly independent, then
is called a basis of .
 Example: is a basis of .
 Example: is a basis of .
 Example: Find a basis of

Calculus 4 Ya-Ju Tsai

Ex :
Show that { ( , 1 ) ,
( - 1
, 2 ) } is .IR
a basiso
t
?
Ex : Find a basis of V =
{ ( x , y ,
t ) x + 2
y + 3 E = 0
}
Basis and Dimension
 Theorem:
 Let be a basis of a vector
space . Then for any , there are
unique numbers such that
.
 Theorem:
 Let be a vector space. Every basis of
contains the same number of elements.

Calculus 4 Ya-Ju Tsai

 Let { 8 ,
Theor of Uavector
Tk 了 be a basisem
:

2
,
,

space

Then for
any ot thene ane numbers r . rk
tRunique
,

such that
E = r ,
F .
+ rzFzt .
+ rkFk .

pf :
Basis and Dimension
 Definition:
 If a basis of consists of elements, then
we say that the dimension of is .

 Theorem:
 Suppose that are vector spaces. If
and , then .

Calculus 4 Ya-Ju Tsai

Basis and Dimension
 Example: is a basis of and
there are two vectors in this basis. Hence the
dimension of is .

 Example: Show that

is a basis for .

Calculus 4 Ya-Ju Tsai

 that
3
Ex : show S (
200 )
, C13 , 0 )
, (
-
,
1
, 1 is
) a basisofIR ,
Inner Products
 Definition: For vectors

we define the inner product of as

and
denote the inner product by or .

Calculus 4 Ya-Ju Tsai

Inner Products
 Properties of Inner Products:
 1.
 2.
 3. If , then
where
is the length of .
 4. for all , and if and
only if .

Calculus 4 Ya-Ju Tsai

Inner Products
 Definition:
 We say that are orthogonal if
. We say that
are mutually orthogonal if
for all .

Calculus 4 Ya-Ju Tsai

Ex :
or
Ii2 thogonal
i 2
(

- ) ) ave

, mutually
outhogonal.
, ,
Ex - 1 0
)
L
- 1

, 1
,
0 ) ,
( 0
,
0
,
τ
) re
Inner Products
 Theorem:
 If are mutually orthogonal
and for , then
are linearly independent.

 has special type of basis which consists

mutually orthogonal vectors with length 1.
We call this basis “ orthonormal basis”.

Calculus 4 Ya-Ju Tsai

Th forcorem
If E Fr Ik are mutually orthogonal andFito
:

, .

IEi ≤ k
,
then F ,
Fr .

,
Frarelinearlyindependent .
Ex
{ , ) is wthonormal of (R ?
( ⾼ ) E an basis
:
,
吉

店
, ( 3

orthonormal
Ex :

{ ( 1 ,
0 ,
0
) ,
( 0
,
1 ,
0 ) ,
( 0
,
0
, }
)is an basis

3
of 1R ,
Inner Product
 Theorem:
 Let be an orthonormal
basis of . For any , if
, then
for .

Calculus 4 Ya-Ju Tsai

Proof of the theorem :
Ex Let
—
v ( 后 品店 ) = ,
⼀
官
官
⾼尝 ) —
=
)
: (
.
,
. √ =
(
0
v
以 3 ,
,

.
that {
show V
, , U
2
, 033 is anorthonormal basofs 1 :
R
3

Write ( 3 F3
w =

,
2 .
i
) as a linear combination of .
o ,
σ r
,
。
Gram-Schmidt Process
 Given a collection of linearly independent
vectors , we want to find an
orthonormal basis of
.

Calculus 4 Ya-Ju Tsai

Gram-Schmidt Process
 Theorem: Let be a basis of .
Let and for ,

Then is an orthonormal basis

of .

Calculus 4 Ya-Ju Tsai

 =∴
"

Ex : Giver } abasis ofR .

,r . , En vet a .
,
,

们
|
ω
i =τ= -
Ʃ<τ∴ ,
π
;
>
以 = ∵= : 1
,
和 2 ≤ i≤ n ,

show
that
{ a , ar , In
} is an orthonormal basis ,
 schmidt process tofind an orthonormal
Ex :

ApplyGram - basis

of the
subspace span ) l 1 , 2 , 2
)
, 10.
3

, - [ 4
Review
 What are the properties of a vector space?
 How do we determine whether vectors are
linearly dependent or independent?
 What is a basis of a vector space?
 What is the dimension of a vector space?
 How do we define the inner product of two
vectors?
 What is an orthonormal basis?
 State Gram-Schmidt Process.

Calculus 4 Ya-Ju Tsai