STATISTICAL AND

MATHEMATICAL METHODS
FOR DATA ANALYSIS
Linear Algebra: Vector Spaces
Dr Sumaira Kausar
 SPACE
• In mathematics, a space is a set (sometimes called a universe) with some
added structure.
• While modern mathematics uses many types of spaces, such as Euclidean
spaces, linear spaces, topological spaces, Hilbert spaces, or probability
spaces, it does not define the notion of "space" itself.
• A space consists of selected mathematical objects that are treated as
points, and selected relationships between these points.
• The nature of the points can vary widely. for example, the points can be
elements of a set, functions on another space, or subspaces of another
space. It is the relationships that define the nature of the space.
 SPACE
• Two basic spaces are:
• Linear spaces (vector spaces)
• Linear spaces are of algebraic nature; there are real linear spaces (over
the field of real numbers), complex linear spaces (over the field of complex numbers),
and more generally,
• Topological spaces
• Topological spaces are of analytic nature. Open sets, given in a topological space
by definition, lead to such notions as continuous functions, paths, maps; convergent
sequences, limits; interior, boundary, exterior.
 VECTOR SPACE
A vector space is a nonempty set V of objects, called vectors, on which are
defined two operations, called addition and multiplication by scalars (real
numbers), subject to the ten axioms (or rules) listed below. The axioms must
hold for all vectors u, v, and w in V and for all scalars c and d.
 EUCLIDEAN SPACE: BASIC VECTOR
SPACE
• A space in any finite number of dimensions, in which points are designated
by coordinates (one for each dimension) and the distance between two points is
given by a distance formula.
• Let R is the field of real numbers. Then Cartesian product R n = R × R × . . . × R of
ordered n-tuples of real numbers (n factors).
• Typical notation for x ∈ R n will be x = (x1, x2, . . . , xn). Here x is called a point or a
vector , and x1, x2, . . . , xn are called the coordinates of x.
• The natural number n is called the dimension of the space. Often when speaking
about R n and its vectors, real numbers are called scalars.
• Special notations:
• R1 x
• R2 x = (x1, x2) or p = (x, y)
• R3 x = (x1, x2, x3) or p = (x, y, z).
EUCLIDEAN SPACE: BASIC VECTOR
SPACE
EUCLIDEAN SPACE: BASIC VECTOR
SPACE
 SUBSPACE

The set consisting of only the zero vector in a vector space V is a subspace of V
, called the zero subspace and written as (0).
SUBSPACE
LINEAR COMBINATION
 SPAN
• Span{ v1,……., vp }denotes the set of all vectors that can be written as linear
combinations of { v1,……., vp }. So span is set of all linear combinations of the
given elements of the space.
• If v1,……., vp are elements in a vector space V, then Span { v1,……., vp } is a
subspace of V.
• Span { v1,……., vp } is called the subspace spanned (or generated) by {
v1,……., vp } .
• It is the smallest subspace of a vector.
• Span { v1,……., vp } is the intersection of all the subspaces, containing the
vectors v1,……., vp .
SPAN
 SPAN
• If x1 and x2 are not parallel, then one can show that Span{x1, x2} is the plane
determined by x1 and x2. This seems reasonable, since every vector in the this
plane appears to be expressible in the form α1 x1 + α2 x2 for suitable scalars
α1 and α2:
SPAN
 LINEAR INDEPENDENCE
• A set of vectors {v1, v2,..., vk} is linearly independent if the vector equation
x1v1+x2v2+···+xkvk=0
• The set {v1+v2+···+vk} is linearly dependent otherwise
• The trivial solution to the equation is that all scalar multiples are zero, if this is
the case the vectors are Linearly independent.
• But if there are some non zero scalar multiples that can satisfy this equation
then vectors are Linearly dependent
• Linearly dependent vectors means that one of the vector can be represented
by some combination of other other vectors in the equation. Such a vector is not
adding any new directionality.
LINEAR INDEPENDENCE
 BASIS

The definition of a basis applies to the case when H = V , because any

vector space is a subspace of itself.
Thus a basis of V is a linearly independent set that spans V .
 BASIS

A basis is a set of linearly independent vectors that can be used as a building

blocks to make any other vector in the vector space/space
BASIS
 BASIS
• Let e1,…….,en be the columns of the n x n identity matrix In .

• The set {e1,…….,en } is called the standard basis for Rn

 DIMENSION OF VECTOR SPACE

Dimension of any vector space is fixed. Any basis for a vector space
of dimension n must be comprised of exactly n vectors.
LINEAR TRANSFORMATION
LINEAR TRANSFORMATION
 LINEAR TRANSFORMATION

The kernel (or null space) of such a T is the set of all u in V such that T (u) = 0
(the zero vector in W ).
The range of T is the set of all vectors in W of the form T (x) for some x in V . This
is called the image of subspace
LINEAR TRANSFORMATION
LINEAR TRANSFOMRAITON
 CREDITS AND REFERENCES
• Linear Algebra and Its Applications, 5th Edition, David C. Lay and Steven R.
Lay
• Vector spaces, Frank Jones, Rice university