Professional Documents
Culture Documents
Textbook Mathematical Methods For Physics and Engineering 1St Edition Mattias Blennow Ebook All Chapter PDF
Textbook Mathematical Methods For Physics and Engineering 1St Edition Mattias Blennow Ebook All Chapter PDF
https://textbookfull.com/product/exercises-and-problems-in-
mathematical-methods-of-physics-giampaolo-cicogna/
https://textbookfull.com/product/mathematical-methods-in-science-
and-engineering-2nd-edition-selcuk-s-bayin/
https://textbookfull.com/product/essentials-of-mathematical-
methods-in-science-and-engineering-selcuk-s-bayin/
https://textbookfull.com/product/essentials-of-mathematical-
methods-in-science-and-engineering-2nd-edition-s-selcuk-bayin/
Mathematical Methods in Engineering and Applied
Sciences (Mathematics and its Applications) 1st Edition
Hemen Dutta (Editor)
https://textbookfull.com/product/mathematical-methods-in-
engineering-and-applied-sciences-mathematics-and-its-
applications-1st-edition-hemen-dutta-editor/
https://textbookfull.com/product/mathematical-methods-for-cancer-
evolution-takashi-suzuki/
https://textbookfull.com/product/spectral-theory-and-
mathematical-physics-1st-edition-marius-mantoiu/
https://textbookfull.com/product/quantum-mathematical-physics-a-
bridge-between-mathematics-and-physics-felix-finster/
Mattias Blennow
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been
made to publish reliable data and information, but the author and publisher cannot assume responsibility for the validity
of all materials or the consequences of their use. The authors and publishers have attempted to trace the copyright
holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this
form has not been obtained. If any copyright material has not been acknowledged please write and let us know so we may
rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized
in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying,
microfilming, and recording, or in any information storage or retrieval system, without written permission from the
publishers.
For permission to photocopy or use material electronically from this work, please access www.copyright.com (http://
www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923,
978-750-8400. CCC is a not-for-profit organization that provides licenses and registration for a variety of users. For
organizations that have been granted a photocopy license by the CCC, a separate system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for
identification and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
To Ana
Contents
vii
viii Contents
Chapter 2 Tensors 69
Index 705
Preface
Mathematics and mathematical methods hold a central role in the scientific pursuit. It
is the language we use in order to describe Nature and make quantifiable and testable
predictions, the cornerstone of the scientific principle. Compiling all of the mathematics
used in physics today would be a daunting task. Instead, this book focuses on common
mathematical methods needed to confront modern theoretical physics that are also used in
many branches of engineering. The target audience of the book is physics or engineering
students that have already taken basic courses in mathematics including linear algebra,
multi-variable calculus, and introductory differential equations, typically in the third year
of university or later. Unlike many other textbooks on mathematical methods in physics
that often use examples from quantum mechanics or other advanced subjects, I have tried to
use examples from subjects that should be more familiar to the student as much as possible.
With this approach, the student will hopefully be able to see these examples in a new light
and prepare his or her intuition for using the new tools in advanced topics at the same time.
I have also attempted to introduce some new concepts as needed for the discussion.
It should be noted that this book is not intended to be mathematically rigorous. Instead,
the idea is to convey mathematics as a tool for describing physical systems and therefore
focus more on the intuition behind the mathematics and its application to physics. You will
therefore not find the typical theorem-proof-corollary structure that you might expect from
a textbook in mathematics.
The topics covered in the different chapters of this book and their applications are:
1. Scalars and Vectors: A basic treatment of vector analysis, which is a fundamental
piece of mathematics used in almost every branch of modern physics. The chapter
introduces the concepts of fields, their derivatives, and integration. Furthermore, we
will work through both non-Cartesian coordinate systems and potential theory, which
are often useful tools for solving particular problems. Examples of theories relying
heavily on vector analysis include Newtonian mechanics and Maxwell’s theory of elec-
tromagnetism.
2. Tensors: Tensor analysis builds upon the concepts introduced in Chapter 1 and ex-
pands them to involve general linear transformations between vectors (and tensors).
The approach taken in this chapter is slightly different from what is usually found
in textbooks. Instead of starting out with tensors in Cartesian coordinates, we will
start by introducing tensors in general coordinates systems already from the begin-
ning as this provides a deeper insight to what tensors are all about. We later treat the
special case of Cartesian coordinates and discuss tensor integration and how tensors
are applied in solid mechanics, electromagnetism, and classical mechanics. Apart from
this, tensor analysis also plays a central role in, for example, fluid mechanics and the
special and general theories of relativity.
3. Partial Differential Equations and Modelling: Modelling is at the core of physics. With-
out a mathematical model for a system, no amount of mathematical techniques will
help us make predictions about it. The chapter covers the most basic ideas in mathe-
matical modelling using differential equations, starting from the continuity equation,
xix
xx Preface
and discusses techniques important for dealing with them. We will also discuss dimen-
sional analysis, which is central to modelling any physical system and lets us draw
conclusions about how they scale, and how delta functions may be used to provide
idealised models.
4. Symmetries and Group Theory: Symmetry arguments are a powerful tool for simplify-
ing and solving many physical systems. In some particular applications, fundamental
symmetries even lie at the heart of the theory itself. The natural language for describ-
ing symmetries is that of group theory and this chapter gives a basic introduction to
these concepts. The resulting mathematical theory is useful for drawing conclusions
about the behaviour of any physical system and is applicable across a wide range of
topics.
5. Function Spaces: This chapter introduces and treats function spaces as a more abstract
form of vector space. We discuss operators acting on these function spaces and their
eigenvalues. In particular, we look at Sturm–Liouville theory and its applications.
By using separation of variables, we arrive at a large number of different Sturm–
Liouville problems whose solutions will be important when approaching the models
constructed in Chapter 3. These functions will turn out to appear also in many other
physics applications as they are the solutions to very particular differential equations.
The framework developed here will be particularly useful in the study of continuous
mechanical systems as well as in basic quantum mechanics.
6. Eigenfunction Expansions: The methods of Chapter 5 are applied in order to solve
many of the models introduced in Chapter 3. In particular, we apply eigenfunction
expansions in order to reduce partial differential equations to ordinary differential
equations for the expansion coefficients. This is used to treat both homogeneous and
inhomogeneous problems in general with additional treatment of critical systems and
resonances in driven systems. We also discuss the effects of terminating series solutions
using only a finite number of terms to approximate the solution. Furthermore, we dis-
cuss the case of infinite domains, where series expansions are replaced by transforms.
Methods of this sort are used in the treatment of continuous mechanical systems.
7. Green’s Functions: The use of Green’s functions to solve differential equations is based
on the principle of superposition. In particular, it is useful as a method for expressing
the solution to a general inhomogeneous linear differential equation in terms of the
solution to the fundamental case with a delta function inhomogeneity. We discuss
different ways of finding Green’s functions for specified problems and applying them
to models. Finally, we apply them to the case of non-linear systems by introducing and
using perturbation theory. These methods are applicable in a wide range of different
fields, from automated control to quantum field theory.
8. Variational Calculus: Functionals are maps from sets of functions to real or complex
numbers. Variational calculus deals with finding stationary values of such functionals
and is applicable to finding the shortest path between two points in a general space
or the stable configurations of different physical systems. Many physical principles
can be formulated in terms of variational problems and we will use Fermat’s principle
for light propagation and Hamilton’s principle in classical mechanics as examples.
Variational methods are also useful as a tool for modelling systems based upon energy
methods rather than finding differential equations by analysing infinitesimal elements
of a system.
9. Calculus on Manifolds: Many physical systems cannot be described in terms of Eu-
clidean spaces. We here introduce the concept of manifolds and describe how calculus
Preface xxi
works on them, discussing both derivatives and integrals. The generalisation of the
vector and tensor concepts to manifolds holds a central role in the discussion and we
treat general curved spaces. The calculus on manifolds is applicable to generalisations
of several theories, including classical mechanics, and essential in the study of general
relativity.
10. Classical Mechanics and Field Theory: The main aim of this chapter is not to in-
troduce new mathematical tools. Instead, it is intended to serve as an example of
the application of several of the concepts treated throughout the book. The Newto-
nian, Lagrangian, and Hamiltonian approaches are introduced and discussed to some
extent. In particular, the realisation of the connection between symmetries and con-
served quantities through Noether’s theorem is fundamental to modern theoretical
physics. We also introduce the Lagrangian approach to field theory, starting by tak-
ing a continuous classical mechanical system as an example.
To the student
This book will introduce you to many of the fundamental mathematical methods used in
modern physics. The range of topics covered is rather broad and the difficulty level will
gradually increase. Throughout the book, you will find many examples that are intended
to illustrate applications of the more abstract notions that are discussed in the main text.
In particular, I strongly recommend reading through the examples if you feel that you are
in need of more concrete realisations in order to shape your understanding.
Note that reading this material will only get you so far. In reality, there is no substi-
tute for actually working through the material yourself. I therefore recommend reading the
material with pen and paper readily available in order to fill in any steps you do not find
immediately evident. Obtaining an intuition for the different topics also requires you to
apply the theory to different problems. Each chapter in this book therefore comes with a
large number of problems, listed at the end of the chapter, intended to illustrate the appli-
cation of the theory. In order to master the material, I therefore also suggest that you work
through the problems rather than continuing straight on to the next topic.
You should also note that there is a lot of material in this book. You should not be
surprised if your course only covers part of the material or your instructor excludes some of
the more advanced topics in any given chapter depending on the length of your course. This
is intentional and the more advanced topics are also intended to serve as additional input
for students who find the material interesting and want to go deeper. If your instructor
excludes parts of the material, pay close attention to what problems he or she recommends,
as they will likely be representative of what is included in your particular course.
I hope you will enjoy reading this book as much as I have enjoyed writing it.
To the instructor
The material covered in this book is extensive and likely sufficient to last for several courses.
Depending on your intentions with your course, you may want to select different parts of the
material to present. In many cases, understanding of the earlier chapters is not necessary,
but often helpful. Be mindful when you select the material and also make sure to recommend
problems that are appropriate and representative of the material that you wish to cover.
You can always recommend parts of the book that you do not cover to interested students
who wish to obtain a deeper knowledge. For reference, the approximate prerequisites for
each chapter are listed below. Obviously, the knowledge of the content for any given chapter
may also be acquired elsewhere.
xxii Preface
1. Scalars and Vectors: Being the first chapter in the book, no knowledge apart from the
prerequisites mentioned earlier should be necessary.
2. Tensors: Understanding the first chapter is necessary. In particular, the notation intro-
duced in the discussion of non-Cartesian coordinate systems will be used extensively.
The potential theory part of the first chapter is not crucial.
3. Partial Differential Equations and Modelling: The first chapter is required knowledge
as many of the tools of vector analysis will be applied. The second chapter is helpful
as some models will be introduced in their general form using tensors, but it is not
crucial for most of the basic understanding.
4. Symmetries and Group Theory: Again, the first chapter is crucial for a basic under-
standing. The second chapter is mainly used for some of the discussion on tensor
product representations.
5. Function Spaces: The first chapter is recommended, in particular the discussion on
different coordinate systems. However, much of the material stands on its own and
mainly requires basic linear algebra. The discussion of group representations on func-
tion spaces requires that the representation theory part of Chapter 4 has been covered.
6. Eigenfunction Expansions: Chapters 1, 3, and 5 should be considered as prerequisites
as well as basic knowledge on the solution of ordinary differential equations.
Acknowledgments
This book started as a set of lecture notes and supplementary material in a course essentially
covering Chapters 3, 5, 6, 7 and 8 as I could not find any textbook that suited the specific
needs for that course, which covered mathematical methods with focus on their application
to physical systems. In this course, the focus was not on the mathematics, but on the
application of the mathematics to physics. In particular, many of the available textbooks
used examples from quantum mechanics, which had not yet been covered by the target
audience, and did not include any part on mathematical modelling. If not for this course,
this book would never have been written.
Preface xxiii
I would also like to take the opportunity to thank my teaching assistants Stefan
Clementz, Per Moosavi, and Mattias Olla for their help in eliminating many typos as well
as all students that have pointed out errors and unclear passages.
I have also drawn some inspiration from discussions with the internet community Physics
Forums (www.physicsforums.com) regarding my mode of presentation and for fine-tuning
my formulation of the subject matter to the target audience. Surprisingly often, people have
been posting questions regarding the very same material I have been writing about, in some
cases leading me to rethink the approach taken.
Since it was written on my free time during evenings and weekends, this book would
also never have been completed without the support of my wife. Admittedly, she has rolled
her eyes at my devotion to the text more than once, but without her understanding and
acceptance, the time necessary to complete the book would not have been available. The
book is dedicated to her.
Mattias Blennow
Stockholm, Sweden, 2017
CHAPTER 1
Essentially everyone who has come into contact with physics at a higher education level
is familiar with the concepts of scalars and vectors. The concept of a scalar is easy to
grasp as a quantity that has a particular value, such as the kinetic energy of an object,
the air pressure at sea level, or the temperature in your oven. The concept of a vector is
also relatively straightforward, generally being presented as a directional quantity that has
magnitude as well as direction. The typical examples of vector quantities include kinematic
quantities such as velocities and accelerations. For example, when flying from New York
to Paris, not only the speed (being the magnitude of the velocity) but also the direction
of the aircraft velocity is of importance. Flying in the wrong direction we might end up in
Anchorage instead, which is not necessarily a bad thing, but probably not what we intended
when boarding the flight.
While a scalar quantity can be represented by a single number and a suitable unit of
dimension (such as meters, feet, or light years for a distance), a vector needs to be described
by several numbers. The most convenient way of doing this is to define a number of linearly
independent directions by choosing a set of basis vectors ~ei . The number of such vectors
should be equal to the dimension of the space we want to describe, normally three when
discussing classical physics, but sometimes less if some directions can be ignored or more
in the case where not only the spatial position of a single object is of interest. Some of
the concepts in this text, such as the vector cross product, are particularly constructed for
three-dimensional space, while others, such as the scalar product or divergence of a vector
field, have straightforward generalisations to more or fewer dimensions. The requirement of
linear independence of the basis vectors states that it is impossible to write a basis vector
as a linear combination of other basis vectors. As a consequence, we can write any vector ~v
in an N -dimensional space as
N
X
~v = v i~ei . (1.1)
i=1
In particular, in three dimensions, ~v = v ~e1 + v 2~e2 + v 3~e3 (note that the superscripts here
1
are indices, not powers!). The N numbers v i uniquely define the vector ~v and it is common
to select basis vectors in such a way that they have magnitude one and are orthogonal. Such
a set of basis vectors is referred to as an orthonormal basis.
1
2 Mathematical Methods for Physics and Engineering
quantity of the same dimension. Naturally, such multiplications or additions do not nec-
essarily have a physical meaning and theories of physics are essentially based on how to
apply mathematical operations in order to describe the world we live in and make useful
predictions.
When it comes to vectors, there is a natural definition of multiplication with a scalar
quantity, we multiply the magnitude of the vector by the same amount. In fact, we have
already used this in Eq. (1.1) when decomposing the vector ~v into a sum of scalar multiples
of the unit vectors ~ei . The same goes for a sum of two vectors, where we can add the
coefficients multiplying each of the basis vectors in order to obtain the coefficient of the
corresponding basis vector for the vector sum. As in the case of a scalar addition, vector
addition also requires the vectors to have the same physical dimension in order to produce
meaningful results. In terms of the basis vectors, we therefore have
N
X N
X
a~v = a v i~ei = (av i )~ei , (1.2a)
i=1 i=1
N
X
~v + w
~= (v i + wi )~ei . (1.2b)
i=1
There is no way of defining an addition of a scalar and a vector, but there are different
possibilities of creating vector products and these are useful tools when constructing physical
theories.
The scalar product (also called dot product or inner product) ~v · w ~ of two vectors ~v and
w
~ is a scalar and is linear in both vectors. It has an intuitive geometrical interpretation (see
Fig. 1.1) as the product of the magnitudes of the vectors multiplied by the cosine of the
angle between their directions. The vectors are orthogonal if ~v · w ~ = 0. Thus, if the basis
vectors ~ei are chosen to be orthonormal, i.e., ~ei · ~ej equals one if i = j and zero otherwise,
then
XN X N N X
X N N
X
i j i j
~v · w
~= v ~ei · w ~ej = v w (~ei · ~ej ) = v i wi . (1.3)
i=1 j=1 i=1 j=1 i=1
We can also use the scalar product in order to define the magnitude (or norm) of a vector
as v
uN
√ uX
|~v | = ~v · ~v = t (v i )2 . (1.4)
i=1
It is very common to denote ~v · ~v = ~v 2 . Note that this is compatible with the definition of
a scalar vector multiplication yielding a new vector with a magnitude which is the original
vector magnitude multiplied by the scalar. The geometrical interpretation of the scalar
product can now be written in the form
~v · w
~ = |~v | |w|
~ cos(α), (1.5)
where α is the angle between the vector directions. It is also common to denote the mag-
nitude of a vector using a scalar with the same letter, but omitting the vector arrow, i.e.,
|~v | = v.
In three dimensions, we can also define the anti-symmetric cross product (or vector
product) ~v × w ~ = −w~ × ~v of two vectors as a new vector. Just as the scalar product, the
cross product is linear in both of the vectors. This means that we can completely define it
Scalars and Vectors 3
~
w
~v ×
w
~ w
~
n(α)
~ | si
|~v | |w
α α
~v
~v
|w|
~ cos(α)
Figure 1.1 Visual of the geometrical interpretation of the scalar (left) and cross (right) products.
In the scalar product, the value of the scalar product is the length of ~v multiplied by |w|
~ cos(α).
Note that this value does not depend on whether we project w ~ on ~v or the other way around. The
shaded vectors have the same scalar product with ~v as w ~ has. For the cross product, the shaded
area is equal to the modulus of the cross product ~v × w,
~ which is also orthogonal to both ~v and w.
~
This defines the ordering of the basis vectors. For a left-handed basis, the definitions come
with a minus sign on one side. In terms of the vector components, we obtain
~e10 0 ~e1
~e20 0 ~e2
~e30 0 ~e3
Figure 1.2 A left- and a right-handed set of vectors. When held as in the image, the vectors ~e1 ,
~e2 , ~e3 , pointing in the directions of the thumb, index finger, and middle finger of the right hand,
respectively, and ordered in that specific order, constitute a right-handed system. On the left part
of the image, the vectors ~e100 , ~e200 , ~e300 constitute a left-handed system.
and have magnitude one. Still, there is a freedom of choice of different orthonormal bases.
In general, an orthonormal basis ~ei can be related to a different orthonormal basis ~ei00 by
means of a rotation, assuming that the two bases have the same handedness. Note here that
we have chosen to use primed indices for the primed basis. This is a notational convention
that is useful to keep track of what indices belong to which basis. As mentioned previously,
the handedness of a basis is based on the ordering of the basis vectors as illustrated in
Fig. 1.2. In order to transform a right-handed basis into a left-handed one, or vice versa, a
reflection is needed in addition to the rotation.
The properties of a vector do not depend on the basis chosen. Regardless of the chosen
basis, a vector pointing to the Moon will always point at the Moon, independent of whether
one of our basis vectors point to the Sun or not. As mentioned in the beginning of this
chapter, the vector ~v may be written in the basis ~ei according to Eq. (1.1). By the fact that
we could just as well use the basis ~ei00 , we must therefore have
0
N N
X X 0
~v = i
v ~ei = v i ~ei00 . (1.9)
i=1 i0 =10
0
Here we have chosen to use a prime only in the index of v i to denote that this component
belongs to the primed basis. Alternatives to this include using a prime only for the symbol
0
itself v 0i (and at the same time using ~ei0 ) or using double primes v 0i . However, using one
prime only is sufficient and our choice is coherent with using primed indices for the primed
basis vectors.
0
With orthonormal bases, the coefficients v i and v i can be found through the scalar
product with the basis vectors themselves
0
v i = ~ei · ~v , v i = ~ei00 · ~v . (1.10)