Professional Documents
Culture Documents
1
4 The Statistical Physics of non-Isolated systems:
The Canonical Ensemble
In principle the tools of Chap. 3 suffice to tackle all problems in statistical physics. In
practice the microcanonical ensemble considered there for isolated systems (E, V, N
fixed) is often complicated to use since it is usually (i.e., except for ideal, non-
interacting systems) very difficult to calculate all possible ways the energy can be
split between all the components (atoms). However, we may also consider non-isolated
systems, and in this chapter we consider systems in contact in with a heat reservoir,
where temperature T is fixed rather than E. This then leads us to the canonical
ensemble. In Chap. 3, we have introduced the canonical ensemble as many copies
of a thermodynamic system, all in thermal contact with one another so energy is
exchanged to keep temperature constant throughout the ensemble. In this chapter
we will introduce the Boltzmann distribution function by focusing on one copy
and considering the rest copies as a giant heat reservoir:
The important point to note is that for a macroscopic system the two approaches
are essentially identical. Thus, if T is held fixed the energy will statistically
√ fluctuate,
but, as we have seen, the fractional size of the fluctuations ∝ 1/ N (we will verify
this explicitly later). Thus, from a macroscopic viewpoint, the energy is constant to
all intents and purposes, and it makes no real difference whether the heat reservoir
is present or not, i.e., whether we use the microcanonical ensemble (with E, V, N
fixed) or the canonical ensemble (with T, V, N fixed). The choice is ours to make,
for convenience or ease of calculations. We will see canonical ensemble is much more
convenience.
As we see below, the canonical ensemble leads to the introduction of some-
thing called the partition function, Z, from which all thermodynamic quantities
(P, E, F, S, · · ·) can be found. At the heart of the partition function lies the Boltz-
mann distribution, which gives the probability that a system in contact with a heat
reservoir at a given temperature will have a given energy.
2
4.1 The Boltzmann distribution
Figure 1
Consider a system S in contact with a heat reservoir R at temperature T as shown
in Figure 1. The whole, (R + S), forms an isolated system with fixed energy E0 . Heat
can be exchanged between S and R, but R is so large that its temperature remains
T if heat is exchanged. We now ask: What is the probability pi that the system S is
in a particular microstate with energy Ei ?
We assume that S and R are independent of each other. The total number of
microstates
Ω = ΩR × ΩS .
Now, if we specify the microstate of ΩS to be the ith microstate, ΩS = 1, we have
Ω = Ω(E0 , Ei ) = ΩR (E0 − Ei ) × 1.
Thus, the probability pi of S being in a state with energy Ei depends on the number
of microstates of R with energy E0 − Ei ,
3
But, from the thermodynamic relations involving partial derivative of S,,
!
∂SR 1
= ,
∂E V,N
T
2
! " # !
∂ SR ∂(1/T ) 1 ∂T 1
= =− 2 =− .
∂E 2 V,N
∂E V,N
T ∂E V,N
T 2C V
Thus,
Ei Ei2
SR (E0 − Ei ) = SR (E0 ) − − (R)
+ O(Ei3 ).
T 2T 2 CV
(R)
If R is large enough, CV T Ei and only the first two terms in the expansion are
nonzero,
" #
1 SR (E0 ) Ei
pi ∝ ΩR (E0 −Ei ) = exp SR (E0 − Ei ) = exp − = const.×e−Ei /kB T
kB kB kB T
since SR (E0 ) is a constant, independent of the microstate index i. Call this constant
of proportionality 1/Z, we have
1 −Ei /kB T
pi = e , (1)
Z
where Z is determined from normalization condition. So if we sum over all microstates
X
pi = 1
i
we have
e−Ei /kB T ,
X
Z= (2)
i
where sum on i runs over all distinct microstates. pi of Eq. (1) is the Boltzmann
distribution function and Z is called the partition function of the system S. As we
will see later, partition function Z is very useful because all other thermodynamic
quantities can be calculated through it.
The internal energy can be calculated by the average
1X
Ei e−Ei /kB T .
X
hEi = Ei pi = (3)
i Z i
4
total energy. For example, a microstate for the case of an spin-1/2 paramagnet of N
independent particles is a configuration of N spins (up or down):
i = (↑, ↑, ↓, . . . , ↓).
For a gas of N molecules, however, i represents a set of values of positions and
momenta as
i = (r1 , r2 , . . . , rN ; p1 , p2 , . . . , pN ),
as discussed in Chap. 3
[Ref.: (1) Mandl 2.5; (2) Bowley and Sánchez 5.1-5.2]
If we further assume that N particles are distinguishable, summations over k’s are
independent of one another and can be carried out separately as
e−k1 /kB T e−k1 /kB T · · · e−kN /kB T
X
ZN =
k1 ,k2 ,...,iN
We notice that in the last equation, the summation in each factor runs over the same
complete single-particle states. Therefore, they are all equal,
e−k1 /kB T = e−k2 /kB T = · · · = e−kN /kB T .
X X X
k1 k2 kN
5
Hence, the N-particle partition function in the independent-particle approximation
is,
ZN = (Z1 )N
where
e−k1 /kB T
X
Z1 =
k1
is the one-body partition function. We notice that the index k1 in the above equation
labels single particle state and k1 is the corresponding energy of the single particle,
contrast to the index i used earlier in Eqs. (1) and (2), where i labels the microstate
of total N-particle system and i is the corresponding total energy of the system.
The above analysis are valid for models of solids and paramagnets where particles
are localized hence distinguishable. However, particles of a gas are identical and are
moving around the whole volume; they are indistinguishable. The case of N indis-
tinguishable particles is more complicated. The fact that permutation of any two
particles in a configuration (k1 , k2 , . . . , kN ) of Eq. (3) does not produce a new mi-
crostate imposes restrictions on the sum i = k1 ,k2 ,...,kN ; the number of microstates
P P
is hence much reduced and sums over k’s are not longer independent of each other.
The simple separation method of Eq. (5) is invalid. For a classical ideal gas, if we
assume the N particles are in different single-particle states (imagine N molecules in
N different cubicles of size h3 in the phase-space (r,p)), the overcounting factor is
clearly N! as there are N! permutations for the same microstate (k1 , k2 , . . . , kN ). We
hence approximate the partition function of N classical particles as,
1
ZN ≈ (Z1 )N .
N!
ZN = (Z1 )N ; (6)
6
Example. Consider a system of two free (independent) particles. Assuming that
there are only two single-particle energy levels 1 , 2 , by enumerating all possible two-
body microstates, determine the partition functions Z2 if these two particle are (a)
distinguishable and (b) indistinguishable.
Solution: (a) We list all four possible microstates of two distinguishable particles in
the following occupation diagram:
Notice that the 2nd and 3rd states are different states as two particles are distin-
guishable. By definition, the partition function of the two-particle system is given
by
e−Ei /kB T = e−21 /kB T +2e−(1 +2 )/kB T +e−22 /kB T = (e−1 /kB T +e−2 /kB T )2 = Z12 ,
X
Z2 =
i
agreed with the general formula ZN = (Z1 )N of Eq. (6). The average energy of the
two-particle system is give by, according to Eq. (3)
1X 1 h i
hEi = Ei e−Ei /kB T = (21 )e−21 /kB T + 2(1 + 2 )e−(1 +2 )/kB T + (22 )e−22 /kB T .
Z i Z2
(b) For two identical particles, there are only three microstates as shown the following
occupation-number diagram.
7
For the case of a two-particle system with three states, see Q1 of Example Sheet 9.
Note:
(a) It is important to note that the sum in Eq. (8) runs over all single-particle states
k1 , and not over all different energies. A given energy eigenvalue k1 may be
degenerate, i.e., belong to more than one (different) state. We can also express
Eq. (8) alternatively as a sum over distinct energy levels, as
(d) Equation (6) is invalid in the low temperature limit where quantum effects
dominate (e.g., a significant portion of particles of a quantum gas are in the zero-
momentum state: the Bose-Einstein condensation). A proper way to tackle the
problems of identical particles is to introduce occupation-number configurations
and to employ grandcanonical ensemble. A third-year course (Fermions and
Bosons) will discuss this subject in details.
Example 1. The ideal spin-1/2 paramagnet. Only 2 energy states for each spin,
k1 =↑, ↓, with energies
↑ = −µB, ↓ = +µB,
8
where µ is the magnetic moment of one spin particle and B is the magnetic field. The
one-body partition function is therefore
e−k1 /kB T = eµB/kB T + e−µB/kB T = 2 cosh(µB/kB T ).
X
Z1 =
k1
1 q 2πkB T 2πkB T
= 2πmkB T 2
= ,
h mω hω
where we have used the Gaussian integral
∞ π
Z r
2
e−ax dx = , a > 0.
−∞ a
The partition function of M oscillators (distinguishable) is
!M
M 2πkB T
ZM = (Z1 ) = . (11)
hω
Example 3. The classical ideal gas of N particles in a volume V . In this case, the
single particle energy is
p2 1 2
(r, p) = (p) = = (p + p2y + p2z ).
2m 2m x
9
The one-body partition function is
1 Z 3 3 −(p)/kB T
Z1 = d rd p e .
h3
As the energy (p) is r independent, the integral over real space produces a factor of
volume V and the integral over momentum is,
Z Z ∞ Z ∞ Z ∞
3 −p2 /2mkB T −p2x /2mkB T −p2y /2mkB T −p2z /2mkB T
dp e = dpx e dpy e dpz e
−∞ −∞ −∞
q q q
= 2πmkB T · 2πmkB T · 2πmkB T = (2πmkB T )3/2 ,
where we have again used the Gaussian integral formula given above. The one-body
partition function is
!3/2
2πmkB T
Z1 = V (12)
h2
and the partition function for a classical ideal gas of N identical molecules in a volume
V is !3N/2
1 N V N 2πmkB T
ZN = Z = . (13)
N! 1 N! h2
Later, we will see the importance of the factor 1/N! when we calculated thermody-
namic quantities such as energy, entropy, etc.
10
The partition function of M quantum oscillators is
1
ZM = (Z1 )M = .
[2 sinh(h̄ω/2kB T )]M
We will see later the thermodynamics of quantum oscillators reduces to the classical
one in the high temperature limit but is completely different in the low temperature
limit.
In the next sections, we will discuss how to calculate energy, entropy and other
thermodynamic quantities from partition functions.
[Ref.: (1) Mandl 2.5; (2) Bowley and Sánchez 5.1-5.2]
tion constant, its usefulness is much deeper than that. Loosely, whereas for an isolated
system (at fixed E, N, V ) all the thermodynamic properties S, T, P, · · · could be de-
rived from Ω(E, N, V ), as for a system in thermal equilibrium at temperature T the
same role is played by Z = Z(T, N, V ) for a hydrostatic system (or Z = Z(T, N, B)
for a magnetic system, etc.). In the last section we have calculated Z of several sys-
tems in the independent-particle approximation. Here we discuss in general how to
calculate other properties from Z.
First, we consider the energy E. The average energy hEi is calculated for the
canonical ensemble (with ν copies of the system and νi of these copies in the i-
microstate, recall Chap. 3.2) as
ν
1X 1X X
hEi = Eλ = νi Ei = pi Ei ,
ν λ=1 ν i i
or
−Ei /kB T
1X i Ei e
P
hEi = Ei e−Ei /kB T = P −Ei /kB T
,
Z i ie
As given by Eq. (3) in Sec. 4.1. Now, in this expression, the numerator can be
obtained from the denominator by differentiating the denominator with respect to
(−1/kB T ). That is a bit awkward, so let’s define
1
β≡ . (14)
kB T
Hence
Ei e−Ei /kB T
!
1 ∂Z
P
i
hEi = P −E /k T = − ,
ie Z ∂β
i B
N,V
11
or, more formally
! !
∂ ln Z 2 ∂ ln Z
hEi = − = kB T . (15)
∂β N,V
∂T N,V
12
• First calculate partition function
e−Ei /kB T .
X
ZN = (18)
i
F = −kB T ln ZN . (19)
or simplely from
E = F + T S. (22)
In the above formulas, we have dropped the average notation hi for F, E and S. This
is because in the large N limit,
√ the fluctuations around the average value very small,
typically proportional to 1/ N . In the next section we will discuss these fluctuations
for the energy hEi.
Note:
(a) For magnetic systems the term −P dV is replaced by −mdB; and hence we have
m = −(∂F/∂B)T,N instead.]
(b) Equations (19)-(20) are very reminiscent of those we met in the case of an
isolated system in Chap. 3 (Eqs. (1)-(3)). Whereas the entropy S played a
central role for isolated systems, that role is now played by F for system in
contact with a heat bath. It is no real surprise that F is now the key state
function for system at fixed T , since that is just how it was introduced in
thermodynamics.
13
where Z1 is the one-body partition function. After taking log, we have
= N ln Z1 , distinguishable particles;
ln ZN
≈ N ln Z1 − ln N!, indistinguishable particles,
we have, for both the distinguishable and indistinguishable particles,
! !
∂ ln ZN ∂ ln Z1
E = EN = − = −N = NE1 ,
∂β N,V
∂β N.V
14
or
∂ 2 ln Z
!
2
(∆E) = = k B T 2 CV . (24)
∂β 2 N,V
Note: For a normal macroscopic system hEi ∝ NkB T , and CV ∝ NkB , hence
√
∆E N kB T 1
∝ =√ .
hEi NkB T N
So, if N ≈ 1024 , ∆E/hEi ≈ 10−12 , an unobservable tiny number! So, for most
normal macroscopic systems the fluctuations are totally negligible and we can forget
the notation hi, and write hEi → E, hCV i → CV , etc., and there is no real difference
between an isolated system of fixed energy E and one in contact with a heat bath at
the same temperature T = (∂E/∂S)N,V .
[Note: A notable exception occurs near critical points, where the distinction be-
tween 2 phases disappears, Near critical points hCV i can be very large and the fluctua-
tions may not be negligible. This can sometimes be observed as ”critical opalescence”
where the meniscus between the liquid and gas phases disappears, and the mixture
becomes milky-looking and opaque as it scatters light.]
[Ref.: (1) Mandl 2.5]
where β = 1/kB T . We can now calculate the total average energy easily using Eq. (21)
∂ ln ZN N
E=− =− · sinh(βµB) · (µB),
∂β cosh(βµB)
hence
µB
E = −NµB tanh . (25)
kB T
The heat capacity at constant magnetic field is calculated as
µ2 B 2
!
∂E µB µB µB
2
CB = = −NµBsech · − =N sech2 , (26)
∂T B
kB T kB T 2 kB T 2 kB T
15
d
where we have used dx tanh x = sech2 x, and sechx ≡ 1/ cosh x.
We can plot E and CB as function of T using the fact that, as x → 0, sinh x → x
and cosh x → 1; and as x → ∞, sinh x → ex /2 and cosh x → ex /2. Hence, from
Eq. (25)
E → −NµB, T → 0
just as expected, since all spins will be in lowering energy spin-up state. On the other
hand, tanh x → x as x → 0, hence
Nµ2 B 2
E→− , T →∞
kB T
again, as expected since as T → ∞, the number of up spins and down spins become
nearly equal and their energies cancel each other out. These behaviors are shown in
Figure 2.
Figure 2
CB → 0, T → 0.
This behavior, which is quite general, is also easy to understand. Thus, at low T ,
thermal fluctuations that flip a spin are rare → very difficult for the system to absorb
heat. Quantization of energy levels → there is always a minimum excitation energy
for any system, and hence, if T is low enough, the system can’t absorb heat.
16
Figure 3
Low-T High-T
Figure 4
The Helmholtz free energy is calculated as, using Eq. (19)
µB
F = −kB T ln ZN = −NkB T ln 2 cosh .
kB T
The entropy and magnetization are calculated by Eqs. (20)
! !
∂F ∂F
S=− , m=− .
∂T B,N
∂B T,N
17
Hence, for the entropy
(i) T → 0 (or β → ∞)
1
S → NkB {ln[2 × eβµB ] − βµB · 1} → 0, T →0
2
which is as expected, since as T → 0 all spins are up, i.e. no disorder!
(ii) T → ∞ (or β → 0)
as expected, since E = −mB is the equation of state for the ideal paramagnet. The
limits:
(i) T → 0 (or β → ∞)
m → Nµ
for all spins are up; and
(ii) T → ∞ (or β → 0)
Nµ2 B
m → , Curies0 s law
kB T
→ 0
We plot S and m versus T for several different external fields as shown in Figure 5.
18
Figure 5
Note: As we have seen above, the entropy S → 0 as T → 0 as all spins align.
This is generally true, namely, a system has no disorder in the limit of T → 0. This
is the third law of thermodynamics:
The entropy of any system S → 0 as T → 0.
In the next section, we discuss a way to reach low temperature limit using paramag-
nets.
[Refs.: (1) Mandl 3; (2) Bowley and Sánchez 5.7.]
Figure 6
19
Start with sample in magnetic field B1 at an (already fairly low) temperature T1 .
In the step 1, we increase the level spacing but keep T constant; population of upper
level falls. In step 2 we reduce the level spacing again, but as the process is now
adiabatic (spins isolated) there is no change in level occupations, the temperature is
lowered.
This is actually a practical way to reach quite low temperatures, to small fractions
of 1 K. If we start with a large sample we could repeat the process with a small sub-
sample, with rest acting as a heat bath. However at each repeat of Steps 1 and 2 we
would reduce the temperature by less and less, as the curves come together as T → 0.
Thus it is impossible to reach T → 0 in a finite number of steps in this way.
This is just one example of the third law of thermodynamics: namely, either
(a) absolute zero is unattainable (in a finite number of steps) or, more precisely,
Note: The (b) statement implies that the ground state is non-degenerate so that all
particles fall into the same state as T → 0.
[Ref.: (1) Mandl 5.6.]
20
Thus, we can colloquially state:
21
4.8 Example: The classical ideal gas
Now it is time to revisit the ideal gas we discussed often in thermodynamics. We
hinted before that it would be a challenge problem using microcanonical ensemble
approach. We will show that this is not the case using canonical ensemble approach.
We have calculated the partition function of classical ideal gas of N identical
molecules at fixed temperature T in a volume V as, Eq. (12)-(13),
!3N/2
1 N VN 2πmkB T
ZN = Z = ,
N! 1 N! h2
Note: If we did not include the 1/N! factor in ZN , the second term in Eq. (29) would
be ln V instead of the intensive quantity ln(V /N), and F would not be extensive as
required.
The entropy is calculated as, according to Eq. (20),
! !
∂F 3 2πmkB T V 5
S=− = kB N ln + ln + , (30)
∂T V,N
2 h2 N 2
3 T V
S = kB N ln + ln + const.
2 T0 V0
Eq. (30) is referred as Sackur-Tetrode equation. It gives absolute value of the entropy
of a gas at a given temperature T . (See Q2 of Example Sheet 11 for more details).
Apart from the factor m of atomic mass, it is the same for every substance. At high
enough temperature and low enough densities all substances behave as ideal gases,
and so the Sackur-Tetrode formula can be checked experimentally. Good agreement
is found.
22
The equation of state is obtained by Eq. (20) for pressure,
!
∂F 1
P =− = kB T N ·
∂V T,N
V
(a) We have ignored interactions between particles when calculating partition func-
tion ZN ; these interactions are responsible for the particles condensing into
liquids or forming solids at low temperature.
(b) We have also ignored quantum effects (significant at low temperature) when we
considered the properties of indistinguishable particles by assuming particles are
in different single-particle state (hence the over-counting factor is simple N!).
The quantum effect of many particles in the zero-momentum state is responsible
for the Bose-Eisntein condensation.
Inclusion either of the above two effects will result correct low temperature behavior
for the entropy. More detailed discussion for validity of the classical ZN above is given
by Mandl 7.3.
23
these three motions are independent of one another, hence write the partition function
of N diatomic molecules as
1
ZN = (Z1 )N , Z1 = Z1t Z1v Z1r (33)
N!
where Z1t is the one-body partition function of translational motion, given by Eq. (12),
Z1v is that of vibrational motion, and Z1r is that of rotational motion. Here we consider
Z1r and Z1r by quantum treatment.
Ev
!
∂ ln Z1 1
=− = · 2 cosh(h̄ωβ/2) · (h̄ω/2)
N ∂β 2 sinh(h̄ωβ/2)
or
Ev 1
= h̄ω coth(h̄ωβ/2). (34)
N 2
The two temperature limits:
Ev 1
→ h̄ω,
N 2
just the zero-point energy;
2
(ii) T → ∞ (β → 0), coth(h̄ωβ/2) → h̄ωβ
,
Ev 1
→ = kB T.
N β
24
Note: For most diatomic molecules, the high-T limit is reached for T ≥ 1000 K.
l(l + 1)h̄2
l = , l = 0, 1, 2, · · · .
2I
Also, for each eigenvalue l we have g(l ) = (2l + 1) degenerate magnetic sublevels,
specified by quantum number ml = −l, −l + 1, · · · , l − 1, l, all with same energy l .
Hence the one-body partition function is
∞
2
Zlr β/2I
X
= (2l + 1)e−l(l+1)h̄ . (35)
l=0
For general β, we can not specify the above Z1 further. However, we can look at the
low- and high-T limits as follows:
(a) T → 0 (β → ∞), for a good approximation, keeping only the first two terms,
2
β/I
Z1 → 1 + 3e−h̄
(b) T → ∞ (β → 0). In this limit (kB T h̄2 /2I) there are many thermally
accessible energy levels, and the discrete series can be well approximated by a
continuum, i.e., Z ∞
2
Z1r → dl(2l + 1)e−l(l+1)h̄ β/2I
0
and luckily this integral can be exactly evaluated by making the substitution
x = l(l + 1) and dx = (2l + 1)dl. And we obtain
2I 2IkB T
Z1r → 2 = . (36)
h̄ β h̄2
25
Er ∂
and the rotational energy per molecule, using N
= − ∂β ln Z1r
Er 1
→ = kB T, T → ∞. (37)
N β
For details, see Example Sheet 10. Note: For typical diatomic molecules,
h̄2 /2I ≈ 10−3 eV, and so the high-T limit is reached well below room tem-
perature.
Translational energy contribution. From Eq. (32) of Sec. 4.8, we have the
translational energy per molecule as
Et 3
= kB T. (38)
N 2
We obtained this result using classical mechanics approach. In the next section we
obtain the same result using quantum treatment.
We will see later in Sec. 4.11 that it is no accident that there is a simple relation
between energies per molecule in the high-T limit for these three motions. They are
examples of the more general equipartition theorem.
[Refs.: (1) Bowley and Sánchez 5.11, 5.12.]
h̄2 2
− ∇ ψ(x, y, z) = Eψ(x, y, z).
2m
We assume the box is impenetrable so that ψ vanishes everywhere on the boundaries
of the box and outside it. The Schrödinger equation with this boundary condition is
easily seen to be satisfied by the solution
(
nx πx ny πy nz πz
A sin sin sin , inside box;
ψ(x, y, z) = Lx Ly Lz
0, outside box,
26
where nx , ny , ny = 1, 2, · · · and A is a normalization constant. The corresponding
energy eigenvalues are E = nx ,ny ,nz
!2
h̄2 h̄2 k 2
2 2
nx π ny π nz π
nx ,ny ,nz = + + ≡ ,
Lx Ly Lz 2m 2m
where k 2 = kx2 + ky2 + kz2 and kx = nx π/Lx , ky = ny π/Ly and kz = nz π/Lz . Hence,
the one-particle partition function for this free translational motion is
∞ X
∞ X
∞
Z1t =
X
e−βnx ,ny ,nz .
nx =1 ny =1 nz =1
This sum can be further evaluated only in the limit kB T h̄2 π 2 /2mL2 , the energy
level spacing. Even for L = 1 cm, m = mH (hydrogen mass), h̄2 π 2 /2mL2 ≈ 2 × 10−18
eV, a truly tiny energy, and for all attainable temperature the condition kB T
h̄2 π 2 /2mL2 always satisfies. Thus, for all macroscopic boxes and even at the lowest
temperature ever reached, we can replace the sums by integrals. Putting nx = kx Lx /π,
etc., we replace
∞
X Z ∞
Lx
··· → dkx · · · ,
nx =1 0 π
etc. We rewrite Z1 as
Lx Ly Lz Z ∞ Z ∞ Z ∞
V Z 3 −β(k)
Z1t = dkx dky dkz e−β(k)
= 3 d ke ,
π π π 0 0 0 8π
where V = Lx Ly Lz and (k) ≡ h̄2 k 2 /2m. Rewrite the above equation as
V Z 3 −β(k) h̄2 k 2
Z1t = d ke , (k) ≡ . (39)
(2π)3 2m
Furthermore, in spherical coordinates d3 k = k 2 dk sin θdθdφ, we rewrite Eq. (21), after
integration of the angles to yield 4π,
Z ∞ V k2
Z1t = dkD(k)e −β(k)
, D(k) = , (40)
0 2π 2
where D(k) is usually referred to as density of states in k-space, i.e., D(k)dk is the
number of states within the spherical shell from k → k + dk.
can insert (k) = h̄2 k 2 /2m and evaluate the integral of Eq. (40).
Finally, we q
Substitute k = 2m/βh̄2 x,
!3/2 Z !3/2
V 2m ∞
2 −x2 m
Z1t = 2 dxx e =V , (41)
2π βh̄2 0 2πβh̄2
27
where we have used Gaussian integral
√
Z ∞
2 −x2 π
xe dx = .
0 4
From Z1t we can calculate the average energy per molecule
Et ∂ ln Z1t 31 3
=− = = kB T,
N ∂β 2β 2
same as Eq. (32) by classical approach. This is not surprising as we have taken the
continuous limit (converting the summations into integrals). The discrete nature of
the energy levels will show up only at temperature T < h̄2 /(kB mV 2/3 ) ≈ 10−14 K.
Note: (a) In Eq. (40), D(k) acts for the continuum k-variable like the degeneracy
factor g(k ) in the discrete k -variable in the discrete sum for Z1 of Eq. (9). (b) We
want to emphasize that although quantum mechanical Z1 obtained here is the same
as classical result shown earlier, the formula for the total partition function
1 N
ZN = Z
N! 1
is the classical approximation. Namely we have ignored the quantum effects of many-
body systems.
[Refs.: (1) Mandl 7.1-7.3,; (2) Bowley and Sánchez 5.9,7.2.]
28
• translations:
1
Etr = m(ẋ2 + ẏ 2 + ż 2 )
2
3 quadratic d.o.f., hence E → 3kB T /2 as T → ∞.
Thus, at room temperature, only the rotational and translational degrees of freedom
can be treated classically, giving CV = 3R/2 for monatomic gases and Cv = 5R/2 for
diatomic gases, for the molar heat capacity. The following diagram is an example for
a diatomic gas (e.g., H2 ).
Figure 8
We can predict the heat capacities of other substances using equipartition, simply
by counting the quadratic degrees of freedom. An example is a solid, for which we
expect the molar heat capacity to be 3R since each atom is free to to vibrate in 3
directions. This is the Dulong-Petit law, which works well for many solids at room
temperature
Note: Equipartition only hods for quadratic degrees of freedom. An example is
for an ultra-relativistic gas, for which = cp = ch̄k, is linear (instead of quadratic).
Two important points:
29
(a) T → 0, quantum effects dominate. In fact, for all quantum systems including
quantum gases, CV → 0 as T → 0, consistent with the 3rd law of thermody-
namics.
(b) We only discussed energy per molecule and specific heat here using the equipar-
tition theorem and avoided discussing other properties such as entropy or equa-
tion of state which require the full N-body partition function ZN (and the
property of identical particles matter).
d3 rd3 p
Np(r, p)
h3
The Maxwell-Boltzmann velocity distribution function f (v) is obtained by setting
translational energy (r, p) = p2 /2m with p = mv, and integrating over spatial dr
and solid angle sin dθdφ of the momentum as
30
we have s 3/2
2 m
2 /2k
f (v) = N v 2 e−mv BT
. (42)
π kB T
Notice the normalization Z ∞
f (v)dv = N.
0
We can also define distribution function for an average particle as P (v) = f (v)/N
and the normalization equation is
Z ∞
P (v)dv = 1.
0
Figure 9
A few physical quantities are calculated as follows.
• most probable speed: let vp be the point of maximum P (v), i.e., dP/dv = 0
d 2 −mv2 β/2
v e =0 → (2v − v 2 mvβ) = 0
dv
we have s s
2kB T kB T
vp = ≈ 1.41 . (43)
m m
• mean speed:
s 3/2 Z
∞ 2 m ∞
Z
2 /2k
hvi = v · P (v)dv = v 3 e−mv BT
dv
0 π kB T 0
s s
8kB T kB T
= ≈ 1.60 . (44)
m m
31
• rms speed:
s 3/2 Z
∞ 2 m ∞
Z
2 2 2 2 /2k
hv i ≡ vrms = v · P (v)dv = v 4 e−mv BT
dv
0 π kB T 0
kB T
= 3 ,
m
or s s
3kB T kB T
vrms = ≈ 1.73 . (45)
m m
These three speeds are marked in Figure 9.
From Eq. (45) we have
1 1 2 m 3kB T 3
E1 = hmv 2 i = mvrms = · = kB T,
2 2 2 m 2
consistent with equipartition theorem. Note also that h̄ has disappeared from the
Maxwell-Boltzmann distribution of Eq. (42), which is why it can be also found from
classical kinetic theory, as was done originally by Maxwell.
Note: In the above integrals, we have used the following general Gaussian integral
∞ 1 · 3 · 5 · · · (2n − 1) π
Z r
2n −ax2
x e dx = .
0 2n+1 an a
[Refs.: (1) Mandl 7.7; (2) Bowley and Sánchez 7.4.]
32
The difficult problem is the inclusion of interactions between particles. Amazingly,
we have most of the fundamental formulas needed for all such further investigation,
although some special techniques will be required. Let’s do a little demonstration to
complete our Thermal and Statistical Physics.
We consider a gas of N identical, classical molecules. These molecules interact
with one another, and the interaction is described by a pair-wise interaction potential,
V (r), where r is the separation between the interacting pair. We draw a typical V (r)
in Fig. 10. Qualitatively, we see the interaction potential consists of a hard-core
(molecules repel each others strongly when they are very close) and an attractive
tail which is responsible for condensation into liquids and formation of solids at low
temperature.
In Chap. 1.3, we have qualitatively discussed the effects due to this interaction to
the equation of state, the so-called van der Waals equation,
αN 2
!
P + 2 (V − Nβ) = NkB T,
V
where α and β are coefficients depending on the interaction potential. This empirical
equation of van der Waals in fact provides a good description of a dense gas (recall
that an ideal gas corresponds to dilute gas where interactions can be ignored) and it
also predicts a phase transition from gas to liquid phase.
One of the tasks in statistical mechanics is to derive this van der Waals equation
from, say, canonical ensemble approach. In canonical-ensemble approach, as discussed
33
earlier, we first need to calculate the partition function of N molecules
e−i /kB T ,
X
ZN =
i
with the factor 1/N! due to the property of identical particles. The energy i is then
the classical Hamiltonian (total energy) of interacting N molecules
H = H(r1 , r2 , . . . ; p1 , p2 , . . .) = K + U;
N
p21 p2 p2 p2k
+ 2 +···+ N =
X
K = ,
2m 2m 2m k=1 2m
X
U = V (|r1 − r2 |) + V (|r1 − r3 |) + · · · = V (|rl − rk |)
k<l
where K is the total kinetic energy, U the total potential energy. Hence, the partition
function of the gas is written as
1 1
Z Z Z
3 3 3 3
ZN = d r1 d p1 d r2 d p2 · · · d3 rN d3 pN e−(K+U )/kB T .
N! h3N
We notice, contrast to the case of an ideal gas, the above multi-dimensional integral
is NOT separatable, due the coupling terms in the potential U between molecular
coordinates r1 , r2 , . . . , rN . (The kinetic energy term K is still separatable, hence the
integrals over momenta p1 , p2 , . . . , pN are still separatable. Can you prove this?).
Special techniques have been developed to evaluate this multi-dimensional integral.
One of such techniques is the so-called cluster-expansion for the factor e−U/kB T . Cor-
rections to the ideal gas equation of state can then be evaluated. We will stop here.
For those who are interested, a good but very advanced reference book (postgraduate
text book) is by K. Huang, Statistical Mechanics.
34
Acknowledgment
The main parts of these lecture notes (including figures, diagrams, and example
sheets) have been passed down to me from Prof. R.F. Bishop and to him from Dr.
J.A. McGovern. If these materials have been useful to you, credits should go to these
earlier lecturers. I have made some significant changes, including re-organizing the
materials. If you find typos, mistakes, or Chinglish, they are likely mine.
35
Lecture Cancellation
Lecture on Thursday, 2:00 pm, 01 May 2008 is can-
celed. Please study the last section Sec. 4.10 (avail-
able on line). Last lecture on Thursday, 08 May will
focus on revision.
36