Statistical mechanics

Statistical mechanics is the application of statistics, which includes mathematical tools for dealing with large populations, to the field of mechanics, which is concerned with the motion of particles or objects when subjected to a force.

It provides a framework for relating the microscopic properties of individual atoms and molecules to the macroscopic or bulk properties of materials that can be observed in everyday life, therefore explaining thermodynamics as a natural result of statistics and mechanics (classical and quantum) at the microscopic level. In particular, it can be used to calculate the thermodynamic properties of bulk materials from the spectroscopic data of individual molecules.

This ability to make macroscopic predictions based on microscopic properties is the main asset of statistical mechanics over thermodynamics. Both theories are governed by the second law of thermodynamics through the medium of entropy. However, Entropy in thermodynamics can only be known empirically, whereas in Statistical mechanics, it is a function of the distribution of the system on its micro-states.

Microcanonical ensemble

Since the second law of thermodynamics applies to isolated systems, the first case investigated will correspond to this case. The Microcanonical ensemble describes an isolated system.

The entropy of such a system can only increase, so that the maximum of its entropy corresponds to an equilibrium state for the system.

Because an isolated systems keeps a constant energy, the total energy of the system does not fluctuate. Thus, the system can access only those of its micro-states that correspond to a given value E of the energy. The internal energy of the system is then strictly equal to its energy.

Let us call $''\Omega (E)$ the number of micro-states corresponding to this value of the system's energy. The macroscopic state of maximal entropy for the system is the one in which all micro-states are equally likely to occur during the system's fluctuations.

$S=k_{B}\ln \left(\Omega (E)\right)\,$

where

$S$ is the system entropy,

$k_{B}$ is Boltzmann's constant

Canonical ensemble

Invoking the concept of the canonical ensemble, it is possible to derive the probability $P_{i}$ that a macroscopic system in thermal equilibrium with its environment will be in a given microstate with energy $E_{i}$:

$P_{i}={\exp \left(-\beta E_{i}\right) \over {\sum _{j}^{j_{max}}\exp \left(-\beta E_{j}\right)}}$

where $\beta ={1 \over {kT}}$,

The temperature T arises from the fact that the system is in thermal equilibrium with its environment . The probabilities of the various microstates must add to one, and the normalization factor in the denominator is the canonical partition function:

$Z=\sum _{j}^{j_{max}}\exp \left(-\beta E_{j}\right)$

where $E_{i}$ is the energy of the ith microstate of the system. The partition function is a measure of the number of states accessible to the system at a given temperature. See derivation of the partition function for a proof of Boltzmann's factor and the form of the partition function from first principles.

To sum up, the probability of finding a system at temperature T in a particular state with energy E_i is

$P_{i}={\frac {\exp(-\beta E_{i})}{Z}}$

Thermodynamic Connection

The partition function can be used to find the expected (average) value of any microscopic property of the system, which can then be related to macroscopic variables. For instance, the expected value of the microscopic energy E is interpreted as the microscopic definition of the thermodynamic variable internal energy (U)., and can be obtained by taking the derivative of the partition function with respect to the temperature. Indeed,

$\langle E\rangle ={\sum _{i}E_{i}e^{-\beta E_{i}} \over Z}=-{dZ \over d\beta }/Z$

implies, together with the interpretation of <E> as U, the following microscopic definition of internal energy:

$U\colon =-{d\ln Z \over d\beta }.$

The entropy can be calculated by (see Shannon entropy)

${S \over k}=-\sum _{i}p_{i}\ln p_{i}=\sum _{i}{e^{-\beta E_{i}} \over Z}(\beta E_{i}+\ln Z)=\ln Z+\beta U$

which implies that

$-{\frac {\ln(Z)}{\beta }}=U-TS=F$

is the Free energy of the system or in other words,

$Z=e^{-\beta F}\,$

Having microscopic expressions for the basic thermodynamic potentials U (internal energy), S (entropy) and F (free energy) is sufficient to derive expressions for other thermodynamic quantities. The basic strategy is as follows. There may be an intensive or extensive quantity that enters explicitly in the expression for the microscopic energy E_i, for instance magnetic field (intensive) or volume (extensive). Then, the conjugate thermodynamic variables are derivatives of the internal energy. For instance, the macroscopic magnetization (extensive) is the derivative of U with respect to the (intensive) magnetic field, and the pressure (intensive) is the derivative of U with respect to volume (extensive).

The treatment in this section assumes no exchange of matter (i.e. fixed mass and fixed particle numbers). However, the volume of the system is variable which means the density is also variable.

This probability can be used to find the average value, which corresponds to the macroscopic value, of any property, $J$, that depends on the energetic state of the system by using the formula:

$\langle J\rangle =\sum _{i}p_{i}J_{i}=\sum _{i}J_{i}{\frac {\exp(-\beta E_{i})}{Z}}$

where $<J>$ is the average value of property $J$. This equation can be applied to the internal energy, $U$:

$U=\sum _{i}E_{i}{\frac {\exp(\beta E_{i})}{Z}}$

Subsequently, these equations can be combined with known thermodynamic relationships between $U$ and V to arrive at an expression for pressure in terms of only temperature, volume and the partition function. Similar relationships in terms of the partition function can be derived for other thermodynamic properties as shown in the following table.

Helmholtz free energy:	$F=-{\ln Z \over \beta }$
Internal energy:	$U=-\left({\frac {\partial \ln Z}{\partial \beta }}\right)_{N,V}$
Pressure:	$P=-\left({\partial F \over \partial V}\right)_{N,T}={1 \over \beta }\left({\frac {\partial \ln Z}{\partial V}}\right)_{N,T}$
Entropy:	$S=k(\ln Z+\beta U)\,$
Gibbs free energy:	$G=F+PV=-{\ln Z \over \beta }+{V \over \beta }\left({\frac {\partial \ln Z}{\partial V}}\right)_{N,T}$
Enthalpy:	$H=U+PV\,$
Constant Volume Heat capacity:	$C_{V}=\left({\frac {\partial U}{\partial T}}\right)_{N,V}$
Constant Pressure Heat capacity:	$C_{P}=\left({\frac {\partial H}{\partial T}}\right)_{N,P}$
Chemical potential:	$\mu _{i}=-{1 \over \beta }\left({\frac {\partial \ln Z}{\partial N_{i}}}\right)_{T,V,N}$

The last entry needs clarification. We are NOT working with a grand canonical ensemble here.

It is often useful to consider the energy of a given molecule to be distributed among a number of modes. For example, translational energy refers to that portion of energy associated with the motion of the center of mass of the molecule. Configurational energy refers to that portion of energy associated with the various attractive and repulsive forces between molecules in a system. The other modes are all considered to be internal to each molecule. They include rotational, vibrational, electronic and nuclear modes. If we assume that each mode is independent (a questionable assumption) the total energy can be expressed as the sum of each of the components:

$E=E_{t}+E_{c}+E_{n}+E_{e}+E_{r}+E_{v}\,$

Where the subscripts t, c, n, e, r, and v correspond to translational, configurational, nuclear, electronic, rotational and vibrational modes, respectively. The relationship in this equation can be substituted into the very first equation to give:

$Z=\sum _{i}\exp \left(-\beta (E_{ti}+E_{ci}+E_{ni}+E_{ei}+E_{ri}+E_{vi})\right)$

$=\sum _{i}\exp \left(-\beta E_{ti}\right)\exp \left(-\beta E_{ci}\right)\exp \left(-\beta E_{ni}\right)\exp \left(-\beta E_{ei}\right)\exp \left(-\beta E_{ri}\right)\exp \left(-\beta E_{vi}\right)$

If we can assume all these modes are completely uncoupled and uncorrelated, so all these factors are in a probability sense completely independent, then

$Z=Z_{t}Z_{c}Z_{n}Z_{e}Z_{r}Z_{v}\,$

Thus a partition function can be defined for each mode. Simple expressions have been derived relating each of the various modes to various measurable molecular properties, such as the characteristic rotational or vibrational frequencies.

Expressions for the various molecular partition functions are shown in the following table.

Nuclear	$Z_{n}=1\qquad (T<10^{8}K)$
Electronic	$Z_{e}=W_{0}\exp(kTD_{e}+W_{1}\exp(-\theta _{e1}/T)+\cdots )$
vibrational	$Z_{v}=\prod _{j}{\frac {\exp(-\theta _{vj}/2T)}{1-\exp(-\theta _{vj}/T)}}$
rotational (linear)	$Z_{r}={\frac {T}{\sigma }}\theta _{r}$
rotational (non-linear)	$Z_{r}={\frac {1}{\sigma }}{\sqrt {\frac {{\pi }T^{3}}{\theta _{A}\theta _{B}\theta _{C}}}}$
Translational	$Z_{t}={\frac {(2\pi mkT)^{3/2}}{h^{3}}}$
Configurational (ideal gas)	$Z_{c}=V\,$

These equations can be combined with those in the first table to determine the contribution of a particular energy mode to a thermodynamic property. For example the "rotational pressure" could be determined in this manner. The total pressure could be found by summing the pressure contributions from all of the individual modes, ie:

$P=P_{t}+P_{c}+P_{n}+P_{e}+P_{r}+P_{v}\,$

Grand canonical ensemble

If the system under study is an open system, (matter can be exchanged), and particle number is conserved, we would have to introduce chemical potentials, μ_j, j=1,...,n and replace the canonical partition function with the grand canonical partition function:

$\Xi (V,T,\mu )=\sum _{i}\exp \left(\beta \left[\sum _{j=1}^{n}\mu _{j}N_{ij}-E_{i}\right]\right)$

where N_ij is the number of j^th species particles in the i^th configuration. Sometimes, we also have other variables to add to the partition function, one corresponding to each conserved quantity. Most of them, however, can be safely interpreted as chemical potentials. In most condensed matter systems, things are nonrelativistic and mass is conserved. However, most condensed matter systems of interest also conserve particle number approximately (metastably) and the mass (nonrelativistically) is none other than the sum of the number of each type of particle times its mass. Mass is inversely related to density, which is the conjugate variable to pressure. For the rest of this article, we will ignore this complication and pretend chemical potentials don't matter. See grand canonical ensemble.

Let's rework everything using a grand canonical ensemble this time. The volume is left fixed and does not figure in at all in this treatment. As before, j is the index for those particles of species j and i is the index for microstate i:

$U=\sum _{i}E_{i}{\frac {\exp(-\beta (E_{i}-\sum _{j}\mu _{j}N_{ij}))}{\Xi }}$

$N_{j}=\sum _{i}N_{ij}{\frac {\exp(-\beta (E_{i}-\sum _{j}\mu _{j}N_{ij}))}{\Xi }}$

Gibbs free energy:	$G=-{\ln \Xi \over \beta }$
Internal energy:	$U=-\left({\frac {\partial \ln \Xi }{\partial \beta }}\right)_{\mu }+\sum _{i}{\mu _{i} \over \beta }\left({\partial \ln \Xi \over \partial \mu _{i}}\right)_{\beta }$
Particle number:	$N_{i}={1 \over \beta }\left({\partial \ln \Xi \over \partial \mu _{i}}\right)_{\beta }$
Entropy:	$S=k(\ln \Xi +\beta U-\beta \sum _{i}\mu _{i}N_{i})\,$
Helmholtz free energy:	$F=G+\sum _{i}\mu _{i}N_{i}=-{\ln \Xi \over \beta }+\sum _{i}{\mu _{i} \over \beta }\left({\frac {\partial \ln \Xi }{\partial \mu _{i}}}\right)_{\beta }$

Equivalence between descriptions at the thermodynamic limit

All the above descriptions differ in the way they allow the given system to fluctuate between its configurations.

In the micro-canonical ensemble, the system exchanges no energy with the outside world, and is therefore not subject to energy fluctuations, while in the canonical ensemble, the system is free to exchange energy with the outside in the form of heat.

In the thermodynamic limit, which is the limit of large systems, fluctuations become negligible, so that all these descriptions converge to the same description. In other words, the macroscopic behavior of a system does not depend on the particular ensemble used for its description.

Given these considerations, the best ensemble to choose for the calculation of the properties of a macroscopic system is that ensemble which allows the result be most easily derived.

See also

• Fluctuation dissipation theorem
• Important Publications in Statistical Mechanics
• List of notable textbooks in statistical mechanics
• Ising Model
• Mean field theory
• Ludwig Boltzmann
• Paul Ehrenfest
• Thermodynamic limit
• Probability of the universe Considering the limitations of statistical mechanics

A Table of Statistical Mechanics Articles

	Maxwell Boltzmann	Bose-Einstein	Fermi-Dirac
Particle		Boson	Fermion
Statistics	Partition function Identical particles#Statistical properties Microcanonical ensemble | Canonical ensemble | Grand canonical ensemble
Statistics	Maxwell-Boltzmann statistics Maxwell-Boltzmann distribution Boltzmann distribution Derivation of the partition function Gibbs paradox	Bose-Einstein statistics	Fermi-Dirac statistics
Thomas-Fermi approximation	gas in a box gas in a harmonic trap
Gas	Ideal gas	Bose gas Debye model Bose-Einstein condensate Planck's law of black body radiation	Fermi gas Fermion condensate
Chemical Equilibrium	Classical Chemical equilibrium

References

• . ISBN 0471815187. {{cite book}}: Missing or empty |title= (help); Unknown parameter |Author= ignored (|author= suggested) (help); Unknown parameter |Publisher= ignored (|publisher= suggested) (help); Unknown parameter |Title= ignored (|title= suggested) (help); Unknown parameter |Year= ignored (|year= suggested) (help)
• . ISBN 0716710889. {{cite book}}: Missing or empty |title= (help); Unknown parameter |Author= ignored (|author= suggested) (help); Unknown parameter |Publisher= ignored (|publisher= suggested) (help); Unknown parameter |Title= ignored (|title= suggested) (help); Unknown parameter |Year= ignored (|year= suggested) (help)

External links

• Philosophy of Statistical Mechanics article by Lawrence Sklar for the Stanford Encyclopedia of Philosophy.