Grand canonical ensemble
In statistical mechanics, a grand canonical ensemble is the statistical ensemble that is used to represent the possible states of a mechanical system of particles that are in thermodynamic equilibrium (thermal and chemical) with a reservoir. The system is said to be open in the sense that the system can exchange energy and particles with a reservoir, so that various possible states of the system can differ in both their total energy and total number of particles. The system's volume, shape, and other external coordinates are kept the same in all possible states of the system.
The thermodynamic variables of the grand canonical ensemble are chemical potential (symbol: µ) and absolute temperature (symbol: T). The ensemble is also dependent on mechanical variables such as volume (symbol: V) which influence the nature of the system's internal states. This ensemble is therefore sometimes called the µVT ensemble, as each of these three quantities are constants of the ensemble.
- 1 Basics
- 2 Applicability
- 3 Properties
- 4 Grand potential, ensemble averages, and exact differentials
- 5 Example ensembles
- 6 Meaning of chemical potential, generalized "particle number"
- 7 Precise expressions for the ensemble
- 8 Notes
- 9 References
In simple terms, the grand canonical ensemble assigns a probability P to each distinct microstate given by the following exponential:
where N is the number of particles in the microstate and E is the total energy of the microstate. k is Boltzmann's constant.
The number Ω is known as the grand potential and is constant for the ensemble. However, the probabilities and Ω will vary if different µ, V, T are selected. The grand potential Ω serves two roles: to provide a normalization factor for the probability distribution (the probabilities, over the complete set of microstates, must add up to one); and, many important ensemble averages can be directly calculated from the function Ω(µ, V, T).
In the case where more than one kind of particle is allowed to vary in number, the probability expression generalizes to
where µ1 is the chemical potential for the first kind of particles, N1 is the number of that kind of particle in the microstate, µ2 is the chemical potential for the second kind of particles and so on (s is the number of distinct kinds of particles). However, these particle numbers should be defined carefully (see the note on particle number conservation below).
Grand ensembles are apt for use when describing systems such as the electrons in a conductor, or the photons in a cavity, where the shape is fixed but the energy and number of particles can easily fluctuate due to contact with a reservoir (e.g., an electrical ground or a dark surface, in these cases). The grand canonical ensemble provides a natural setting for an exact derivation of the Fermi–Dirac statistics or Bose–Einstein statistics for a system of non-interacting quantum particles (see examples below).
- Note on formulation
- An alternative formulation for the same concept writes the probability as , using the grand partition function rather than the grand potential. The equations in this article (in terms of grand potential) may be restated in terms of the grand partition function by simple mathematical manipulations.
The grand canonical ensemble is the ensemble that describes the possible states of an isolated system that is in thermal and chemical equilibrium with a reservoir (the derivation proceeds along lines analogous to the heat bath derivation of the normal canonical ensemble, and can be found in Reif). The grand canonical ensemble applies to systems of any size, small or large; it is only necessary to assume that the reservoir with which it is in contact is much larger (i.e., to take the macroscopic limit).
The condition that the system is isolated is necessary in order to ensure it has well-defined thermodynamic quantities and evolution. In practice, however, it is desirable to apply the grand canonical ensemble to describe systems that are in direct contact with the reservoir, since it is that contact that ensures the equilibrium. The use of the grand canonical ensemble in these cases is usually justified either 1) by assuming that the contact is weak, or 2) by incorporating a part of the reservoir connection into the system under analysis, so that the connection's influence on the region of interest is correctly modeled. Alternatively, theoretical approaches can be used to model the influence of the connection, yielding an open statistical ensemble.
Another case in which the grand canonical ensemble appears is when considering a system that is large and thermodynamic (a system that is "in equilibrium with itself"). Even if the exact conditions of the system do not actually allow for variations in energy or particle number, the grand canonical ensemble can be used to simplify calculations of some thermodynamic properties. The reason for this is that various thermodynamic ensembles (microcanonical, canonical) become equivalent in some aspects to the grand canonical ensemble, once the system is very large.[note 1] Of course, for small systems, the different ensembles are no longer equivalent even in the mean. As a result, the grand canonical ensemble can be highly inaccurate when applied to small systems of fixed particle number, such as atomic nuclei.
- Uniqueness: The grand canonical ensemble is uniquely determined for a given system at given temperature and given chemical potentials, and does not depend on arbitrary choices such as choice of coordinate system (classical mechanics) or basis (quantum mechanics).
- Statistical equilibrium (steady state): A grand canonical ensemble does not evolve over time, despite the fact that the underlying system is in constant motion. Indeed, the ensemble is only a function of the conserved quantities of the system (energy and particle numbers).
- Thermal and chemical equilibrium with other systems: Two systems, each described by a grand canonical ensemble of equal temperature and chemical potentials, brought into thermal and chemical contact[note 2] will remain unchanged, and the resulting combined system will be described by a combined grand canonical ensemble of the same temperature and chemical potentials.
- Maximum entropy: For given mechanical parameters (fixed V), the grand canonical ensemble average of the log-probability −<log P> (also called the "entropy") is the maximum possible for any ensemble (i.e. probability distribution P) with the same <E>, <N1>, etc.
- Minimum grand potential: For given mechanical parameters (fixed V) and given values of T, µ1, …, µs, the ensemble average <E + kT log P − µ1N1 − … µsNs> is the lowest possible of any ensemble.
Grand potential, ensemble averages, and exact differentials
- the averages of numbers of particles
- the average pressure
- the Gibbs entropy
- and the average energy
Exact differential: From the above expressions, it can be seen that the function Ω has the exact differential
First law of thermodynamics: Substituting the above relationship for ⟨E⟩ into the exact differential of Ω, an equation similar to the first law of thermodynamics is found, except with average signs on some of the quantities:
The usefulness of the grand canonical ensemble is illustrated in the examples below. In each case the grand potential is calculated on the basis of the relationship
which is required for the microstates' probabilities to add up to 1.
Statistics of noninteracting particles
Bosons and fermions (quantum)
In the special case of a quantum system of many non-interacting particles, the thermodynamics are simple to compute. Since the particles are non-interacting, one can compute a series of single-particle stationary states, each of which represent a separable part that can be included into the total quantum state of the system. For now let us refer to these single-particle stationary states as orbitals (to avoid confusing these "states" with the total many-body state), with the provision that each possible internal particle property (spin or polarization) counts as a separate orbital. Each orbital may be occupied by a particle (or particles), or may be empty.
Since the particles are non-interacting, we may take the viewpoint that each orbital forms a separate thermodynamic system. Thus each orbital is a grand canonical ensemble unto itself, one so simple that its statistics can be immediately derived here. Focusing on just one orbital labelled i, the total energy for a microstate of N particles in this orbital will be Nϵi, where ϵi is the characteristic energy level of that orbital. The grand potential for the orbital is given by one of two forms, depending on whether the orbital is bosonic or fermionic:
- For fermions, the Pauli exclusion principle allows only two microstates for the orbital (occupation of 0 or 1), giving a two-term series
- For bosons, N may be any nonnegative integer and each value of N counts as one microstate due to the indistinguishability of particles, leading to a geometric series:
In each case the value gives the thermodynamic average number of particles on the orbital: the Fermi–Dirac distribution for fermions, and the Bose–Einstein distribution for bosons. Considering again the entire system, the total grand potential is found by adding up the Ωi for all orbitals.
Indistinguishable classical particles
In classical mechanics it is also possible to consider indistinguishable particles (in fact, indistinguishability is a prerequisite for defining a chemical potential in a consistent manner; all particles of a given kind must be interchangeable). We again consider placing multiple particles of the same kind into the same microstate of single-particle phase space, which we again call an "orbital". However, compared to quantum mechanics, the classical case is complicated by the fact that a microstate in classical mechanics does not refer to a single point in phase space but rather to an extended region in phase space: one microstate contains an infinite number of states, all distinct but of similar character. As a result, when multiple particles are placed into the same orbital, the overall collection of the particles (in the system phase space) does not count as one whole microstate but rather only a fraction of a microstate, because identical states (formed by permutation of identical particles) should not be overcounted. The overcounting correction factor is the factorial of the number of particles.
The statistics in this case take the form of an exponential power series
the value corresponding to Maxwell–Boltzmann statistics.
Ionization of an isolated atom
The grand canonical ensemble can be used to predict whether an atom prefers to be in a neutral state or ionized state. An atom is able to exist in ionized states with more or fewer electrons compared to neutral. As shown below, ionized states may be thermodynamically preferred depending on the environment. Consider a simplified model where the atom can be in a neutral state or in one of two ionized states (a detailed calculation also includes the degeneracy factors of the states):
- charge neutral state, with N0 electrons and energy E0.
- an oxidized state (N0 − 1 electrons) with energy E0 + ΔEI + qϕ
- a reduced state (N0 + 1 electrons) with energy E0 − ΔEA − qϕ
The grand potential in this case is thus determined by
The quantity −qϕ − µ is critical in this case, for determining the balance between the various states. This value is determined by the environment around the atom.
If one of these atoms is placed into a vacuum box, then −qϕ − µ = W, the work function of the box lining material. Comparing the tables of work function for various solid materials with the tables of electron affinity and ionization energy for atomic species, it is clear that many combinations would result in a neutral atom, however some specific combinations would result in the atom preferring an ionized state: e.g., a halogen atom in a ytterbium box, or a cesium atom in a tungsten box. At room temperature this situation is not stable since the atom tends to adsorb to the exposed lining of the box instead of floating freely. At high temperatures, however, the atoms are evaporated from the surface in ionic form; this spontaneous surface ionization effect has been used as a cesium ion source.
At room temperature, this example finds application in semiconductors, where the ionization of an dopant atom is well described by this ensemble. In the semiconductor, the conduction band edge ϵC plays the role of the vacuum energy level (replacing −qϕ), and µ is known as the Fermi level. Of course, the ionization energy and electron affinity of the dopant atom are strongly modified relative to their vacuum values. A typical donor dopant in silicon, phosphorus, has ΔEI = 45 meV; the value of ϵC − µ in the intrinsic silicon is initially about 600 meV, guaranteeing the ionization of the dopant. The value of ϵC − µ depends strongly on electrostatics, however, so under some circumstances it is possible to de-ionize the dopant.
Meaning of chemical potential, generalized "particle number"
In order for a particle number to have an associated chemical potential, it must be conserved during the internal dynamics of the system, and only able to change when the system exchanges particles with an external reservoir.
If the particles can be created out of energy during the dynamics of the system, then an associated µN term must not appear in the probability expression for the grand canonical ensemble. In effect, this is the same as requiring that µ = 0 for that kind of particle. Such is the case for photons in a black cavity, whose number regularly change due to absorption and emission on the cavity walls. (On the other hand, photons in a highly reflective cavity can be conserved and caused to have a nonzero µ.)
In some cases the number of particles is not conserved and the N represents a more abstract conserved quantity:
- Chemical reactions: Chemical reactions can convert one type of molecule to another; if reactions occur then the Ni must be defined such that they do not change during the chemical reaction.
- High energy particle physics: Ordinary particles can be spawned out of pure energy, if a corresponding antiparticle is created. If this sort of process is allowed, then neither the number of particles nor antiparticles are conserved. Instead, N = (particle number - antiparticle number) is conserved.[note 3] As particle energies increase, there are more possibilities to convert between particle types, and so there are fewer numbers that are truly conserved. At the very highest energies the only conserved numbers are electric charge, weak isospin, and baryon number − lepton number.
On the other hand, in some cases a single kind of particle may have multiple conserved numbers:
- Closed compartments: In a system composed of multiple compartments that share energy but do not share particles, it is possible to set the chemical potentials separately for each compartment. For example, a capacitor is composed of two isolated conductors and is charged by applying a difference in electron chemical potential.
- Slow equilibration: In some quasi-equilibrium situations it is possible to have two distinct populations of the same kind of particle in the same location, which are each equilibrated internally but not with each other. Though not strictly in equilibrium, it may be useful to name quasi-equilibrium chemical potentials which can differ among the different populations. Examples: (semiconductor physics) distinct quasi-Fermi levels (electron chemical potentials) in the conduction band and valence band; (spintronics) distinct spin-up and spin-down chemical potentials; (cryogenics) distinct parahydrogen and orthohydrogen chemical potentials.
Precise expressions for the ensemble
The precise mathematical expression for statistical ensembles has a distinct form depending on the type of mechanics under consideration (quantum or classical), as the notion of a "microstate" is considerably different. In quantum mechanics, the grand canonical ensemble affords a simple description since diagonalization provides a set of distinct microstates of a system, each with well-defined energy and particle number. The classical mechanical case is more complex as it involves not stationary states but instead an integral over canonical phase space.
where Ĥ is the system's total energy operator (Hamiltonian), N̂1 is the system's total particle number operator for particles of type 1, N̂2 is the total particle number operator for particles of type 2, and so on. exp is the matrix exponential operator. The grand potential Ω is determined by the probability normalization condition that the density matrix has a trace of one, :
Note that for the grand ensemble, the basis states of the operators Ĥ, N̂1, etc. are all states with multiple particles in Fock space, and the density matrix is defined on the same basis. Since the energy and particle numbers are all separately conserved, these operators are mutually commuting.
The grand canonical ensemble can alternatively be written in a simple form using bra–ket notation, since it is possible (given the mutually commuting nature of the energy and particle number operators) to find a complete basis of simultaneous eigenstates |ψi⟩, indexed by i, where Ĥ|ψi⟩ = Ei|ψi⟩, N̂1|ψi⟩ = N1,i|ψi⟩, and so on. Given such an eigenbasis, the grand canonical ensemble is simply
where the sum is over the complete set of states with state i having Ei total energy, N1,i particles of type 1, N2,i particles of type 2, and so on.
In classical mechanics, a grand ensemble is instead represented by a joint probability density function defined over multiple phase spaces of varying dimensions, ρ(N1, … Ns, p1, … pn, q1, … qn), where the p1, … pn and q1, … qn are the canonical coordinates (generalized momenta and generalized coordinates) of the system's internal degrees of freedom. The expression for the grand canonical ensemble is somewhat more delicate than the canonical ensemble since:
- The number of particles and thus the number of coordinates n varies between the different phase spaces, and,
- it is vital to consider whether permuting similar particles counts as a distinct state or not.
In a system of particles, the number of degrees of freedom n depends on the number of particles in a way that depends on the physical situation. For example, in a three-dimensional gas of monoatoms n = 3N, however in molecular gases there will also be rotational and vibrational degrees of freedom.
The probability density function for the grand canonical ensemble is:
- E is the energy of the system, a function of the phase (N1, … Ns, p1, … pn, q1, … qn),
- h is an arbitrary but predetermined constant with the units of energy×time, setting the extent of one microstate and providing correct dimensions to ρ.[note 4]
- C is an overcounting correction factor (see below), a function of N1, … Ns.
Again, the value of Ω is determined by demanding that ρ is a normalized probability density function:
This integral is taken over the entire available phase space for the given numbers of particles.
A well-known problem in the statistical mechanics of fluids (gases, liquids, plasmas) is how to treat particles that are similar or identical in nature: should they be regarded as distinguishable or not? In the system's equation of motion each particle is forever tracked as a distinguishable entity, and yet there are also valid states of the system where the positions of each particle have simply been swapped: these states are represented at different places in phase space, yet would seem to be equivalent.
If the permutations of similar particles are regarded to count as distinct states, then the factor C above is simply C = 1. From this point of view, ensembles include every permuted state as a separate microstate. Although appearing benign at first, this leads to a problem of severely non-extensive entropy in the canonical ensemble, known today as the Gibbs paradox. In the grand canonical ensemble a further logical inconsistency occurs: the number of distinguishable permutations depends not only on how many particles are in the system, but also on how many particles are in the reservoir (since the system may exchange particles with a reservoir). In this case the entropy and chemical potential are non-extensive but also badly defined, depending on a parameter (reservoir size) that should be irrelevant.
To solve these issues it is necessary that the exchange of two similar particles (within the system, or between the system and reservoir) must not be regarded as giving a distinct state of the system.[note 5] In order to incorporate this fact, integrals are still carried over full phase space but the result is divided by
which is the number of different permutations possible. The division by C neatly corrects the overcounting that occurs in the integral over all phase space.
It is of course possible to include distinguishable types of particles in the grand canonical ensemble—each distinguishable type is tracked by a separate particle counter and chemical potential . As a result, the only consistent way to include "fully distinguishable" particles in the grand canonical ensemble is to consider every possible distinguishable type of those particles, and to track each and every possible type with a separate particle counter and separate chemical potential.
- To quote Reif, "For purposes of calculating mean values of physical quantities, it makes no noticeable difference whether a macroscopic system is isolated, or in contact with a reservoir with which it can only exchange energy, or in contact with a reservoir with which it can exchange both energy and particles. [...] In some problems where the constraint of a fixed number of particles is cumbersome, one can thus readily circumvent the complication by approximating the actual situation with [...] the grand canonical distribution."
- Thermal and chemical contact means that the systems are able to exchange energy and particles through a connection. The connection must be weak as to not significantly disturb the systems' microstates.
- Of course, very high temperatures are required for significant thermal generation of particle-antiparticle pairs, e.g., of order 109 K for electron-positron creation, and so this process is not a concern for everyday thermodynamics.
- (Historical note) Gibbs' original ensemble effectively set h = 1 [energy unit]×[time unit], leading to unit-dependence in the values of some thermodynamic quantities like entropy and chemical potential. Since the advent of quantum mechanics, h is often taken to be equal to Planck's constant in order to obtain a semiclassical correspondence with quantum mechanics.
- This can be compared to the canonical ensemble where it is optional to consider particles as distinguishable; this only gives N-dependent error in entropy, which is unobservable as long as N is kept constant. In general, however, there is no such freedom: "when the number of particles in a system is to be treated as variable, the average index of probability for phases generically defined corresponds to entropy." (Gibbs).
- Gibbs, Josiah Willard (1902). Elementary Principles in Statistical Mechanics. New York: Charles Scribner's Sons.
- Reif, F. (1965). Fundamentals of Statistical and Thermal Physics. McGraw–Hill. ISBN 9780070518001.
- Chaudhuri, G.; Gupta, S. (2007). "Specific heat and bimodality in canonical and grand canonical versions of the thermodynamic model". Physical Review C. 76. arXiv:0704.0288. Bibcode:2007PhRvC..76a4619C. doi:10.1103/PhysRevC.76.014619.
- "Archived copy" (PDF). Archived from the original (PDF) on 2013-10-19. Retrieved 2013-05-02.
- Srivastava, R. K.; Ashok, J. (2005). Statistical Mechanics. New Delhi: PHI Learning Pvt. Ltd. ISBN 9788120327825.
- Balkanski, M.; Wallis, R.F. (2000). Semiconductor Physics and Applications. Oxford University Press. ISBN 0198517408.
- Alton, G. D. (1988). "Characterization of a cesium surface ionization source with a porous tungsten ionizer. I" (PDF). Review of Scientific Instruments. 59 (7): 1039. Bibcode:1988RScI...59.1039A. doi:10.1063/1.1139776.
- Ciuti, C. (2014). "Statistical flickers in a Bose-Einstein Condensate of Photons". Physics. 7. Bibcode:2014PhyOJ...7....7C. doi:10.1103/Physics.7.7.