- Entropy (statistical thermodynamics)
In

thermodynamics ,**statistical entropy**is the modeling of the energetic functionentropy usingprobability theory . The statistical entropy perspective was introduced in 1870 with the work of the Austrian physicistLudwig Boltzmann .**Mathematical definition**The macroscopic state of the system is defined by a distribution on the microstates that are accessible to a system in the course of its thermal fluctuations. So the entropy is defined over two different levels of description of the given system. For a quantum system with a discrete set of microstates, if $E\_i$ is the energy of microstate "i", and $p\_i$ is its probability that it occurs during the system's fluctuations, then the entropy of the system is

: $S\; =\; -k\_B,sum\_i\; p\_i\; ln\; ,p\_i$

**Entropy changes for systems in a canonical state**A system with a well-defined temperature, i.e., one in thermal equilibrium with a thermal reservoir, has a probability of being in a microstate "i" given by

Boltzmann's distribution .Changes in the entropy caused by changes in the external constraints are then given by::$dS\; =\; -k\_B,sum\_i\; dp\_i\; ln\; p\_i$:$,,,\; =\; -k\_B,sum\_i\; dp\_i\; (-E\_i/k\_BT\; -ln\; Z)$:$,,,\; =\; sum\_i\; E\_i\; dp\_i\; /\; T$:$,,,\; =\; sum\_i\; [d\; (E\_i\; p\_i)\; -\; (dE\_i)\; p\_i]\; /\; T$

where we have twice used the conservation of probability, "∑ dp

_{i}=0" .Now, "∑

_{i}d (E_{i}p_{i})" is the expectation value of the change in the total energy of the system.If the changes are sufficiently slow, so that the system remains in the same microscopic state, but the state slowly (and reversibly) changes, then "∑

_{i}(dE_{i}) p_{i}" is the expectation value of the work done on the system through this reversible process, "dw_{rev}".But from the first law of thermodynamics, "δE = δw +δq". Therefore,:$dS\; =\; frac\{deltalangle\; q\_\{rev\}\; angle\}\{T\}$

In the

thermodynamic limit , the fluctuation of the macroscopic quantities from their average values becomes negligible; so this reproduces the definition of entropy from classical thermodynamics, given above.The quantity $k\_B$ is a

physical constant known as Boltzmann's constant, which, like the entropy, has units ofheat capacity . Thelogarithm is dimensionless.This definition is valid including far away from equilibrium. Other definitions assume that the system is in

thermal equilibrium , either as anisolated system , or as a system in exchange with its surroundings. The set of microstates on which the sum is to be done is called astatistical ensemble . Eachstatistical ensemble (micro-canonical, canonical, grand-canonical, etc.) describes a different configuration of the system's exchanges with the outside, from anisolated system to a system that can exchange one more quantity with a reservoir, like energy, volume or molecules. In every ensemble, the equilibrium configuration of the system is dictated by the maximization of the entropy of the union of the system and its reservoir, according to thesecond law of thermodynamics (see thestatistical mechanics article).Note the above expression of the statistical entropy is a discretized version of

Shannon entropy .**Boltzmann's principle**In Boltzmann's definition, entropy is a measure of the number of possible microscopic states (or

**microstates**) of a system inthermodynamic equilibrium , consistent with its macroscopic thermodynamic properties (or**macrostate**). To understand what microstates and macrostates are, consider the example of agas in a container. At a microscopic level, the gas consists of a vast number of freely movingatom s, which occasionally collide with one another and with the walls of the container. The microstate of the system is a description of theposition s and momenta of all the atoms. In principle, all the physical properties of the system are determined by its microstate. However, because the number of atoms is so large, the motion of individual atoms is mostly irrelevant to the behavior of the system as a whole. Provided the system is in thermodynamic equilibrium, the system can be adequately described by a handful of macroscopic quantities, called "thermodynamic variables": the totalenergy "E",volume "V",pressure "P",temperature "T", and so forth. The macrostate of the system is a description of its thermodynamic variables.There are three important points to note. Firstly, to specify any one microstate, we need to write down an impractically long list of numbers, whereas specifying a macrostate requires only a few numbers ("E", "V", etc.). However, and this is the second point, the usual

thermodynamic equations only describe the macrostate of a system adequately when this system is in equilibrium; non-equilibrium situations can generally "not" be described by a small number of variables. For example, if a gas is sloshing around in its container, even a macroscopic description would have to include, e.g., the velocity of the fluid at each different point. Actually, the macroscopic state of the system will be described by a small number of variables only if the system is at globalthermodynamic equilibrium . Thirdly, more than one microstate can correspond to a single macrostate. In fact, for any given macrostate, there will be a huge number of microstates that are consistent with the given values of "E", "V", etc.We are now ready to provide a definition of entropy. The entropy "S" is defined as

:$S\; =\; k\_B\; ln\; Omega\; !$where:"k

_{B}" is Boltzmann's constant and:"$Omega\; !$" is the number of microstates consistent with the given macrostate.The statistical entropy reduces to Boltzman's entropy when all the accessible microstates of the system are equally likely. It is also the configuration corresponding to the maximum of a system's entropy for a given set of accessible microstates, in other words the macroscopic configuration in which the lack of information is maximal. As such, according to the

second law of thermodynamics , it is the equilibrium configuration of anisolated system. Boltzman's entropy is the expression of entropy at thermodynamic equilibrium in the micro-canonical ensemble.This postulate, which is known as Boltzmann's principle, may be regarded as the foundation of

statistical mechanics , which describes thermodynamic systems using the statistical behaviour of its constituents. It turns out that "S" is itself a thermodynamic property, just like "E" or "V". Therefore, it acts as a link between the microscopic world and the macroscopic. One important property of "S" follows readily from the definition: since "Ω" is anatural number (1,2,3,...), "S" is either "zero" or "positive" (this is a property of thelogarithm .)**Lack of knowledge and the second law of thermodynamics**We can view "Ω" as a measure of our lack of knowledge about a system. As an illustration of this idea, consider a set of 100

coin s, each of which is either heads up or tails up. The macrostates are specified by the total number of heads and tails, whereas the microstates are specified by the facings of each individual coin. For the macrostates of 100 heads or 100 tails, there is exactly one possible configuration, so our knowledge of the system is complete. At the opposite extreme, the macrostate which gives us the least knowledge about the system consists of 50 heads and 50 tails in any order, for which there are 100,891,344,545,564,193,334,812,497,256 (100 choose 50) ≈ 10^{29}possible microstates.Even when a system is entirely isolated from external influences, its microstate is constantly changing. For instance, the particles in a gas are constantly moving, and thus occupy a different position at each moment of time; their momenta are also constantly changing as they collide with each other or with the container walls. Suppose we prepare the system in an artificially highly-ordered equilibrium state. For instance, imagine dividing a container with a partition and placing a gas on one side of the partition, with a vacuum on the other side. If we remove the partition and watch the subsequent behavior of the gas, we will find that its microstate evolves according to some chaotic and unpredictable pattern, and that on average these microstates will correspond to a more disordered macrostate than before. It is "possible", but "extremely unlikely", for the gas molecules to bounce off one another in such a way that they remain in one half of the container. It is overwhelmingly probable for the gas to spread out to fill the container evenly, which is the new equilibrium macrostate of the system.

This is an example illustrating the Second Law of Thermodynamics:

:"the total entropy of any isolated thermodynamic system tends to increase over time, approaching a maximum value".

Since its discovery, this idea has been the focus of a great deal of thought, some of it confused. A chief point of confusion is the fact that the Second Law applies only to "isolated" systems. For example, the

Earth is not an isolated system because it is constantly receiving energy in the form ofsunlight . In contrast, theuniverse may be considered an isolated system, so that its total disorder is constantly increasing.**Counting of microstates**In classical statistical mechanics, the number of microstates is actually uncountably infinite, since the properties of classical systems are continuous. For example, a microstate of a classical ideal gas is specified by the positions and momenta of all the atoms, which range continuously over the

real number s. If we want to define "Ω", we have to come up with a method of grouping the microstates together to obtain a countable set. This procedure is known ascoarse graining . In the case of the ideal gas, we count two states of an atom as the "same" state if their positions and momenta are within "δx" and "δp" of each other. Since the values of "δx" and "δp" can be chosen arbitrarily, the entropy is not uniquely defined. It is defined only up to an additive constant. (As we will see, the thermodynamic definition of entropy is also defined only up to a constant.)This ambiguity can be resolved with

quantum mechanics . Thequantum state of a system can be expressed as a superposition of "basis" states, which can be chosen to be energyeigenstate s (i.e. eigenstates of the quantum Hamiltonian.) Usually, the quantum states are discrete, even though there may be an infinite number of them. For a system with some specified energy E, one takes Ω to be the number of energy eigenstates within a macroscopically small energy range between E and E + δE. In the thermodynamical limit, the specific entropy becomes independent on the choice of δE.An important result, known as

Nernst's theorem or thethird law of thermodynamics , states that the entropy of a system at zero absolute temperature is a well-defined constant. This is because a system at zero temperature exists in its lowest-energy state, orground state , so that its entropy is determined by the degeneracy of the ground state. Many systems, such as crystal lattices, have a unique ground state, and (since ln(1) = 0) this means that they have zero entropy at absolute zero. Other systems have more than one state with the same, lowest energy, and have a non-vanishing "zero-point entropy". For instance, ordinaryice has a zero-point entropy of 3.41 J/(mol·K), because its underlyingcrystal structure possesses multiple configurations with the same energy (a phenomenon known asgeometrical frustration ).The third law of thermodynamics states that the entropy of a perfect crystal at absolute zero or 0

kelvin s is zero. This means that in a perfect crystal, at 0 kelvins, nearly all molecular motion should cease in order to achieve ΔS=0. A perfect crystal is one in which the internal lattice structure is the same at all times; in other words, it is fixed and non-moving, and does not have rotational or vibrational energy. This means that there is only one way in which this order can be attained: when every particle of the structure is in its proper place.However, the equation for predicting quantized vibrational levels shows that even when the vibrational quantum number is 0, the molecule still has vibrational energy. This means that no matter how cold the temperature gets, the molecule will always have vibration. This is in keeping with the Heisenberg uncertainty principle, which states that both the position and the momentum of a particle cannot be known precisely, at a given time:

:$E\; u=h\; u\_0(v+egin\{matrix\}\; frac\{1\}\{2\}\; end\{matrix\}),$

where $h$ is Planck's constant, $u\_0$ is the characteristic frequency of the vibration, and $v$ is the vibrational quantum number. Note that even when $v=0$ (the

zero-point energy ), $E\; u$ does not equal 0.Since all molecules will have some vibrational energy at all times, the entropy of such a molecule will not be 0. However, the third law of thermodynamics requires the entropy of a perfect crystal to be 0, at absolute zero. Therefore, it can be inferred that absolute zero is not attainable, since a perfect crystal configuration cannot be achieved.Fact|date=June 2008

**References**Boltzmann, Ludwig (1896, 1898). Vorlesungen über Gastheorie : 2 Volumes - Leipzig 1895/98 UB: O 5262-6. English version: Lectures on gas theory. Translated by Stephen G. Brush (1964) Berkeley: University of California Press; (1995) New York: Dover ISBN 0-486-68455-5

**See also***

Entropy

*Enthalpy

*Thermodynamic free energy

*History of entropy

*Entropy (classical thermodynamics)

*Information theory

*Wikimedia Foundation.
2010.*