Gibbs entropy

In thermodynamics, specifically in statistical mechanics, the Gibbs entropy formula is the standard formula for calculating the statistical mechanical entropy of a thermodynamic system,

:$S\; =\; -k\_\; ext\{B\}\; sum\_i\; p\_i\; ln\; p\_i\; ,$ (1)

where "k"_B is the Boltzmann constant, "p"_"i" is the probability of the "i"-th state and the summation is taken over the possible states of the system as a whole (typically a 6"N"-dimensional space, if the system contains "N" separate particles). An overestimation of entropy will occur if all correlations, and more generally if statistical dependence between the state probabilities are ignored. These correlations occur in systems of interacting particles, that is, in all systems more complex than an ideal gas.

The Shannon entropy formula is mathematically and conceptually equivalent to equation (1); the factor of $k\_B$ out front reflects two facts: our choice of base for the logarithm, [http://www.av8n.com/physics/thermo-laws.htm "The Laws of Thermodynamics"] including careful definitions of energy, entropy, et cetera.] and our use of an arbitrary temperature scale with water as a reference substance.

The importance of this formula is discussed at much greater length in the main article "Entropy (thermodynamics)".

This "S" is almost universally called simply the "entropy". It can also be called the "statistical entropy" or the "thermodynamic entropy" withoutchanging the meaning. The Von Neumann entropy formula is a slightly more general wayof calculating the same thing. The Boltzmann entropy formula canbe seen as a corollary of equation (1), valid under certain restrictive conditions of no statistical dependence between the states. [Jaynes, E. T. (1965). [http://bayes.wustl.edu/etj/articles/gibbs.vs.boltzmann.pdf Gibbs vs Boltzmann entropies] . "American Journal of Physics", 33, 391-8.]

= See also =

* J. Willard Gibbs
* Entropy (thermodynamics)"
* Von Neumann entropy formula
* Boltzmann entropy formula
* Shannon entropy formula

= References =