Dyadic distribution

Dyadic distribution

A dyadic distribution is a specific type of discrete or categorical probability distribution that is of some theoretical importance in data compression.

Definition

A dyadic distribution on the nonnegative integers 0, 1, 2, ... is a probability distribution whose probability mass function is

f(u) = 2^{-n_u},\quad u \in U

where nu is some (positive) integer. More generally it is a categorical distribution in which the probability assigned to any label is of the above form

It is possible to find a code defined on this distribution, which has an average code length that is equal to the entropy.[citation needed]

References

  • Cover, T.M., Joy A. Thomas, J.A. (2006) Elements of information theory, Wiley. ISBN 0471241954

Wikimedia Foundation. 2010.

Игры ⚽ Нужна курсовая?

Look at other dictionaries:

  • Data compression — Source coding redirects here. For the term in computer programming, see Source code. In computer science and information theory, data compression, source coding or bit rate reduction is the process of encoding information using fewer bits than… …   Wikipedia

  • List of mathematics articles (D) — NOTOC D D distribution D module D D Agostino s K squared test D Alembert Euler condition D Alembert operator D Alembert s formula D Alembert s paradox D Alembert s principle Dagger category Dagger compact category Dagger symmetric monoidal… …   Wikipedia

  • formal logic — the branch of logic concerned exclusively with the principles of deductive reasoning and with the form rather than the content of propositions. [1855 60] * * * Introduction       the abstract study of propositions, statements, or assertively used …   Universalium

  • Hardy space — In complex analysis, the Hardy spaces (or Hardy classes) Hp are certain spaces of holomorphic functions on the unit disk or upper half plane. They were introduced by Frigyes Riesz (Riesz 1923), who named them after G. H. Hardy, because of the… …   Wikipedia

  • Democratic peace theory — (or liberal democratic theory[1] or simply the democratic peace ) is the theory that democracies, for some appropriate definition of democracy, rarely, or even never, go to war with one another. Some have preferred the term inter democracy… …   Wikipedia

  • Self-similarity — NOTOC [ thumb|right|250px|A Koch curve has an infinitely repeating self similarity when it is magnified.] In mathematics, a self similar object is exactly or approximately similar to a part of itself (i.e. the whole has the same shape as one or… …   Wikipedia

  • Dirac delta function — Schematic representation of the Dirac delta function by a line surmounted by an arrow. The height of the arrow is usually used to specify the value of any multiplicative constant, which will give the area under the function. The other convention… …   Wikipedia

  • Charles Sanders Peirce —  B …   Wikipedia

  • Electric field integral equation — The electric field integral equation is a relationship that allows one to calculate the electric field intensity E generated by an electric current distribution J .DerivationWe consider all quantities in the frequency domain, and so assume a time …   Wikipedia

  • Liste der Dateiendungen/D — In dieser Liste sind übliche Dateinamenserweiterungen aufgelistet, die in einigen Betriebssystemen (wie zum Beispiel Microsoft Windows) zur Unterscheidung von Dateiformaten verwendet werden. In anderen Betriebssystemen erfolgt die… …   Deutsch Wikipedia

Share the article and excerpts

Direct link
… Do a right-click on the link above
and select “Copy Link”