Information source (mathematics)
- Information source (mathematics)
In mathematics, an information source is a sequence of random variables ranging over a finite alphabet Γ, having a stationary distribution.
The uncertainty, or entropy rate, of an information source is defined as
:
where
:
is the sequence of random variables defining the information source, and
:
is the conditional information entropy of the sequence of random variables. Equivalently, one has
:
ee also
* Markov information source
References
* Robert B. Ash, "Information Theory", (1965) Dover Publications. ISBN 0-486-66521-6
Wikimedia Foundation.
2010.
Look at other dictionaries:
Information source — * In mathematics, see the article Information source (mathematics) . Source means the origin of something. An information source is a source of information for somebody, i.e. anything that might inform a person about something or provide… … Wikipedia
Markov information source — In mathematics, a Markov information source, or simply, a Markov source, is an information source whose underlying dynamics are given by a stationary finite Markov chain. Contents 1 Formal definition 2 Applications 3 See also … Wikipedia
List of mathematics articles (I) — NOTOC Ia IA automorphism ICER Icosagon Icosahedral 120 cell Icosahedral prism Icosahedral symmetry Icosahedron Icosian Calculus Icosian game Icosidodecadodecahedron Icosidodecahedron Icositetrachoric honeycomb Icositruncated dodecadodecahedron… … Wikipedia
Information forensics — is the science of investigation into systemic processes that produce information. Systemic processes utilize primarily computing and communication technologies to capture, treat, store and transmit data. Manual processes complement technology… … Wikipedia
Mathematics and Physical Sciences — ▪ 2003 Introduction Mathematics Mathematics in 2002 was marked by two discoveries in number theory. The first may have practical implications; the second satisfied a 150 year old curiosity. Computer scientist Manindra Agrawal of the… … Universalium
Information theory — Not to be confused with Information science. Information theory is a branch of applied mathematics and electrical engineering involving the quantification of information. Information theory was developed by Claude E. Shannon to find fundamental… … Wikipedia
mathematics — /math euh mat iks/, n. 1. (used with a sing. v.) the systematic treatment of magnitude, relationships between figures and forms, and relations between quantities expressed symbolically. 2. (used with a sing. or pl. v.) mathematical procedures,… … Universalium
MATHEMATICS — Bible The Bible does not deal directly with proper mathematical subjects; however there are some parts that do relate indirectly to different mathematical topics. These are widely discussed by the various commentators on the Bible and Talmud: the … Encyclopedia of Judaism
information theory — the mathematical theory concerned with the content, transmission, storage, and retrieval of information, usually in the form of messages or data, and esp. by means of computers. [1945 50] * * * ▪ mathematics Introduction a mathematical… … Universalium
Chinese mathematics — Mathematics in China emerged independently by the 11th century BC.[1] The Chinese independently developed very large and negative numbers, decimals, a place value decimal system, a binary system, algebra, geometry, and trigonometry. Many[who?]… … Wikipedia
