Donsker's theorem

Donsker's theorem

In probability theory, Donsker's theorem, named after M. D. Donsker, identifies a certain stochastic process as a limit of empirical processes. It is sometimes called the functional central limit theorem.

A centered and scaled version of empirical distribution function Fn defines an empirical process

 G_n(x)= \sqrt n ( F_n(x) - F(x) ) \,

indexed by x ∈ R.

Theorem (Donsker, Skorokhod, Kolmogorov) The sequence of Gn(x), as random elements of the Skorokhod space \mathcal{D}(-\infty,\infty), converges in distribution to a Gaussian process G with zero mean and covariance given by

\operatorname{cov}[G(s), G(t)] = E[G(s)G(t)] = F(\min\{s, t\}) - F(s)F(t). \,

The process G(x) can be written as B(F(x)) where B is a standard Brownian bridge on the unit interval.

History

By the classical central limit theorem, for fixed x, the random variable Gn(x) converges in distribution to a Gaussian (normal) random variable G(x) with zero mean and variance F(x)(1 − F(x)) as the sample size n grows.

Kolmogorov (1933) showed that when F is continuous, the supremum \scriptstyle\sup_t G_n(t) and supremum of absolute value, \scriptstyle\sup_t |G_n(t)| converges in distribution to the laws of the same functionals of the Brownian bridge B(t), see the Kolmogorov–Smirnov test. In 1949 Doob asked whether the convergence in distribution held for more general functionals, thus formulating a problem of weak convergence of random functions in a suitable function space.[1]

In 1952 Donsker stated and proved (not quite correctly)[2] a general extension for the Doob-Kolmogorov heuristic approach. In the original paper, Donsker proved that the convergence in law of Gn to the Brownian bridge holds for Uniform[0,1] distributions with respect to uniform convergence in t over the interval [0,1].[3]

However Donsker's formulation was not quite correct because of the problem of measurability of the functionals of discontinuous processes. In 1956 Skorokhod and Kolmogorov defined a separable metric d, called the Skorokhod metric, on the space of cadlag functions on [0,1], such that convergence for d to a continuous function is equivalent to convergence for the sup norm, and showed that Gn converges in law in \mathcal{D}[0,1] to the Brownian bridge.

Later Dudley reformulated Donsker's result to avoid the problem of measurability and the need of the Skorokhod metric. One can prove[2] that there exist Xi, iid uniform in [0,1] and a sequence of sample-continuous Brownian bridges Bn, such that

\|G_n-B_n\|_\infty

is measurable and converges in probability to 0. An improved version of this result, providing more detail on the rate of convergence, is the Komlós–Major–Tusnády approximation.

See also

  • Glivenko–Cantelli theorem
  • Kolmogorov–Smirnov test

References

  1. ^ Doob, J.L. (1949). "Heuristic approach to the Kolmogorov–Smirnov theorems". Annals of Mathematical Statistics 20: 393–403. doi:10.1214/aoms/1177729991. MR30732. Zbl 0035.08901. 
  2. ^ a b Dudley, R.M. (1999). Uniform Central Limit Theorems. Cambridge University Press. ISBN 0 521 46102 2. 
  3. ^ Donsker, M.D. (1952). "Justification and extension of Doob's heuristic approach to the Kolmogorov–Smirnov theorems". Annals of Mathematical Statistics 23: 277–281. doi:10.1214/aoms/1177729445. MR47288. Zbl 0046.35103. 

Wikimedia Foundation. 2010.

Игры ⚽ Поможем решить контрольную работу

Look at other dictionaries:

  • Glivenko-Cantelli theorem — In the theory of probability, the Glivenko Cantelli theorem determines the asymptotic behaviour of the empirical distribution function as the number of iid observations grows. This uniform convergence of more general empirical measures becomes an …   Wikipedia

  • Empirical process — The study of empirical processes is a branch of mathematical statistics and a sub area of probability theory. It is a generalization of the central limit theorem for empirical measures. DefinitionIt is known that under certain conditions… …   Wikipedia

  • Brownian motion — This article is about the physical phenomenon; for the stochastic process, see Wiener process. For the sports team, see Brownian Motion (Ultimate). For the mobility model, see Random walk. Brownian motion (named after the botanist Robert Brown)… …   Wikipedia

  • List of theorems — This is a list of theorems, by Wikipedia page. See also *list of fundamental theorems *list of lemmas *list of conjectures *list of inequalities *list of mathematical proofs *list of misnamed theorems *Existence theorem *Classification of finite… …   Wikipedia

  • List of mathematics articles (D) — NOTOC D D distribution D module D D Agostino s K squared test D Alembert Euler condition D Alembert operator D Alembert s formula D Alembert s paradox D Alembert s principle Dagger category Dagger compact category Dagger symmetric monoidal… …   Wikipedia

  • List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… …   Wikipedia

  • Empirical distribution function — In statistics, an empirical distribution function is a cumulative probability distribution function that concentrates probability 1/ n at each of the n numbers in a sample.Let X 1,ldots,X n be iid random variables in mathbb{R} with the cdf F ( x… …   Wikipedia

  • Wiener process — In mathematics, the Wiener process is a continuous time stochastic process named in honor of Norbert Wiener. It is often called Brownian motion, after Robert Brown. It is one of the best known Lévy processes (càdlàg stochastic processes with… …   Wikipedia

  • Brownian bridge — A Brownian bridge is a continuous time stochastic process whose probability distribution is the conditional probability distribution of a Wiener process B ( t ) (a mathematical model of Brownian motion) given the condition that B (0) = B (1) = 0 …   Wikipedia

  • Броуновский мост — это частный случай случайного блуждания с непрерывным временем (винеровского процесса) B(t), когда начальная и конечная точки совпадают: B(0) = B(1) = 0. Стандартный винеровский процесс привязан в начальной точке W(0) = 0, но имеет свободный… …   Википедия

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”