Sufficient statistic

Sufficient statistic

In statistics, a sufficient statistic is a statistic which has the property of sufficiency with respect to a statistical model and its associated unknown parameter, meaning that "no other statistic which can be calculated from the same sample provides any additional information as to the value of the parameter".[1] A statistic is sufficient for a family of probability distributions if the sample from which it is calculated gives no additional information than does the statistic, as to which of those probability distributions is that of the population from which the sample was taken.

In practical terms, given a set  \mathbf{X} of independent identically distributed data conditioned on an unknown parameter θ, a sufficient statistic is a function T(\mathbf{X}) whose value contains all the information needed to compute any estimate of the parameter (e.g. a maximum likelihood estimate). Due to the factorization theorem (see below), for a sufficient statistic T(\mathbf{X}), the joint distribution can be written as p(\mathbf{X}) = h(\mathbf{X}) \, g(\theta, T(\mathbf{X}))\,. From this factorization, it can easily be seen that the maximum likelihood estimate of θ will interact with \mathbf{X} only through T(\mathbf{X}). Typically, the sufficient statistic is a simple function of the data, e.g. the sum of all the data points.

More generally, the "unknown parameter" may represent a vector of unknown quantities or may represent everything about the model that is unknown or not fully specified. In such a case, the sufficient statistic may be a set of functions, called a jointly sufficient statistic. Typically, there are as many functions as there are parameters. For example, for a Gaussian distribution with unknown mean and variance, the jointly sufficient statistic, from which maximum likelihood estimates of both parameters can be estimated, consists of two functions, the sum of all data points and the sum of all squared data points (or equivalently, the sample mean and sample variance).

The concept, due to Sir Ronald Fisher, is equivalent to the statement that, conditional on the value of a sufficient statistic for a parameter, the joint probability distribution of the data does not depend on that parameter. Both the statistic and the underlying parameter can be vectors.

A related concept is that of linear sufficiency, which is weaker than sufficiency but can be applied in some cases where there is no sufficient statistic, although it is restricted to linear estimators.[2]

The concept of sufficiency has fallen out of favor in descriptive statistics because of the strong dependence on an assumption of the distributional form (see Pitman–Koopman–Darmois theorem below), but remains very important in theoretical work.[3]

Contents

Mathematical definition

A statistic T(X) is sufficient for underlying parameter θ precisely if the conditional probability distribution of the data X, given the statistic T(X), does not depend on the parameter θ,[4] i.e.

\Pr(X=x|T(X)=t,\theta) = \Pr(X=x|T(X)=t), \,

or in shorthand

\Pr(x|t,\theta) = \Pr(x|t).\,

Example

As an example, the sample mean is sufficient for the mean (μ) of a normal distribution with known variance. Once the sample mean is known, no further information about μ can be obtained from the sample itself. On the other hand, the median is not sufficient for the mean: even if the median of the sample is known, knowing the sample itself would provide further information about the population mean. For example, if the observations that are less than the median are only slightly less, but observations exceeding the median exceed it by a large amount, then this would have a bearing on one's inference about the population mean.

Fisher–Neyman factorization theorem

Fisher's factorization theorem or factorization criterion provides a convenient characterization of a sufficient statistic. If the probability density function is ƒθ(x), then T is sufficient for θ if and only if functions g and h can be found such that

 f_\theta(x)=h(x) \, g_\theta(T(x)), \,\!

i.e. the density ƒ can be factored into a product such that one factor, h, does not depend on θ and the other factor, which does depend on θ, depends on x only through T(x).

Likelihood principle interpretation

An implication of the theorem is that when using likelihood-based inference, two sets of data yielding the same value for the sufficient statistic T(X) will always yield the same inferences about θ. By the factorization criterion, the likelihood's dependence on θ is only in conjunction with T(X). As this is the same in both cases, the dependence on θ will be the same as well, leading to identical inferences.

Proof

Due to Hogg and Craig.[5] Let X_1, X_2, \ldots, X_n, denote a random sample from a distribution having the pdf f(xθ) for γ < θ < δ. Let Y = u(X1X2, ..., Xn) be a statistic whose pdf is g(yθ). Then Y = u(X1, X2, ..., Xn) is a sufficient statistic for θ if and only if, for some function H,

 \prod_{i=1}^n f(x_i; \theta) = g \left[u(x_1, x_2, \dots, x_n); \theta \right] H(x_1, x_2, \dots, x_n). \,

First, suppose that

 \prod_{i=1}^n f(x_i; \theta) = g \left[u(x_1, x_2, \dots, x_n); \theta \right] H(x_1, x_2, \dots, x_n). \,

We shall make the transformation yi = ui(x1x2, ..., xn), for i = 1, ..., n, having inverse functions xi = wi(y1y2, ..., yn), for i = 1, ..., n, and Jacobian  J = \left[w_i/y_j \right] . Thus,


 \prod_{i=1}^n f \left[ w_i(y_1, y_2, \dots, y_n); \theta \right]  = 
 |J| g(y; \theta) H \left[ w_1(y_1, y_2, \dots, y_n), \dots, w_n(y_1, y_2, \dots, y_n) \right].

The left-hand member is the joint pdf g(y1, y2, ..., yn; θ) of Y1 = u1(X1, ..., Xn), ..., Yn = un(X1, ..., Xn). In the right-hand member, g(y_1,\dots,y_n;\theta) is the pdf of Y1, so that H[ w_1, \dots , w_n] |J| is the quotient of g(y_1,\dots,y_n;\theta) and g1(y1;θ); that is, it is the conditional pdf h(y_2, \dots, y_n | y_1; \theta) of Y_2,\dots,Y_n given Y1 = y1.

But H(x_1,x_2,\dots,x_n), and thus H\left[w_1(y_1,\dots,y_n), \dots, w_n(y_1, \dots, y_n))\right], was given not to depend upon θ. Since θ was not introduced in the transformation and accordingly not in the Jacobian J, it follows that h(y_2, \dots, y_n | y_1; \theta) does not depend upon θ and that Y1 is a sufficient statistics for θ.

The converse is proven by taking:

g(y_1,\dots,y_n;\theta)=g_1(y_1; \theta) h(y_2, \dots, y_n | y_1),\,

where h(y_2, \dots, y_n | y_1) does not depend upon θ because Y2...Yn depend only upon X1...Xn which are independent on Θ when conditioned by Y1, a sufficient statistics by hypothesis. Now divide both members by the absolute value of the non-vanishing Jacobian J, and replace y_1, \dots, y_n by the functions u_1(x_1, \dots, x_n), \dots, u_n(x_1,\dots, x_n) in x_1,\dots, x_n. This yields

\frac{g\left[ u_1(x_1, \dots, x_n), \dots, u_n(x_1, \dots, x_n); \theta \right]}{|J*|}=g_1\left[u_1(x_1,\dots,x_n); \theta\right] \frac{h(u_2, \dots, u_n | u_1)}{|J*|}

where J * is the Jacobian with y_1,\dots,y_n replaced by their value in terms x_1, \dots, x_n. The left-hand member is necessarily the joint pdf f(x_1;\theta)\cdots f(x_n;\theta) of X_1,\dots,X_n. Since h(y_2,\dots,y_n|y_1), and thus h(u_2,\dots,u_n|u_1), does not depend upon θ, then

H(x_1,\dots,x_2)=\frac{h(u_2,\dots,u_n|u_1)}{|J*|}

is a function that does not depend upon θ.

Another Proof
A simpler more illustrative proof is as follows, although it applies only in the discrete case.

We use the shorthand notation to denote the joint probability of (X,T(X)) by fθ(x,t). Since T is a function of X, we have fθ(x,t) = fθ(x) and thus:

fθ(x) = fθ(x,t) = fθ | t(x)fθ(t)

with the last equality being true by the definition of conditional probability distributions. Thus fθ(x) = a(x)bθ(t) with a(x) = fθ | t(x) and b(x) = fθ(t).

Reciprocally, if fθ(x) = a(x)bθ(t), we have


\begin{align}
f_\theta(t) & = \sum _{x : T(x) = t} f_\theta(x, t) \\ 
& = \sum _{x : T(x) = t} f_\theta(x) \\
& = \sum _{x : T(x) = t} a(x) b_\theta(t) \\
& = \left( \sum _{x : T(x) = t} a(x) \right) b_\theta(t).
\end{align}

With the first equality by the definition of pdf for multiple variables, the second by the remark above, the third by hypothesis, and the fourth because the summation is not over t.

Thus, the conditional probability distribution is:


\begin{align}
f_{\theta|t}(x)
& = \frac{f_\theta(x, t)}{f_\theta(t)} \\
& = \frac{f_\theta(x)}{f_\theta(t)} \\
& = \frac{a(x) b_\theta(t)}{\left( \sum _{x : T(x) = t} a(x) \right) b_\theta(t)} \\
& = \frac{a(x)}{\sum _{x : T(x) = t} a(x)}.
\end{align}

With the first equality by definition of conditional probability density, the second by the remark above, the third by the equality proven above, and the fourth by simplification. This expression does not depend on θ and thus T is a sufficient statistic.[6]

Minimal sufficiency

A sufficient statistic is minimal sufficient if it can be represented as a function of any other sufficient statistic. In other words, S(X) is minimal sufficient if and only if

  1. S(X) is sufficient, and
  2. if T(X) is sufficient, then there exists a function f such that S(X) = f(T(X)).

Intuitively, a minimal sufficient statistic most efficiently captures all possible information about the parameter θ.

A useful characterization of minimal sufficiency is that when the density fθ exists, S(X) is minimal sufficient if and only if

\frac{f_\theta(x)}{f_\theta(y)} is independent of θ :\Longleftrightarrow S(x) = S(y)

This follows as a direct consequence from Fisher's factorization theorem stated above.

A case in which there is no minimal sufficient statistic was shown by Bahadur, 1957.[7] However, under mild conditions, a minimal sufficient statistic does always exist. In particular, in Euclidean space, these conditions always hold if the random variables (associated with Pθ ) are all discrete or are all continuous.

If there exists a minimal sufficient statistic, and this is usually the case, then every complete sufficient statistic is necessarily minimal sufficient[8](note that this statement does not exclude the option of a pathological case in which a complete sufficient exists while there is no minimal sufficient statistic). While it is hard to find cases in which a minimal sufficient statistic does not exist, it is not so hard to find cases in which there is no complete statistic.

The collection of likelihood ratios \left\{\frac{L(\theta_1|X)}{L(\theta_2|X)}\right\} is a minimal sufficient statistic if P(X | θ) is discrete or has a density function.

Examples

Bernoulli distribution

If X1, ...., Xn are independent Bernoulli-distributed random variables with expected value p, then the sum T(X) = X1 + ... + Xn is a sufficient statistic for p (here 'success' corresponds to Xi = 1 and 'failure' to Xi = 0; so T is the total number of successes)

This is seen by considering the joint probability distribution:

 \Pr\{X=x\}=\Pr\{X_1=x_1,X_2=x_2,\ldots,X_n=x_n\}.

Because the observations are independent, this can be written as


p^{x_1}(1-p)^{1-x_1} p^{x_2}(1-p)^{1-x_2}\cdots p^{x_n}(1-p)^{1-x_n} \,\!

and, collecting powers of p and 1 − p, gives


p^{\sum x_i}(1-p)^{n-\sum x_i}=p^{T(x)}(1-p)^{n-T(x)} \,\!

which satisfies the factorization criterion, with h(x) = 1 being just a constant.

Note the crucial feature: the unknown parameter p interacts with the data x only via the statistic T(x) = Σ xi.

Uniform distribution

If X1, ...., Xn are independent and uniformly distributed on the interval [0,θ], then T(X) = max(X1, …, Xn) is sufficient for θ — the sample maximum is a sufficient statistic for the population maximum.

To see this, consider the joint probability density function of X=(X1,…,Xn). Because the observations are independent, the pdf can be written as a product of individual densities

\begin{align}
f_X(x_1,\ldots,x_n) 
  &= \frac{1}{\theta}\mathbf{1}_{\{0\leq x_1\leq\theta\}} \cdots 
     \frac{1}{\theta}\mathbf{1}_{\{0\leq x_n\leq\theta\}} \\
  &= \frac{1}{\theta^n}\mathbf{1}_{\{0\leq\min\{x_i\}\}}\mathbf{1}_{\{\max\{x_i\}\leq\theta\}}
\end{align}

where 1{...} is the indicator function. Thus the density takes form required by the Fisher–Neyman factorization theorem, where h(x) = 1{min{xi}≥0}, and the rest of the expression is a function of only θ and T(x) = max{xi}.

In fact, the minimum-variance unbiased estimator (MVUE) for θ is

 \frac{n+1}{n}T(X).

This is the sample maximum, scaled to correct for the bias, and is MVUE by the Lehmann–Scheffé theorem. Unscaled sample maximum T(X) is the maximum likelihood estimator for θ.

Uniform distribution (with two parameters)

If X_1,...,X_n\, are independent and uniformly distributed on the interval [\alpha, \beta]\, (where \alpha\, and \beta\, are unknown parameters), then T(X_1^n)=\left(\min_{1 \leq i \leq n}X_i,\max_{1 \leq i \leq n}X_i\right)\, is a two-dimensional sufficient statistic for (\alpha\, , \, \beta).

To see this, consider the joint probability density function of X_1^n=(X_1,\ldots,X_n). Because the observations are independent, the pdf can be written as a product of individual densities, i.e.

\begin{align}
f_{X_1^n}(x_1^n)
  &= \prod_{i=1}^n \left({1 \over \beta-\alpha}\right) \mathbf{1}_{ \{ \alpha \leq x_i \leq \beta \} }
  = \left({1 \over \beta-\alpha}\right)^n \mathbf{1}_{ \{ \alpha \leq x_i \leq \beta, \, \forall \, i = 1,\ldots,n\}} \\
  &= \left({1 \over \beta-\alpha}\right)^n \mathbf{1}_{ \{ \alpha \, \leq \, \min_{1 \leq i \leq n}X_i \} } \mathbf{1}_{ \{ \max_{1 \leq i \leq n}X_i \, \leq \, \beta \} }.
\end{align}

The joint density of the sample takes the form required by the Fisher–Neyman factorization theorem, by letting

\begin{align} 
h(x_1^n)= 1, \quad
g_{(\alpha, \beta)}(x_1^n)= \left({1 \over \beta-\alpha}\right)^n \mathbf{1}_{ \{ \alpha \, \leq \, \min_{1 \leq i \leq n}X_i \} } \mathbf{1}_{ \{ \max_{1 \leq i \leq n}X_i \, \leq \, \beta \} }.
\end{align}

Since h(x_1^n) does not depend on the parameter (α,β) and g_{(\alpha \, , \, \beta)}(x_1^n) depends only on x_1^n through the function T(X_1^n)= \left(\min_{1 \leq i \leq n}X_i,\max_{1 \leq i \leq n}X_i\right),\,

the Fisher–Neyman factorization theorem implies T(X_1^n) = \left(\min_{1 \leq i \leq n}X_i,\max_{1 \leq i \leq n}X_i\right)\, is a sufficient statistic for (\alpha\, , \, \beta).

Poisson distribution

If X1, ...., Xn are independent and have a Poisson distribution with parameter λ, then the sum T(X) = X1 + ... + Xn is a sufficient statistic for λ.

To see this, consider the joint probability distribution:


\Pr(X=x)=P(X_1=x_1,X_2=x_2,\ldots,X_n=x_n). \,

Because the observations are independent, this can be written as


{e^{-\lambda} \lambda^{x_1} \over x_1 !} \cdot 
{e^{-\lambda} \lambda^{x_2} \over x_2 !} \cdots
{e^{-\lambda} \lambda^{x_n} \over x_n !} \,

which may be written as


e^{-n\lambda} \lambda^{(x_1+x_2+\cdots+x_n)} \cdot 
{1 \over x_1 ! x_2 !\cdots x_n ! } \,

which shows that the factorization criterion is satisfied, where h(x) is the reciprocal of the product of the factorials. Note the parameter λ interacts with the data only through its sum T(X).

Normal distribution

If X_1,\dots,X_n are independent and normally distributed with expected value θ (a parameter) and known finite variance σ2, then T(X_1^n)=\overline{X}=\frac1n\sum_{i=1}^nX_i is a sufficient statistic for θ.

To see this, consider the joint probability density function of X_1^n=(X_1,\dots,X_n). Because the observations are independent, the pdf can be written as a product of individual densities, i.e. -

\begin{align}
f_{X_1^n}(x_1^n) 
  & = \prod_{i=1}^n \tfrac{1}{\sqrt{2\pi\sigma^2}}\, e^{-(x_i-\theta)^2/(2\sigma^2)}
    = (2\pi\sigma^2)^{-n/2}\, e^{ -\sum_{i=1}^n(x_i-\theta)^2/(2\sigma^2)} \\
  & = (2\pi\sigma^2)^{-n/2}\, e^{ -\sum_{i=1}^n( (x_i-\overline{x}) - (\theta-\overline{x}) )^2/(2\sigma^2)} \\
  & = (2\pi\sigma^2)^{-n/2}\, \exp \left( {-1\over2\sigma^2} \left(\sum_{i=1}^n(x_i-\overline{x})^2 + \sum_{i=1}^n(\theta-\overline{x})^2 -2\sum_{i=1}^n(x_i-\overline{x})(\theta-\overline{x})\right) \right).
\end{align}

Then, since \sum_{i=1}^n(x_i-\overline{x})(\theta-\overline{x})=0, which can be shown simply by expanding this term,

\begin{align}
f_{X_1^n}(x_1^n) 
  &= (2\pi\sigma^2)^{-n\over2}\, e^{ {-1\over2\sigma^2} (\sum_{i=1}^n(x_i-\overline{x})^2 + n(\theta-\overline{x})^2) }  
  &= (2\pi\sigma^2)^{-n\over2}\, e^{ {-1\over2\sigma^2} \sum_{i=1}^n(x_i-\overline{x})^2}\, e^{ {-n\over2\sigma^2}(\theta-\overline{x})^2 }.
\end{align}

The joint density of the sample takes the form required by the Fisher–Neyman factorization theorem, by letting

\begin{align} 
h(x_1^n)= (2\pi\sigma^2)^{-n\over2}\, e^{ {-1\over2\sigma^2} \sum_{i=1}^n(x_i-\overline{x})^2},\,\,\, 
g_{\theta}(x_1^n)= e^{ {-n\over2\sigma^2}(\theta-\overline{x})^2 }.
\end{align}

Since h(x_1^n) does not depend on the parameter θ and g_{\theta}(x_1^n) depends only on x_1^n through the function T(X_1^n)=\overline{X}=\frac1n\sum_{i=1}^nX_i,

the Fisher–Neyman factorization theorem implies T(X_1^n)=\overline{X}=\frac1n\sum_{i=1}^nX_i is a sufficient statistic for θ.

Exponential distribution

If X_1,\dots,X_n are independent and exponentially distributed with expected value θ (an unknown real-valued positive parameter), then T(X_1^n)=\sum_{i=1}^nX_i is a sufficient statistic for θ.

To see this, consider the joint probability density function of X_1^n=(X_1,\dots,X_n). Because the observations are independent, the pdf can be written as a product of individual densities, i.e. -

\begin{align}
f_{X_1^n}(x_1^n) 
  &= \prod_{i=1}^n {1 \over \theta}  \, e^{ {-1 \over \theta}x_i }
   =               {1 \over \theta^n}\, e^{ {-1 \over \theta} \sum_{i=1}^nx_i }.
\end{align}

The joint density of the sample takes the form required by the Fisher–Neyman factorization theorem, by letting

\begin{align} 
h(x_1^n)= 1,\,\,\, 
g_{\theta}(x_1^n)= {1 \over \theta^n}\, e^{ {-1 \over \theta} \sum_{i=1}^nx_i }.
\end{align}

Since h(x_1^n) does not depend on the parameter θ and g_{\theta}(x_1^n) depends only on x_1^n through the function T(X_1^n)=\sum_{i=1}^nX_i

the Fisher–Neyman factorization theorem implies T(X_1^n)=\sum_{i=1}^nX_i is a sufficient statistic for θ.

Gamma distribution

If X_1,\dots,X_n\, are independent and distributed as a \Gamma(\alpha \, , \, \beta) \,\,, where \alpha\, and \beta\, are unknown parameters of a Gamma distribution, then T(X_1^n) = \left( \prod_{i=1}^n{x_i} , \sum_{i=1}^n x_i \right)\, is a two-dimensional sufficient statistic for (α,β).

To see this, consider the joint probability density function of X_1^n=(X_1,\dots,X_n). Because the observations are independent, the pdf can be written as a product of individual densities, i.e. -

\begin{align}
f_{X_1^n}(x_1^n)
  &= \prod_{i=1}^n \left({1 \over \Gamma(\alpha) \beta^{\alpha}}\right) x_i^{\alpha -1} e^{{-1 \over \beta}x_i}
  &= \left({1 \over \Gamma(\alpha) \beta^{\alpha}}\right)^n \left(\prod_{i=1}^n x_i\right)^{\alpha-1} e^{{-1 \over \beta} \sum_{i=1}^n{x_i}}.
\end{align}

The joint density of the sample takes the form required by the Fisher–Neyman factorization theorem, by letting

\begin{align} 
h(x_1^n)= 1,\,\,\, 
g_{(\alpha \, , \, \beta)}(x_1^n)= \left({1 \over \Gamma(\alpha) \beta^{\alpha}}\right)^n \left(\prod_{i=1}^n x_i\right)^{\alpha-1} e^{{-1 \over \beta} \sum_{i=1}^n{x_i}}.
\end{align}

Since h(x_1^n) does not depend on the parameter (\alpha\, , \, \beta) and g_{(\alpha \, , \, \beta)}(x_1^n) depends only on x_1^n through the function T(X_1^n)= \left( \prod_{i=1}^n{x_i} , \sum_{i=1}^n{x_i} \right),

the Fisher–Neyman factorization theorem implies T(X_1^n)= \left( \prod_{i=1}^n{x_i} , \sum_{i=1}^n{x_i} \right) is a sufficient statistic for (\alpha\, , \, \beta).

Rao–Blackwell theorem

Sufficiency finds a useful application in the Rao–Blackwell theorem. It states that if g(X) is any kind of estimator of θ, then typically the conditional expectation of g(X) given sufficient statistic T(X) is a better estimator of θ, and is never worse. Sometimes one can very easily construct a very crude estimator g(X), and then evaluate that conditional expected value to get an estimator that is in various senses optimal.

Exponential family

According to the Pitman–Koopman–Darmois theorem, among families of probability distributions whose domain does not vary with the parameter being estimated, only in exponential families is there a sufficient statistic whose dimension remains bounded as sample size increases. Less tersely, suppose X_n, n = 1, 2, 3, \dots are independent identically distributed random variables whose distribution is known to be in some family of probability distributions. Only if that family is an exponential family is there a (possibly vector-valued) sufficient statistic T(X_1, \dots, X_n) whose number of scalar components does not increase as the sample size n increases.

This theorem shows that sufficiency (or rather, the existence of a scalar or vector-valued of bounded dimension sufficient statistic) sharply restricts the possible forms of the distribution.

Other types of sufficiency

Bayesian sufficiency

An alternative formulation of the condition that a statistic be sufficient, set in a Bayesian context, involves the posterior distributions obtained by using the full data-set and by using only a statistic. Thus the requirement is that, for almost every x,

\Pr(\theta|X=x) = \Pr(\theta|T(X)=t(x)). \,

It turns out that this "Bayesian sufficiency" is a consequence of the formulation above,[9] however they are not directly equivalent in the infinite-dimensional case.[10] A range of theoretical results for sufficiency in a Bayesian context is available.[11]

Linear sufficiency

A concept called "linear sufficiency" can be formulated in a Bayesian context,[12] and more generally.[13] First define the best linear predictor of a vector Y based on X as \hat E[Y|X]. Then a linear statistic T(x) is linear sufficient[14] if

\hat E[\theta|X]= \hat E[\theta|T(X)] .

See also

Notes

  1. ^ Fisher, R.A. (1922). "On the mathematical foundations of theoretical statistics". Philosophical Transactions of the Royal Society of London. Series A 222: 309–368. doi:10.1098/rsta.1922.0009. JFM 48.1280.02. JSTOR 91208. http://digital.library.adelaide.edu.au/dspace/handle/2440/15172. 
  2. ^ Dodge, Y. (2003) — entry for linear sufficiency
  3. ^ Stigler, Stephen (December 1973). "Studies in the History of Probability and Statistics. XXXII: Laplace, Fisher and the Discovery of the Concept of Sufficiency". Biometrika 60 (3): 439–445. doi:10.1093/biomet/60.3.439. JSTOR 2334992. MR0326872. 
  4. ^ Casella, George; Berger, Roger L. (2002). Statistical Inference, 2nd ed. Duxbury Press. 
  5. ^ Hogg, Robert V.; Craig, Allen T. (1995). Introduction to Mathematical Statistics. Prentice Hall. ISBN 9780023557224. 
  6. ^ "The Fisher–Neyman Factorization Theorem". http://cnx.org/content/m11480/1.6/. 
  7. ^ Lehmann and Casella
  8. ^ Lehmann and Casella , page 72
  9. ^ Bernardo, J.M.; Smith, A.F.M. (1994). "Section 5.1.4". Bayesian Theory. Wiley. ISBN 0471924164. 
  10. ^ Blackwell, D.; Ramamoorthi, R. V. (1982). "A Bayes but not classically sufficient statistic.". Annals of Statistics 10 (3): 1025–1026. doi:10.1214/aos/1176345895. MR663456. Zbl 0485.62004. 
  11. ^ Nogales, A.G.; Oyola, J.A.; Perez, P. (2000). "On conditional independence and the relationship between sufficiency and invariance under the Bayesian point of view". Statistics & Probability Letters 46 (1): 75–84. doi:10.1016/S0167-7152(99)00089-9. MR1731351. Zbl 0964.62003. 
  12. ^ M. Goldstein and A. O'Hagan (1996) "Bayes Linear Sufficiency and Systems of Expert Posterior Assessments", Journal of the Royal Statistical Society, Series B), 58(2), 301–316 jstor
  13. ^ Godambe, V.P. (1966) "A New Approach to Sampling from Finite Populations. II Distribution-Free Sufficiency", Journal of the Royal Statistical Society, Series B, 28 (2), 320–328. jstor
  14. ^ Witting, T. (1987) "The linear Markov property in credibility theory", ASTIN Bulletin, 17 (1), 71–84.

References


Wikimedia Foundation. 2010.

Игры ⚽ Поможем написать курсовую

Look at other dictionaries:

  • Ancillary statistic — In statistics, an ancillary statistic is a statistic whose probability distribution does not depend on which of the probability distributions among those being considered is the distribution of the statistical population from which the data were… …   Wikipedia

  • Summary statistic — Box plot of the Michelson–Morley experiment, showing several summary statistics. In descriptive statistics, summary statistics are used to summarize a set of observations, in order to communicate the largest amount as simply as possible.… …   Wikipedia

  • Sufficiency (statistics) — In statistics, sufficiency is the property possessed by a statistic, with respect to a parameter, when no other statistic which can be calculated from the same sample provides any additional information as to the value of the parameter cite… …   Wikipedia

  • Exponential family — Not to be confused with the exponential distribution. Natural parameter links here. For the usage of this term in differential geometry, see differential geometry of curves. In probability and statistics, an exponential family is an important… …   Wikipedia

  • Completeness (statistics) — In statistics, completeness is a property of a statistic in relation to a model for a set of observed data. In essence, it is a condition which ensures that the parameters of the probability distribution representing the model can all be… …   Wikipedia

  • Rao–Blackwell theorem — In statistics, the Rao–Blackwell theorem is a result which characterizes the transformation of an arbitrarily crude estimator into an estimator that is optimal by the mean squared error criterion or any of a variety of similar criteria. The Rao… …   Wikipedia

  • Minimum-variance unbiased estimator — In statistics a uniformly minimum variance unbiased estimator or minimum variance unbiased estimator (UMVUE or MVUE) is an unbiased estimator that has lower variance than any other unbiased estimator for all possible values of the parameter. The… …   Wikipedia

  • Fisher information — In statistics and information theory, the Fisher information (denoted mathcal{I}( heta)) is the variance of the score. It is named in honor of its inventor, the statistician R.A. Fisher.DefinitionThe Fisher information is a way of measuring the… …   Wikipedia

  • Fiducial inference — was a form of statistical inference put forward by R A Fisher in an attempt to perform inverse probability without prior probability distributions.A fiducial interval may be used instead of a confidence interval or a Bayesian credible interval in …   Wikipedia

  • Basu's theorem — In statistics, Basu s theorem states that any complete sufficient statistic is independent of any ancillary statistic. This is a 1955 result of Debabrata Basu.It is often used in statistics as a tool to prove independence of two statistics, by… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”