# Covariance function

Covariance function

In probability theory and statistics, covariance is a measure of how much two variables change together and the covariance function describes the variance of a random variable process or field. For a random field or stochastic process Z(x) on a domain D, a covariance function C(xy) gives the covariance of the values of the random field at the two locations x and y:

$C(x,y):=\operatorname{cov}(Z(x),Z(y)).\,$

The same C(xy) is called autocovariance in two instances: in time series (to denote exactly the same concept, where x is time), and in multivariate random fields (to refer to the covariance of a variable with itself, as opposed to the cross covariance between two different variables at different locations, Cov(Z(x1), Y(x2))).[1]

## Contents

For locations x1, x2, …, xND the variance of every linear combination

$X=\sum_{i=1}^N w_i Z(x_i)$

can be computed as

$\operatorname{var}(X)=\sum_{i=1}^N \sum_{j=1}^N w_i C(x_i,x_j) w_j.$

A function is a valid covariance function if and only if[2] this variance is non-negative for all possible choices of N and weights w1, …, wN. A function with this property is called positive definite.

## Simplifications with stationarity

In case of a weakly stationary random field, where

$C(x_i,x_j)=C(x_i+h,x_j+h)\,$

for any lag h, the covariance function can be represented by a one-parameter function

$C_s(h)=C(0,h)=C(x,x+h)\,$

which is called a covariogram and also a covariance function. Implicitly the C(xixj) can be computed from Cs(h) by:

$C(x,y)=C_s(y-x).\,$

The positive definiteness of this single-argument version of the covariance function can be checked by Bochner's theorem.[2]

## Parametric families of covariance functions

A simple stationary parametric covariance function is the "exponential covariance function"

C(d) = exp( − d / V)

where V is a scaling parameter, and d=d(x,y) is the distance between two points. Sample paths of a Gaussian process with the exponential covariance function are not smooth. The "squared exponential covariance function"

C(d) = exp( − d2 / V)

is a stationary covariance function with smooth sample paths.

The Matérn covariance function and rational quadratic covariance function are two parametric families of stationary covariance functions. The Matérn family includes the exponential and squared exponential covariance functions as special cases.

## References

1. ^ Wackernagel, Hans (2003). Multivariate Geostatistics. Springer.
2. ^ a b Cressie, Noel A.C. (1993). Statistics for Spatial Data. Wiley-Interscience.

Wikimedia Foundation. 2010.

### Look at other dictionaries:

• Matérn covariance function — In statistics, the Matérn covariance (named after the Swedish forestry statistician Bertil Matérn[1]) is a covariance function used in spatial statistics, geostatistics, machine learning, image analysis, and other applications of multivariate… …   Wikipedia

• Covariance (disambiguation) — Covariance may refer to: Covariance, a measure of how much two variables change together Covariance matrix, a matrix of covariances between a number of variables Cross covariance, the covariance between two vectors of variables Autocovariance,… …   Wikipedia

• Covariance — This article is about the measure of linear relation between random variables. For other uses, see Covariance (disambiguation). In probability theory and statistics, covariance is a measure of how much two variables change together. Variance is a …   Wikipedia

• Covariance operator — in probability theory, for a probability measure P on a Hilbert space H with inner product , the covariance of P is the bilinear form Cov: H × H → R given by for all x and y in H. The covariance operator C is then defined …   Wikipedia

• Covariance and contravariance (computer science) — Within the type system of a programming language, covariance and contravariance refers to the ordering of types from narrower to wider and their interchangeability or equivalence in certain situations (such as parameters, generics, and return… …   Wikipedia

• Covariance matrix — A bivariate Gaussian probability density function centered at (0,0), with covariance matrix [ 1.00, .50 ; .50, 1.00 ] …   Wikipedia

• Covariance and contravariance of vectors — For other uses of covariant or contravariant , see covariance and contravariance. In multilinear algebra and tensor analysis, covariance and contravariance describe how the quantitative description of certain geometric or physical entities… …   Wikipedia

• covariance — [kəʊ vɛ:rɪəns] noun 1》 Mathematics the property of a function of retaining its form when the variables are linearly transformed. 2》 Statistics the mean value of the product of the deviations of two variates from their respective means …   English new terms dictionary

• Correlation function — For other uses, see Correlation function (disambiguation). A correlation function is the correlation between random variables at two different points in space or time, usually as a function of the spatial or temporal distance between the points.… …   Wikipedia

• Estimation of covariance matrices — In statistics, sometimes the covariance matrix of a multivariate random variable is not known but has to be estimated. Estimation of covariance matrices then deals with the question of how to approximate the actual covariance matrix on the basis… …   Wikipedia