VEGAS algorithm

The VEGAS algorithm, due to G. P. Lepage, is a method for reducing error in the Monte Carlo simulation by using a known or approximate probability distribution function to concentrate the search in those areas of the graph that make the greatest contribution to the final integral.

The VEGAS algorithm is based on importance sampling. It samples points from the probability distribution described by the function |f|, so that the points are concentrated in the regions that make the largest contribution to the integral.

In general, if the Monte Carlo integral of f is sampled with points distributed according to a probability distribution described by the function g, we obtain an estimate $E\_g(f;\; N)$,

:$E\_g(f;\; N)\; =\; E(f/g;\; N),$

where $E(f,\; N)$ is the Monte Carlo estimate of the integral of f,

:$E(f;\; N)\; =\; \{1\; over\; N\; \}\; sum\_i^N\; f(x\_i)$

for N randomly distributed points $x\_i$.The variance of the new estimate is then

:$Var\_g(f;\; N)\; =\; Var(f/g;\; N)$

where $Var(f;N)$ is the variance of the original estimate, $Var(f;\; N)\; =\; E(f^2;\; N)\; -\; (E(f;\; N))^2$.

If the probability distribution is chosen as $g\; =\; |f|/I(|f|)$ then it can be shown that the variance $Var\_g(f;\; N)$ vanishes, and the error in the estimate will be zero. In practice it is not possible to sample from the exact distribution g for an arbitrary function, so importance sampling algorithms aim to produce efficient approximations to the desired distribution.

The VEGAS algorithm approximates the exact distribution by making a number of passes over the integration region while histogramming the function f. Each histogram is used to define a sampling distribution for the next pass. Asymptotically this procedure converges to the desired distribution. In order to avoid the number of histogram bins growing like $K^d$ the probability distribution is approximated by a separable function: $g(x\_1,\; x\_2,\; ldots)\; =\; g\_1(x\_1)\; g\_2(x\_2)\; cdots$ so that the number of bins required is only Kd. This is equivalent to locating the peaks of the function from the projections of the integrand onto the coordinate axes. The efficiency of VEGAS depends on the validity of this assumption. It is most efficient when the peaks of the integrand are well-localized. If an integrand can be rewritten in a form which is approximately separable this will increase the efficiency of integration with VEGAS.

ee also

* Las Vegas algorithm

References

* G.P. Lepage, A New Algorithm for Adaptive Multidimensional Integration, Journal of Computational Physics 27, 192-203, (1978)
* G.P. Lepage, VEGAS: An Adaptive Multi-dimensional Integration Program, Cornell preprint CLNS 80-447, March 1980
* The [http://www.gnu.org/software/gsl GNU Scientific Library] provides VEGAS routines