Quasi-maximum likelihood

Quasi-maximum likelihood

A quasi-maximum likelihood estimate (QMLE, also known as a "pseudo-likelihood estimate" or a "composite likelihood estimate") is an estimate of a parameter θ in a statistical model that is formed by maximizing a function that is related to the logarithm of the likelihood function, but is not equal to it[1][2]. In contrast, the maximum likelihood estimate maximizes the actual log likelihood function for the data and model. The function that is maximized to form a QMLE is often a simplified form of the actual log likelihood function. A common way to form such a simplified function is to use the log-likelihood function of a misspecified model that treats certain data values as being independent, even when in actuality they may not be. This removes any parameters from the model that are used to characterize these dependencies. Doing this only makes sense if the dependency structure is a nuisance parameter with respect to the goals of the analysis.

As long as the quasi-likelihood function that is maximized is not overly simplified, the QMLE (or composite likelihood estimate) is consistent and asymptotically normal. It is less efficient than the maximum likelihood estimate, but may only be slightly less efficient if the quasi-likelihood is constructed so as to minimize the loss of information relative to the actual likelihood[3]. Standard approaches to statistical inference that are used with maximum likelihood estimates, such as the formation of confidence intervals, and statistics for model comparison[4], can be generalized to the quasi-maximum likelihood setting.

See also

References

  1. ^ Lindsay, Bruce G. (1988). "Composite Likelihood Methods". Contemporary Mathematics 80: 221–239. 
  2. ^ MacKinnon, James (2004). Econometric Theory and Methods. New York, New York: Oxford University Press. ISBN 0-19-512372-7. 
  3. ^ Cox, D.R.; Reid, Nancy (2004). "A note on pseudo-likelihood constructed from marginal densities". Biometrika 91 (3): 729–737. doi:10.1093/biomet/91.3.729. 
  4. ^ Varin, Cristiano; Vidoni,Paolo (2005). "A note on composite likelihood inference and model selection". Biometrika 92 (3): 519–528. doi:10.1093/biomet/92.3.519. 
Stub icon This Econometrics-related article is a stub. You can help Wikipedia by expanding it. This statistics-related article is a stub. You can help Wikipedia by expanding it.