 Mean and predicted response

In linear regression mean response and predicted response are values of the dependent variable calculated from the regression parameters and a given value of the independent variable. The values of these two responses are the same, but their calculated variances are different.
Contents
Straight line regression
In straight line fitting the model is
where y_{i} is the response variable, x_{i} is the explanatory variable, ε_{i} is the random error, and α and β are parameters. The predicted response value for a given explanatory value, x_{d}, is given by
while the actual response would be
Expressions for the values and variances of and are given in linear regression.
Mean response is an estimate of the mean of the y population associated with x_{d}, that is . The variance of the mean response is given by
This expression can be simplified to
To demonstrate this simplification, one can make use of the identity
The predicted response distribution is the predicted distribution of the residuals at the given point x_{d}. So the variance is given by
The second part of this expression was already calculated for the mean response. Since (a fixed but unknown parameter that can be estimated), the variance of the predicted response is given by
Confidence intervals
The 100(1 − α)% confidence intervals are computed as . Thus, the confidence interval for predicted response is wider than the interval for mean response. This is expected intuitively – the variance population of y values does not shrink when one samples from it, because the random variable ε_{i} does not decrease, but the variance mean of the y does shrink with increased sampling, because the variance in and decrease, so the mean response (predicted response value) becomes closer to α + βx_{d}.
This is analogous to the difference between the variance of a population and the variance of the sample mean of a population: the variance of a population is a parameter and does not change, but the variance of the sample mean decreases with increased samples.
General linear regression
The general linear model can be written as
Therefore since the general expression for the variance of the mean response is
where M is the covariance matrix of the parameters, given by
 .
References
Draper, N.R., Smith, H. (1998) Applied Regression Analysis. Wiley. ISBN 0471170828
Least squares and regression analysis Computational statistics Least squares · Linear least squares · Nonlinear least squares · Iteratively reweighted least squaresCorrelation and dependence Regression analysis Regression as a
statistical modelSimple linear regression · Ordinary least squares · Generalized least squares · Weighted least squares · General linear modelPredictor structureNonstandardNonnormal errorsDecomposition of variance Model exploration Background Mean and predicted response · Gauss–Markov theorem · Errors and residuals · Goodness of fit · Studentized residual · Minimum meansquare errorDesign of experiments Numerical approximation Applications Regression analysis category  Statistics category · Statistics portal · Statistics outline · Statistics topics Categories:
Wikimedia Foundation. 2010.