The meaning of F Value in the Analysis of Variance for Linear regression

This is a sample output for linear regression:

Linear regression output

The F Value is computed by dividing the value in the Mean Square column for Model with the value in the Mean Square column for Error. In our example, it’s 178.11288/5.34346 = 33.33.

There are two possible interpretations for the F Value in the Analysis of Variance table for the linear regression.

  1. We are comparing the variances of the model and of the error.
    The two factors represent each the numerator of the variance of the model and of the error. What do we want? The only hypothesis of the linear regression model is that \epsilon is a normal variable with zero mean. Thus we want a small variance for the error, so we can say the errors are close to zero.
  2. We are comparing the model with all the variables with the model with only the intercept as variable.

This ambiguity exists because \|\^{y} - \overline{y}\| can either be seen as the numerator of the variance of y, or as a comparison between the complete model \^{y} and the reduced model in which only the intercept is used.

  • Was this Helpful ?
  • yes   no

Leave a Reply

Your email address will not be published. Required fields are marked *