The Three Basic Types of Residuals for a Linear Model

Summary We consider residuals for the linear model with a general covariance structure. In contrast to the situation where observations are independent there are several alternative definitions. We draw attention to three quite distinct types of residuals: the marginal residuals, the model‐specified residuals and the full‐conditional residuals. We adopt a very broad perspective including linear mixed models, time series and smoothers as well as models for spatial and multivariate data. We concentrate on defining these different residual types and discussing their interrelationships. The full‐conditional residuals are seen to play several important roles.