A Geometric Approach to Assess Bias Due to Omitted Covariates in Generalized Linear Models

Misspecifying generalized linear models by omitting covariates associated with the response can result in seriously biased estimates of the effects of the included covariates. For certain models, such bias can occur even when the omitted covariate is independent of the included covariates, as in studies with randomized treatment assignment. This paper presents a geometric approach to assess the direction of the bias resulting from omitted covariates and develop intuition about the effects of omitted covariates. We show that the direction of the bias depends simply on geometric properties of the link function. We present an expression for the magnitude of the bias and the results of simulations which corroborate these findings. We also consider an extension of the methods to assess the effects of omitted covariates which are correlated with those included.