The Relation between Information and Variance Analyses

Analysis of variance and uncertainty analysis are analogous techniques for partitioning variability. In both analyses negative interaction terms due to negative covariance terms that appear when non-orthogonal predictor variables are allowed may occur. Uncertainties can be estimated directly from variances if the form of distribution is assumed. The decision as to which of the techniques to use depends partly on the properties of the criterion variable. Only uncertainty analysis may be used with a non-metric criterion. Since uncertainties are dimensionless (using no metric), however, uncertainty analysis has a generality which may make it useful even when variances can be computed.