Multilevel Covariance Structure Analysis by Fitting Multiple Single-Level Models

Data in social and behavioral sciences are often hierarchically organized. Multilevel statistical procedures have been developed to analyze such data while taking into account the dependence of observations. When simultaneously evaluating models at all levels, a significant statistic provides no information on the level at which the model is misspecified. Model misspecification can exist at one or several levels simultaneously. When one level is misspecified, the other levels may be affected even when they are correctly specified. Motivated by these observations, we propose to separate a multilevel covariance structure into multiple single-level covariance structure models and to fit these single-level models as in conventional covariance structure analysis. A procedure for segregating the multilevel model into single-level models is developed. Five test statistics for evaluating a model at each level are provided. Standard error formulas for the separate estimators are also provided, and their efficiency is compared to simultaneous estimators. Empirical and Monte Carlo results demonstrate the advantages of the segregated procedure over the simultaneous procedure. Computer programs that will allow the developed procedure to be used in practice are also presented.