Estimating the Weights for Multiple Attributes in a Composite Criterion Using Pairwise Judgments

This paper presents a new methodology for estimating the weights or saliences of subcriteria (attributes) in a composite criterion measure. The inputs to the estimation procedure consist of (i) a set of stimuli or objects with each stimulus defined by its subcriteria profile (set of attribute values) and (ii) the set of paired comparison dominance ( e.g. , preference) judgments on the stimuli made by a single judge (expert) in terms of the global criterion. A criterion of fit is developed and its optimization via linear programming is illustrated with an example. The procedure is generalized to estimate a common set of weights when the pairwise judgments on the stimuli are made by more than one judge. The procedure is computationally efficient and has been applied in developing a composite criterion of managerial success yielding high concurrent validity. This methodology can also be used to perform ordinal multiple regression— i.e. , multiple regression with an ordinally scaled dependent variable and a set of intervally scaled predictor variables. The approach is further extended to “internal analysis” (unfolding) using the vector model of preference and to the additive model of “conjoint measurement.”