When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods

Decision makers often face complicated decision problems with intangible and conflicting criteria. Numerous multi-criteria decision-making (MCDM) methods have been proposed to handle the measurement of the priorities of conflicting tangible/intangible criteria and in turn use them to choose the best alternative for a decision. However, the presence of many MCDM methods bewilders users. The existence of these methods becomes a decision problem in itself, and decision makers may be uncertain about which one to use. Thus the comparative analysis and evaluation of various MCDM methods has come under scrutiny by both researchers and practitioners in order to discover if there are logical, mathematical, social or practical reasons why one method is better than another. Criteria for their evaluation are the first important issue that needs to be resolved. In this paper, 16 criteria are introduced that may be used to judge and evaluate various MCDM methods. The criteria proposed and some guidelines for their evaluation are given to help readers evaluate these MCDM methods.