Evaluating the Application of Decision Analysis Methods in Simulated Alternatives Assessment Case Studies: Potential Benefits and Challenges of Using MCDA

We compare how several forms of multicriteria decision analysis (MCDA) can enhance the practice of alternatives assessment (AA). We report on a workshop in which 12 practitioners from US corporations, government agencies, NGOs, and consulting organizations applied different MCDA techniques to 3 AA case studies to understand how they improved the decision process. Participants were asked to select a preferred alternative in each case using a different decision analysis approach: their unaided decision-making method, individual or lightly facilitated group multiattribute value theory (MAVT), and more extensively facilitated group structured decision making (SDM). Surveys conducted after each exercise revealed that participants were positive toward the use of formal decision-making methods for AA, reporting meaningful increases in their understanding of the trade-offs involved and their own values. Participants also reported challenges with each approach. While the MCDA techniques were reported to enhance transparency and communication, they did not consistently lead to higher satisfaction with a decision and/or outcome, and they were not more likely to be adopted within their organizations than unaided approaches. More formal decision-making methods have promise in the context of AA, but practitioners will need more guidance to use such tools successfully. Practitioners will also need to define what “success” constitutes; different approaches may be called for depending on whether the objective is increased understanding, satisfaction with the outcome, satisfaction with the process, or something else. Integr Environ Assess Manag 2021;17:27–41. © 2020 SETAC KEY POINTS The research evaluates the use of multicriteria decision analysis (MCDA) in simulated alternatives assessment scenarios. The results reveal a range of unaided decision approaches used by experts in chemical assessment and product design. Participants found MCDA approaches enhanced their understanding of key trade-offs and critical information presented by the scenarios. Participants concluded, however, that their institutions would likely be reluctant to use MCDA approaches.