Evaluation of large research initiatives: Outcomes, challenges, and methodological considerations

The authors synthesize relevant literature and findings of evaluations of four large‐scale, federally funded scientific research programs in the United States to identify desired outcomes of these types of programs, major evaluation chal‐lenges, and methodological principles and approaches. Evaluators face numer‐ous contextual, political, and methodological challenges in evaluating big science. The authors propose that these may be addressed through participatory planning, such as concept mapping, triangulation of evidence, use of promising methodologies, and a systems approach.