An evaluator's balancing act: Making decisions about methodological rigor

Methodological rigor consists of a series of elements that, in combination, determine the confidence with which conclusions can be drawn from the evaluation results. These elements include evaluation design, conceptualization of constructs, measurement strategies, time frames, program integrity, and others. The authors examine the factors that influence rigor‐related evaluation planning decisions and the relationship of rigor to evaluation use by the sponsoring organization. Rather than following generalized predetermined standards, decisions about rigor should be based on the specific organizational context, information needs for the evaluation, and anticipated benefits and costs of available methodological alternatives. Extension offers a rich organizational context for discussion because of the diversity and complexity of its funding, stakeholders, programs, and evaluations. Several roles are proposed through which evaluators can promote organizational learning with regard to the contribution of methodological rigor to sound evaluation practice. Two Extension evaluations are presented as examples; though they reflect differing levels of rigor, both were thoughtfully planned and resulted in strong use of findings.