Illustrating the Evaluation of System Feedback Mechanisms Using System Evaluation Theory (SET)

This article describes how system evaluation theory (SET) guided the evaluation of cardiac care response systems efficiency in seven rural United States. Specifically, the article focuses on the approach and methods used to evaluate system feedback mechanisms; one key factor affecting system efficiency. Mixed methods were applied to evaluate five criteria of system feedback efficiency: frequency, timeliness, credibility, specificity, and relevance. Examples from the cardiac care response system evaluation are used to illustrate each of the evaluation criteria. The discussion contrasts the role of the evaluator in system versus program evaluation, notes the post-hoc support of SET system attributes in affecting system efficiency, and offers additional consideration in evaluating system feedback mechanisms.