Answers are grounded in this paper and cite their sources.
Health systems are adding verifiers, AI models that check another AI’s drafted care plans, to reduce errors and omissions. We tested a verifier in two ways. First, three AI models drafted care plans for 447 retrospective test cases; a verifier caught 5 of 17 errors checkable against the patient’s record when counting flags for wrong recommendations, and 10 of 17 when also including flags for missing care. Second, in a prospective trial (NCT07718893), we randomized 240 patients in complex primary care management programs in four states to unassisted physicians, physicians with a guardrailed AI assistant, or physicians with the guardrailed assistant plus a verifier. The verifier raised 11 alerts across 77 encounters; physician adjudicators judged 9 correct, but clinicians in the trial acted on only 1. Safety events were similar across arms. Effective verification may therefore require alerts that clinicians must resolve, despite the risk of alert fatigue.
No takes yet. Share an insight, caveat, or question.
Basu et al. (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: