AI agents complete tasks through workflows involving multiple tool calls and changes to stored data. Verifying completion requires checking whether these actions achieved the requested outcome while respecting the task's constraints. Successful tool execution alone cannot establish this. We present AURA (Agent Uncertainty and Residue Arbiter), a Python and SQLite framework that verifies postconditions, permitted mutations, process requirements, and observation coverage. Independent observations are bound to execution epochs and evaluated under explicit evidence rules to produce PASS, FAIL, or UNCERTAIN verdicts. An optional Counterexample-guided Evaluation with Risk Amortization (CERA) planner selects verification probes using finite candidate worlds, prior weights, and inspection costs; the verifier independently determines the verdict. Evaluation covers 13 scripted local scenarios, 36 controlled SQL cases, and two separate five-episode Qwen2.5 agent cohorts. Across these 59 records, AURA produced 13 PASS, 39 FAIL, and seven UNCERTAIN verdicts. All 59 agreed with supplied harness expectations or specification-sharing reference judgments; this concordance is not independently established verification accuracy. A fresh validation run reproduced these totals through 46 saved-evidence replays and 13 regenerated local scenarios, with replay comparisons limited to selected certificate fields. A separate planning study shows that CERA's modeled inspection-cost advantage depends on prior assumptions and does not hold across all evaluated regimes. The findings support the feasibility of evidence-gated task-completion verification within declared observation boundaries, without establishing general agent reliability, independent specification correctness, or detection of unobserved transient effects.
No takes yet. Share an insight, caveat, or question.
Shanmukh Datta (2026) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: