Answers are grounded in this paper and cite their sources.
Reveals a structural trade-off in accountability and action non-establishment in autonomous systems, indicating critical implications for safety.
We report a structural trade-off in reactive, safety-critical autonomous systems, found by a static audit of a working two-controller autonomous ground vehicle and made precise by machine-checked models. The system's governance layer commits to total accountability: every persisted non-telemetry event must carry a correlation identifier and be sealed into a tamper-evident integrity chain. We show that this commitment is mutually exclusive with action non-establishment — the capability of letting a physical effect occur without it ever being constituted as an attributable action of the system. Writing I_TA for the accountability invariant and NE for the existence of a reachable non-established persistent effect, we prove □I_TA ⟹ ¬NE. The implication is not vacuous, and the audited system itself supplies the evidence: it already emits one class of reflex — a "last-will" stop, fired as a process dies — without attribution, while forcing another reflex of the same kind (a stop fired on a controller conflict) into the accountability pipeline. The system oscillates on exactly the boundary the theorem describes. The audit further shows that accountability is a three-surface notarization pipeline whose hash chain links events by their position in the chain, not by any label. Our central machine-checked result characterises what genuine separation from that pipeline requires: over the model, non-retroactive separation (Sep) holds if and only if the effect exits the shared notarization pipeline and drops its correlation key; label removal alone never suffices. This characterisation formally separates non-establishment from runtime shielding and runtime verification, which operate on effects already constituted as actions.
No takes yet. Share an insight, caveat, or question.
JULGI KANG (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: