PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 25, 20260 citationsOpen Access

The AI Black Box: A Three-Layer Verification Architecture for Accountable AI Agent Operations

View Full Paper
OUOctavian UntilaRomanian Academy

Key Points

  • The research aims to create a verification architecture for ensuring AI agent safety and accountability.
  • Developed a three-layer architecture combining eBPF, OPA/Rego, and Z3 SMT solver.
  • Deployed the framework (substrate-guard) for 125 AI agents operating continuously since February 2026.
  • Evaluated on 2,788 real events across 1,646 pipeline traces and 1,142 agent runs.
  • Achieved zero violations at an event processing time of 0.18ms per event.
  • Implemented a tamper-evident audit chain using HMAC-SHA256 ensuring event integrity.
  • Provided compliance evidence for standards such as SOC 2 and ISO 27001.

Abstract

We present a three-layer verification architecture for AI agent safety that unifies kernel-level observation (eBPF), policy-as-code evaluation (OPA/Rego), and formal mathematical verification (Z3 SMT solver) into a single pipeline. Each layer answers a distinct question: eBPF observes what the agent actually does at the system level, OPA evaluates whether the agent has permission, and Z3 proves whether the output is mathematically correct. We implement this architecture as substrate-guard, an open-source framework deployed in production on a 125-agent AI ecosystem operating continuously since February 2026. Evaluation on 2,788 real events from 1,646 pipeline traces and 1,142 agent runs shows zero violations at 0.18ms per event on ARM64 hardware. The HMAC-SHA256 tamper-evident audit chain ensures no event can be modified retroactively. We provide compliance evidence export for SOC 2, ISO 27001, and ISO/IEC 42001. To our knowledge, this is the first framework combining all three verification layers with experimental results on a production AI ecosystem.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Octavian Untila (2026) studied this question.

synapsesocial.com/papers/69c37bc2b34aaaeb1a67e7a6https://doi.org/10.5281/zenodo.19183507
Ask AI
Helpful
Bookmark
Share
View Full Paper