This technical report presents two paired-design experiments (L2 and L2b)investigating leaky integration as a structural noise mechanism within the SafeAttractor Architecture (SAA) framework. Previous experiments established thatamplitude-modulated noise (β(t) modulation) is structurally safe but producesno measurable improvement in safe-edge occupancy. We demonstrate that leakyintegration, parameterized by a mixing coefficient λ controlling the blend betweenthe current hidden state and the attention update, produces a qualitatively differentand strongly positive effect.In Test L2 (Npairs = 30, paired design), all five λ 0.35), substantial reduction in pchaos,and no MSE degradation relative to the static λ = 1.0 baseline. In Test L2b(Npairs = 30), a full λ sweep from 1.0 to 0.2 revealed three distinct operating regimes:a chaos-prone regime (λ = 0.8–1.0), a safe edge zone (λ = 0.5–0.7), and a freeze zone(λ = 0.2–0.4). The optimal operating point is λ = 0.5, maximizing pedge = 0.640,while the balanced operating point considering freeze risk is λ = 0.6 (pedge = 0.614,pchaos = 0.110, freeze rate = 0.20).These findings suggest that leaky integration is a viable candidate for Layer-9structural noise implementation in transformer-based dynamical systems, providinga tunable mechanism to maintain safe-edge dynamics without architecturalmodifications.
Building similarity graph...
Analyzing shared references across papers
Loading...
Jun Sakai
Building similarity graph...
Analyzing shared references across papers
Loading...
Jun Sakai (Sun,) studied this question.
www.synapsesocial.com/papers/69f04e9b727298f751e72880 — DOI: https://doi.org/10.5281/zenodo.19776964
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: