This paper develops a rigorous operator-theoretic framework for learning-augmented quasi-gradient methods in constrained optimization. We consider the minimization of an objective function over a closed convex feasible set, where feasibility is enforced via projection and directional updates may incorporate data-driven corrections. Such settings arise naturally in modern optimization algorithms that integrate artificial intelligence components under structural constraints. The proposed formulation introduces an explicit contraction–bias–variance decomposition of the iterative dynamics. Curvature induces deterministic contraction, alignment distortion—quantified by a geometric parameter—modifies the effective contraction margin, and stochastic learning components inject controlled dispersion. Explicit error recursions yield convergence guarantees under strong convexity, the Polyak–Łojasiewicz condition, and smooth nonconvexity. The analysis establishes that stability regions and first-order complexity bounds are preserved whenever alignment distortion remains below unity and bounded second-moment conditions hold. A fully reproducible computational study provides quantitative validation: the empirically observed steady-state error closely matches the theoretical prediction proportional to \ (²/ (1-) \). Comparative experiments with gradient, stochastic gradient, and momentum methods confirm that the proposed operator retains classical stability margins and conditioning sensitivity while enabling principled integration of learned directional components. The results provide a transparent mathematical bridge between stochastic approximation theory and contemporary AI-enhanced constrained optimization.
Pérez-Lechuga et al. (Fri,) studied this question.