Algorithmic analysis demonstrates unbounded computational errors in automatic differentiation software, suggesting that lack of algebraic expression simplification causes critical calculation...
Software efforts in automatic differentiation are built on the observation that every computation is implemented as a series of elementary operations, and that symbolic partial derivatives can be supplied for each of these operations. Any computation can then be traversed (either forwards or backwards) utilizing the chain rule to accumulate derivatives. These frameworks have no mechanism for simplifying these expressions before evaluating them. As we illustrate below, the resulting errors tend to be unbounded.
No takes yet. Share an insight, caveat, or question.
Johnson et al. (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: