Accelerating Many-Body Quantum Chemistry via Generative Transformer-Enhanced Configuration Interaction

Quantum many-body calculations are fundamentally limited by the exponential growth of the configuration space, making accurate treatment of strongly correlated systems computationally prohibitive. Here we present the Generative Transformer Neural Network Selected Configuration Interaction (GTNN-SCI), a Transformer-based machine learning approach that generatively samples important configurations to accelerate many-body quantum chemistry calculations. By leveraging the Transformer architecture's self-attention mechanism to capture long-range electron correlations, GTNN-SCI achieves up to 10× speedup compared to state-of-the-art neural network methods while maintaining high accuracy. We demonstrate the efficacy of GTNN-SCI by calculating correlation and binding energies for representative molecules including N₂, H₂O, and C₂ using both Gaussian (cc-pVDZ) and plane-wave basis sets, achieving faster convergence and lower energies than previously reported neural network-based selected CI techniques. Most significantly, our generative approach identifies higher-order excitations missed by conventional coupling schemes, yielding lower variational energies than established methods including heat-bath CI. This capability enables GTNN-SCI to accurately treat the strongly correlated [Fe₂S₂(SCH₃)₄]²⁻ ([2Fe-2S]) cluster system, achieving ground-state energies within chemical accuracy of DMRG benchmarks, whereas conventional selected CI methods have failed on this system. The GTNN-SCI method thus combines modern deep learning with high-performance electronic structure computation, providing an efficient and precise avenue for solving the electronic Schrödinger equation in challenging molecular systems.