Studying number theory with deep learning: a case study with the Möbius and squarefree indicator functions

Building on work of Charton, we train small transformer models to calculate the Möbius function μ(n) and the squarefree indicator function μ²(n). The models attain nontrivial predictive power. We apply a mixture of additional models and feature scoring to give a theoretical explanation.