Reasoning Machines

We distill large language models into large reasoning models via implicit recurrent deep learning. Attention and logic are entwined; the distributions of Transformer attention query updates over keys define a compositional relation between judgements in Open Horn Type Theory (OHTT). Dependent type theory OHTT is sound, has semiotic logical hexagon reasoning, and enables abductive inference that reverses entailment.