Sequential Monte Carlo sampling with integrator snippets

Assume interest is in sampling from a probability distribution μ μ defined on Z. Z . We develop a framework for sampling algorithms which take full advantage of ODE numerical integrators, say ψ :Z→ Z ψ : Z → Z for one integration step, to explore μ μ efficiently and robustly. The popular Hamiltonian Monte Carlo (HMC) algorithm and its derivatives are examples of such a use of numerical integrators. A key idea developed here is that of sampling integrator snippets, that is fragments of the orbit of an ODE numerical integrator ψ , ψ , and the definition of an associated probability distribution μ ̄ μ ¯ such that expectations with respect to μ μ can be estimated from integrator snippets distributed according to μ ̄. μ ¯ . The integrator snippet target distribution μ ̄ μ ¯ takes the form of a mixture of pushforward distributions which suggest generalisations beyond HMC. Importantly this structure also leads to new, principled and robust strategies to tune the parameters of integrators, such as the discretisation stepsize, effective integration time, or number of integration steps, in a Leapfrog integrator. We illustrate performance and, in particular, robustness through numerical experiments.