Probabilistic Numerics Article 2018

A probabilistic model for the numerical solution of initial value problems

Hp teaser

We study connections between ordinary differential equation (ODE) solvers and probabilistic regression methods in statistics. We provide a new view of probabilistic ODE solvers as active inference agents operating on stochastic differential equation models that estimate the unknown initial value problem (IVP) solution from approximate observations of the solution derivative, as provided by the ODE dynamics. Adding to this picture, we show that several multistep methods of Nordsieck form can be recast as Kalman filtering on q-times integrated Wiener processes. Doing so provides a family of IVP solvers that return a Gaussian posterior measure, rather than a point estimate. We show that some such methods have low computational overhead, nontrivial convergence order, and that the posterior has a calibrated concentration rate. Additionally, we suggest a step size adaptation algorithm which completes the proposed method to a practically useful implementation, which we experimentally evaluate using a representative set of standard codes in the DETEST benchmark set.

Author(s): Schober, M. and Särkkä, S. and Hennig, P.
Journal: Statistics and Computing
Volume: 29
Number (issue): 1
Pages: 99–122
Year: 2018
Project(s):
Bibtex Type: Article (article)
DOI: 10.1007/s11222-017-9798-7
State: Published
Electronic Archiving: grant_archive
Links:

BibTex

@article{SchoberSarkkaHennig2018,
  title = {A probabilistic model for the numerical solution of initial value problems},
  journal = {Statistics and Computing},
  abstract = {We study connections between ordinary differential equation (ODE) solvers and probabilistic regression methods in statistics. We provide a new view of probabilistic ODE solvers as active inference agents operating on stochastic differential equation models that estimate the unknown initial value problem (IVP) solution from approximate observations of the solution derivative, as provided by the ODE dynamics. Adding to this picture, we show that several multistep methods of Nordsieck form can be recast as Kalman filtering on q-times integrated Wiener processes. Doing so provides a family of IVP solvers that return a Gaussian posterior measure, rather than a point estimate. We show that some such methods have low computational overhead, nontrivial convergence order, and that the posterior has a calibrated concentration rate. Additionally, we suggest a step size adaptation algorithm which completes the proposed method to a practically useful implementation, which we experimentally evaluate using a representative set of standard codes in the DETEST benchmark set.},
  volume = {29},
  number = {1},
  pages = {99–122},
  year = {2018},
  slug = {schobersarkkahennig2018},
  author = {Schober, M. and S{\"a}rkk{\"a}, S. and Hennig, P.}
}