Perceiving Systems Autonomous Vision Conference Paper 2015

Discrete Optimization for Optical Flow

Menze

We propose to look at large-displacement optical flow from a discrete point of view. Motivated by the observation that sub-pixel accuracy is easily obtained given pixel-accurate optical flow, we conjecture that computing the integral part is the hardest piece of the problem. Consequently, we formulate optical flow estimation as a discrete inference problem in a conditional random field, followed by sub-pixel refinement. Naive discretization of the 2D flow space, however, is intractable due to the resulting size of the label set. In this paper, we therefore investigate three different strategies, each able to reduce computation and memory demands by several orders of magnitude. Their combination allows us to estimate large-displacement optical flow both accurately and efficiently and demonstrates the potential of discrete optimization for optical flow. We obtain state-of-the-art performance on MPI Sintel and KITTI.

Author(s): Moritz Menze and Christian Heipke and Andreas Geiger
Book Title: German Conference on Pattern Recognition (GCPR)
Volume: 9358
Pages: 16--28
Year: 2015
Publisher: Springer International Publishing
Bibtex Type: Conference Paper (inproceedings)
DOI: 10.1007/978-3-319-24947-6_2
Event Place: Aachen
Electronic Archiving: grant_archive
ISBN: 978-3-319-24946-9
Links:

BibTex

@inproceedings{Menze2015GCPR,
  title = {Discrete Optimization for Optical Flow},
  booktitle = {German Conference on Pattern Recognition (GCPR)},
  abstract = {We propose to look at large-displacement optical flow from a discrete point of view. Motivated by the observation that sub-pixel accuracy is easily obtained given pixel-accurate optical flow, we conjecture that computing the integral part is the hardest piece of the problem. Consequently, we formulate optical flow estimation as a discrete inference problem in a conditional random field, followed by sub-pixel refinement. Naive discretization of the 2D flow space, however, is intractable due to the resulting size of the label set. In this paper, we therefore investigate three different strategies, each able to reduce computation and memory demands by several orders of magnitude. Their combination allows us to estimate large-displacement optical flow both accurately and efficiently and demonstrates the potential of discrete optimization for optical flow. We obtain state-of-the-art performance on MPI Sintel and KITTI.},
  volume = {9358},
  pages = {16--28},
  publisher = {Springer International Publishing},
  year = {2015},
  slug = {menze2015gcpr},
  author = {Menze, Moritz and Heipke, Christian and Geiger, Andreas}
}