Teaser

Intrinsic images such as albedo and shading are valuable for later stages of visual processing. Previous methods for extracting albedo and shading use either single images or images together with depth data. Instead, we define intrinsic video estimation as the problem of extracting temporally coherent albedo and shading from video alone. Our approach exploits the assumption that albedo is constant over time while shading changes slowly. Optical flow aids in the accurate estimation of intrinsic video by providing temporal continuity as well as putative surface boundaries. Additionally, we find that the estimated albedo sequence can be used to improve optical flow accuracy in sequences with changing illumination. The approach makes only weak assumptions about the scene and we show that it substantially outperforms existing single-frame intrinsic image methods. We evaluate this quantitatively on synthetic sequences as well on challenging natural sequences with complex geometry, motion, and illumination.

Author(s): Naejin Kong and Peter V. Gehler and Michael J. Black
Book Title: Computer Vision – ECCV 2014
Volume: 8690
Pages: 360--375
Year: 2014
Month: September
Series: Lecture Notes in Computer Science
Editors: D. Fleet and T. Pajdla and B. Schiele and T. Tuytelaars
Publisher: Springer International Publishing
Project(s):
Bibtex Type: Conference Paper (inproceedings)
DOI: 10.1007/978-3-319-10605-2_24
Event Name: 13th European Conference on Computer Vision
Event Place: Zürich, Switzerland
Electronic Archiving: grant_archive
Links:

BibTex

@inproceedings{Kong:ECCV:2014,
  title = {Intrinsic Video},
  booktitle = {Computer Vision -- ECCV 2014},
  abstract = {Intrinsic images such as albedo and shading are valuable for later stages of visual processing. Previous methods for extracting albedo and shading use either single images or images together with depth data. Instead, we define intrinsic video estimation as the problem of extracting temporally coherent albedo and shading from video alone. Our approach exploits the assumption that albedo is constant over time while shading changes slowly. Optical flow aids in the accurate estimation of intrinsic video by providing temporal continuity as well as putative surface boundaries. Additionally, we find that the estimated albedo sequence can be used to improve optical flow accuracy in sequences with changing illumination. The approach makes only weak assumptions about the scene and we show that it substantially outperforms existing single-frame intrinsic image methods. We evaluate this quantitatively on synthetic sequences as well on challenging natural sequences with complex geometry, motion, and illumination.},
  volume = {8690},
  pages = {360--375},
  series = {Lecture Notes in Computer Science},
  editors = {D. Fleet  and T. Pajdla and B. Schiele  and T. Tuytelaars },
  publisher = {Springer International Publishing},
  month = sep,
  year = {2014},
  slug = {kong-eccv-2014},
  author = {Kong, Naejin and Gehler, Peter V. and Black, Michael J.},
  month_numeric = {9}
}