Perceiving Systems Conference Paper 2014

FAUST: Dataset and evaluation for 3D mesh registration

Faust

New scanning technologies are increasing the importance of 3D mesh data and the need for algorithms that can reliably align it. Surface registration is important for building full 3D models from partial scans, creating statistical shape models, shape retrieval, and tracking. The problem is particularly challenging for non-rigid and articulated objects like human bodies. While the challenges of real-world data registration are not present in existing synthetic datasets, establishing ground-truth correspondences for real 3D scans is difficult. We address this with a novel mesh registration technique that combines 3D shape and appearance information to produce high-quality alignments. We define a new dataset called FAUST that contains 300 scans of 10 people in a wide range of poses together with an evaluation methodology. To achieve accurate registration, we paint the subjects with high-frequency textures and use an extensive validation process to ensure accurate ground truth. We find that current shape registration methods have trouble with this real-world data. The dataset and evaluation website are available for research purposes at http://faust.is.tue.mpg.de.

Award: (Dataset Award, Eurographics Symposium on Geometry Processing (SGP), 2016)
Author(s): Federica Bogo and Javier Romero and Matthew Loper and Michael J. Black
Book Title: Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)
Pages: 3794 --3801
Year: 2014
Month: June
Project(s):
Bibtex Type: Conference Paper (inproceedings)
Address: Columbus, Ohio, USA
DOI: 10.1109/CVPR.2014.491
Event Name: IEEE International Conference on Computer Vision and Pattern Recognition
Event Place: Columbus, Ohio, USA
Award Paper: Dataset Award, Eurographics Symposium on Geometry Processing (SGP), 2016
Electronic Archiving: grant_archive
Links:

BibTex

@inproceedings{Bogo:CVPR:2014,
  title = {{FAUST}: Dataset and evaluation for {3D} mesh registration},
  aword_paper = {Dataset Award, Eurographics Symposium on Geometry Processing (SGP), 2016},
  booktitle = { Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)},
  abstract = {New scanning technologies are increasing the importance of 3D mesh data and the need for algorithms that can reliably align it. Surface registration is important for building full 3D models from partial scans, creating statistical shape models, shape retrieval, and tracking. The problem is particularly challenging for non-rigid and articulated objects like human bodies. While the challenges of real-world data registration are not present in existing synthetic datasets, establishing ground-truth correspondences for real 3D scans is difficult. We address this with a novel mesh registration technique that combines 3D shape and appearance information to produce high-quality alignments. We define a new dataset called FAUST that contains 300 scans of 10 people in a wide range of poses together with an evaluation methodology. To achieve accurate registration, we paint the subjects with high-frequency textures
  and use an extensive validation process to ensure accurate ground truth. We find that current shape registration methods have trouble with this real-world data. The dataset and evaluation website are available for research purposes at http://faust.is.tue.mpg.de.},
  pages = {3794  --3801},
  address = {Columbus, Ohio, USA},
  month = jun,
  year = {2014},
  slug = {bogo-cvpr-2014},
  author = {Bogo, Federica and Romero, Javier and Loper, Matthew and Black, Michael J.},
  month_numeric = {6}
}