Publications

Haptic Intelligence Perceiving Systems Conference Paper Reconstructing Signing Avatars from Video Using Linguistic Priors Forte, M., Kulits, P., Huang, C. P., Choutas, V., Tzionas, D., Kuchenbecker, K. J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12791-12801, CVPR, June 2023 (Published) pdf arXiv project code DOI URL BibTeX

Perceiving Systems Conference Paper Simulation of Dynamic Environments for SLAM Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Workshop on the Active Methods in Autonomous Navigation, ICRA, June 2023 (Published) Code Evaluation code Data pdf URL BibTeX

Perceiving Systems Article Virtual Reality Exposure to a Healthy Weight Body Is a Promising Adjunct Treatment for Anorexia Nervosa Behrens, S. C., Tesch, J., Sun, P. J., Starke, S., Black, M. J., Schneider, H., Pruccoli, J., Zipfel, S., Giel, K. E. Psychotherapy Psychosomatics, 92(3):170-179, June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper 3D Human Pose Estimation via Intuitive Physics Tripathi, S., Müller, L., Huang, C. P., Taheri, O., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :4713-4725, CVPR, June 2023 (Published) Project Page Moyo Dataset DOI URL BibTeX

Perceiving Systems Conference Paper ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation Fan, Z., Taheri, O., Tzionas, D., Kocabas, M., Kaufmann, M., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12943-12954, CVPR, June 2023 (Published) Project Page Code Paper arXiv Video DOI URL BibTeX

Perceiving Systems Conference Paper BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion Black, M. J., Patel, P., Tesch, J., Yang, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8726-8737, CVPR, June 2023 (Published) pdf project CVF code DOI URL BibTeX

Perceiving Systems Conference Paper BITE: Beyond Priors for Improved Three-D Dog Pose Estimation Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8867-8876, CVPR, June 2023 (Published) pdf supp project DOI URL BibTeX

Perceiving Systems Conference Paper ECON: Explicit Clothed humans Optimized via Normal integration Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :512-523, CVPR, June 2023 (Published) Page Paper Demo Code Video Colab DOI URL BibTeX

Perceiving Systems Conference Paper HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :16965-16974, CVPR, June 2023 (Published) arXiv project pdf supp URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX

Perceiving Systems Conference Paper PointAvatar: Deformable Point-Based Head Avatars From Videos Zheng, Y., Yifan, W., Wetzstein, G., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :21057-21067, CVPR, June 2023 (Published) pdf project code video DOI URL BibTeX

Perceiving Systems Conference Paper SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Dai, Y., Lin, Y., Lin, X., Wen, C., Xu, L., Yi, H., Shen, S., Ma, Y., Wang, C. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :682-692, CVF, CVPR, June 2023 (Published) project dataset codebase paper arXiv BibTeX

Perceiving Systems Conference Paper TRACE: 5D Temporal Regression of Avatars With Dynamic Cameras in 3D Environments Sun, Y., Bao, Q., Liu, W., Mei, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8856-8866, CVPR, June 2023 (Published) pdf supp code video URL BibTeX

Perceiving Systems Empirical Inference Conference Paper MeshDiffusion: Score-based Generative 3D Mesh Modeling Liu, Z., Feng, Y., Black, M. J., Nowrouzezahrai, D., Paull, L., Liu, W. The Eleventh International Conference on Learning Representations (ICLR), ICLR, May 2023 (Published) Home Code URL BibTeX

Perceiving Systems Article Fast-SNARF: A Fast Deformer for Articulated Neural Fields Chen, X., Jiang, T., Song, J., Rietmann, M., Geiger, A., Black, M. J., Hilliges, O. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), :1-15, April 2023 (Published) pdf publisher site code DOI URL BibTeX

Perceiving Systems Article Viewpoint-Driven Formation Control of Airships for Cooperative Target Tracking Price, E., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, 8(6):3653-3660, 2023 (Published) publisher's site DOI BibTeX

Perceiving Systems Article SmartMocap: Joint Estimation of Human and Camera Motion Using Uncalibrated RGB Cameras Saini, N., Huang, C. P., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, 8(6):3206-3213, 2023 (Published) publisher site DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Neural Shape Modeling of 3D Clothed Humans Ma, Q. October 2023 (Published) download Thesis DOI BibTeX

Perceiving Systems Ph.D. Thesis Reconstruction and Synthesis of Human-Scene Interaction Hassan, M. University of Tübingen, February 2023 (Published) download pdf DOI BibTeX

Perceiving Systems Article AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time Fang, H., Li, J., Tang, H., Xu, C., Zhu, H., Xiu, Y., Li, Y., Lu, C. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 45(6):7157 - 7173, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds Jiang, T. C. X. S. J. H. O. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Learning Clothed 3D Human Models with Articulated Neural Implicit Representations Chen, X. July 2023 (Published) download DOI BibTeX

Perceiving Systems Patent Method and systems for labelling motion-captured points J., B. M., Ghorbani, N. (US Patent App.~17/949,087), April 2023 (Published) BibTeX

Perceiving Systems Ph.D. Thesis Monocular 3D Shape and Pose Estimation for Humans and Animals Rueegg, N. 2023 (Published) download pdf DOI BibTeX

Perceiving Systems Conference Paper On Fairness in Face Albedo Estimation Feng, H., Bolkart, T., Tesch, J., Black, M. J., Abrevaya, V. In PROCEEDINGS SIGGRAPH 2022 TALKS, PROCEEDINGS SIGGRAPH 2022 TALKS, :1-2, SIGGRAPH, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper OpenScene: 3D Scene Understanding with Open Vocabularies Peng, S., Genova, K., Jiang, C. M., Tagliasacchi, A., Pollefeys, M., Funkhouser, T. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :815-824, IEEE Explore, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Reining in the Deep Generative Models Ghosh, P. University of Tübingen, May 2023 (Published) download pdf DOI BibTeX

Perceiving Systems Conference Paper Vid2Avatar: 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition Guo, C., Jiang, T., Chen, X., Song, J., Hilliges, O. In EEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :12858-12868, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Capturing and Animation of Body and Clothing from Monocular Video Feng, Y., Yang, J., Pollefeys, M., Black, M. J., Bolkart, T. In Proceedings SIGGRAPH Asia 2022 Conference Papers Proceedings (SA ’22 2022) , SIGGRAPH Asia 2022 Conference Papers Proceedings (SA'22) , December 2022 (Published) project code pdf DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Reconstructing Expressive 3D Humans from RGB Images Choutas, V. ETH Zurich, Max Planck Institute for Intelligent Systems and ETH Zurich, December 2022 (Published) pdf DOI BibTeX

Perceiving Systems Article How immersive virtual reality can become a key tool to advance research and psychotherapy of eating and weight disorders Behrens, S. C., Streuber, S., Keizer, A., Giel, K. E. Frontiers in Psychiatry, 13:1011620, November 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper DART: Articulated Hand Model with Diverse Accessories and Rich Textures Gao, D., Xiu, Y., Li, K., Yang, L., Wang, F., Zhang, P., Zhang, B., Lu, C., Tan, P. Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), NeurIPS 2022-Datasets and Benchmarks Track, November 2022 (Published) Home Code Video BibTeX

Perceiving Systems Conference Paper Deep Residual Reinforcement Learning based Autonomous Blimp Control Liu, Y. T., Price, E., Black, M. J., Ahmad, A. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022), :12566-12573, IEEE, Piscataway, NJ, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022) , October 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper Learning to Fit Morphable Models Choutas, V., Bogo, F., Shen, J., Valentin, J. In Computer Vision – ECCV 2022, 6:160-179, Lecture Notes in Computer Science, 13666, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) Project page Video PDF Poster DOI BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Towards Metrical Reconstruction of Human Faces Zielonka, W., Bolkart, T., Thies, J. In Computer Vision – ECCV 2022, 13:250-269, Lecture Notes in Computer Science, 13673, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) pdf project video code DOI URL BibTeX

Perceiving Systems Conference Paper Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguation Feng, H., Bolkart, T., Tesch, J., Black, M. J., Fernandez Abrevaya, V. In Computer Vision – ECCV 2022, 13:72-90, Lecture Notes in Computer Science, 13673, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) pdf project code DOI URL BibTeX

Perceiving Systems Conference Paper SUPR: A Sparse Unified Part-Based Human Representation Osman, A. A. A., Bolkart, T., Tzionas, D., Black, M. J. In Computer Vision – ECCV 2022, 2:568-585, Lecture Notes in Computer Science, 13662, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) Project website Code Main Paper Supp. Mat. Poster DOI BibTeX

Perceiving Systems Conference Paper TEMOS: Generating Diverse Human Motions from Textual Descriptions Petrovich, M., Black, M. J., Varol, G. In European Conference on Computer Vision (ECCV 2022), Springer International Publishing, ECCV, October 2022 (Published) website code paper-arxiv video DOI URL BibTeX

Perceiving Systems Conference Paper Neural Point-based Shape Modeling of Humans in Challenging Clothing Ma, Q., Yang, J., Black, M. J., Tang, S. In 2022 International Conference on 3D Vision (3DV 2022), :679-689, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project page Code arXiv Paper Supp Poster DOI URL BibTeX

Perceiving Systems Conference Paper Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors Wang, X., Li, G., Kuo, Y., Kocabas, M., Aksan, E., Hilliges, O. In 2022 International Conference on 3D Vision (3DV 2022), :353-362, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project Page Video Arxiv DOI BibTeX

Perceiving Systems Conference Paper InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction Huang, Y., Taheri, O., Black, M. J., Tzionas, D. In Pattern Recognition, :281-299, Lecture Notes in Computer Science, 13485, (Editors: Andres, Björn and Bernard, Florian and Cremers, Daniel and Frintrop, Simone and Goldlücke, Bastian and Ihrke, Ivo), Springer, Cham, 44th DAGM German Conference on Pattern Recognition (DAGM GCPR 2022), September 2022 (Published) Code Data YouTube Video pdf DOI URL BibTeX

Perceiving Systems Autonomous Learning Conference Paper InvGAN: Invertible GANs Ghosh, P., Zietlow, D., Black, M. J., Davis, L. S., Hu, X. In Pattern Recognition, :3-19, Lecture Notes in Computer Science, 13485, (Editors: Andres, Björn and Bernard, Florian and Cremers, Daniel and Frintrop, Simone and Goldlücke, Bastian and Ihrke, Ivo), Springer, Cham, 44th DAGM German Conference on Pattern Recognition (DAGM GCPR 2022), September 2022 (Published) pdf DOI BibTeX

Perceiving Systems Conference Paper TEACH: Temporal Action Composition for 3D Humans Athanasiou, N., Petrovich, M., Black, M. J., Varol, G. In 2022 International Conference on 3D Vision (3DV), :414-423, 3DV'22, September 2022 (Published) code arXiv website video camera-ready DOI URL BibTeX

Perceiving Systems Conference Paper TempCLR: Reconstructing Hands via Time-Coherent Contrastive Learning Ziani, A., Fan, Z., Kocabas, M., Christen, S., Hilliges, O. In 2022 International Conference on 3D Vision (3DV 2022), :627-636, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project Page Code Arxiv Video DOI URL BibTeX

Perceiving Systems Article iRotate: Active visual SLAM for omnidirectional robots Bonetto, E., Goldschmid, P., Pabst, M., Black, M. J., Ahmad, A. Robotics and Autonomous Systems, 154:104102, Elsevier, August 2022 (Published) Code Data iRotate Data Independent Camera experiments DOI URL BibTeX

Perceiving Systems Conference Paper Accurate 3D Body Shape Regression using Metric and Semantic Attributes Choutas, V., Müller, L., Huang, C. P., Tang, S., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :2708-2718, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Video Paper Supplementary Material Poster DOI URL BibTeX

Perceiving Systems Optics and Sensing Laboratory Conference Paper Capturing and Inferring Dense Full-Body Human-Scene Contact Huang, C. P., Yi, H., Höschle, M., Safroshkin, M., Alexiadis, T., Polikovsky, S., Scharstein, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13264-13275, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv BSTRO code video DOI URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper Human-Aware Object Placement for Visual Environment Reconstruction Yi, H., Huang, C. P., Tzionas, D., Kocabas, M., Hassan, M., Tang, S., Thies, J., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :3949-3960, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI URL BibTeX

Perceiving Systems Conference Paper Occluded Human Mesh Recovery Khirodkar, R., Tripathi, S., Kitani, K. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :1705-1715, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI BibTeX

Perceiving Systems Conference Paper Putting People in their Place: Monocular Regression of 3D People in Depth Sun, Y., Liu, W., Bao, Q., Fu, Y., Mei, T., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13233-13242, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Project Code Data Sup Mat DOI URL BibTeX

Publications

Filter by