Publications

Empirical Inference Perceiving Systems Conference Paper Controlling Text-to-Image Diffusion by Orthogonal Finetuning Qiu*, Z., Liu*, W., Feng, H., Xue, Y., Feng, Y., Liu, Z., Zhang, D., Weller, A., Schölkopf, B. In Advances in Neural Information Processing Systems 36, 36:79320-79362, (Editors: A. Oh and T. Neumann and A. Globerson and K. Saenko and M. Hardt and S. Levine), Curran Associates, Inc., 37th Annual Conference on Neural Information Processing Systems , December 2023, *equal contribution (Published) Home Code URL BibTeX

Perceiving Systems Conference Paper Emotional Speech-Driven Animation with Content-Emotion Disentanglement Daněček, R., Chhatre, K., Tripathi, S., Wen, Y., Black, M. J., Bolkart, T. In SIGGRAPH Asia 2023 Conference Papers, ACM, SIGGRAPH Asia, December 2023 (Published) arXiv DOI URL BibTeX

Perceiving Systems Article From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humans Keller, M., Werling, K., Shin, S., Delp, S., Pujades, S., Liu, C. K., Black, M. J. ACM Transactions on Graphics (TOG), ACM Transactions on Graphics (TOG), 42(6):253:1-253:15, ACM New York, NY, USA, December 2023 (Published) Project Page Paper DOI URL BibTeX

Perceiving Systems Article FLARE: Fast learning of Animatable and Relightable Mesh Avatars Bharadwaj, S., Zheng, Y., Hilliges, O., Black, M. J., Fernandez Abrevaya, V. ACM Transactions on Graphics (TOG), ACM Transactions on Graphics (TOG), 42(6):204:1-204:15, ACM New York, NY, USA, December 2023 (Published) Paper Project Page Code DOI URL BibTeX

Perceiving Systems Conference Paper Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariance Feng, H., Kulits, P., Liu, S., Black, M. J., Fernandez Abrevaya, V. In Proc. International Conference on Computer Vision (ICCV), International Conference on Computer Vision, October 2023 (Published) arxiv project URL BibTeX

Empirical Inference Perceiving Systems Conference Paper One-shot Implicit Animatable Avatars with Model-based Priors Huang, Y., Yi, H., Liu, W., Wang, H., Wu, B., Wang, W., Lin, B., Zhang, D., Cai, D. In Proc. International Conference on Computer Vision (ICCV), :8940-8951, International Conference on Computer Vision, October 2023, *equal contribution (Published) arXiv code project DOI BibTeX

Perceiving Systems Conference Paper Optimizing the 3D Plate Shape for Proximal Humerus Fractures Keller, M., Krall, M., Smith, J., Clement, H., Kerner, A. M., Gradischar, A., Schäfer, Ü., Black, M. J., Weinberg, A., Pujades, S. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), :487-496, Springer, MICCAI, October 2023 (Published) Project page Code Paper Poster DOI URL BibTeX

Perceiving Systems Empirical Inference Conference Paper Pairwise Similarity Learning is SimPLE Wen, Y., Liu, W., Feng, Y., Raj, B., Singh, R., Weller, A., Black, M. J., Schölkopf, B. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), International Conference on Computer Vision, October 2023 (Published) URL BibTeX

Perceiving Systems Conference Paper AG3D: Learning to Generate 3D Avatars from 2D Image Collections Dong, Z., Chen, X., Yang, J., Black, M. J., Hilliges, O., Geiger, A. In Proc. International Conference on Computer Vision (ICCV), :14916-14927, International Conference on Computer Vision (ICCV), October 2023 (Published) project pdf code video DOI URL BibTeX

Perceiving Systems Conference Paper D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field Yang, X., Luo, Y., Xiu, Y., Wang, W., Xu, H., Fan, Z. In Proc. International Conference on Computer Vision (ICCV), :9122-9132, International Conference on Computer Vision, October 2023 (Published) Code Homepage URL BibTeX

Perceiving Systems Software Workshop Conference Paper DECO: Dense Estimation of 3D Human-Scene Contact in the Wild Tripathi, S., Chatterjee, A., Passy, J., Yi, H., Tzionas, D., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :8001-8013, International Conference on Computer Vision, October 2023 (Published) Project Video Poster Code Data DOI URL BibTeX

Perceiving Systems Conference Paper SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation Athanasiou, N., Petrovich, M., Black, M. J., Varol, G. In Proc. International Conference on Computer Vision (ICCV), :9984-9995, International Conference on Computer Vision, October 2023 (Published) website code paper-arxiv video BibTeX

Perceiving Systems Conference Paper TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis Petrovich, M., Black, M. J., Varol, G. In Proc. International Conference on Computer Vision (ICCV), :9488-9497, International Conference on Computer Vision, October 2023 (Published) website code paper-arxiv video URL BibTeX

Perceiving Systems Conference Paper Synthetic Data-Based Detection of Zebras in Drone Imagery Bonetto, E., Ahmad, A. 2023 European Conference on Mobile Robots (ECMR), :1-8, IEEE, ECMR, September 2023 (Published) Generation code pdf DOI URL BibTeX

Haptic Intelligence Perceiving Systems Article Learning to Estimate Palpation Forces in Robotic Surgery From Visual-Inertial Data Lee, Y., Mat Husin, H., Forte, M., Lee, S., Kuchenbecker, K. J. IEEE Transactions on Medical Robotics and Bionics, 5(3):496-506, August 2023 (Published) DOI BibTeX

Perceiving Systems Conference Paper Synthesizing Physical Character-scene Interactions Hassan, M., Guo, Y., Wang, T., Black, M. J., Fidler, S., Bin Peng, X. In ACM SIGGRAPH 2023 Conference Proceedings, SIGGRAPH, August 2023 (Published) video arXiv ACM paper pdf BibTeX

Perceiving Systems Article BARC: Breed-Augmented Regression Using Classification for 3D Dog Reconstruction from Images Rueegg, N., Zuffi, S., Schindler, K., Black, M. J. Int. J. of Comp. Vis. (IJCV), 131(8):1964–1979, August 2023 (Published) On-line DOI URL BibTeX

Perceiving Systems Conference Paper Detecting Human-Object Contact in Images Chen, Y., Kumar Dwivedi, S., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :17100-17110, CVPR, June 2023 (Published) Project Page Paper Code DOI URL BibTeX

Perceiving Systems Conference Paper Generating Holistic 3D Human Motion from Speech Yi, H., Liang, H., Liu, Y., Cao, Q., Wen, Y., Bolkart, T., Tao, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :469-480, CVPR, June 2023 (Published) project SHOW code TalkSHOW code arXiv paper BibTeX

Perceiving Systems Conference Paper High-Fidelity Clothed Avatar Reconstruction from a Single Image Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G., Zhang, Y., Wang, X., Zhu, X., Lei, Z. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8662-8672, CVPR, June 2023 (Published) Code Paper Homepage Youtube URL BibTeX

Perceiving Systems Conference Paper Instant Multi-View Head Capture through Learnable Registration Bolkart, T., Li, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :768-779, CVPR, June 2023 (Published) project video paper sup. mat. poster BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Instant Volumetric Head Avatars Zielonka, W., Bolkart, T., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :4574-4584, CVPR, June 2023 (Published) pdf project video code face tracker code dataset DOI URL BibTeX

Perceiving Systems Conference Paper Learning from Synthetic Data Generated with GRADE Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Pretraining for Robotics (PT4R) Workshop , ICRA 2023 Pretraining for Robotics (PT4R) Workshop, June 2023 (Published) Code Data and network models pdf URL BibTeX

Haptic Intelligence Perceiving Systems Conference Paper Reconstructing Signing Avatars from Video Using Linguistic Priors Forte, M., Kulits, P., Huang, C. P., Choutas, V., Tzionas, D., Kuchenbecker, K. J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12791-12801, CVPR, June 2023 (Published) pdf arXiv project code DOI URL BibTeX

Perceiving Systems Conference Paper Simulation of Dynamic Environments for SLAM Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Workshop on the Active Methods in Autonomous Navigation, ICRA, June 2023 (Published) Code Evaluation code Data pdf URL BibTeX

Perceiving Systems Article Virtual Reality Exposure to a Healthy Weight Body Is a Promising Adjunct Treatment for Anorexia Nervosa Behrens, S. C., Tesch, J., Sun, P. J., Starke, S., Black, M. J., Schneider, H., Pruccoli, J., Zipfel, S., Giel, K. E. Psychotherapy Psychosomatics, 92(3):170-179, June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper 3D Human Pose Estimation via Intuitive Physics Tripathi, S., Müller, L., Huang, C. P., Taheri, O., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :4713-4725, CVPR, June 2023 (Published) Project Page Moyo Dataset DOI URL BibTeX

Perceiving Systems Conference Paper ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation Fan, Z., Taheri, O., Tzionas, D., Kocabas, M., Kaufmann, M., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12943-12954, CVPR, June 2023 (Published) Project Page Code Paper arXiv Video DOI URL BibTeX

Perceiving Systems Conference Paper BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion Black, M. J., Patel, P., Tesch, J., Yang, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8726-8737, CVPR, June 2023 (Published) pdf project CVF code DOI URL BibTeX

Perceiving Systems Conference Paper BITE: Beyond Priors for Improved Three-D Dog Pose Estimation Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8867-8876, CVPR, June 2023 (Published) pdf supp project DOI URL BibTeX

Perceiving Systems Conference Paper ECON: Explicit Clothed humans Optimized via Normal integration Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :512-523, CVPR, June 2023 (Published) Page Paper Demo Code Video Colab DOI URL BibTeX

Perceiving Systems Conference Paper HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :16965-16974, CVPR, June 2023 (Published) arXiv project pdf supp URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX

Perceiving Systems Conference Paper PointAvatar: Deformable Point-Based Head Avatars From Videos Zheng, Y., Yifan, W., Wetzstein, G., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :21057-21067, CVPR, June 2023 (Published) pdf project code video DOI URL BibTeX

Perceiving Systems Conference Paper SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Dai, Y., Lin, Y., Lin, X., Wen, C., Xu, L., Yi, H., Shen, S., Ma, Y., Wang, C. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :682-692, CVF, CVPR, June 2023 (Published) project dataset codebase paper arXiv BibTeX

Perceiving Systems Conference Paper TRACE: 5D Temporal Regression of Avatars With Dynamic Cameras in 3D Environments Sun, Y., Bao, Q., Liu, W., Mei, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8856-8866, CVPR, June 2023 (Published) pdf supp code video URL BibTeX

Perceiving Systems Empirical Inference Conference Paper MeshDiffusion: Score-based Generative 3D Mesh Modeling Liu, Z., Feng, Y., Black, M. J., Nowrouzezahrai, D., Paull, L., Liu, W. The Eleventh International Conference on Learning Representations (ICLR), ICLR, May 2023 (Published) Home Code URL BibTeX

Perceiving Systems Article Fast-SNARF: A Fast Deformer for Articulated Neural Fields Chen, X., Jiang, T., Song, J., Rietmann, M., Geiger, A., Black, M. J., Hilliges, O. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), :1-15, April 2023 (Published) pdf publisher site code DOI URL BibTeX

Perceiving Systems Article Viewpoint-Driven Formation Control of Airships for Cooperative Target Tracking Price, E., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, 8(6):3653-3660, 2023 (Published) publisher's site DOI BibTeX

Perceiving Systems Article SmartMocap: Joint Estimation of Human and Camera Motion Using Uncalibrated RGB Cameras Saini, N., Huang, C. P., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, 8(6):3206-3213, 2023 (Published) publisher site DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Neural Shape Modeling of 3D Clothed Humans Ma, Q. October 2023 (Published) download Thesis DOI BibTeX

Perceiving Systems Ph.D. Thesis Reconstruction and Synthesis of Human-Scene Interaction Hassan, M. University of Tübingen, February 2023 (Published) download pdf DOI BibTeX

Perceiving Systems Article AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time Fang, H., Li, J., Tang, H., Xu, C., Zhu, H., Xiu, Y., Li, Y., Lu, C. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 45(6):7157 - 7173, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds Jiang, T. C. X. S. J. H. O. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Learning Clothed 3D Human Models with Articulated Neural Implicit Representations Chen, X. July 2023 (Published) download DOI BibTeX

Perceiving Systems Patent Method and systems for labelling motion-captured points J., B. M., Ghorbani, N. (US Patent App.~17/949,087), April 2023 (Published) BibTeX

Perceiving Systems Ph.D. Thesis Monocular 3D Shape and Pose Estimation for Humans and Animals Rueegg, N. 2023 (Published) download pdf DOI BibTeX

Perceiving Systems Conference Paper On Fairness in Face Albedo Estimation Feng, H., Bolkart, T., Tesch, J., Black, M. J., Abrevaya, V. In PROCEEDINGS SIGGRAPH 2022 TALKS, PROCEEDINGS SIGGRAPH 2022 TALKS, :1-2, SIGGRAPH, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper OpenScene: 3D Scene Understanding with Open Vocabularies Peng, S., Genova, K., Jiang, C. M., Tagliasacchi, A., Pollefeys, M., Funkhouser, T. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :815-824, IEEE Explore, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Reining in the Deep Generative Models Ghosh, P. University of Tübingen, May 2023 (Published) download pdf DOI BibTeX

Publications

Filter by