Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Perceiving Systems Empirical Inference Conference Paper Grasping Field: Learning Implicit Representations for Human Grasps Karunratanakul, K., Yang, J., Zhang, Y., Black, M., Muandet, K., Tang, S. In 2020 International Conference on 3D Vision (3DV 2020), :333-344, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf arXiv code DOI BibTeX
Thumb ticker lg graspinfield

Perceiving Systems Article Occlusion Boundary: A Formal Definition & Its Detection via Deep Exploration of Context Wang, C., Fu, H., Tao, D., Black, M. J. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(5):2641-2656, November 2020 (Published) official version DOI BibTeX
Thumb ticker lg occlusionpami

Perceiving Systems Conference Paper GIF: Generative Interpretable Faces Ghosh, P., Gupta, P. S., Uziel, R., Ranjan, A., Black, M. J., Bolkart, T. In 2020 International Conference on 3D Vision (3DV 2020), 1:868-878, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf project code video DOI BibTeX
Thumb ticker lg gif

Perceiving Systems Conference Paper PLACE: Proximity Learning of Articulation and Contact in 3D Environments Zhang, S., Zhang, Y., Ma, Q., Black, M. J., Tang, S. In 2020 International Conference on 3D Vision (3DV 2020), 1:642-651, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf arXiv project code DOI BibTeX
Thumb ticker lg place

Perceiving Systems Article 3D Morphable Face Models - Past, Present and Future Egger, B., Smith, W. A. P., Tewari, A., Wuhrer, S., Zollhoefer, M., Beeler, T., Bernard, F., Bolkart, T., Kortylewski, A., Romdhani, S., et al. ACM Transactions on Graphics, 39(5):157, October 2020 (Published) project page pdf preprint DOI BibTeX
Thumb ticker lg 3dmm

Perceiving Systems Article AirCapRL: Autonomous Aerial Human Motion Capture Using Deep Reinforcement Learning Tallamraju, R., Saini, N., Bonetto, E., Pabst, M., Liu, Y. T., Black, M., Ahmad, A. IEEE Robotics and Automation Letters, 5(4):6678-6685, IEEE, October 2020, Also accepted and presented in the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (Published) DOI URL BibTeX
Thumb ticker lg cover paper website

Perceiving Systems Conference Paper Learning a statistical full spine model from partial observations Meng, D., Keller, M., Boyer, E., Black, M., Pujades, S. In Shape in Medical Imaging, :122-133, Lecture Notes in Computer Science, 12474, (Editors: Reuter, Martin and Wachinger, Christian and Lombaert, Hervé and Paniagua, Beatriz and Goksel, Orcun and Rekik, Islem), Springer, Cham, International Workshop on Shape in Medical Imaging (ShapeMI 2020), October 2020 (Published) Gitlab Code PDF DOI BibTeX
Thumb ticker lg demo 600

Perceiving Systems Conference Paper GRAB: A Dataset of Whole-Body Human Grasping of Objects Taheri, O., Ghorbani, N., Black, M. J., Tzionas, D. In Computer Vision – ECCV 2020, 4:581-600, Lecture Notes in Computer Science, 12349, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) pdf suppl video (long) video (short) DOI URL BibTeX
Thumb ticker lg grab thumb3

Perceiving Systems Conference Paper Monocular Expressive Body Regression through Body-Driven Attention Choutas, V., Pavlakos, G., Bolkart, T., Tzionas, D., Black, M. J. In Computer Vision - ECCV 2020, 10:20-40, Lecture Notes in Computer Science, 12355, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) code Short video Long video arxiv pdf suppl DOI URL BibTeX
Thumb ticker lg merged2

Perceiving Systems Conference Paper STAR: Sparse Trained Articulated Human Body Regressor Osman, A. A. A., Bolkart, T., Black, M. J. In Computer Vision - ECCV 2020, 6:598-613, Lecture Notes in Computer Science, 12351, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) Project Page Code Video paper supplemental DOI BibTeX
Thumb ticker lg main teaser

Perceiving Systems Article Analysis of motor development within the first year of life: 3-D motion tracking without markers for early detection of developmental disorders Parisi, C., Hesse, N., Tacke, U., Rocamora, S. P., Blaschek, A., Hadders-Algra, M., Black, M. J., Heinen, F., Müller-Felber, W., Schroeder, A. S. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 63(7):881–890, July 2020 (Published) pdf on-line w/ sup mat DOI BibTeX
Thumb ticker lg baby2

Perceiving Systems Conference Paper Generating 3D People in Scenes without People Zhang, Y., Hassan, M., Neumann, H., Black, M. J., Tang, S. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :6193-6203, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Code Video PDF DOI BibTeX
Thumb ticker lg yancvpr

Perceiving Systems Conference Paper Learning Physics-guided Face Relighting under Directional Light Nestmeyer, T., Lalonde, J., Matthews, I., Lehrmann, A. M. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :5123-5132, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Paper DOI BibTeX
Thumb ticker lg teaser incl ball

Perceiving Systems Article Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequences Hesse, N., Pujades, S., Black, M., Arens, M., Hofmann, U., Schroeder, S. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 42(10):2540-2551, 2020 () pdf Journal DOI BibTeX
Thumb ticker lg hessepami

Perceiving Systems Conference Paper Learning to Dress 3D People in Generative Clothing Ma, Q., Yang, J., Ranjan, A., Pujades, S., Pons-Moll, G., Tang, S., Black, M. J. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :6468-6477, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Project page Code Long video Short Video arXiv DOI URL BibTeX
Thumb ticker lg cape teaser ps website v3

Perceiving Systems Patent Machine learning systems and methods of estimating body shape from images Black, M., Rachlin, E., Heron, N., Loper, M., Weiss, A., Hu, K., Hinkle, T., Kristiansen, M. (US Patent 10,679,046), June 2020 () BibTeX
Thumb ticker lg patent2020b

Perceiving Systems Conference Paper GENTEL: GENerating Training data Efficiently for Learning to segment medical images Thakur, R. P., Pujades, S., Goel, L., Pohmann, R., Machann, J., Black, M. J. RFIAP 2020 - Congrés Reconnaissance des Formes, Image, Apprentissage et Perception , Congrès Reconnaissance des Formes, Image, Apprentissage et Perception (RFAIP 2020) , June 2020 (Published) Project Page PDF URL BibTeX
Thumb ticker lg gentel

Perceiving Systems Conference Paper VIBE: Video Inference for Human Body Pose and Shape Estimation Kocabas, M., Athanasiou, N., Black, M. J. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :5252-5262, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) arXiv code video supplemental video pdf DOI BibTeX
Thumb ticker lg vibe

Perceiving Systems Article General Movement Assessment from videos of computed 3D infant body models is equally effective compared to conventional RGB Video rating Schroeder, S., Hesse, N., Weinberger, R., Tacke, U., Gerstl, L., Hilgendorff, A., Heinen, F., Arens, M., Bodensteiner, C., Dijkstra, L. J., et al. Early Human Development, 144:104967, May 2020 () DOI BibTeX
Thumb ticker lg gma

Empirical Inference Perceiving Systems Probabilistic Learning Group Conference Paper From Variational to Deterministic Autoencoders Ghosh*, P., Sajjadi*, M. S. M., Vergari, A., Black, M. J., Schölkopf, B. 8th International Conference on Learning Representations (ICLR) , April 2020, *equal contribution (Published) arXiv URL BibTeX
Thumb ticker lg rae

Perceiving Systems Article Learning Multi-Human Optical Flow Ranjan, A., Hoffmann, D. T., Tzionas, D., Tang, S., Romero, J., Black, M. J. International Journal of Computer Vision (IJCV), 128(4):873-890, April 2020 (Published) pdf DOI poster DOI URL BibTeX
Thumb ticker lg multihumanoflow thumb

Empirical Inference Perceiving Systems Article Real Time Trajectory Prediction Using Deep Conditional Generative Models Gomez-Gonzalez, S., Prokudin, S., Schölkopf, B., Peters, J. IEEE Robotics and Automation Letters, 5(2):970-976, IEEE, April 2020 (Published) arXiv DOI BibTeX
Thumb ticker lg sergeyrobot

Perceiving Systems Conference Paper Attractiveness and Confidence in Walking Style of Male and Female Virtual Characters Thaler, A., Bieg, A., Mahmood, N., Black, M. J., Mohler, B. J., Troje, N. F. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2020), :678-679, IEEE, Piscataway, NJ, IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2020), March 2020 (Published) pdf DOI BibTeX
Thumb ticker lg thaler2020

Perceiving Systems Article The iReAct study - A biopsychosocial analysis of the individual response to physical activity Thiel, A., Sudeck, G., Gropper, H., Maturana, F. M., Schubert, T., Srismith, D., Widmann, M., Behrens, S., Martus, P., Munz, B., et al. Contemporary Clinical Trials Communications , 17:100508, March 2020 (Published) DOI BibTeX
Thumb ticker lg 1 s2.0 s2451865419302716 gr1

Perceiving Systems Conference Paper Chained Representation Cycling: Learning to Estimate 3D Human Pose and Shape by Cycling Between Representations Rueegg, N., Lassner, C., Black, M. J., Schindler, K. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, 4:5561-5569, AAAI Press, Palo Alto, CA, Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2020), February 2020 (Published) pdf DOI BibTeX
Thumb ticker lg aaai

Perceiving Systems Patent Machine learning systems and methods for augmenting images Black, M., Rachlin, E., Lee, E., Heron, N., Loper, M., Weiss, A., Smith, D. (US Patent 10,529,137 B1), January 2020 () BibTeX
Thumb ticker lg patentaugmentation

Perceiving Systems Article Influence of Physical Activity Interventions on Body Representation: A Systematic Review Srismith, D., Wider, L., Wong, H. Y., Zipfel, S., Thiel, A., Giel, K. E., Behrens, S. C. Frontiers in Psychiatry, 11:99, 2020 (Published) DOI BibTeX
Thumb ticker lg frontiers