Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Perceiving Systems Conference Paper Learning Joint Reconstruction of Hands and Manipulated Objects Hasson, Y., Varol, G., Tzionas, D., Kalevatykh, I., Black, M. J., Laptev, I., Schmid, C. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :11807-11816, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () pdf suppl poster DOI URL BibTeX
Thumb ticker lg obman new

Perceiving Systems Conference Paper Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision Sanyal, S., Bolkart, T., Feng, H., Black, M. J. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), :7763-7772, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () code pdf preprint URL BibTeX
Thumb ticker lg ringnet

Perceiving Systems Empirical Inference Conference Paper Local Temporal Bilinear Pooling for Fine-grained Action Parsing Zhang, Y., Tang, S., Muandet, K., Jarvers, C., Neumann, H. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), :12005-12015, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () Code video demo pdf URL BibTeX
Thumb ticker lg cvpr2019 demo v2.001

Perceiving Systems Conference Paper Distributed, Collaborative Virtual Reality Application for Product Development with Simple Avatar Calibration Method Dixken, M., Diers, D., Wingert, B., Hatzipanayioti, A., Mohler, B. J., Riedel, O., Bues, M. IEEE Conference on Virtual Reality and 3D User Interfaces, (VR), :1299-1300, IEEE, March 2019 (Published) DOI BibTeX
Thumb ticker lg vr

Perceiving Systems Article Perceptual Effects of Inconsistency in Human Animations Kenny, S., Mahmood, N., Honda, C., Black, M. J., Troje, N. F. ACM Trans. Appl. Percept., 16(1):2:1-2:18, February 2019 () publisher pdf DOI BibTeX
Thumb ticker lg kenny

Perceiving Systems Miscellaneous Perceiving Systems (2016-2018) Scientific Advisory Board Report, 2019 () pdf BibTeX
Thumb ticker lg webteaser

Perceiving Systems Article Self and Body Part Localization in Virtual Reality: Comparing a Headset and a Large-Screen Immersive Display van der Veer, A. H., Longo, M. R., Alsmith, A. J. T., Wong, H. Y., Mohler, B. J. Frontiers in Robotics and AI, 6(33), 2019 (Published) DOI BibTeX
Thumb ticker lg frobt 06 00033 g001

Perceiving Systems Article The Virtual Caliper: Rapid Creation of Metrically Accurate Avatars from 3D Measurements Pujades, S., Mohler, B., Thaler, A., Tesch, J., Mahmood, N., Hesse, N., Bülthoff, H. H., Black, M. J. IEEE Transactions on Visualization and Computer Graphics, 25(5):1887-1897, IEEE, 2019 () Project Page IEEE Open Access IEEE Open Access PDF DOI BibTeX
Thumb ticker lg vc teaser thumb

Perceiving Systems Article DeepCEST 3T: Robust MRI parameter determination and uncertainty quantification with neural networks—application to CEST imaging of the human brain at 3T Glang, F., Deshmane, A., Prokudin, S., Martin, F., Herz, K., Lindig, T., Bender, B., Scheffler, K., Zaiss, M. Magnetic Resonance in Medicine , 84(1):450-466, 2019 (Published) DOI URL BibTeX
Thumb ticker lg mri

Perceiving Systems Conference Paper Customized Multi-Person Tracker Ma, L., Tang, S., Black, M. J., Van Gool, L. In Computer Vision – ACCV 2018, Springer International Publishing, Asian Conference on Computer Vision, December 2018 () PDF BibTeX
Thumb ticker lg imgidx 00326

Perceiving Systems Article Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time Huang, Y., Kaufmann, M., Aksan, E., Black, M. J., Hilliges, O., Pons-Moll, G. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 37:185:1-185:15, ACM, November 2018, Two first authors contributed equally () data code pdf preprint errata video DOI BibTeX
Thumb ticker lg dip final

Perceiving Systems Article Deep Neural Network-based Cooperative Visual Tracking through Multiple Micro Aerial Vehicles Price, E., Lawless, G., Ludwig, R., Martinovic, I., Buelthoff, H. H., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, Robotics and Automation Letters, 3(4):3193-3200, IEEE, October 2018, Also accepted and presented in the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (Published) Published Version DOI URL BibTeX
Thumb ticker lg cover

Perceiving Systems Article First Impressions of Personality Traits From Body Shapes Hu, Y., Parde, C. J., Hill, M. Q., Mahmood, N., O’Toole, A. J. Psychological Science, 29(12):1969-–1983, October 2018 () publisher site pdf DOI BibTeX
Thumb ticker lg alice

Perceiving Systems Autonomous Vision Conference Paper On the Integration of Optical Flow and Action Recognition Sevilla-Lara, L., Liao, Y., Güney, F., Jampani, V., Geiger, A., Black, M. J. In German Conference on Pattern Recognition (GCPR), LNCS 11269:281-297, Springer, Cham, October 2018 () arXiv DOI BibTeX
Thumb ticker lg sevillagcpr

Perceiving Systems Conference Paper Temporal Interpolation as an Unsupervised Pretraining Task for Optical Flow Estimation Wulff, J., Black, M. J. In German Conference on Pattern Recognition (GCPR), LNCS 11269:567-582, Springer, Cham, October 2018 () pdf arXiv DOI BibTeX
Thumb ticker lg interpolation

Perceiving Systems Conference Paper Human Motion Parsing by Hierarchical Dynamic Clustering Zhang, Y., Tang, S., Sun, H., Neumann, H. In Proceedings of the British Machine Vision Conference (BMVC), :269, BMVA Press, 29th British Machine Vision Conference, September 2018 () pdf BibTeX
Thumb ticker lg bmvc pic

Perceiving Systems Conference Paper Deep Directional Statistics: Pose Estimation with Uncertainty Quantification Prokudin, S., Gehler, P., Nowozin, S. European Conference on Computer Vision (ECCV), 9:542-559, September 2018 () code pdf BibTeX
Thumb ticker lg eccv pascal results  thumbnail

Perceiving Systems Conference Paper Generating 3D Faces using Convolutional Mesh Autoencoders Ranjan, A., Bolkart, T., Sanyal, S., Black, M. J. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11207:725-741, Springer, Cham, September 2018 () Code (tensorflow) Code (pytorch) Project Page paper supplementary DOI BibTeX
Thumb ticker lg coma faces

Perceiving Systems Conference Paper Learning Human Optical Flow Ranjan, A., Romero, J., Black, M. J. In 29th British Machine Vision Conference, September 2018 () video code pdf URL BibTeX
Thumb ticker lg persondetect  copy

Perceiving Systems Conference Paper Learning an Infant Body Model from RGB-D Data for Accurate Full Body Motion Analysis Hesse, N., Pujades, S., Romero, J., Black, M. J., Bodensteiner, C., Arens, M., Hofmann, U. G., Tacke, U., Hadders-Algra, M., Weinberger, R., et al. In Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI), September 2018 () pdf Project page video extended arXiv version DOI BibTeX
Thumb ticker lg sample3 merge black

Perceiving Systems Conference Paper Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimation Omran, M., Lassner, C., Pons-Moll, G., Gehler, P. V., Schiele, B. In 3DV, :484-494, September 2018 () arXiv code BibTeX
Thumb ticker lg nbf

Perceiving Systems Conference Paper Part-Aligned Bilinear Representations for Person Re-identification Suh, Y., Wang, J., Tang, S., Mei, T., Lee, K. M. In European Conference on Computer Vision (ECCV), 11218:418-437, Springer, Cham, September 2018 () pdf supplementary DOI BibTeX
Thumb ticker lg person reid.001

Perceiving Systems Conference Paper Recovering Accurate 3D Human Pose in The Wild Using IMUs and a Moving Camera Marcard, T. V., Henschel, R., Black, M. J., Rosenhahn, B., Pons-Moll, G. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11214:614-631, Springer, Cham, September 2018 () pdf SupMat data project DOI BibTeX
Thumb ticker lg vip

Autonomous Vision Perceiving Systems Conference Paper Unsupervised Learning of Multi-Frame Optical Flow with Occlusions Janai, J., Güney, F., Ranjan, A., Black, M. J., Geiger, A. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11220:713-731, Springer, Cham, September 2018 () pdf suppmat Video Project Page DOI BibTeX
Thumb ticker lg joeleccv18

Perceiving Systems Article Visual Perception and Evaluation of Photo-Realistic Self-Avatars From 3D Body Scans in Males and Females Thaler, A., Piryankova, I., Stefanucci, J. K., Pujades, S., de la Rosa, S., Streuber, S., Romero, J., Black, M. J., Mohler, B. J. Frontiers in ICT, 5:1-14, September 2018 () pdf DOI BibTeX
Thumb ticker lg fict 05 00018 g003

Perceiving Systems Conference Paper Decentralized MPC based Obstacle Avoidance for Multi-Robot Target Tracking Scenarios Tallamraju, R., Rajappa, S., Black, M. J., Karlapalem, K., Ahmad, A. 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), :1-8, IEEE, August 2018 (Published) Published Version DOI URL BibTeX
Thumb ticker lg aircap ca 3

Perceiving Systems Movement Generation and Control Article Robust Physics-based Motion Retargeting with Realistic Body Shapes Borno, M. A., Righetti, L., Black, M. J., Delp, S. L., Fiume, E., Romero, J. Computer Graphics Forum, 37:6:1-12, July 2018 () pdf video BibTeX
Thumb ticker lg mazen

Perceiving Systems Article Assessing body image in anorexia nervosa using biometric self-avatars in virtual reality: Attitudinal components rather than visual body size estimation are distorted Mölbert, S. C., Thaler, A., Mohler, B. J., Streuber, S., Romero, J., Black, M. J., Zipfel, S., Karnath, H., Giel, K. E. Psychological Medicine, 48(4):642-653, March 2018 () doi pdf DOI BibTeX
Thumb ticker lg animage2mask3

Perceiving Systems Article Body size estimation of self and others in females varying in BMI Thaler, A., Geuss, M. N., Mölbert, S. C., Giel, K. E., Streuber, S., Romero, J., Black, M. J., Mohler, B. J. PLoS ONE, 13(2), February 2018 () pdf DOI BibTeX
Thumb ticker lg plos1

Perceiving Systems Patent Co-Registration – Simultaneous Alignment and Modeling of Articulated 3D Shapes Black, M., Hirshberg, D., Loper, M., Rachlin, E., Weiss, A. February 2018, U.S.~Patent 9,898,848 () text BibTeX
Thumb ticker lg coregpatentfig

Perceiving Systems Ph.D. Thesis Combining Data-Driven 2D and 3D Human Appearance Models Lassner, C. Eberhard Karls Universität Tübingen, 2018 () BibTeX
Thumb ticker lg lassnerthesis

Perceiving Systems Conference Paper End-to-end Recovery of Human Shape and Pose Kanazawa, A., Black, M. J., Jacobs, D. W., Malik, J. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), :7122-7131, IEEE Computer Society, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2018 () pdf code project video BibTeX
Thumb ticker lg hmrteaser

Perceiving Systems Conference Paper Lions and Tigers and Bears: Capturing Non-Rigid, 3D, Articulated Shape from Images Zuffi, S., Kanazawa, A., Black, M. J. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), :3955-3963, IEEE Computer Society, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2018 () pdf code/data 3D models DOI BibTeX
Thumb ticker lg smalrteaser

Perceiving Systems Article Motion Segmentation & Multiple Object Tracking by Correlation Co-Clustering Keuper, M., Tang, S., Andres, B., Brox, T., Schiele, B. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018 () pdf DOI BibTeX
Thumb ticker lg motion segmentation tracking clustering teaser

Perceiving Systems Article Temporal Human Action Segmentation via Dynamic Clustering Zhang, Y., Sun, H., Tang, S., Neumann, H. arXiv preprint arXiv:1803.05790, 2018 () URL BibTeX
Thumb ticker lg yanzhang clustering

Perceiving Systems Article Embodied Hands: Modeling and Capturing Hands and Bodies Together Romero, J., Tzionas, D., Black, M. J. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 36(6):245:1-245:17, 245:1–245:17, ACM, November 2017 () website youtube paper suppl video DOI URL BibTeX
Thumb ticker lg manoteaser

Perceiving Systems Article Investigating Body Image Disturbance in Anorexia Nervosa Using Novel Biometric Figure Rating Scales: A Pilot Study Mölbert, S. C., Thaler, A., Streuber, S., Black, M. J., Karnath, H., Zipfel, S., Mohler, B., Giel, K. E. European Eating Disorders Review, 25(6):607-612, November 2017 () publisher DOI BibTeX
Thumb ticker lg molbert

Perceiving Systems Article Learning a model of facial shape and expression from 4D scans Li, T., Bolkart, T., Black, M. J., Li, H., Romero, J. ACM Transactions on Graphics, 36(6):194:1-194:17, November 2017, Two first authors contributed equally () data/model video code chumpy code tensorflow paper supplemental BibTeX
Thumb ticker lg flamewebteaserwide

Perceiving Systems Conference Paper A Generative Model of People in Clothing Lassner, C., Pons-Moll, G., Gehler, P. V. In Proceedings IEEE International Conference on Computer Vision (ICCV), :853-862, IEEE, Piscataway, NJ, USA, IEEE International Conference on Computer Vision (ICCV), October 2017 () URL BibTeX
Thumb ticker lg teasercrop

Perceiving Systems Conference Paper Semantic Video CNNs through Representation Warping Gadde, R., Jampani, V., Gehler, P. V. In Proceedings IEEE International Conference on Computer Vision (ICCV), :4463-4472, IEEE, Piscataway, NJ, USA, IEEE International Conference on Computer Vision (ICCV), October 2017, Accepted (Accepted) pdf Supplementary BibTeX
Thumb ticker lg website teaser

Perceiving Systems Article An Online Scalable Approach to Unified Multirobot Cooperative Localization and Object Tracking Ahmad, A., Lawless, G., Lima, P. IEEE Transactions on Robotics (T-RO), 33:1184 - 1199, October 2017 (Published) Published Version DOI URL BibTeX
Thumb ticker lg cover tro paper

Perceiving Systems Conference Paper Effects of animation retargeting on perceived action outcomes Kenny, S., Mahmood, N., Honda, C., Black, M. J., Troje, N. F. Proceedings of the ACM Symposium on Applied Perception (SAP’17), :2:1-2:7, September 2017 () pdf DOI BibTeX
Thumb ticker lg kenny

Probabilistic Numerics Perceiving Systems Conference Paper Coupling Adaptive Batch Sizes with Learning Rates Balles, L., Romero, J., Hennig, P. In Proceedings of the 33rd Conference on Uncertainty in Artificial Intelligence (UAI), :ID 141, (Editors: Gal Elidan, Kristian Kersting, and Alexander T. Ihler), August 2017 (Published) Code URL BibTeX
Thumb ticker lg teaser

Perceiving Systems Patent Crowdshaping Realistic 3D Avatars with Words Streuber, S., Ramirez, M. Q., Black, M., Zuffi, S., O’Toole, A., Hill, M. Q., Hahn, C. A. August 2017, Application PCT/EP2017/051954 () Google Patents BibTeX
Thumb ticker lg bodytalk

Perceiving Systems Conference Paper Deep representation learning for human motion prediction and classification Bütepage, J., Black, M., Kragic, D., Kjellström, H. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, :1591-1599, IEEE, Piscataway, NJ, USA, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017 () arXiv BibTeX
Thumb ticker lg judith

Perceiving Systems Conference Paper Detailed, accurate, human shape estimation from clothed 3D scan sequences Zhang, C., Pujades, S., Black, M., Pons-Moll, G. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), :5484-5493, IEEE Computer Society, Washington, DC, USA, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), July 2017, Spotlight () arxiv_preprint video dataset pdf supplemental DOI BibTeX
Thumb ticker lg web teaser

Perceiving Systems Conference Paper Dynamic FAUST: Registering Human Bodies in Motion Bogo, F., Romero, J., Pons-Moll, G., Black, M. J. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017, :5573-5582, IEEE, Piscataway, NJ, USA, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017 () pdf video BibTeX
Thumb ticker lg teaser