Publications

Empirical Inference Haptic Intelligence Perceiving Systems Physical Intelligence Robotic Materials MPI Year Book Scientific Report 2016 - 2021 2021 () Scientific Report 2016 - 2021 BibTeX

Perceiving Systems Empirical Inference Conference Paper Grasping Field: Learning Implicit Representations for Human Grasps Karunratanakul, K., Yang, J., Zhang, Y., Black, M., Muandet, K., Tang, S. In 2020 International Conference on 3D Vision (3DV 2020), :333-344, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf arXiv code DOI BibTeX

Perceiving Systems Article Occlusion Boundary: A Formal Definition & Its Detection via Deep Exploration of Context Wang, C., Fu, H., Tao, D., Black, M. J. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(5):2641-2656, November 2020 (Published) official version DOI BibTeX

Perceiving Systems Conference Paper GIF: Generative Interpretable Faces Ghosh, P., Gupta, P. S., Uziel, R., Ranjan, A., Black, M. J., Bolkart, T. In 2020 International Conference on 3D Vision (3DV 2020), 1:868-878, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf project code video DOI BibTeX

Perceiving Systems Conference Paper PLACE: Proximity Learning of Articulation and Contact in 3D Environments Zhang, S., Zhang, Y., Ma, Q., Black, M. J., Tang, S. In 2020 International Conference on 3D Vision (3DV 2020), 1:642-651, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2020), November 2020 (Published) pdf arXiv project code DOI BibTeX

Perceiving Systems Article 3D Morphable Face Models - Past, Present and Future Egger, B., Smith, W. A. P., Tewari, A., Wuhrer, S., Zollhoefer, M., Beeler, T., Bernard, F., Bolkart, T., Kortylewski, A., Romdhani, S., et al. ACM Transactions on Graphics, 39(5):157, October 2020 (Published) project page pdf preprint DOI BibTeX

Perceiving Systems Article AirCapRL: Autonomous Aerial Human Motion Capture Using Deep Reinforcement Learning Tallamraju, R., Saini, N., Bonetto, E., Pabst, M., Liu, Y. T., Black, M., Ahmad, A. IEEE Robotics and Automation Letters, 5(4):6678-6685, IEEE, October 2020, Also accepted and presented in the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Learning a statistical full spine model from partial observations Meng, D., Keller, M., Boyer, E., Black, M., Pujades, S. In Shape in Medical Imaging, :122-133, Lecture Notes in Computer Science, 12474, (Editors: Reuter, Martin and Wachinger, Christian and Lombaert, Hervé and Paniagua, Beatriz and Goksel, Orcun and Rekik, Islem), Springer, Cham, International Workshop on Shape in Medical Imaging (ShapeMI 2020), October 2020 (Published) Gitlab Code PDF DOI BibTeX

Perceiving Systems Conference Paper GRAB: A Dataset of Whole-Body Human Grasping of Objects Taheri, O., Ghorbani, N., Black, M. J., Tzionas, D. In Computer Vision – ECCV 2020, 4:581-600, Lecture Notes in Computer Science, 12349, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) pdf suppl video (long) video (short) DOI URL BibTeX

Perceiving Systems Conference Paper Monocular Expressive Body Regression through Body-Driven Attention Choutas, V., Pavlakos, G., Bolkart, T., Tzionas, D., Black, M. J. In Computer Vision - ECCV 2020, 10:20-40, Lecture Notes in Computer Science, 12355, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) code Short video Long video arxiv pdf suppl DOI URL BibTeX

Perceiving Systems Conference Paper STAR: Sparse Trained Articulated Human Body Regressor Osman, A. A. A., Bolkart, T., Black, M. J. In Computer Vision - ECCV 2020, 6:598-613, Lecture Notes in Computer Science, 12351, (Editors: Vedaldi, Andrea and Bischof, Horst and Brox, Thomas and Frahm, Jan-Michael), Springer, Cham, 16th European Conference on Computer Vision (ECCV 2020), August 2020 (Published) Project Page Code Video paper supplemental DOI BibTeX

Perceiving Systems Article Analysis of motor development within the first year of life: 3-D motion tracking without markers for early detection of developmental disorders Parisi, C., Hesse, N., Tacke, U., Rocamora, S. P., Blaschek, A., Hadders-Algra, M., Black, M. J., Heinen, F., Müller-Felber, W., Schroeder, A. S. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz, 63(7):881–890, July 2020 (Published) pdf on-line w/ sup mat DOI BibTeX

Perceiving Systems Conference Paper Generating 3D People in Scenes without People Zhang, Y., Hassan, M., Neumann, H., Black, M. J., Tang, S. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :6193-6203, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Code Video PDF DOI BibTeX

Perceiving Systems Conference Paper Learning Physics-guided Face Relighting under Directional Light Nestmeyer, T., Lalonde, J., Matthews, I., Lehrmann, A. M. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :5123-5132, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Paper DOI BibTeX

Perceiving Systems Article Learning and Tracking the 3D Body Shape of Freely Moving Infants from RGB-D sequences Hesse, N., Pujades, S., Black, M., Arens, M., Hofmann, U., Schroeder, S. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 42(10):2540-2551, 2020 () pdf Journal DOI BibTeX

Perceiving Systems Conference Paper Learning to Dress 3D People in Generative Clothing Ma, Q., Yang, J., Ranjan, A., Pujades, S., Pons-Moll, G., Tang, S., Black, M. J. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :6468-6477, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) Project page Code Long video Short Video arXiv DOI URL BibTeX

Perceiving Systems Patent Machine learning systems and methods of estimating body shape from images Black, M., Rachlin, E., Heron, N., Loper, M., Weiss, A., Hu, K., Hinkle, T., Kristiansen, M. (US Patent 10,679,046), June 2020 () BibTeX

Perceiving Systems Conference Paper GENTEL: GENerating Training data Efficiently for Learning to segment medical images Thakur, R. P., Pujades, S., Goel, L., Pohmann, R., Machann, J., Black, M. J. RFIAP 2020 - Congrés Reconnaissance des Formes, Image, Apprentissage et Perception , Congrès Reconnaissance des Formes, Image, Apprentissage et Perception (RFAIP 2020) , June 2020 (Published) Project Page PDF URL BibTeX

Perceiving Systems Conference Paper VIBE: Video Inference for Human Body Pose and Shape Estimation Kocabas, M., Athanasiou, N., Black, M. J. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), :5252-5262, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020 (Published) arXiv code video supplemental video pdf DOI BibTeX

Perceiving Systems Article General Movement Assessment from videos of computed 3D infant body models is equally effective compared to conventional RGB Video rating Schroeder, S., Hesse, N., Weinberger, R., Tacke, U., Gerstl, L., Hilgendorff, A., Heinen, F., Arens, M., Bodensteiner, C., Dijkstra, L. J., et al. Early Human Development, 144:104967, May 2020 () DOI BibTeX

Empirical Inference Perceiving Systems Probabilistic Learning Group Conference Paper From Variational to Deterministic Autoencoders Ghosh*, P., Sajjadi*, M. S. M., Vergari, A., Black, M. J., Schölkopf, B. 8th International Conference on Learning Representations (ICLR) , April 2020, *equal contribution (Published) arXiv URL BibTeX

Perceiving Systems Article Learning Multi-Human Optical Flow Ranjan, A., Hoffmann, D. T., Tzionas, D., Tang, S., Romero, J., Black, M. J. International Journal of Computer Vision (IJCV), 128(4):873-890, April 2020 (Published) pdf DOI poster DOI URL BibTeX

Empirical Inference Perceiving Systems Article Real Time Trajectory Prediction Using Deep Conditional Generative Models Gomez-Gonzalez, S., Prokudin, S., Schölkopf, B., Peters, J. IEEE Robotics and Automation Letters, 5(2):970-976, IEEE, April 2020 (Published) arXiv DOI BibTeX

Perceiving Systems Conference Paper Attractiveness and Confidence in Walking Style of Male and Female Virtual Characters Thaler, A., Bieg, A., Mahmood, N., Black, M. J., Mohler, B. J., Troje, N. F. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2020), :678-679, IEEE, Piscataway, NJ, IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2020), March 2020 (Published) pdf DOI BibTeX

Perceiving Systems Article The iReAct study - A biopsychosocial analysis of the individual response to physical activity Thiel, A., Sudeck, G., Gropper, H., Maturana, F. M., Schubert, T., Srismith, D., Widmann, M., Behrens, S., Martus, P., Munz, B., et al. Contemporary Clinical Trials Communications , 17:100508, March 2020 (Published) DOI BibTeX

Perceiving Systems Conference Paper Chained Representation Cycling: Learning to Estimate 3D Human Pose and Shape by Cycling Between Representations Rueegg, N., Lassner, C., Black, M. J., Schindler, K. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, 4:5561-5569, AAAI Press, Palo Alto, CA, Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2020), February 2020 (Published) pdf DOI BibTeX

Perceiving Systems Patent Machine learning systems and methods for augmenting images Black, M., Rachlin, E., Lee, E., Heron, N., Loper, M., Weiss, A., Smith, D. (US Patent 10,529,137 B1), January 2020 () BibTeX

Perceiving Systems Article Influence of Physical Activity Interventions on Body Representation: A Systematic Review Srismith, D., Wider, L., Wong, H. Y., Zipfel, S., Thiel, A., Giel, K. E., Behrens, S. C. Frontiers in Psychiatry, 11:99, 2020 (Published) DOI BibTeX

Perceiving Systems Ph.D. Thesis Addressing the Data Scarcity of Learning-based Optical Flow Approaches Janai, J. University of Tübingen, July 2020 (Published) download DOI BibTeX

Perceiving Systems Ph.D. Thesis Towards Geometric Understanding of Motion Ranjan, A. University of Tübingen, December 2019 () PhD Thesis BibTeX

Perceiving Systems Autonomous Vision Conference Paper Attacking Optical Flow Ranjan, A., Janai, J., Geiger, A., Black, M. J. In Proceedings International Conference on Computer Vision (ICCV), :2404-2413, IEEE, 2019 IEEE/CVF International Conference on Computer Vision (ICCV), November 2019, ISSN: 2380-7504 (Published) Video Project Page Paper Supplementary Material DOI URL BibTeX

Perceiving Systems Conference Paper AirCap – Aerial Outdoor Motion Capture Ahmad, A., Price, E., Tallamraju, R., Saini, N., Lawless, G., Ludwig, R., Martinovic, I., Bülthoff, H. H., Black, M. J. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2019), Workshop on Aerial Swarms, November 2019 () Talk slides BibTeX

Perceiving Systems Article Decoding subcategories of human bodies from both body- and face-responsive cortical regions Foster, C., Zhao, M., Romero, J., Black, M. J., Mohler, B. J., Bartels, A., Bülthoff, I. NeuroImage, 202(15):116085, November 2019 () paper pdf DOI BibTeX

Perceiving Systems Conference Paper Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loop Kolotouros, N., Pavlakos, G., Black, M. J., Daniilidis, K. Proceedings International Conference on Computer Vision (ICCV), :2252-2261, IEEE, 2019 IEEE/CVF International Conference on Computer Vision (ICCV), October 2019, ISSN: 2380-7504 (Published) pdf code project DOI BibTeX

Perceiving Systems Conference Paper Markerless Outdoor Human Motion Capture Using Multiple Autonomous Micro Aerial Vehicles Saini, N., Price, E., Tallamraju, R., Enficiaud, R., Ludwig, R., Martinović, I., Ahmad, A., Black, M. Proceedings 2019 IEEE/CVF International Conference on Computer Vision (ICCV), :823-832, IEEE, International Conference on Computer Vision (ICCV), October 2019 (Published) Code Data Video Paper Manuscript DOI BibTeX

Perceiving Systems Conference Paper Resolving 3D Human Pose Ambiguities with 3D Scene Constraints Hassan, M., Choutas, V., Tzionas, D., Black, M. J. In International Conference on Computer Vision (ICCV), :2282-2292, October 2019 (Published) pdf poster DOI URL BibTeX

Perceiving Systems Conference Paper Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild" Zuffi, S., Kanazawa, A., Berger-Wolf, T., Black, M. J. In International Conference on Computer Vision, :5358-5367, IEEE, International Conference on Computer Vision, October 2019 (Published) code pdf supmat iccv19 presentation DOI BibTeX

Perceiving Systems Conference Paper Energy Conscious Over-actuated Multi-Agent Payload Transport Robot: Simulations and Preliminary Physical Validation Tallamraju, R., Verma, P., Sripada, V., Agrawal, S., Karlapalem, K. 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), :1-7, IEEE, 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), October 2019 (Published) DOI BibTeX

Perceiving Systems Article Active Perception based Formation Control for Multiple Aerial Vehicles Tallamraju, R., Price, E., Ludwig, R., Karlapalem, K., Bülthoff, H. H., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, Robotics and Automation Letters, 4(4):4491-4498, IEEE, October 2019 () pdf DOI BibTeX

Perceiving Systems Conference Paper Efficient Learning on Point Clouds With Basis Point Sets Prokudin, S., Lassner, C., Romero, J. International Conference on Computer Vision, :4332-4341, October 2019 () code pdf BibTeX

Perceiving Systems Conference Paper End-to-end Learning for Graph Decomposition Song, J., Andres, B., Black, M., Hilliges, O., Tang, S. In International Conference on Computer Vision, :10093-10102, October 2019 () PDF BibTeX

Perceiving Systems Conference Paper AMASS: Archive of Motion Capture as Surface Shapes Mahmood, N., Ghorbani, N., Troje, N. F., Pons-Moll, G., Black, M. J. In Proceedings International Conference on Computer Vision, :5442-5451, IEEE, International Conference on Computer Vision (ICCV), October 2019 (Published) code pdf suppl arxiv project website video poster AMASS_Poster DOI BibTeX

Perceiving Systems Conference Paper The Influence of Visual Perspective on Body Size Estimation in Immersive Virtual Reality Thaler, A., Pujades, S., Stefanucci, J. K., Creem-Regehr, S. H., Tesch, J., Black, M. J., Mohler, B. J. In ACM Symposium on Applied Perception, :1-12, ACM, SAP '19: ACM Symposium on Applied Perception, September 2019 (Published) pdf DOI BibTeX

Perceiving Systems Patent Method for providing a three dimensional body model Loper, M., Mahmood, N., Black, M. September 2019, U.S.~Patent 10,417,818 () MoSh Project pdf BibTeX

Perceiving Systems Article Decoding the Viewpoint and Identity of Faces and Bodies Foster, C., Zhao, M., Bolkart, T., Black, M., Bartels, A., Bülthoff, I. Journal of Vision, 19(10): 54c:54-55, Arvo Journals, September 2019 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Learning to Train with Synthetic Humans Hoffmann, D. T., Tzionas, D., Black, M. J., Tang, S. In German Conference on Pattern Recognition (GCPR), :609-623, Springer International Publishing, September 2019 () pdf suppl poster DOI URL BibTeX

Perceiving Systems Conference Paper Motion Planning for Multi-Mobile-Manipulator Payload Transport Systems Tallamraju, R., Salunkhe, D., Rajappa, S., Ahmad, A., Karlapalem, K., Shah, S. V. In 15th IEEE International Conference on Automation Science and Engineering, :1469-1474, IEEE, 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), August 2019, ISSN: 2161-8089 (Published) DOI BibTeX

Perceiving Systems Conference Paper Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation Ranjan, A., Jampani, V., Balles, L., Kim, K., Sun, D., Wulff, J., Black, M. J. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), :12240-12249, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () Paper URL BibTeX

Perceiving Systems Conference Paper Capture, Learning, and Synthesis of 3D Speaking Styles Cudeiro, D., Bolkart, T., Laidlaw, C., Ranjan, A., Black, M. J. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), :10101-10111, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () code Project Page video paper BibTeX

Perceiving Systems Conference Paper Expressive Body Capture: 3D Hands, Face, and Body from a Single Image Pavlakos, G., Choutas, V., Ghorbani, N., Bolkart, T., Osman, A. A. A., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :10975-10985, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), June 2019 () video code pdf suppl poster DOI URL BibTeX

Publications

Filter by