DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Empirical Inference Conference Paper Bridging the Gap between Model Explanations in Partially Annotated Multi-label Classification Kim, Y., Kim, J. M., Jeong, J., Schmid, C., Akata, Z., Lee, J. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :3408-3417, IEEE, June 2023 (Published) DOI URL BibTeX

Empirical Inference Article Classifying the unknown: Insect identification with deep hierarchical Bayesian learning Badirli, S., Picard, C. J., Mohler, G., Richert, F., Akata, Z., Dundar, M. Methods in Ecology and Evolution, 14(6):1515-1530, June 2023 (Published) DOI BibTeX

Physics for Inference and Optimization Article Community Detection in Large Hypergraphs Ruggeri, N., Contisciani, M., Battiston, F., De Bacco, C. Science Advances, 9, eadg9159, June 2023 (Published) Preprint Code Published version DOI BibTeX

Perceiving Systems Conference Paper Detecting Human-Object Contact in Images Chen, Y., Kumar Dwivedi, S., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :17100-17110, CVPR, June 2023 (Published) Project Page Paper Code DOI URL BibTeX

Empirical Inference Conference Paper Editing a Woman’s Voice Costello, A., Fedorova, E., Jin, Z., Mihalcea, R. International Conference on the Science of Science and Innovation (ICSSI), June 2023 (Published) URL BibTeX

Physical Intelligence Article Electrodeposited Superhydrophilic-Superhydrophobic Composites for Untethered Multi-Stimuli-Responsive Soft Millirobots Zheng, Z., Han, J., Demir, S. O., Wang, H., Jiang, W., Liu, H., Sitti, M. Advanced Science, :2302409, June 2023 () DOI BibTeX

Empirical Inference Article Evaluating vaccine allocation strategies using simulation-assisted causal modeling Kekić, A., Dehning, J., Gresele, L., von Kügelgen, J., Priesemann, V., Schölkopf, B. Patterns, 4(6), June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Generating Holistic 3D Human Motion from Speech Yi, H., Liang, H., Liu, Y., Cao, Q., Wen, Y., Bolkart, T., Tao, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :469-480, CVPR, June 2023 (Published) project SHOW code TalkSHOW code arXiv paper BibTeX

Perceiving Systems Conference Paper High-Fidelity Clothed Avatar Reconstruction from a Single Image Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G., Zhang, Y., Wang, X., Zhu, X., Lei, Z. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8662-8672, CVPR, June 2023 (Published) Code Paper Homepage Youtube URL BibTeX

Physical Intelligence Article In situ sensing physiological properties of biological tissues using wireless miniature soft robots Wang, C., Wu, Y., Dong, X., Armacki, M., Sitti, M. Science advances, 9(23):eadg3988, June 2023 () DOI BibTeX

Haptic Intelligence Article In the Arms of a Robot: Designing Autonomous Hugging Robots with Intra-Hug Gestures Block, A. E., Seifi, H., Hilliges, O., Gassert, R., Kuchenbecker, K. J. ACM Transactions on Human-Robot Interaction, 12(2):1-49, June 2023, Special Issue on Designing the Robot Body: Critical Perspectives on Affective Embodied Interaction (Published) DOI BibTeX

Perceiving Systems Conference Paper Instant Multi-View Head Capture through Learnable Registration Bolkart, T., Li, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :768-779, CVPR, June 2023 (Published) project video paper sup. mat. poster BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Instant Volumetric Head Avatars Zielonka, W., Bolkart, T., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :4574-4584, CVPR, June 2023 (Published) pdf project video code face tracker code dataset DOI URL BibTeX

Empirical Inference Conference Paper Learning Locomotion Skills from MPC in Sensor Space Khadiv, M., Meduri, A., Zhu, H., Righetti, L., Schölkopf, B. Proceedings of The 5th Annual Learning for Dynamics and Control Conference (L4DC), 211:1218-1230, (Editors: Matni, Nikolai and Morari, Manfred and Pappas, George J.), PMLR, June 2023 (Published) URL BibTeX

Perceiving Systems Conference Paper Learning from Synthetic Data Generated with GRADE Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Pretraining for Robotics (PT4R) Workshop , ICRA 2023 Pretraining for Robotics (PT4R) Workshop, June 2023 (Published) Code Data and network models pdf URL BibTeX

Physical Intelligence Article Liquid Metal Actuators: A Comparative Analysis of Surface Tension Controlled Actuation Liao, J., Majidi, C., Sitti, M. Advanced Materials (Deerfield Beach, Fla.), :e2300560-e2300560, June 2023 () DOI BibTeX

Dynamic Locomotion Conference Paper Multi-segmented Adaptive Feet for Versatile Legged Locomotion in Natural Terrain Chatterjee, A., Mo, A., Kiss, B., Goenen, E. C., Badri-Spröwitz, A. 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), :1162-1169 , IEEE, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA), June 2023 (Published) Youtube Edmond CAD DOI URL BibTeX

Haptic Intelligence Miscellaneous Naturalistic Vibrotactile Feedback Could Facilitate Telerobotic Assembly on Construction Sites Gong, Y., Javot, B., Lauer, A. P. R., Sawodny, O., Kuchenbecker, K. J. Poster presented at the ICRA Workshop on Future of Construction: Robot Perception, Mapping, Navigation, Control in Unstructured and Cluttered Environments, London, UK, June 2023 (Published) BibTeX

Physical Intelligence Article Pangolin-inspired untethered magnetic robot for on-demand biomedical heating applications Soon, R. H., Yin, Z., Dogan, M. A., Dogan, N. O., Tiryaki, M. E., Karacakol, A. C., Aydin, A., Esmaeili-Dokht, P., Sitti, M. Nature Communications, 14(1):3320, June 2023 () DOI BibTeX

Physical Intelligence Article Programmable self-organization of heterogeneous microrobot collectives Ceron, S., Gardi, G., Petersen, K., Sitti, M. Proceedings of the National Academy of Sciences, 120(24):e2221913120, June 2023 () DOI BibTeX

Empirical Inference Article Quantification of intratumoural heterogeneity in mice and patients via machine-learning models trained on PET–MRI data Katiyar, P., Schwenck, J., Frauenfeld, L., Divine, M. R., Agrawal, V., Kohlhofer, U., Gatidis, S., Kontermann, R., Königsrainer, A., Quintanilla-Martinez, L., et al. Nature Biomedical Engineering, 7(8):1014-1027, June 2023 (Published) DOI BibTeX

Haptic Intelligence Perceiving Systems Conference Paper Reconstructing Signing Avatars from Video Using Linguistic Priors Forte, M., Kulits, P., Huang, C. P., Choutas, V., Tzionas, D., Kuchenbecker, K. J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12791-12801, CVPR, June 2023 (Published) pdf arXiv project code DOI URL BibTeX

Empirical Inference Conference Paper Robustness Implies Fairness in Causal Algorithmic Recourse Ehyaei, A., Karimi, A., Schölkopf, B., Maghsudi, S. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT), :984-1001, ACM, June 2023 (Published) DOI BibTeX

Perceiving Systems Conference Paper Simulation of Dynamic Environments for SLAM Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Workshop on the Active Methods in Autonomous Navigation, ICRA, June 2023 (Published) Code Evaluation code Data pdf URL BibTeX

Perceiving Systems Article Virtual Reality Exposure to a Healthy Weight Body Is a Promising Adjunct Treatment for Anorexia Nervosa Behrens, S. C., Tesch, J., Sun, P. J., Starke, S., Black, M. J., Schneider, H., Pruccoli, J., Zipfel, S., Giel, K. E. Psychotherapy Psychosomatics, 92(3):170-179, June 2023 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Workshop: Machine Learning for Science: Mathematics at the Interface of Data-driven and Mechanistic Modelling Lawrence, N., Montgomery, J., Schölkopf, B. Oberwolfach Reports, 20(2):1453-1484, June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper 3D Human Pose Estimation via Intuitive Physics Tripathi, S., Müller, L., Huang, C. P., Taheri, O., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :4713-4725, CVPR, June 2023 (Published) Project Page Moyo Dataset DOI URL BibTeX

Empirical Inference Conference Paper AIMY: An Open-source Table Tennis Ball Launcher for Versatile and High-fidelity Trajectory Generation Dittrich, A., Schneider, J., Guist, S., Gürtler, N., Ott, H., Steinbrenner, T., Schölkopf, B., Büchler, D. IEEE International Conference on Robotics and Automation (ICRA), :3058-3064, IEEE, June 2023 (Published) arXiv DOI BibTeX

Perceiving Systems Conference Paper ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation Fan, Z., Taheri, O., Tzionas, D., Kocabas, M., Kaufmann, M., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12943-12954, CVPR, June 2023 (Published) Project Page Code Paper arXiv Video DOI URL BibTeX

Perceiving Systems Conference Paper BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion Black, M. J., Patel, P., Tesch, J., Yang, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8726-8737, CVPR, June 2023 (Published) pdf project CVF code DOI URL BibTeX

Perceiving Systems Conference Paper BITE: Beyond Priors for Improved Three-D Dog Pose Estimation Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8867-8876, CVPR, June 2023 (Published) pdf supp project DOI URL BibTeX

Perceiving Systems Conference Paper ECON: Explicit Clothed humans Optimized via Normal integration Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :512-523, CVPR, June 2023 (Published) Page Paper Demo Code Video Colab DOI URL BibTeX

Perceiving Systems Conference Paper HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :16965-16974, CVPR, June 2023 (Published) arXiv project pdf supp URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX

Perceiving Systems Conference Paper PointAvatar: Deformable Point-Based Head Avatars From Videos Zheng, Y., Yifan, W., Wetzstein, G., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :21057-21067, CVPR, June 2023 (Published) pdf project code video DOI URL BibTeX

Perceiving Systems Conference Paper SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Dai, Y., Lin, Y., Lin, X., Wen, C., Xu, L., Yi, H., Shen, S., Ma, Y., Wang, C. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :682-692, CVF, CVPR, June 2023 (Published) project dataset codebase paper arXiv BibTeX

Perceiving Systems Conference Paper TRACE: 5D Temporal Regression of Avatars With Dynamic Cameras in 3D Environments Sun, Y., Bao, Q., Liu, W., Mei, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8856-8866, CVPR, June 2023 (Published) pdf supp code video URL BibTeX

Autonomous Learning Conference Paper Backpropagation through Combinatorial Algorithms: Identity with Projection Works Sahoo, S., Paulus, A., Vlastelica, M., Musil, V., Kuleshov, V., Martius, G. In Proceedings of the Eleventh International Conference on Learning Representations, May 2023, Accepted (Accepted) OpenReview Arxiv Pdf URL BibTeX

Autonomous Learning Empirical Inference Conference Paper Benchmarking Offline Reinforcement Learning on Real-Robot Hardware Gürtler, N., Blaes, S., Kolev, P., Widmaier, F., Wüthrich, M., Bauer, S., Schölkopf, B., Martius, G. In Proceedings of the Eleventh International Conference on Learning Representations, The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) Website arXiv Code URL BibTeX

Autonomous Learning Empirical Inference Conference Paper DEP-RL: Embodied Exploration for Reinforcement Learning in Overactuated and Musculoskeletal Systems Schumacher, P., Haeufle, D. F., Büchler, D., Schmitt, S., Martius, G. In The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) Arxiv pdf Website URL BibTeX

Empirical Inference Article ResMiCo: Increasing the quality of metagenome-assembled genomes with deep learning Mineeva*, O., Danciu*, D., Schölkopf, B., Ley, R. E., Rätsch, G., Youngblut, N. D. PLOS Computational Biology, 19(5), Public Library of Science, San Francisco, CA, May 2023, *equal contribution (Published) DOI BibTeX

Haptic Intelligence Miscellaneous 3D Reconstruction for Minimally Invasive Surgery: Lidar Versus Learning-Based Stereo Matching Caccianiga, G., Nubert, J., Hutter, M., Kuchenbecker., K. J. Workshop paper (2 pages) presented at the ICRA Workshop on Robot-Assisted Medical Imaging, London, UK, May 2023 (Published) BibTeX

Empirical Inference Article A Kernel Stein Test for Comparing Latent Variable Models Kanagawa, H., Jitkrittum, W., Mackey, L., Fukumizu, K., Gretton, A. Journal of the Royal Statistical Society Series B: Statistical Methodology, 85(3):986-1011, May 2023 (Published) arXiv DOI BibTeX

Social Foundations of Computation Conference Paper A Theory of Dynamic Benchmarks Shirali, A., Abebe, R., Hardt, M. In The Eleventh International Conference on Learning Representations (ICLR 2023) , May 2023 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper A law of adversarial risk, interpolation, and label noise Paleka, D., Sanyal, A. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Haptic Intelligence Miscellaneous AiroTouch: Naturalistic Vibrotactile Feedback for Telerobotic Construction-Related Tasks Gong, Y., Tashiro, N., Javot, B., Lauer, A. P. R., Sawodny, O., Kuchenbecker, K. J. Extended abstract (1 page) presented at the ICRA Workshop on Communicating Robot Learning across Human-Robot Interaction, London, UK, May 2023 (Published) BibTeX

Empirical Inference Article Better Together: Data Harmonization and Cross-StudAnalysis of Abdominal MRI Data From UK Biobank and the German National Cohort Gatidis, S., Kart, T., Fischer, M., Winzeck, S., Glocker, B., Bai, W., Bülow, R., Emmel, C., Friedrich, L., Kauczor, H., et al. Investigative Radiology, 58(5):346-354, May 2023 (Published) DOI BibTeX