DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Haptic Intelligence Miscellaneous Toward a Device for Reliable Evaluation of Vibrotactile Perception Ballardini, G., Kuchenbecker, K. J. Work-in-progress paper (1 page) presented at the IEEE World Haptics Conference (WHC), Delft, The Netherlands, July 2023 (Published) BibTeX

Rationality Enhancement Conference Paper Toward a normative theory of (self-)management by goal-setting Singhi, N., Mohnert, F., Prystawski, B., Lieder, F. Proceedings of the Annual Meeting of the Cognitive Science Society, Annual Meeting of the Cognitive Science Society, July 2023 (Published) DOI URL BibTeX

Haptic Intelligence Miscellaneous Vibrotactile Playback for Teaching Manual Skills from Expert Recordings Gourishetti, R., Hughes, A. G., Javot, B., Kuchenbecker, K. J. Hands-on demonstration presented at the IEEE World Haptics Conference (WHC), Delft, The Netherlands, July 2023 (Published) BibTeX

Empirical Inference Conference Paper When Does Aggregating Multiple Skills with Multi-Task Learning Work? A Case Study in Financial NLP Ni, J., Jin, Z., Wang, Q., Sachan, M., Leippold, M. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Volume 1: Long Papers:7465-7488, (Editors: Rogers, A. and Boyd-Graber, J. L. and Okazaki, N.), Association for Computational Linguistics, July 2023 (Published) DOI BibTeX

Empirical Inference Conference Paper World Models for Math Story Problems Opedal, A., Stoehr, N., Saparov, A., Sachan, M. Findings of the Association for Computational Linguistics (ACL), :9088-9115, (Editors: Anna Rogers, Jordan L. Boyd-Graber and Naoaki Okazaki), Association for Computational Linguistics, July 2023 (Published) URL BibTeX

Empirical Inference Conference Paper ALERT: Adapt Language Models to Reasoning Tasks Yu, P., Wang, T., Golovneva, O., AlKhamissi, B., Verma, S., Jin, Z., Ghosh, G., Diab, M., Celikyilmaz, A. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), 1:1055-1081, (Editors: Rogers, Anna and Boyd-Graber, Jordan and Okazaki, Naoaki), Association for Computational Linguistics, July 2023 (Published) DOI URL BibTeX

Haptic Intelligence Miscellaneous CAPT Motor: A Strong Direct-Drive Haptic Interface Javot, B., Nguyen, V. H., Ballardini, G., Kuchenbecker, K. J. Hands-on demonstration presented at the IEEE World Haptics Conference (WHC), Delft, The Netherlands, July 2023 (Published) BibTeX

Robotic Materials Patent Capacitive Self-Sensing for Electrostatic Transducers with High Voltage Isolation Correll, N., Ly, K. D., Kellaris, N. A., Keplinger, C. M. (US Patent App. 17/928,453), June 2023 () URL BibTeX

Neural Capture and Synthesis Conference Paper High-Res Facial Appearance Capture from Polarized Smartphone Images Azinovic, D. M. O. H. C. N. M. T. J. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :16836-16846, Vancouver, CA, CVPR, June 2023 (Published) DOI URL BibTeX

Rationality Enhancement Article A Computational Process-Tracing Method for Measuring People’s Planning Strategies and How They Change Over Time Jain, Y. R., Callaway, F., Griffiths, T. L., Dayan, P., He, R., Krueger, P. M., Lieder, F. Behavior Research Methods, 55:20377-2079, June 2023 (Published) DOI URL BibTeX

Physical Intelligence Article Avian-Inspired Perching Mechanism for Jumping Robots Kim, H., Woodward, M. A., Sitti, M. Advanced Intelligent Systems, 5(6), June 2023 (Published) DOI URL BibTeX

Embodied Vision Learning and Dynamical Systems Empirical Inference Conference Paper Black-Box vs. Gray-Box: A Case Study on Learning Table Tennis Ball Trajectory Prediction with Spin and Impacts Achterhold, J., Tobuschat, P., Ma, H., Büchler, D., Muehlebach, M., Stueckler, J. In Conference on Learning for Dynamics and Control, 211:878-890, Proceedings of Machine Learning Research, (Editors: Nikolai Matni, Manfred Morari and George J. Pappa), PMLR, June 2023 (Published) preprint code URL BibTeX

Empirical Inference Conference Paper Bridging the Gap between Model Explanations in Partially Annotated Multi-label Classification Kim, Y., Kim, J. M., Jeong, J., Schmid, C., Akata, Z., Lee, J. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :3408-3417, IEEE, June 2023 (Published) DOI URL BibTeX

Empirical Inference Article Classifying the unknown: Insect identification with deep hierarchical Bayesian learning Badirli, S., Picard, C. J., Mohler, G., Richert, F., Akata, Z., Dundar, M. Methods in Ecology and Evolution, 14(6):1515-1530, June 2023 (Published) DOI BibTeX

Physics for Inference and Optimization Article Community Detection in Large Hypergraphs Ruggeri, N., Contisciani, M., Battiston, F., De Bacco, C. Science Advances, 9, eadg9159, June 2023 (Published) Preprint Code Published version DOI BibTeX

Perceiving Systems Conference Paper Detecting Human-Object Contact in Images Chen, Y., Kumar Dwivedi, S., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :17100-17110, CVPR, June 2023 (Published) Project Page Paper Code DOI URL BibTeX

Empirical Inference Conference Paper Editing a Woman’s Voice Costello, A., Fedorova, E., Jin, Z., Mihalcea, R. International Conference on the Science of Science and Innovation (ICSSI), June 2023 (Published) URL BibTeX

Physical Intelligence Article Electrodeposited Superhydrophilic-Superhydrophobic Composites for Untethered Multi-Stimuli-Responsive Soft Millirobots Zheng, Z., Han, J., Demir, S. O., Wang, H., Jiang, W., Liu, H., Sitti, M. Advanced Science, :2302409, June 2023 () DOI BibTeX

Empirical Inference Article Evaluating vaccine allocation strategies using simulation-assisted causal modeling Kekić, A., Dehning, J., Gresele, L., von Kügelgen, J., Priesemann, V., Schölkopf, B. Patterns, 4(6), June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Generating Holistic 3D Human Motion from Speech Yi, H., Liang, H., Liu, Y., Cao, Q., Wen, Y., Bolkart, T., Tao, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :469-480, CVPR, June 2023 (Published) project SHOW code TalkSHOW code arXiv paper BibTeX

Perceiving Systems Conference Paper High-Fidelity Clothed Avatar Reconstruction from a Single Image Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G., Zhang, Y., Wang, X., Zhu, X., Lei, Z. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8662-8672, CVPR, June 2023 (Published) Code Paper Homepage Youtube URL BibTeX

Physical Intelligence Article In situ sensing physiological properties of biological tissues using wireless miniature soft robots Wang, C., Wu, Y., Dong, X., Armacki, M., Sitti, M. Science advances, 9(23):eadg3988, June 2023 () DOI BibTeX

Haptic Intelligence Article In the Arms of a Robot: Designing Autonomous Hugging Robots with Intra-Hug Gestures Block, A. E., Seifi, H., Hilliges, O., Gassert, R., Kuchenbecker, K. J. ACM Transactions on Human-Robot Interaction, 12(2):1-49, June 2023, Special Issue on Designing the Robot Body: Critical Perspectives on Affective Embodied Interaction (Published) DOI BibTeX

Perceiving Systems Conference Paper Instant Multi-View Head Capture through Learnable Registration Bolkart, T., Li, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :768-779, CVPR, June 2023 (Published) project video paper sup. mat. poster BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Instant Volumetric Head Avatars Zielonka, W., Bolkart, T., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :4574-4584, CVPR, June 2023 (Published) pdf project video code face tracker code dataset DOI URL BibTeX

Empirical Inference Conference Paper Learning Locomotion Skills from MPC in Sensor Space Khadiv, M., Meduri, A., Zhu, H., Righetti, L., Schölkopf, B. Proceedings of The 5th Annual Learning for Dynamics and Control Conference (L4DC), 211:1218-1230, (Editors: Matni, Nikolai and Morari, Manfred and Pappas, George J.), PMLR, June 2023 (Published) URL BibTeX

Perceiving Systems Conference Paper Learning from Synthetic Data Generated with GRADE Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Pretraining for Robotics (PT4R) Workshop , ICRA 2023 Pretraining for Robotics (PT4R) Workshop, June 2023 (Published) Code Data and network models pdf URL BibTeX

Physical Intelligence Article Liquid Metal Actuators: A Comparative Analysis of Surface Tension Controlled Actuation Liao, J., Majidi, C., Sitti, M. Advanced Materials (Deerfield Beach, Fla.), :e2300560-e2300560, June 2023 () DOI BibTeX

Dynamic Locomotion Conference Paper Multi-segmented Adaptive Feet for Versatile Legged Locomotion in Natural Terrain Chatterjee, A., Mo, A., Kiss, B., Goenen, E. C., Badri-Spröwitz, A. 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), :1162-1169 , IEEE, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA), June 2023 (Published) Youtube Edmond CAD DOI URL BibTeX

Haptic Intelligence Miscellaneous Naturalistic Vibrotactile Feedback Could Facilitate Telerobotic Assembly on Construction Sites Gong, Y., Javot, B., Lauer, A. P. R., Sawodny, O., Kuchenbecker, K. J. Poster presented at the ICRA Workshop on Future of Construction: Robot Perception, Mapping, Navigation, Control in Unstructured and Cluttered Environments, London, UK, June 2023 (Published) BibTeX

Physical Intelligence Article Pangolin-inspired untethered magnetic robot for on-demand biomedical heating applications Soon, R. H., Yin, Z., Dogan, M. A., Dogan, N. O., Tiryaki, M. E., Karacakol, A. C., Aydin, A., Esmaeili-Dokht, P., Sitti, M. Nature Communications, 14(1):3320, June 2023 () DOI BibTeX

Physical Intelligence Article Programmable self-organization of heterogeneous microrobot collectives Ceron, S., Gardi, G., Petersen, K., Sitti, M. Proceedings of the National Academy of Sciences, 120(24):e2221913120, June 2023 () DOI BibTeX

Empirical Inference Article Quantification of intratumoural heterogeneity in mice and patients via machine-learning models trained on PET–MRI data Katiyar, P., Schwenck, J., Frauenfeld, L., Divine, M. R., Agrawal, V., Kohlhofer, U., Gatidis, S., Kontermann, R., Königsrainer, A., Quintanilla-Martinez, L., et al. Nature Biomedical Engineering, 7(8):1014-1027, June 2023 (Published) DOI BibTeX

Haptic Intelligence Perceiving Systems Conference Paper Reconstructing Signing Avatars from Video Using Linguistic Priors Forte, M., Kulits, P., Huang, C. P., Choutas, V., Tzionas, D., Kuchenbecker, K. J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12791-12801, CVPR, June 2023 (Published) pdf arXiv project code DOI URL BibTeX

Empirical Inference Conference Paper Robustness Implies Fairness in Causal Algorithmic Recourse Ehyaei, A., Karimi, A., Schölkopf, B., Maghsudi, S. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT), :984-1001, ACM, June 2023 (Published) DOI BibTeX

Perceiving Systems Conference Paper Simulation of Dynamic Environments for SLAM Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Workshop on the Active Methods in Autonomous Navigation, ICRA, June 2023 (Published) Code Evaluation code Data pdf URL BibTeX

Perceiving Systems Article Virtual Reality Exposure to a Healthy Weight Body Is a Promising Adjunct Treatment for Anorexia Nervosa Behrens, S. C., Tesch, J., Sun, P. J., Starke, S., Black, M. J., Schneider, H., Pruccoli, J., Zipfel, S., Giel, K. E. Psychotherapy Psychosomatics, 92(3):170-179, June 2023 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Workshop: Machine Learning for Science: Mathematics at the Interface of Data-driven and Mechanistic Modelling Lawrence, N., Montgomery, J., Schölkopf, B. Oberwolfach Reports, 20(2):1453-1484, June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper 3D Human Pose Estimation via Intuitive Physics Tripathi, S., Müller, L., Huang, C. P., Taheri, O., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :4713-4725, CVPR, June 2023 (Published) Project Page Moyo Dataset DOI URL BibTeX

Empirical Inference Conference Paper AIMY: An Open-source Table Tennis Ball Launcher for Versatile and High-fidelity Trajectory Generation Dittrich, A., Schneider, J., Guist, S., Gürtler, N., Ott, H., Steinbrenner, T., Schölkopf, B., Büchler, D. IEEE International Conference on Robotics and Automation (ICRA), :3058-3064, IEEE, June 2023 (Published) arXiv DOI BibTeX

Perceiving Systems Conference Paper ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation Fan, Z., Taheri, O., Tzionas, D., Kocabas, M., Kaufmann, M., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12943-12954, CVPR, June 2023 (Published) Project Page Code Paper arXiv Video DOI URL BibTeX

Perceiving Systems Conference Paper BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion Black, M. J., Patel, P., Tesch, J., Yang, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8726-8737, CVPR, June 2023 (Published) pdf project CVF code DOI URL BibTeX

Perceiving Systems Conference Paper BITE: Beyond Priors for Improved Three-D Dog Pose Estimation Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :8867-8876, CVPR, June 2023 (Published) pdf supp project DOI URL BibTeX

Perceiving Systems Conference Paper ECON: Explicit Clothed humans Optimized via Normal integration Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :512-523, CVPR, June 2023 (Published) Page Paper Demo Code Video Colab DOI URL BibTeX

Perceiving Systems Conference Paper HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :16965-16974, CVPR, June 2023 (Published) arXiv project pdf supp URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX