DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Haptic Intelligence Article Generating Clear Vibrotactile Cues with a Magnet Embedded in a Soft Finger Sheath Gertler, I., Serhat, G., Kuchenbecker, K. J. Soft Robotics, 10(3):624-635, June 2023 (Published) DOI BibTeX

Social Foundations of Computation Conference Paper Human-Guided Fair Classification for Natural Language Processing Dorner, F. E., Peychev, M., Konstantinov, N., Goel, N., Ash, E., Vechev, M. In The Eleventh International Conference on Learning Representations (ICLR 2023), February 2023 (Published) arXiv URL BibTeX

Conference Paper Imitator: Personalized Speech-driven 3D Facial Animation Thambiraja, B., Habibie, I., Aliakbarian, S., Cosker, D., Theobalt, C., Thies, J. In Proceedings 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), :20564-20574, 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds Jiang, T. C. X. S. J. H. O. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures Eschenhagen, R., Immer, A., Turner, R., Schneider, F., Hennig, P. Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 36:33624-33655, (Editors: A. Oh and T. Neumann and A. Globerson and K. Saenko and M. Hardt and S. Levine), Curran Associates, Inc., 37th Annual Conference on Neural Information Processing Systems, December 2023 (Published) URL BibTeX

Perceiving Systems Patent Method and systems for labelling motion-captured points J., B. M., Ghorbani, N. (US Patent App.~17/949,087), April 2023 (Published) BibTeX

Perceiving Systems Conference Paper On Fairness in Face Albedo Estimation Feng, H., Bolkart, T., Tesch, J., Black, M. J., Abrevaya, V. In PROCEEDINGS SIGGRAPH 2022 TALKS, PROCEEDINGS SIGGRAPH 2022 TALKS, :1-2, SIGGRAPH, 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper OpenScene: 3D Scene Understanding with Open Vocabularies Peng, S., Genova, K., Jiang, C. M., Tagliasacchi, A., Pollefeys, M., Funkhouser, T. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :815-824, IEEE Explore, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 (Published) DOI URL BibTeX

Robust Machine Learning Conference Paper Provable Compositional Generalization for Object-Centric Learning Wiedemer, T., Brady, J., Panfilov, A., Juhos, A., Bethge, M., Brendel, W. In October 2023 (Published) ArXiv BibTeX

Empirical Inference Article Quantitative three-dimensional imaging of chemical short-range order via machine learning enhanced atom probe tomography Li, Y. W. Y. W. Z. L. X. C. T. H. L. R. Z. Z. X. H. L. D. R. G. Y. N. J. M. A. R. M. B. S. L. H. B. I. S. L. T. G. B. Nature Communications, 14:7410, 2023 (Published) DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Reining in the Deep Generative Models Ghosh, P. University of Tübingen, May 2023 (Published) download pdf DOI BibTeX

Empirical Inference Ph.D. Thesis Stochastic Predictive Control for Legged Robots Gazar, A. University of Tübingen, Germany, December 2023 (Published) DOI BibTeX

Haptic Intelligence Autonomous Learning Empirical Inference Miscellaneous A Sequential Group VAE for Robot Learning of Haptic Representations Richardson, B. A., Kuchenbecker, K. J., Martius, G. :1-11, Workshop paper (8 pages) presented at the CoRL Workshop on Aligning Robot Representations with Humans, Auckland, New Zealand, December 2022 (Published) URL BibTeX

Empirical Inference Article A survey of algorithmic recourse: contrastive explanations and consequential recommendations Karimi, A., Barthe, G., Schölkopf, B., Valera, I. ACM Computing Surveys, 55(5), Association for Computing Machinery (ACM), December 2022 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Active Bayesian Causal Inference Toth, C., Lorch, L., Knoll, C., Krause, A., Pernkopf, F., Peharz*, R., von Kügelgen*, J. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:16261-16275, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022, *shared last author (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Amortized Inference for Causal Structure Learning Lorch, L., Sussex, S., Rothfuss, J., Krause, A., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:13104-13118, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper AutoML Two-Sample Test Kübler, J. M., Stimper, V., Buchholz, S., Muandet, K., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:15929-15941, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Perceiving Systems Conference Paper Capturing and Animation of Body and Clothing from Monocular Video Feng, Y., Yang, J., Pollefeys, M., Black, M. J., Bolkart, T. In Proceedings SIGGRAPH Asia 2022 Conference Papers Proceedings (SA ’22 2022) , SIGGRAPH Asia 2022 Conference Papers Proceedings (SA'22) , December 2022 (Published) project code pdf DOI URL BibTeX

Empirical Inference Conference Paper Causal Discovery in Heterogeneous Environments Under the Sparse Mechanism Shift Hypothesis Perry, R., von Kügelgen*, J., Schölkopf*, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), :10904-10917, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022, *shared last author (Published) arXiv URL BibTeX

Physical Intelligence Article Control of Two-Degree-of-Freedom Inertial Appendages of a Small-Scale Jumping Robot for Enhanced Terrestrial and Aerial Maneuverability Hong, C., Tang, D., Quan, Q., Cao, Z., Wang, C., Sitti, M., Deng, Z. IEEE/ASME Transactions on Mechatronics, 28(3):1754-1765, December 2022 () DOI URL BibTeX

Autonomous Learning Conference Paper Curious Exploration via Structured World Models Yields Zero-Shot Object Manipulation Sancaktar, C., Blaes, S., Martius, G. In Advances in Neural Information Processing Systems 35 (NeurIPS 2022), :24170-24183 , Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) Arxiv Videos Openreview URL BibTeX

Physical Intelligence Patent DRY ADHESIVES AND METHODS FOR MAKING DRY ADHESIVES Metin Sitti, M. M. B. A. December 2022, US Patent App. 17/895,334, 2022 () BibTeX

Empirical Inference Conference Paper Decoding Attention from Gaze: A Benchmark Dataset and End-to-End Models Uppal, K., Kim, J., Singh, S. Proceedings of The 1st Gaze Meets ML workshop in conjunction with NeurIPS 2022, 210:219-240, Proceedings of Machine Learning Research, (Editors: Lourentzou, Ismini and Wu, Joy and Kashyap, Satyananda and Karargyris, Alexandros and Celi, Leo Anthony and Kawas, Ban and Talathi, Sachin), PMLR, December 2022 (Published) PDF URL BibTeX

Empirical Inference Conference Paper Differentially Private Language Models for Secure Data Sharing Mattern, J., Jin, Z., Weggenmann, B., Schölkopf, B., Sachan, M. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP), :4860-4873, (Editors: Yoav Goldberg and Zornitsa Kozareva and Yue Zhang), Association for Computational Linguistics, The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) , December 2022 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Direct Advantage Estimation Pan, H., Gürtler, N., Neitz, A., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:11869-11880, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *also at 15th European Workshop on Reinforcement Learning (EWRL 2022) (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Efficient identification of informative features in simulation-based inference Beck, J., Deistler, M., Bernaerts, Y., Macke, J. H., Berens, P. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:19260-19273, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) URL BibTeX

Empirical Inference Autonomous Learning Robust Machine Learning Conference Paper Embrace the Gap: VAEs Perform Independent Mechanism Analysis Reizinger*, P., Gresele*, L., Brady*, J., von Kügelgen, J., Zietlow, D., Schölkopf, B., Martius, G., Brendel, W., Besserve, M. Advances in Neural Information Processing Systems (NeurIPS 2022), 35:12040-12057, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *equal first authorship (Published) Arxiv PDF URL BibTeX

Empirical Inference Conference Paper Exploring the Latent Space of Autoencoders with Interventional Assays Leeb, F., Bauer, S., Besserve, M., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:21562-21574, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Function Classes for Identifiable Nonlinear Independent Component Analysis Buchholz, S., Besserve, M., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:16946-16961, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Article Generalized Few-Shot Video Classification With Video Retrieval and Feature Generation Xian, Y., Korbar, B., Douze, M., Torresani, L., Schiele, B., Akata, Z. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(12):8949-8961, December 2022 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Interventions, Where and How? Experimental Design for Causal Models at Scale Tigas, P., Annadani, Y., Jesson, A., Schölkopf, B., Gal, Y., Bauer, S. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:24130-24143, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximations Immer, A., van der Ouderaa, T. F. A., Rätsch, G., Fortuin, V., van der Wilk, M. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:12449-12463, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Autonomous Learning Conference Paper Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations Li, C., Vlastelica, M., Blaes, S., Frey, J., Grimminger, F., Martius, G. Proceedings of the 6th Conference on Robot Learning (CoRL), Conference on Robot Learning (CoRL), December 2022, Accepted (Accepted) Arxiv Videos Project URL BibTeX

Empirical Inference Conference Paper Learning Random Feature Dynamics for Uncertainty Quantification Agudelo-España, D., Nemmour, Y., Schölkopf, B., Zhu, J. 2022 IEEE 61st IEEE Conference on Decision and Control (CDC), :4937-4944, IEEE, 61st IEEE Conference on Decision and Control (CDC 2022), December 2022 (Published) PDF DOI URL BibTeX

Empirical Inference Autonomous Learning Conference Paper Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic Tasks Wochner, I., Schumacher, P., Martius, G., Büchler, D., Schmitt, S., Haeufle, D. Proceedings of the 6th Conference on Robot Learning (CoRL), 205:1178-1188, Proceedings of Machine Learning Research, (Editors: Liu, Karen and Kulic, Dana and Ichnowski, Jeff), PMLR, December 2022 (Published) URL BibTeX

Empirical Inference Conference Paper Logical Fallacy Detection Jin, Z., Lalwani, A., Vaidhya, T., Shen, X., Ding, Y., Lyu, Z., Sachan, M., Mihalcea, R., Schölkopf, B. Findings of the Association for Computational Linguistics: EMNLP 2022, :7180-7198, (Editors: Goldberg, Yoav and Kozareva, Zornitsa and Zhang, Yue), Association for Computational Linguistics, The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) , December 2022 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Maximum Mean Discrepancy Distributionally Robust Nonlinear Chance-Constrained Optimization with Finite-Sample Guarantee Nemmour, Y., Kremer, H., Schölkopf, B., Zhu, J. IEEE 61st Conference on Decision and Control (CDC), :5660-5667, December 2022 (Published) DOI BibTeX

Haptic Intelligence Ph.D. Thesis Multi-Timescale Representation Learning of Human and Robot Haptic Interactions Richardson, B. University of Stuttgart, Stuttgart, Germany, December 2022, Faculty of Computer Science, Electrical Engineering and Information Technology () URL BibTeX

Physical Intelligence Medical Systems Article Multifunctional 3D-Printed Pollen Grain-Inspired Hydrogel Microrobots for On-Demand Anchoring and Cargo Delivery Lee, Y., Kim, J., Bozuyuk, U., Dogan, N. O., Khan, M. T. A., Shiva, A., Wild, A., Sitti, M. Advanced Materials, 35(10):2209812, December 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Neural Attentive Circuits Weiss*, M., Rahaman*, N., Locatello, F., Pal, C., Bengio, Y., Schölkopf, B., Li, E. L., Ballas, N. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:7741-7754, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Optimal Binary Classification Beyond Accuracy Singh, S., Khim, J. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), :18226-18240, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) arXiv URL BibTeX

Dynamic Locomotion Article Physically Modelling Fluid- and Soft-tissue Mechanics of Lumbosacral Intraspinal Mechanosensing in Avians Mo, A., Kamska, V., Bribiesca-Contreras, F., Hauptmann, J., Daley, M., Badri-Spröwitz, A. arxiv, December 2022, Submitted (Submitted) URL BibTeX

Empirical Inference Conference Paper Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks Kristiadi, A., Eschenhagen, R., Hennig, P. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), :30333-30346, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Posterior and Computational Uncertainty in Gaussian Processes Wenger, J., Pleiss, G., Pförtner, M., Hennig, P., Cunningham, J. P. Advances in Neural Information Processing Systems 35 , :10876-10890, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Probable Domain Generalization via Quantile Risk Minimization Eastwood, C., Robey, A., Singh, S., von Kügelgen, J., Hassani, H., Pappas, G. J., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:17340-17358, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX