DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Haptic Intelligence Empirical Inference Optics and Sensing Laboratory Software Workshop Article Fiber-Optic Shape Sensing Using Neural Networks Operating on Multispecklegrams Cao, C. G. L., Javot, B., Bhattarai, S., Bierig, K., Oreshnikov, I., Volchkov, V. V. IEEE Sensors Journal, 24(17):27532-27540, September 2024 (Published) DOI BibTeX

Perceiving Systems Conference Paper Generating Human Interaction Motions in Scenes with Text Control Yi, H., Thies, J., Black, M. J., Peng, X. B., Rempe, D. In European Conference on Computer Vision (ECCV 2024), :246-263, LNCS, Springer Cham, September 2024 (Published) pdf project DOI URL BibTeX

Empirical Inference Autonomous Learning Conference Paper Learning to Control Emulated Muscles in Real Robots: A Software Test Bed for Bio-Inspired Actuators in Hardware Schumacher, P., Krause, L., Schneider, J., Büchler, D., Martius, G., Haeufle, D. In Proceedings 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob), :806-813, IEEE, 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob), September 2024 (Published) arXiv DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Leveraging Unpaired Data for the Creation of Controllable Digital Humans Sanyal, S. Max Planck Institute for Intelligent Systems and Eberhard Karls Universität Tübingen, November 2024 (Published) download BibTeX

Perceiving Systems Article Localization and recognition of human action in 3D using transformers Sun, J., Huang, L., Hongsong Wang, C. Z. J. Q., Islam, M. T., Xie, E., Zhou, B., Xing, L., Chandrasekaran, A., Black, M. J. Nature Communications Engineering , 13(125), September 2024 (Published) paper DOI BibTeX

Physics for Inference and Optimization Article Optimal transport with constraints: from mirror descent to classical mechanics Ibrahim, A. A., Muehlebach, M., De Bacco, C. Physical Review Letters, 133:057401, July 2024 (Published) Preprint Code Paper DOI URL BibTeX

Robust Machine Learning Conference Paper Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts Mészáros, A., Ujváry, S., Brendel, W., Reizinger, P., Huszár, F. In September 2024 (Published) ArXiv BibTeX

Perceiving Systems Conference Paper AWOL: Analysis WithOut synthesis using Language Zuffi, S., Black, M. J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, September 2024 (Published) Paper URL BibTeX

Perceiving Systems Article EarthRanger: An Open-Source Platform for Ecosystem Monitoring, Research, and Management Wall, J., Lefcourt, J., Jones, C., Doehring, C., O’Neill, D., Schneider, D., Steward, J., Krautwurst, J., Wong, T., Jones, B., et al. Methods in Ecology and Evolution, 13, British Ecological Society, September 2024 (Published) pdf DOI BibTeX

Perceiving Systems Conference Paper GraspXL: Generating Grasping Motions for Diverse Objects at Scale Zhang, H., Christen, S., Fan, Z., Hilliges, O., Song, J. In European Conference on Computer Vision (ECCV 2024), Part XXVI:386-403, LNCS, Springer Cham, September 2024 (Published) Code Video Paper DOI URL BibTeX

Autonomous Learning Robotics Article Identifying Terrain Physical Parameters from Vision-Towards Physical-Parameter-Aware Locomotion and Navigation Chen, J., Frey, J., Zhou, R., Miki, T., Martius, G., Hutter, M. IEEE Robotics and Automation Letters, Identifying Terrain Physical Parameters From Vision, 9(11):9279-9286, August 2024 (Published) DOI URL BibTeX

Autonomous Learning Miscellaneous Directed Exploration in Reinforcement Learning from Linear Temporal Logic Bagatella, M., Krause, A., Martius, G. August 2024, In revision (In revision) URL BibTeX

Organizational Leadership and Diversity Conference Paper Gig work in organizations: Trends and perspectives from Human Resource Management professionals Singh, V., Keplinger, K., Tursunbayeva, A., Di Lauro, S. In Proceedings of the 84th Annual Meeting of the Academy of Management, :https://doi.org/10.5465/AMPROC.2024.14769symposium, Chicago, USA, 84th Annual Meeting of the Academy of Management, August 2024 (Published) Gig work and HRM DOI URL BibTeX

Physics for Inference and Optimization Article A model for efficient dynamical ranking in networks Della Vecchia, A., Neocosmos, K., Larremore, D. B., Moore, C., De Bacco, C. Phys. Rev. E 110, 034310, September 2024 (Published) Preprint Code Paper DOI URL BibTeX

Haptic Intelligence Miscellaneous Adapting a High-Fidelity Simulation of Human Skin for Comparative Touch Sensing Schulz, A., Serhat, G., Kuchenbecker, K. J. Extended abstract (1 page) presented at the American Society of Biomechanics Annual Meeting (ASB), Madison, USA, August 2024 (Published) BibTeX

Empirical Inference Conference Paper Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals Ortu*, F., Jin*, Z., Doimo, D., Sachan, M., Cazzaniga, A., Schölkopf, B. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL) , Volume 1, Long Papers:8420-8436, (Editors: Lun-Wei Ku and Andre Martins and Vivek Srikumar), Association for Computational Linguistics, August 2024, *equal contribution (Published) arXiv URL BibTeX

Haptic Intelligence Ph.D. Thesis Engineering and Evaluating Naturalistic Vibrotactile Feedback for Telerobotic Assembly Gong, Y. University of Stuttgart, Stuttgart, Germany, August 2024, Faculty of Engineering Design, Production Engineering and Automotive Engineering (Published) BibTeX

Haptic Intelligence Article Fingertip Dynamic Response Simulated Across Excitation Points and Frequencies Serhat, G., Kuchenbecker, K. J. Biomechanics and Modeling in Mechanobiology, 23(4):1369-1376, August 2024 (Published) DOI BibTeX

Empirical Inference Article Leveraging Task Structures for Improved Identifiability in Neural Network Representations Chen*, W., Horwood*, J., Heo, J., Hernández-Lobato, J. M. Transactions on Machine Learning Research, August 2024, *equal contribution (Published) URL BibTeX

Haptic Intelligence Robotics Miscellaneous Modeling Shank Tissue Properties and Quantifying Body Composition with a Wearable Actuator-Accelerometer Set Rokhmanova, N., Martus, J., Faulkner, R., Fiene, J., Kuchenbecker, K. J. Extended abstract (1 page) presented at the American Society of Biomechanics Annual Meeting (ASB), Madison, USA, August 2024 (Published) BibTeX

Empirical Inference Conference Paper Modelling Variability in Human Annotator Simulation Wu*, W., Chen*, W., Zhang, C., Woodland, P. C. Findings of the Association for Computational Linguistics (ACL), :1139-1157, (Editors: Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek), Association for Computational Linguistics, August 2024, *equal contribution (Published) URL BibTeX

Empirical Inference Conference Paper Moûsai: Efficient Text-to-Music Diffusion Models Schneider, F., Kamal, O., Jin, Z., Schölkopf, B. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), Volume 1: Long Papers:8050-8068, (Editors: Lun-Wei Ku and Andre Martins and Vivek Srikumar), Association for Computational Linguistics, August 2024 (Published) URL BibTeX

Perceiving Systems Article Re-Thinking Inverse Graphics with Large Language Models Kulits, P., Feng, H., Liu, W., Abrevaya, V., Black, M. J. Transactions on Machine Learning Research, August 2024 (Published) pdf URL BibTeX

Empirical Inference Conference Paper CausalCite: A Causal Formulation of Paper Citations Agrawal, I., Jin, Z., Mokhtarian, E., Guo, S., Chen, Y., Sachan, M., Schölkopf, B. Findings of the Association for Computational Linguistics (ACL), :8395-8410, (Editors: Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek), Association for Computational Linguistics, August 2024 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper A Sparsity Principle for Partially Observable Causal Representation Learning Xu, D., Yao, D., Lachapelle, S., Taslakian, P., von Kügelgen, J., Locatello, F., Magliacane, S. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:55389-55433, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Empirical Inference Conference Paper Accuracy on the wrong line: On the pitfalls of noisy data for OOD generalisation Sanyal, A., Hu, Y., Yu, Y., Ma, Y., Wang, Y., Schölkopf, B. ICML 2024 Next Generation of AI Safety Workshop (Oral), July 2024 (Published) arXiv PDF BibTeX

Empirical Inference Conference Paper All-in-one simulation-based inference Gloeckler, M., Deistler, M., Weilbach, C. D., Wood, F., Macke, J. H. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:15735-15766, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Social Foundations of Computation Conference Paper Allocation Requires Prediction Only if Inequality Is Low Shirali, A., Abebe, R., Hardt, M. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), PMLR, The Forty-First International Conference on Machine Learning (ICML), July 2024, *equal contribution (Published) ArXiv URL BibTeX

Autonomous Learning Conference Paper Causal Action Influence Aware Counterfactual Data Augmentation Urpi, N. A., Bagatella, M., Vlastelica, M., Martius, G. In Proceedings of the 41st International Conference on Machine Learning (ICML), 235:1709-1729, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Social Foundations of Computation Conference Paper Causal Inference from Competing Treatments Stoica, A., Nastl, V. Y., Hardt, M. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), PMLR, The Forty-First International Conference on Machine Learning (ICML), July 2024 (Published) ArXiv URL BibTeX

Learning and Dynamical Systems Empirical Inference Article Deep Backtracking Counterfactuals for Causally Compliant Explanations Kladny, K., Kügelgen, J. V., Schölkopf, B., Muehlebach, M. Transactions on Machine Learning Research, July 2024 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Detecting and Identifying Selection Structure in Sequential Data Zheng, Y., Tang, Z., Qiu, Y., Schölkopf, B., Zhang, K. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:61498-61525, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Empirical Inference Conference Paper Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for ODEs Beck, J., Bosch, N., Deistler, M., Kadhim, K. L., Macke, J. H., Hennig, P., Berens, P. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:3305-3326, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Diffusive Gibbs Sampling Chen*, W., Zhang*, M., Paige, B., Hernández-Lobato, J. M., Barber, D. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:7731-7747, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024, *equal contribution (Published) URL BibTeX

Empirical Inference Conference Paper Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners? Opedal, A., Stolfo, A., Shirakami, H., Jiao, Y., Cotterell, R., Schölkopf, B., Saparov, A., Sachan, M. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:38762-38778, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Social Foundations of Computation Conference Paper Don’t Label Twice: Quantity Beats Quality when Comparing Binary Classifiers on a Budget Dorner, F. E., Hardt, M. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), PMLR, The Forty-First International Conference on Machine Learning (ICML), July 2024 (Published) ArXiv URL BibTeX

Haptic Intelligence Master Thesis Estimating Contact Forces Across Soft Capacitive Tactile Sensors Using Machine Learning Tiwari, A. :1-99, Saarland University, Saarbrücken, Germany, July 2024, M.Sc. in Embedded Systems (Published) BibTeX

Empirical Inference Conference Paper Geometry-Aware Instrumental Variable Regression Kremer, H., Schölkopf, B. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:25560-25582, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Empirical Inference Conference Paper Implicit meta-learning may lead language models to trust more reliable sources Krasheninnikov, D., Krasheninnikov, E., Mlodozeniec, B. K., Maharaj, T., Krueger, D. Proceedings of the 41st International Conference on Machine Learning, 235:25534-25559, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Empirical Inference Conference Paper Improving Neural Additive Models with Bayesian Principles Bouchiat, K., Immer, A., Yèche, H., Rätsch, G., Fortuin, V. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:4416-4443, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Social Foundations of Computation Conference Paper Inherent Trade-Offs between Diversity and Stability in Multi-Task Benchmarks Zhang, G., Hardt, M. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), PMLR, The Forty-First International Conference on Machine Learning (ICML), July 2024 (Published) ArXiv Code URL BibTeX

Autonomous Learning Conference Paper LPGD: A General Framework for Backpropagation through Embedded Optimization Layers Paulus, A., Martius, G., Musil, V. In Proceedings of the 41st International Conference on Machine Learning (ICML), 235:39989-40014, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Autonomous Learning Conference Paper Learning with 3D rotations, a hitchhiker’s guide to SO(3) Geist, A. R., Frey, J., Zhobro, M., Levina, A., Martius, G. In Proceedings of Machine Learning Research, Proceedings of the Forty-First International Conference on Machine Learning , 235:15331-15350, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), Forty-First International Conference on Machine Learning , July 2024 (Published) URL BibTeX

Autonomous Learning Conference Paper Modelling Microbial Communities with Graph Neural Networks Ruaud, A., Sancaktar, C., Bagatella, M., Ratzke, C., Martius, G. In Proceedings of the 41st International Conference on Machine Learning (ICML), 235:42742-42765, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX

Haptic Intelligence Intelligent Control Systems Article Multimodal Multi-User Surface Recognition with the Kernel Two-Sample Test Khojasteh, B., Solowjow, F., Trimpe, S., Kuchenbecker, K. J. IEEE Transactions on Automation Science and Engineering, 21(3):4432-4447, July 2024 (Published) DOI BibTeX

Empirical Inference Conference Paper On the Growth of Mistakes in Differentially Private Online Learning: A Lower Bound Perspective Dmitriev, D., Szabó, K., Sanyal, A. Proceedings of the 37th Annual Conference on Learning Theory (COLT), 247:1379-1398, Proceedings of Machine Learning Research, (Editors: Agrawal, Shipra and Roth, Aaron), PMLR, July 2024, (talk) (Published) URL BibTeX