DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Physical Intelligence Medical Systems Article Nanodiamond-Enhanced Magnetic Resonance Imaging Jelena Lazovic, E. G. A. W. P. S. A. S. J. L. G. W. M. S. Advanced Materials, 36(11):2310109, 2024 () DOI BibTeX

Perceiving Systems Ph.D. Thesis Natural Language Control for 3D Human Motion Synthesis Petrovich, M. LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, 2024 (Published) Thesis BibTeX

Embodied Vision Conference Paper Online Calibration of a Single-Track Ground Vehicle Dynamics Model by Tight Fusion with Visual-Inertial Odometry Li, H., Stueckler, J. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 2024 (Published) preprint supplemental video code datasets DOI URL BibTeX

Learning and Dynamical Systems Conference Paper Online learning under adversarial nonlinear constraints Kolev, P., Martius, G., Muehlebach, M. In Advances in Neural Information Processing Systems 36, Advances in Neural Information Processing Systems, 2024 (Published) URL BibTeX

Empirical Inference Article Optimal Decision Making Under Strategic Behavior Tsirtsis, S., Tabibian, B., Khajehnejad, M., Singla, A., Schölkopf, B., Gomez-Rodriguez, M. Management Science, 2024, Published Online, In press (In press) DOI BibTeX

Empirical Inference Article Parameterizing pressure-temperature profiles of exoplanet atmospheres with neural networks Gebhard, T. D., Angerhausen, D., Konrad, B. S., Alei, E., Quanz, S. P., Schölkopf, B. Astronomy & Astrophysics, 681, 2024 (Published) DOI BibTeX

Physical Intelligence Article Perspective on smart materials for empowering small-scale manipulation Zhang, M., Sitti, M. Science Bulletin, 69(6):718-721, 2024 (Published) DOI URL BibTeX

Embodied Vision Conference Paper Physically Plausible Object Pose Refinement in Cluttered Scenes Strecke, M., Stueckler, J. In Proceedings of the German Conference on Pattern Recognition (GCPR), 2024, to appear, To be published (To be published) code preprint (submitted version) BibTeX

Embodied Vision Conference Paper Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videos Kandukuri, R. K., Strecke, M., Stueckler, J. In Proceedings of the International Conference on 3D Vision (3DV), 2024 (Published) preprint supplemental video dataset DOI URL BibTeX

Learning and Dynamical Systems Article Primal Methods for Variational Inequality Problems with Functional Constraints Zhang, L., He, N., Muehlebach, M. Mathematical Programming, 2024, Submitted (Submitted) URL BibTeX

Physical Intelligence Article Roadmap for Clinical Translation of Mobile Microrobotics Bozuyuk, U., Wrede, P., Yildiz, E., Sitti, M. Advanced Materials, 2311462, 2024 () DOI BibTeX

Physical Intelligence Article Single-step precision programming of decoupledmultiresponsive soft millirobots Zheng, Z., Han, J., Shi, Q., Demir, S. O., Jiang, W., Sitti, M. PNAS, 121, 2024 (Published) DOI URL BibTeX

Modern Magnetic Systems Article Size-dependent bistability of magnetic states in soft magnetic cap arrays Sam, S. A., Seyd, J., Ullrich, A., Jung, F., Groß, F., Krupiński, M., Albrecht, M., Thomas, S. Nanotechnology, 35(22), IOP Pub., Bristol, UK, 2024 () DOI BibTeX

Modern Magnetic Systems Article Small-pore hydridic frameworks store densely packed hydrogen Oh, H., Tumanov, N., Ban, V., Li, X., Richter, B., Hudson, M. R., Brown, C. M., Iles, G. N., Wallacher, D., Jorgensen, S. W., et al. Nature Chemistry, 16(5):809-816, Nature Publishing Group, London, UK, 2024 () DOI BibTeX

Materials Article Soft Sub-Structured Multi-Material Biosensor Hydrogels with Enzymes Retained by Plant Viral Scaffolds Grübel, J., Wendlandt, T., Urban, D., Jauch, C. O., Wege, C., Tovar, G. E. M., Southan, A. Macromolecular Bioscience, 24(3), Wiley, 2024 (Published) pdf DOI URL BibTeX

Learning and Dynamical Systems Article Stochastic Online Optimization for Cyber-Physical and Robotic Systems Ma, H., Zeilinger, M., Muehlebach, M. Machine Learning, 2024, Submitted (Submitted) URL BibTeX

Learning and Dynamical Systems Conference Paper Subgroup-Specific Risk-Controlled Dose Estimation in Radiotherapy Fischer, P., Willms, H., Muehlebach, M., Thorwarth, D., Schneider, M., Baumgartner, C. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024 (Published) BibTeX

Learning and Dynamical Systems Article Towards a systems theory of algorithms Dörfler, F., He, Z., Belgioioso, G., Bolognani, S., Lygeros, J., Muehlebach, M. IEEE Control System Letters, 2024 (Published) URL BibTeX

Materials Article Unravelling parameter interactions in calcium alginate/polyacrylamide double network hydrogels using a design of experiments approach for the optimization of mechanical properties Gorke, O., Stuhlmüller, M., Tovar, G. E. M., Southan, A. Materials Advances, 5:2851-2859, Royal Society of Chemistry, 2024 (Published) pdf DOI URL BibTeX

Empirical Inference Article Use the 4S (Signal-Safe Speckle Subtraction): Explainable Machine Learning reveals the Giant Exoplanet AF Lep b in High-Contrast Imaging Data from 2011 Bonse, M. J., Gebhard, T. D., Dannert, F. A., Absil, O., Cantalloube, F., Christiaens, V., Cugno, G., Garvin, E. O., Hayoz, J., Kasper, M., et al. The Astronomical Journal, 2024, Accepted (Accepted) arXiv BibTeX

Physical Intelligence Article Wireless flow-powered miniature robot capable of traversing tubular structures Hong, C., Wu, Y., Wang, C., Ren, Z., Wang, C., Liu, Z., Hu, W., Sitti, M. Science Robotics, 9(88):eadi5155, 2024 (Published) DOI URL BibTeX

Perceiving Systems Article HMP: Hand Motion Priors for Pose and Shape Estimation from Video Duran, E., Kocabas, M., Choutas, V., Fan, Z., Black, M. J. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), January 2024 (Published) webpage pdf code BibTeX

Perceiving Systems Article InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction from Multi-view RGB-D Images Huang, Y., Taheri, O., Black, M. J., Tzionas, D. International Journal of Computer Vision (IJCV), 132(7):2551-2566, 2024 (Published) Paper DOI URL BibTeX

Deep Models and Optimization Article NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs Köprücü, N., Okpekpe, D., Orvieto, A. October 2024, In preparation (In preparation) BibTeX

Dynamic Locomotion Patent Advanced mechanism for segmented robotic legs Sarvestani, A., Badri-Spröwitz, A. February 2024 (Published) BibTeX

Safety- and Efficiency- aligned Learning Technical Report A Realistic Threat Model for Large Language Model Jailbreaks Boreiko, V., Panfilov, A., Hein, M., Geiping, J. October 2024, Submitted (Submitted) URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers Singh, S., Singhania, P., Ranjan, A., Kirchenbauer, J., Geiping, J., Wen, Y., Jain, N., Hans, A., Shu, M., Tomar, A., et al. International Conference for High Performance Computing, Networking, Storage and Analysis SC (SC24), :36-49, Supercomputing, IEEE Digital Library, Atlanta, GA, International Conference for High Performance Computing, November 2024 (Published) DOI URL BibTeX

Perceiving Systems Book Chapter ElephantBook: Participatory Human–AI Elephant Population Monitoring Kulits, P., Wall, J., Beery, S. In Collaborative Intelligence: How Humans and AI Are Transforming Our World, :173-196, 7, (Editors: Lane, Mira and Sethumadhavan, Arathi), The MIT Press, Cambridge, Massachusetts, December 2024 (Published) URL BibTeX

Autonomous Learning Conference Paper Zero-Shot Object-Centric Representation Learning Didolkar, A., Zadaianchuk, A., Goyal, A., Mozer, M., Bengio, Y., Martius, G., Seitzer, M. In Zero-Shot Object-Centric Representation Learning, August 2024, Accepted (Accepted) URL BibTeX

Autonomous Learning Article Sensing multi-directional forces at superresolution using taxel value isoline theory Sun, H., Spiers, A., Lee, H., Fiene, J., Martius, G. Sensing multi-directional forces at superresolution using taxel value isoline theory, August 2024, Accepted (Accepted) URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Efficiently Dispatching Flash Attention For Partially Filled Attention Masks Sharma, A., Geiping, J. In ENSLP NeurIPS Workshop 2024, ENSLP NeurIPS Workshop 2024, ENSLP NeurIPS Workshop, December 2024 (Published) URL BibTeX

Autonomous Learning Empirical Inference Miscellaneous Zero-Shot Offline Imitation Learning via Optimal Transport Rupf, T., Bagatella, M., Gürtler, N., Frey, J., Martius, G. October 2024, Submitted (Submitted) URL BibTeX

Autonomous Learning Conference Paper Active Fine-Tuning of Generalist Policies Bagatella, M., Hübotter, J., Martius, G., Krause, A. October 2024, Submitted (Submitted) BibTeX

Deep Models and Optimization Article Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes Yi Meng, S., Orvieto, A., Yiming Cao, D., De Sa, C. June 2024, Submitted (Submitted) BibTeX

Autonomous Learning Conference Paper Dual-Force: Enhanced Offline Diversity Maximization under Imitation Constraints Kolev, P., Vlastelica, M., Martius, G. In Seventeenth European Workshop on Reinforcement Learning, August 2024, Accepted (Accepted) URL BibTeX

Deep Models and Optimization Conference Paper Loss Landscape Characterization of Neural Networks without Over-Parametrization Islamov, R., Ajroldi, N., Orvieto, A., Lucchi, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Recurrent Distance Filtering for Graph Representation Learning Ding, Y., Orvieto, A., He, B., Hofmann, T. In PMLR, ICML, January 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Recurrent neural networks: vanishing and exploding gradients are not the end of the story Zucchet, N., Orvieto, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper SDEs for Minimax Optimization Monzio Compagnoni, E., Orvieto, A., Kersting, H., Proske, F., Lucchi, A. PMLR, AISTATS, February 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Super Consistency of Neural Network Landscapes and Learning Rate Transfer Noci, L., Meterez, A., Hofmann, T., Orvieto, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, January 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Theoretical Foundations of Deep Selective State-Space Models Muca Cirone, N., Orvieto, A., Walker, B., Salvi, C., Lyons, T. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks Sieber, J., Amo Alonso, C., Didier, A., Zeilinger, M., Orvieto, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX

Deep Models and Optimization Conference Paper Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues Orvieto, A., De, S., Gulcehre, C., Pascanu, R., Smith, S. L. In Proceedings of Machine Learning Research, Proceedings of the Forty-First International Conference on Machine Learning , Forty-First International Conference on Machine Learning , June 2024 (Published) URL BibTeX

Perceiving Systems Conference Paper 3D Neural Edge Reconstruction Lil, L., Peng, S., Yu, Z., Liu, S., Pautrat, R., Yin, X., Pollefeys, M. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :21219-21229, 10.1109/CVPR52733.2024.02005, 2024 (Published) DOI URL BibTeX

Physics for Inference and Optimization Conference Paper A causality-inspired adjusted plus-minus model for player evaluation in team sports De Bacco, C., Wang, Y., Blei, D. M. In Proceedings of Machine Learning Research (PMLR), Proceedings Third Conference on Causal Learning and Reasoning, 236:769-792, Third Conference on Causal Learning and Reasoning, 2024 (Published) URL BibTeX