DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Physics for Inference and Optimization Conference Paper A causality-inspired plus-minus model for player evaluation in team sports De Bacco, C., Wang, Y., Blei, D. In Proceedings of Machine Learning Research , Conference on Causal Learning and Reasoning, July 2024 (Published) Paper DOI URL BibTeX

Empirical Inference Article A phenomenological account for causality in terms of elementary actions Mejia, D. J. E. L. U. S. H. G. Journal of Causal Inference, 12(1), 2024 (Published) DOI URL BibTeX

Empirical Inference Article A temperate super-Jupiter imaged with JWST in the mid-infrared Matthews, E. C. C. A. L. P. P. M. C. V. P. M. W. P. M. S. K. F. F. B. M. J. B. L. A. B. J. A. C. I. J. M. D. E. S. H. T. H. J. K. C. -. K. M. L. A. -. P. D. D. L. R. D. P. F. Nature, 633:789–792, 2024 (Published) DOI URL BibTeX

Safety- and Efficiency- aligned Learning Technical Report AI Risk Management Should Incorporate Both Safety and Security Qi, X., Huang, Y., Zeng, Y., Debenedetti, E., Geiping, J., He, L., Huang, K., Madhushani, U., Sehwag, V., Shi, W., et al. 2024 () BibTeX

Perceiving Systems Article Accelerated Video Annotation Driven by Deep Detector and Tracker Price, E., Ahmad, A. INTELLIGENT AUTONOMOUS SYSTEMS 18, 2:141–153, ICCV, 2024 (Published) project DOI URL BibTeX

Robust Machine Learning Conference Paper An interventional perspective on identifiability in gaussian lti systems with independent component analysis Rajendran, G., Reizinger, P., Brendel, W., Ravikumar, P. K. :41-70, Causal Learning and Reasoning, March 2024 (Published) PMLR BibTeX

Empirical Inference Miscellaneous Analyzing Human Questioning Behavior and Causal Curiosity through Natural Queries Ceraolo, R., Kharlapenko, D., Khan, A., Reymond, A., Mihalcea, R., Sachan, M., Schölkopf, B., Jin, Z. 2024 (Published) URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Be like a Goldfish, Don’t Memorize! Mitigating Memorization in Generative LLMs Hans, A., Wen, Y., Jain, N., Kirchenbauer, J., Kazemi, H., Singhania, P., Singh, S., Somepalli, G., Geiping, J., Bhatele, A., et al. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, 2024 (Published) URL BibTeX

Learning and Dynamical Systems Article Bi-level Motion Imitation for Humanoid Robots Zhao, W., Zhao, Y., Pajarinen, J., Muehlebach, M. Conference on Robot Learning, 2024 (Published) BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Bring Your Own Data! Self-Sensitivity Evaluation for Large Language Models Jain, N., Saifullah, K., Wen, Y., Kirchenbauer, J., Shu, M., Saha, A., Goldblum, M., Geiping, J., Goldstein, T. In Proceedings of the First Conference on Language Modeling, First Conference on Language Modeling, 2024 (Published) URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper CALVIN: Improved Contextual Video Captioning via Instruction Tuning Somepalli, G., Chowdhury, A., Geiping, J., Basri, R., Goldstein, T., Jacobs, D. W. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, 2024 (Published) URL BibTeX

Human Aspects of Machine Learning Conference Paper Causal Adversarial Perturbations for Individual Fairness and Robustness in Heterogeneous Data Spaces. Ehyaei, A., Mohammadi, K., Karimi, A., Samadi, S., Farnadi, G. In Proceedings of the AAAI Conference on Artificial Intelligence, 2024 (Published) BibTeX

Safety- and Efficiency- aligned Learning Technical Report Coercing LLMs to do and reveal (almost) anything Geiping, J., Stein, A., Shu, M., Saifullah, K., Wen, Y., Goldstein, T. 2024, Submitted (Submitted) URL BibTeX

Empirical Inference Article Connectome-constrained networks predict neural activity across the fly\nvisual system Lappalainen, J. K., Tschopp, F. D., Prakhya, S., McGill, M., Nern, A., Shinomiya, K., Takemura, S., Gruntman, E., Macke, J. H., Turaga, S. C. Nature, 634:1132–1140, 2024 (Published) DOI URL BibTeX

Learning and Dynamical Systems Article Controlling Participation in Federated Learning with Feedback Cummins, M., Er, G. D., Muehlebach, M. 2024, Submitted (Submitted) BibTeX

Empirical Inference Conference Paper DeViL: Decoding Vision features into Language Dani, M., Rio-Torto, I., Alaniz, S., Akata, Z. In Lecture Notes in Computer Science, vol 14264, :363–377, 45th Annual Conference of the German-Association-for-Pattern-Recognition (DAGM GCPR), 2024 (Published) DOI URL BibTeX

Human Aspects of Machine Learning Conference Paper Designing Ambiguity Sets for Distributionally Robust Optimization Using Structural Causal Optimal Transport Ehyaei, A. R., Farnadi, G., Samadi, S. In Proceedings of the AAAI Conference on Artificial Intelligence, 2024 (Published) BibTeX

Robust Machine Learning Conference Paper Does CLIP’s Generalization Performance Mainly Stem from High Train-Test Similarity? Mayilvahanan, P., Wiedemer, T., Rusak, E., Bethge, M., Brendel, W. In June 2024 (Published) ArXiv BibTeX

Robust Machine Learning Conference Paper Don’t trust your eyes: on the (un) reliability of feature visualizations Geirhos, R., Zimmermann, R. S., Bilodeau, B., Brendel, W., Kim, B. In June 2024 (Published) ArXiv BibTeX

Perceiving Systems Article Editor’s Note: Special Issue on Computer Vision Approach for Animal Tracking and Modeling Park, H. S., Rhodin, H., Kanazawa, A., Neverova, N., Nobuhara, S., Black, M., Zuffi, S. Journal of Computer Vision, 132, 2024 (Published) DOI URL BibTeX

Robust Machine Learning Conference Paper Effective pruning of web-scale datasets based on complexity of concept clusters Abbas, A., Rusak, E., Tirumala, K., Brendel, W., Chaudhuri, K., Morcos, A. S. In January 2024 (Published) ArXiv BibTeX

Learning and Dynamical Systems Article Event-Based Federated Q-Learning Er, D., Muehlebach, M. Workshop on Foundations of RL and Control, International Conference on Machine Learning, 2024 (Published) BibTeX

Empirical Inference Conference Paper Exploring the Jungle of Bias: Political Bias Attribution in Language Models via Dependency Analysis Jenny*, D. F., Billeter*, Y., Schölkopf, B., Jin, Z. Proceedings of the Third Workshop on NLP for Positive Impact, :152-178, (Editors: Dementieva, Daryna and Ignat, Oana and Jin, Zhijing and Mihalcea, Rada and Piatti, Giorgio and Tetreault, Joel and Wilson, Steven and Zhao, Jieyu), Association for Computational Linguistics, November 2024, *equal contribution (Published) URL BibTeX

Neural Capture and Synthesis Conference Paper FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Aneja, S., Thies, J., Dail, A., Niessner, M. In Proceedings 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :21263-21273, IEEE, CVPR, 2024 (Published) DOI URL BibTeX

Physics for Inference and Optimization Article Flexible inference in heterogeneous and attributed multilayer networks Contisciani, M., Hobbhahn, M., Power, A. E., Hennig, P., De Bacco, C. September 2024, Submitted (Submitted) Preprint Code URL BibTeX

Safety- and Efficiency- aligned Learning Technical Report Generating Potent Poisons and Backdoors from Scratch with Guided Diffusion Souri, H., Bansal, A., Kazemi, H., Fowl, L., Saha, A., Geiping, J., Wilson, A. G., Chellappa, R., Goldstein, T., Goldblum, M. 2024, Submitted (Submitted) URL BibTeX

Physical Intelligence Article Hierarchical Nanostructures as Acoustically Manipulatable Multifunctional Agents in Dynamic Fluid Flow Kim, D. W., Wrede, P., Estrada, H., Yildiz, E., Lazovic, J., Bhargava, A., Razansky, D., Sitti, M. Advanced Materials, 2024:2404514, 2024 (Published) DOI URL BibTeX

Empirical Inference Article How developments in natural language processing help us in understanding human behaviour Mihalcea, R., Biester, L., Boyd, R. L., Jin, Z., Perez-Rosas, V., Wilson, S., Pennebaker, J. W. Nature Human Behaviour, 8(10):1877-1889, Nature Publishing Group UK London, October 2024 (Published) DOI URL BibTeX

Rationality Enhancement Article Identifying Resource-Rational Heuristics for Risky Choice Krueger, P., Callaway, F., Gul, S., Griffiths, T., Lieder, F. Psychological Review, 2024 (Published) DOI URL BibTeX

Physical Intelligence Article Individual and collective manipulation of multifunctional bimodal droplets in three dimensions Sun, M., Sun, B., Park, M., Yang, S., Wu, Y., Zhang, M., Kang, W., Yoon, J., Zhang, L., Sitti, M. Science Advances, 10(19):eadp1439, American Association for the Advancement of Science, 2024 (Published) BibTeX

Robust Machine Learning Conference Paper InfoNCE: Identifying the Gap Between Theory and Practice Rusak, E., Reizinger, P., Juhos, A., Bringmann, O., Zimmermann, R. S., Brendel, W. In July 2024 (Published) BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Investigating Style Similarity in Diffusion Models Somepalli, G., Gupta, A., Gupta, K., Palta, S., Goldblum, M., Geiping, J., Shrivastava, A., Goldstein, T. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, 2024 (Published) URL BibTeX

Article LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry Chen, W., Chen, L., Wang, R., Pollefeys, M. Proceedings 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :19844-19853, 1, 1, YeaakEMl, 2024, Accepted (Accepted) DOI URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper LMD3: Language Model Data Density Dependence Kirchenbauer, J., Honke, G., Somepalli, G., Geiping, J., Lee, K., Ippolito, D., Goldstein, T., Andre, D. In Proceedings of the First Conference on Language Modeling, First Conference on Language Modeling, 2024 (Published) URL BibTeX

Empirical Inference Miscellaneous Language Model Alignment in Multilingual Trolley Problems Jin, Z., Levine, S., Kleiman-Weiner, M., Piatti, G., Liu, J., Gonzalez, F., Ortu, F., Strausz, A., Sachan, M., Mihalcea, R., et al. 2024 (Published) URL BibTeX

Empirical Inference Article Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light Song, A., Kottapalli, S. N. M., Goyal, R., Schoelkopf, B., Fischer, P. Nature Communications, 15:10692, 2024 (Published) DOI URL BibTeX

Robust Machine Learning Conference Paper Measuring Per-Unit Interpretability at Scale Without Humans Klindt, D., Zimmermann, R., Brendel, W. In September 2024 (Published) OpenReview BibTeX

Embodied Vision Ph.D. Thesis Methods for Learning Adaptive and Symbolic Forward Models for Control and Planning Achterhold, J. M. Eberhard Karls Universität Tübingen, Tübingen, 2024 (Published) DOI URL BibTeX

Physical Intelligence Article Micro- and nanofabrication of dynamic hydrogels with multichannel information Zhang, M., Lee, Y., Zheng, Z., Khan, M. T. A., Lyu, X., Byun, J., Giessen, H., Sitti, M. 2024 (Published) BibTeX

Empirical Inference Article Neonatal apnea and hypopnea prediction in infants with Robin sequence with neural additive models for time series Julius Vetter, K. L. T. M. H. D. P. A. D. O. K. J. H. M. C. F. P. PLOS Health Digital, 3(12):e0000678, 2024, Accepted (Accepted) DOI URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Object Recognition as Next Token Prediction Yue, K., Chen, B., Geiping, J., Li, H., Goldstein, T., Lim, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, 2024 (Published) DOI URL BibTeX

Safety- and Efficiency- aligned Learning Conference Paper On the Reliability of Watermarks for Large Language Models Kirchenbauer, J., Geiping, J., Wen, Y., Shu, M., Saifullah, K., Kong, K., Fernando, K., Saha, A., Goldblum, M., Goldstein, T. In The Twelfth International Conference on Learning Representations, ICLR 2024, The Twelfth International Conference on Learning Representations, 2024 (Published) URL BibTeX

Learning and Dynamical Systems Article Online Performance Optimization of Nonlinear Systems: A Gray-Box Approach He, Z., Muehlebach, M., Bolognani, S., Dörfler, F. Workshop on Foundations of RL and Control, International Conference on Machine Learning, 2024 (Published) BibTeX

Learning and Dynamical Systems Article Optimal Transport with Constraints: From Mirror Descent to Classical Mechanics Ibrahim, A. A., Muehlebach, M., De Bacco, C. Physical Review Letters, 133:057401 , 2024 (Published) DOI BibTeX

Physical Intelligence Article Perturbing Dynamics of Active Emulsions and Their Collectives Khan, M. T. A., Gardi, G., Soon, R. H., Zhang, M., Sitti, M. arXiv preprint arXiv:2405.05889, 2024, Submitted (Submitted) BibTeX

Safety- and Efficiency- aligned Learning Conference Paper Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models Wen, Y., Marchyok, L., Hong, S., Geiping, J., and Goldstein, T., Carlini, N. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, 2024 (Published) URL BibTeX