DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Micro, Nano, and Molecular Systems Article Amplification of Acoustic Forces Using Microbubble Arrays Enables Manipulation of Centimeter-Scale Objects Goyal, R., Athanassiadis, A. G., Ma, Z., Fischer, P. Physical Review Letters, 128(25):254502, June 2022 (Published) DOI URL BibTeX

Micro, Nano, and Molecular Systems Article Diffusion mechanisms of DNA in agarose gels: NMR Studies and Monte Carlo Simulations Bochert, I., Günther, J., Fischer, P., Majer, G. The Journal of Chemical Physics, 156(24):245103, June 2022 (Published) DOI URL BibTeX

Probabilistic Learning Group Empirical Inference Conference Paper Don’t Throw it Away! The Utility of Unlabeled Data in Fair Decision Making Rateike, M., Majumdar, A., Mineeva, O., Gummadi, K. P., Valera, I. In FAccT ’22: 2022 ACM Conference on Fairness, Accountability, and Transparency, :1421-1433, ACM, New York, NY, 5th ACM Conference on Fairness, Accountability, and Transparency (FAccT 2022), June 2022 (Published) DOI BibTeX

Autonomous Vision Conference Paper NICE-SLAM: Neural Implicit Scalable Encoding for SLAM Zhu, Z. P. S. L. V. X. W. B. H. C. Z. O. M. R. P. M. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :12776-12786, IEEE, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) DOI BibTeX

Autonomous Vision Human-centric Vision & Learning Conference Paper PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence Dong, Z. G. C. S. J. C. X. G. A. H. O. Proceedings 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), :20438-20448, IEEE, CVPR, June 2022 (Published) DOI BibTeX

Movement Generation and Control Conference Paper iRiSC: Iterative Risk Sensitive Control for Nonlinear Systems with Imperfect Observations Hammoud, B., Jordana, A., Righetti, L. In 2022 American Control Conference (ACC 2022), :3550-3557, IEEE, Piscataway, NJ, American Control Conference (ACC 2022), June 2022 (Published) DOI BibTeX

Empirical Inference Learning and Dynamical Systems Conference Paper A Learning-based Iterative Control Framework for Controlling a Robot Arm with Pneumatic Artificial Muscles Ma, H., Büchler, D., Schölkopf, B., Muehlebach, M. Proceedings of Robotics: Science and Systems XVIII (R:SS 2022), 18, (Editors: Kris Hauser, Dylan Shell, and Shoudong Huang), Robotics: Science and Systems XVIII, June 2022 (Published) PDF DOI URL BibTeX

Haptic Intelligence Miscellaneous A Sensorized Needle-Insertion Device for Characterizing Percutaneous Thoracic Tool-Tissue Interactions L’Orsa, R., Zareinia, K., Westwick, D., Sutherland, G., Kuchenbecker, K. J. Short paper (2 pages) presented at the Hamlyn Symposium on Medical Robotics (HSMR), London, UK, June 2022 (Published) BibTeX

Perceiving Systems Conference Paper Accurate 3D Body Shape Regression using Metric and Semantic Attributes Choutas, V., Müller, L., Huang, C. P., Tang, S., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :2708-2718, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Video Paper Supplementary Material Poster DOI URL BibTeX

Social Foundations of Computation Conference Paper Adversarial Scrutiny of Evidentiary Statistical Software Abebe, R., Hardt, M., Jin, A., Miller, J., Schmidt, L., Wexler, R. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT), ACM, June 2022 (Published) URL BibTeX

Empirical Inference Conference Paper Attention Consistency on Visual Corruptions for Single-Source Domain Generalization Cugu, I., Mancini, M., Chen, Y., Akata, Z. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), :4164-4173, IEEE, IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2022) , June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and Language Mercea, O., Riesch, L., Koepke, A. S., Akata, Z. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :10553-10563, June 2022 (Published) arXiv URL BibTeX

Perceiving Systems Optics and Sensing Laboratory Conference Paper Capturing and Inferring Dense Full-Body Human-Scene Contact Huang, C. P., Yi, H., Höschle, M., Safroshkin, M., Alexiadis, T., Polikovsky, S., Scharstein, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13264-13275, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv BSTRO code video DOI URL BibTeX

Empirical Inference Article Combination of Whole-Body Baseline CT Radiomics and Clinical Parameters to Predict Response and Survival in a Stage-IV Melanoma Cohort Undergoing Immunotherapy Peisen, F., Hänsch, A., Hering, A., Brendlin, A. S., Afat, S., Nikolaou, K., Gatidis, S., Eigentler, T., Amaral, T., Moltz, J. H., et al. Cancers, 14(12):2992, June 2022 (Published) DOI BibTeX

Haptic Intelligence Miscellaneous Dense 3D Reconstruction Through Lidar: A New Perspective on Computer-Integrated Surgery Caccianiga, G., Kuchenbecker, K. J. Short paper (2 pages) presented at the Hamlyn Symposium on Medical Robotics (HSMR), London, UK, June 2022 (Published) BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper Human-Aware Object Placement for Visual Environment Reconstruction Yi, H., Huang, C. P., Tzionas, D., Kocabas, M., Hassan, M., Tang, S., Thies, J., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :3949-3960, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI URL BibTeX

Empirical Inference Conference Paper Integrating Language Guidance into Vision-based Deep Metric Learning Roth, K., Vinyals, O., Akata, Z. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , :16177-16189, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) arXiv DOI URL BibTeX

Theory of Inhomogeneous Condensed Matter Article Ionic liquids in conducting nanoslits: how important is the range of the screened electrostatic interactions? Groda, Y., Dudka, M., Oshanin, G., Kornyshev, A. A., Kondrat, S. Journal of Physics: Condensed Matter, 34(26):26LT01, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning Karthik, S., Mancini, M., Akata, Z. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :9336-9345, June 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Large Loss Matters in Weakly Supervised Multi-Label Classification Kim*, Y., Kim*, J. M., Akata, Z., Lee, J. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :14156-14165, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022, *equal contribution (Published) arXiv DOI URL BibTeX

Intelligent Control Systems Article Learning Fast and Precise Pixel-to-Torque Control: A Platform for Reproducible Research of Learning on Hardware Bleher, S., Heim, S., Trimpe, S. IEEE Robotics & Automation Magazine, 29(2):75-84 , June 2022 (Published) DOI BibTeX

Empirical Inference Autonomous Learning Conference Paper Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers Zietlow, D., Lohaus, M., Balakrishnan, G., Kleindessner, M., Locatello, F., Schölkopf, B., Russell, C. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), :10410-10421, June 2022 (Published) arXiv URL BibTeX

Physical Intelligence Article Leveraging Building Material as Part of the In-Plane Robotic Kinematic System for Collective Construction Leder, S., Kim, H., Oguz, O. S., Kubail Kalousdian, N., Hartmann, V. N., Menges, A., Toussaint, M., Sitti, M. Advanced Science, 9(24):2201524, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Non-isotropy Regularization for Proxy-based Deep Metric Learning Roth, K., Vinyals, O., Akata, Z. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :7420-7430, June 2022 (Published) arXiv URL BibTeX

Perceiving Systems Conference Paper Occluded Human Mesh Recovery Khirodkar, R., Tripathi, S., Kitani, K. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :1705-1715, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI BibTeX

Empirical Inference Conference Paper Probabilistic Compositional Embeddings for Multimodal Image Retrieval Neculai, A., Chen, Y., Akata, Z. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), :4546-4556, IEEE, June 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper Putting People in their Place: Monocular Regression of 3D People in Depth Sun, Y., Liu, W., Bao, Q., Fu, Y., Mei, T., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13233-13242, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Project Code Data Sup Mat DOI URL BibTeX

Empirical Inference Conference Paper Revisiting Random Channel Pruning for Neural Network Compression Li, Y., Adamczewski, K., Li, W., Gu, S., Timofte, R., Van Gool, L. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :191-201, EEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) arXiv DOI URL BibTeX

Perceiving Systems Conference Paper Simulation and Control of Deformable Autonomous Airships in Turbulent Wind Price, E., Liu, Y., Black, M. J., Ahmad, A. In Intelligent Autonomous Systems 16, :608-626, Lecture Notes in Networks and Systems, 412, (Editors: Ang Jr, Marcelo H. and Asama, Hajime and Lin, Wei and Foong, Shaohui), Springer, Cham, 16th International Conference on Intelligent Autonomous Systems (IAS-16), 2022 (Published) pdf arXiv project/code DOI URL BibTeX

Physics for Inference and Optimization Article Sustainable optimal transport in multilayer networks Ibrahim, A. A., Leite, D., De Bacco, C. Physical Review E, 105(6):064302, June 2022 (Published) Preprint Code DOI URL BibTeX

Empirical Inference Article T2 mapping for the characterization of prostate lesions Hepp, T., Kalmbach, L., Kolb, M., Martirosian, P., Hilbert, T., Thaiss, W. M., Notohamiprodjo, M., Bedke, J., Nikolaou, K., Stenzl, A., et al. World Journal of Urology, 40(6):1455–1461, June 2022 (Published) DOI BibTeX

Modern Magnetic Systems Article Toggle-like current-induced Bloch point dynamics of 3D skyrmion strings in a room temperature nanowire Birch, M. T., Cortés-Ortuno, D., Litzius, K., Wintz, S., Schulz, F., Weigand, M., Stefancic, A., Mayoh, D. A., Balakrishnan, G., Hatton, P. D., et al. Nature Communications, 13:3630, Nature Publishing Group, London, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Towards Principled Disentanglement for Domain Generalization Zhang, H., Zhang, Y., Liu, W., Weller, A., Schölkopf, B., Xing, E. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :8024-8034, June 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Uniform Priors for Data-Efficient Learning Sinha, S., Roth, K., Goyal, A., Ghassemi, M., Akata, Z., Larochelle, H., Garg, A. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), :4016-4027, IEEE, IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2022), June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning Xu, W., Xian, Y., Wang, J., Schiele, B., Akata, Z. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :9316-9325, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv DOI URL BibTeX

Perceiving Systems Conference Paper BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Information Rueegg, N., Zuffi, S., Schindler, K., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :3866-3874, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) pdf Sup. Mat. project Code Poster Video Demo DOI URL BibTeX

Perceiving Systems Conference Paper D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions Christen, S., Kocabas, M., Aksan, E., Hwangbo, J., Song, J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20545-20554, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper project video code DOI BibTeX

Perceiving Systems Conference Paper EMOCA: Emotion Driven Monocular Face Capture and Animation Daněček, R., Black, M. J., Bolkart, T. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20279-20290, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) code project pdf supplemental DOI URL BibTeX

Perceiving Systems Conference Paper GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping Taheri, O., Choutas, V., Black, M. J., Tzionas, D. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13253-13263, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Sup. Mat Project YouTube Code Models DOI URL BibTeX

Perceiving Systems Conference Paper I M Avatar: Implicit Morphable Head Avatars from Videos Zheng, Y., Fernández Abrevaya, V., Bühler, M. C., Chen, X., Black, M. J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13535-13545, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper video code synth. data DOI URL BibTeX

Perceiving Systems Conference Paper ICON: Implicit Clothed humans Obtained from Normals Xiu, Y., Yang, J., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13286-13296 , IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Demo Video arXiv Paper Sup. Mat. Poster DOI URL BibTeX

Perceiving Systems Conference Paper OSSO: Obtaining Skeletal Shape from Outside Keller, M., Zuffi, S., Black, M. J., Pujades, S. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20460-20469, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Paper Sup. Mat. DOI URL BibTeX

Perceiving Systems Autonomous Vision Conference Paper gDNA: Towards Generative Detailed Neural Avatars Chen, X., Jiang, T., Song, J., Yang, J., Black, M. J., Geiger, A., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :204395-20405, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Video Code DOI URL BibTeX

Materials Article Stable Cycling of Room-Temperature Sodium-Sulfur Batteries Based on an In Situ Crosslinked Gel Polymer Electrolyte Murugan, S., Klostermann, S. V., Schützendübe, P., Richter, G., Kästner, J., Buchmeiser, M. R. Advanced Functional Materials, 32(32):2201191, May 2022 (Published) DOI BibTeX

Physical Intelligence Article Wireless soft millirobots for climbing three-dimensional surfaces in confined spaces Wu, Y., Dong, X., Kim, J., Wang, C., Sitti, M. Science Advances, 8(21):eabn3431, May 2022 (Published) DOI BibTeX

Micro, Nano, and Molecular Systems Article Toward Maximally Electromagnetically Chiral Scatterers at Optical Frequencies Garcia-Santiago, X., Hammerschmidt, M., Sachs, J., Burger, S., Kwon, H., Knöller, M., Arens, T., Fischer, P., Fernandez-Corbaton, I., Rockstuhl, C. ACS Photonics, 9(6):1954-1964, May 2022 (Published) DOI URL BibTeX