DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Empirical Inference Conference Paper Integrating Language Guidance into Vision-based Deep Metric Learning Roth, K., Vinyals, O., Akata, Z. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , :16177-16189, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) arXiv DOI URL BibTeX

Theory of Inhomogeneous Condensed Matter Article Ionic liquids in conducting nanoslits: how important is the range of the screened electrostatic interactions? Groda, Y., Dudka, M., Oshanin, G., Kornyshev, A. A., Kondrat, S. Journal of Physics: Condensed Matter, 34(26):26LT01, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning Karthik, S., Mancini, M., Akata, Z. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :9336-9345, June 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Large Loss Matters in Weakly Supervised Multi-Label Classification Kim*, Y., Kim*, J. M., Akata, Z., Lee, J. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :14156-14165, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022, *equal contribution (Published) arXiv DOI URL BibTeX

Intelligent Control Systems Article Learning Fast and Precise Pixel-to-Torque Control: A Platform for Reproducible Research of Learning on Hardware Bleher, S., Heim, S., Trimpe, S. IEEE Robotics & Automation Magazine, 29(2):75-84 , June 2022 (Published) DOI BibTeX

Empirical Inference Autonomous Learning Conference Paper Leveling Down in Computer Vision: Pareto Inefficiencies in Fair Deep Classifiers Zietlow, D., Lohaus, M., Balakrishnan, G., Kleindessner, M., Locatello, F., Schölkopf, B., Russell, C. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), :10410-10421, June 2022 (Published) arXiv URL BibTeX

Physical Intelligence Article Leveraging Building Material as Part of the In-Plane Robotic Kinematic System for Collective Construction Leder, S., Kim, H., Oguz, O. S., Kubail Kalousdian, N., Hartmann, V. N., Menges, A., Toussaint, M., Sitti, M. Advanced Science, 9(24):2201524, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Non-isotropy Regularization for Proxy-based Deep Metric Learning Roth, K., Vinyals, O., Akata, Z. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :7420-7430, June 2022 (Published) arXiv URL BibTeX

Perceiving Systems Conference Paper Occluded Human Mesh Recovery Khirodkar, R., Tripathi, S., Kitani, K. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :1705-1715, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI BibTeX

Empirical Inference Conference Paper Probabilistic Compositional Embeddings for Multimodal Image Retrieval Neculai, A., Chen, Y., Akata, Z. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), :4546-4556, IEEE, June 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper Putting People in their Place: Monocular Regression of 3D People in Depth Sun, Y., Liu, W., Bao, Q., Fu, Y., Mei, T., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13233-13242, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Project Code Data Sup Mat DOI URL BibTeX

Empirical Inference Conference Paper Revisiting Random Channel Pruning for Neural Network Compression Li, Y., Adamczewski, K., Li, W., Gu, S., Timofte, R., Van Gool, L. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :191-201, EEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) arXiv DOI URL BibTeX

Perceiving Systems Conference Paper Simulation and Control of Deformable Autonomous Airships in Turbulent Wind Price, E., Liu, Y., Black, M. J., Ahmad, A. In Intelligent Autonomous Systems 16, :608-626, Lecture Notes in Networks and Systems, 412, (Editors: Ang Jr, Marcelo H. and Asama, Hajime and Lin, Wei and Foong, Shaohui), Springer, Cham, 16th International Conference on Intelligent Autonomous Systems (IAS-16), 2022 (Published) pdf arXiv project/code DOI URL BibTeX

Physics for Inference and Optimization Article Sustainable optimal transport in multilayer networks Ibrahim, A. A., Leite, D., De Bacco, C. Physical Review E, 105(6):064302, June 2022 (Published) Preprint Code DOI URL BibTeX

Empirical Inference Article T2 mapping for the characterization of prostate lesions Hepp, T., Kalmbach, L., Kolb, M., Martirosian, P., Hilbert, T., Thaiss, W. M., Notohamiprodjo, M., Bedke, J., Nikolaou, K., Stenzl, A., et al. World Journal of Urology, 40(6):1455–1461, June 2022 (Published) DOI BibTeX

Modern Magnetic Systems Article Toggle-like current-induced Bloch point dynamics of 3D skyrmion strings in a room temperature nanowire Birch, M. T., Cortés-Ortuno, D., Litzius, K., Wintz, S., Schulz, F., Weigand, M., Stefancic, A., Mayoh, D. A., Balakrishnan, G., Hatton, P. D., et al. Nature Communications, 13:3630, Nature Publishing Group, London, June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Towards Principled Disentanglement for Domain Generalization Zhang, H., Zhang, Y., Liu, W., Weller, A., Schölkopf, B., Xing, E. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :8024-8034, June 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Uniform Priors for Data-Efficient Learning Sinha, S., Roth, K., Goyal, A., Ghassemi, M., Akata, Z., Larochelle, H., Garg, A. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), :4016-4027, IEEE, IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW 2022), June 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning Xu, W., Xian, Y., Wang, J., Schiele, B., Akata, Z. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :9316-9325, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv DOI URL BibTeX

Perceiving Systems Conference Paper BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Information Rueegg, N., Zuffi, S., Schindler, K., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :3866-3874, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) pdf Sup. Mat. project Code Poster Video Demo DOI URL BibTeX

Perceiving Systems Conference Paper D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions Christen, S., Kocabas, M., Aksan, E., Hwangbo, J., Song, J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20545-20554, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper project video code DOI BibTeX

Perceiving Systems Conference Paper EMOCA: Emotion Driven Monocular Face Capture and Animation Daněček, R., Black, M. J., Bolkart, T. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20279-20290, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) code project pdf supplemental DOI URL BibTeX

Perceiving Systems Conference Paper GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping Taheri, O., Choutas, V., Black, M. J., Tzionas, D. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13253-13263, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Sup. Mat Project YouTube Code Models DOI URL BibTeX

Perceiving Systems Conference Paper I M Avatar: Implicit Morphable Head Avatars from Videos Zheng, Y., Fernández Abrevaya, V., Bühler, M. C., Chen, X., Black, M. J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13535-13545, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper video code synth. data DOI URL BibTeX

Perceiving Systems Conference Paper ICON: Implicit Clothed humans Obtained from Normals Xiu, Y., Yang, J., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :13286-13296 , IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Demo Video arXiv Paper Sup. Mat. Poster DOI URL BibTeX

Perceiving Systems Conference Paper OSSO: Obtaining Skeletal Shape from Outside Keller, M., Zuffi, S., Black, M. J., Pujades, S. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :20460-20469, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Paper Sup. Mat. DOI URL BibTeX

Perceiving Systems Autonomous Vision Conference Paper gDNA: Towards Generative Detailed Neural Avatars Chen, X., Jiang, T., Song, J., Yang, J., Black, M. J., Geiger, A., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :204395-20405, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Video Code DOI URL BibTeX

Materials Article Stable Cycling of Room-Temperature Sodium-Sulfur Batteries Based on an In Situ Crosslinked Gel Polymer Electrolyte Murugan, S., Klostermann, S. V., Schützendübe, P., Richter, G., Kästner, J., Buchmeiser, M. R. Advanced Functional Materials, 32(32):2201191, May 2022 (Published) DOI BibTeX

Physical Intelligence Article Wireless soft millirobots for climbing three-dimensional surfaces in confined spaces Wu, Y., Dong, X., Kim, J., Wang, C., Sitti, M. Science Advances, 8(21):eabn3431, May 2022 (Published) DOI BibTeX

Micro, Nano, and Molecular Systems Article Toward Maximally Electromagnetically Chiral Scatterers at Optical Frequencies Garcia-Santiago, X., Hammerschmidt, M., Sachs, J., Burger, S., Kwon, H., Knöller, M., Arens, T., Fischer, P., Fernandez-Corbaton, I., Rockstuhl, C. ACS Photonics, 9(6):1954-1964, May 2022 (Published) DOI URL BibTeX

Robotic Materials Patent Composite Layering of Hydraulically Amplified Self-Healing Electrostatic Transducers Keplinger, C. M., Mitchell, S. K., Kellaris, N. A., Rothemund, P. (US Patent App. 17436455), May 2022 () URL BibTeX

Physical Intelligence Article 3D bioprinted organ-on-chips Rahmani Dabbagh, S., Rezapour Sarabi, M., Birtek, M. T., Mustafaoglu, N., Zhang, Y. S., Tasoglu, S. Aggregate, 4(1):e197, May 2022 (Published) DOI BibTeX

Empirical Inference Article Attribute Prototype Network for Any-Shot Learning Xu, W., Xian, Y., Wang, J., Schiele, B., Akata, Z. International Journal of Computer Vision, 130(7):1735-1753, May 2022 (Published) DOI BibTeX

Haptic Intelligence Miscellaneous Comparing Two Grounded Force-Feedback Haptic Devices Fazlollahi, F., Kuchenbecker, K. J. Hands-on demonstration presented at EuroHaptics, Hamburg, Germany, May 2022 (Published) BibTeX

Empirical Inference Article Complex interlinkages, key objectives and nexuses amongst the Sustainable Development Goals and climate change: a network analysis Laumann, F., von Kügelgen, J., Kanashiro Uehara, T. H., Barahona, M. The Lancet Planetary Health, 6(5):e422-e430, May 2022 (Published) DOI BibTeX

Robotic Materials Article Electro-hydraulic Rolling Soft Wheel: Design, Hybrid Dynamic Modeling, and Model Predictive Control Ly, K., Mayekar, J. V., Aguasvivas, S., Keplinger, C., Rentschler, M. E., Correll, N. IEEE Transactions on Robotics, 38(5):3044-3063, IEEE, May 2022 (Published) DOI URL BibTeX

Haptic Intelligence Miscellaneous Finger Contact during Pressing and Sliding on a Glass Plate Nam, S., Gueorguiev, D., Kuchenbecker, K. J. Poster presented at the EuroHaptics Workshop on Skin Mechanics and its Role in Manipulation and Perception, Hamburg, Germany, May 2022 (Published) BibTeX

Haptic Intelligence Miscellaneous HuggieBot: A Human-Sized Haptic Interface Block, A. E., Seifi, H., Christen, S., Javot, B., Kuchenbecker, K. J. Hands-on demonstration presented at EuroHaptics, Hamburg, Germany, May 2022, Award for best hands-on demonstration (Published) BibTeX

Haptic Intelligence Conference Paper Larger Skin-Surface Contact Through a Fingertip Wearable Improves Roughness Perception Gueorguiev, D., Javot, B., Spiers, A., Kuchenbecker, K. J. In Haptics: Science, Technology, Applications, :171-179, Lecture Notes in Computer Science, 13235, (Editors: Seifi, Hasti and Kappers, Astrid M. L. and Schneider, Oliver and Drewing, Knut and Pacchierotti, Claudio and Abbasimoshaei, Alireza and Huisman, Gijs and Kern, Thorsten A.), Springer, Hamburg, Germany, 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications (EuroHaptics 2022), May 2022 (Published) DOI BibTeX

Physics for Inference and Optimization Article Multicommodity routing optimization for engineering networks Lonardi, A., Putti, M., De Bacco, C. Scientific Reports , 12:7474, May 2022 (Published) Preprint Code DOI URL BibTeX

Haptic Intelligence Article Normal and Tangential Forces Combine to Convey Contact Pressure During Dynamic Tactile Stimulation Gueorguiev, D., Lambert, J., Thonnard, J., Kuchenbecker, K. J. Scientific Reports, 12:8215, May 2022 (Published) DOI BibTeX

Haptic Intelligence Article Predicting Knee Adduction Moment Response to Gait Retraining with Minimal Clinical Data Rokhmanova, N., Kuchenbecker, K. J., Shull, P. B., Ferber, R., Halilaj, E. PLOS Computational Biology, 18(5):e1009500, May 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slang Keidar*, D., Opedal*, A., Jin, Z., Sachan, M. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL), 1:1422-1442, (Editors: Smaranda Muresan and Preslav Nakov and Aline Villavicencio), Association for Computational Linguistics, May 2022, *equal contribution (Published) arXiv URL BibTeX

Physics for Inference and Optimization Article The interplay between ranking and communities in networks Iacovissi, L., De Bacco, C. Scientific Reports, 12:8992, May 2022 (Published) Code Preprint DOI URL BibTeX

Empirical Inference Article The unpopular Package: A Data-driven Approach to Detrending TESS Full-frame Image Light Curves Hattori, S., Foreman-Mackey, D., Hogg, D. W., Montet, B. T., Angus, R., Pritchard, T. A., Curtis, J. L., Schölkopf, B. The Astronomical Journal, 163(6), May 2022 (Published) arXiv DOI URL BibTeX

Physical Intelligence Article Three-Dimensional-Bioprinted Liver Chips and Challenges Dabbagh, S. R., Ozdalgic, B., Mustafaoglu, N., Tasoglu, S. Applied Sciences, 12(10):5029, May 2022 (Published) DOI BibTeX

Dynamic Locomotion Article A Novel Spider-Inspired Rotary-Rolling Diaphragm Actuator with Linear Torque Characteristic and High Mechanical Efficiency Hepp, J., Badri-Spröwitz, A. Soft Robotics, 9(2):364-375, Mary Ann Liebert, Inc., April 2022 (Published) YouTube DOI URL BibTeX