DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Neural Capture and Synthesis Conference Paper ID-Reveal: Identity-aware DeepFake Video Detection Cozzolino, D., Rössler, A., Thies, J., Nießner, M., Verdoliva, L. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :15088-15097 , IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021 (Published) Paper Video Code DOI URL BibTeX

Empirical Inference Article Improving 1-year mortality prediction in ACS patients using machine learning Weichwald, S., Candreva, A., Burkholz, R., Klingenberg, R., Räber, L., Heg, D., Manka, R., Gencer, B., Mach, F., Nanchen, D., et al. European Heart Journal. Acute Cardiovascular Care, 10(8):855-865, October 2021 (Published) DOI BibTeX

Empirical Inference Conference Paper Keep CALM and Improve Visual Feature Attribution Kim, J. M., Choe, J., Akata, Z., Oh, S. J. International Conference on Computer Vision (ICCV), :8330-8340, IEEE, October 2021 (Published) DOI BibTeX

Perceiving Systems Conference Paper Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistency Sanyal, S., Vorobiov, A., Bolkart, T., Loper, M., Mohler, B., Davis, L., Romero, J., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11118-11127, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf arxiv DOI BibTeX

Perceiving Systems Conference Paper Learning To Regress Bodies From Images Using Differentiable Semantic Rendering Dwivedi, S. K., Athanasiou, N., Kocabas, M., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11230-11239, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp code project-website video poster DOI BibTeX

Perceiving Systems Conference Paper Monocular, One-Stage, Regression of Multiple 3D People Sun, Y., Bao, Q., Liu, W., Fu, Y., Black, M. J., Mei, T. In Proc. International Conference on Computer Vision (ICCV), :11159-11168, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp arXiv code DOI BibTeX

Autonomous Vision Conference Paper NEAT: Neural Attention Fields for End-to-End Autonomous Driving Chitta, K., Prakash, A., Geiger, A. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :15773-15783 , IEEE, International Conference on Computer Vision (ICCV), 2021 (Published) Paper Supplementary Material Video 1 Video 2 Project page DOI URL BibTeX

Neural Capture and Synthesis Conference Paper Neural Parametric Models for 3D Deformable Shapes Palafox, P., Bozic, A., Thies, J., Nießner, M., Dai, A. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV 2021) , :12675-12685 , IEEE, IEEE/CVF International Conference on Computer Vision (ICCV 2021) , October 2021 (Published) DOI BibTeX

Neural Capture and Synthesis Conference Paper RetrievalFuse: Neural 3D Scene Reconstruction with a Database Siddiqui, Y., Thies, J., Ma, F., Shan, Q., Nießner, M., Dai, A. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :12548-12557 , IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021 (Published) DOI BibTeX

Haptic Intelligence Article Robotics for Occupational Therapy: Learning Upper-Limb Exercises From Demonstrations Hu, S., Mendonca, R., Johnson, M. J., Kuchenbecker, K. J. IEEE Robotics and Automation Letters, 6(4):7781-7788, October 2021 (Published) DOI BibTeX

Movement Generation and Control Article Robust walking based on MPC with viability guarantees Yeganegi, M. H., Khadiv, M., Prete, A. D., Moosavian, S. A. A., Righetti, L. IEEE Transactions on Robotics, October 2021, Accepted (Accepted) URL BibTeX

Empirical Inference Conference Paper Self-Supervised 3D Face Reconstruction via Conditional Estimation Wen, Y., Liu, W., Raj, B., Singh, R. IEEE/CVF International Conference on Computer Vision (ICCV), :13269-13278, IEEE, October 2021 (Published) DOI BibTeX

Perceiving Systems Conference Paper Stochastic Scene-Aware Motion Prediction Hassan, M., Ceylan, D., Villegas, R., Saito, J., Yang, J., Zhou, Y., Black, M. In Proc. International Conference on Computer Vision (ICCV), :11354-11364, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) Project Page pdf DOI BibTeX

Perceiving Systems Conference Paper The Power of Points for Modeling Humans in Clothing Ma, Q., Yang, J., Tang, S., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :10954-10964, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) Project Page Code Video Dataset arXiv PDF Supp. Poster DOI BibTeX

Empirical Inference Software Workshop Movement Generation and Control Article The o80 C++ templated toolbox: Designing customized Python APIs for synchronizing realtime processes Berenz, V., Naveau, M., Widmaier, F., Wüthrich, M., Passy, J., Guist, S., Büchler, D. Journal of Open Source Software, 6(66), October 2021 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper Topologically Consistent Multi-View Face Inference Using Volumetric Sampling Li, T., Liu, S., Bolkart, T., Liu, J., Li, H., Zhao, Y. In Proc. International Conference on Computer Vision (ICCV), :3804-3814, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) project paper DOI BibTeX

Empirical Inference Article Weakly supervised segmentation of tumor lesions in PET-CT hybrid imaging Früh, M., Fischer, M., Schilling, A., Gatidis, S., Hepp, T. Journal of Medical Imaging, 8(5), SPIE, October 2021 (Published) DOI BibTeX

Perceiving Systems Conference Paper PARE: Part Attention Regressor for 3D Human Body Estimation Kocabas, M., Huang, C. P., Hilliges, O., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11107-11117, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp code video arXiv project website poster DOI BibTeX

Perceiving Systems Autonomous Vision Conference Paper SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes Chen, X., Zheng, Y., Black, M. J., Hilliges, O., Geiger, A. In Proc. International Conference on Computer Vision (ICCV), :11574-11584, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf pdf 2 supplementary material project blog blog 2 video video 2 code DOI URL BibTeX

Perceiving Systems Conference Paper SOMA: Solving Optical Marker-Based MoCap Automatically Ghorbani, N., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11097-11106, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) code pdf suppl arxiv project website video poster DOI BibTeX

Perceiving Systems Conference Paper SPEC: Seeing People in the Wild with an Estimated Camera Kocabas, M., Huang, C. P., Tesch, J., Müller, L., Hilliges, O., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11015-11025, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp arXiv code video project website poster DOI BibTeX

Empirical Inference Conference Paper e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks Maxime Kayser, O. C. O., Salewski, L., Emde, C., Do, V., Akata, Z., Lukasiewicz, T. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :1224-1234, IEEE, IEEE/CVF International Conference on Computer Vision (ICCV 2021) , October 2021 (Published) DOI URL BibTeX

Autonomous Motion Conference Paper Differentiable Factor Graph Optimization for Learning Smoothers Yi, B. L. M. A. K. A. M. R. B. J. 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), :1339-1345, IEEE, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021), September 2021 (Published) DOI BibTeX

Physical Intelligence Article Amplification factor in shear-activated adhesives: effect of elasticity Kim, J., Varenberg, M. Soft Matter, 17(40):9087-9093, September 2021 () DOI BibTeX

Micro, Nano, and Molecular Systems Article Optical Activity in Third‐Harmonic Rayleigh Scattering: A New Route for Measuring Chirality Ohnoutek, L., Jeong, H., Jones, R., Sachs, J., Olohan, B., Rasadean, D., Pantos, G., Andrews, D., Fischer, P., Valev, V. Laser & Photonics Reviews, 15(11):2100235, September 2021 () DOI URL BibTeX

Empirical Inference Ph.D. Thesis A Large Scale Brain-Computer Interface for Patients with Neurological Diseases Hohmann, M. University of Tübingen, Germany, September 2021 (Published) BibTeX

Perceiving Systems Conference Paper Active Visual SLAM with Independently Rotating Camera Bonetto, E., Goldschmid, P., Black, M. J., Ahmad, A. In 2021 European Conference on Mobile Robots (ECMR 2021), :266-273, IEEE, Piscataway, NJ, European Conference on Mobile Robots (ECMR 2021), 2021 (Published) Code Data DOI URL BibTeX

Physics for Inference and Optimization Conference Paper Convergence properties of optimal transport-based temporal networks Baptista Theuerkauf, D., De Bacco, C. Complex Networks & Their Applications X , 1, Studies in Computational Intelligence , 10th International Conference on Complex Networks and Their Applications (COMPLEX NETWORKS 2021) , September 2021 (Published) Preprint DOI BibTeX

Empirical Inference Ph.D. Thesis Deep Learning Beyond The Training Distribution Parascandolo, G. ETH Zürich, Switzerland, Zürich, September 2021, (CLS Fellowship Program) (Published) DOI BibTeX

Empirical Inference Article Deep learning enables fast and dense single-molecule localization with high accuracy Speiser*, A., Müller*, L., Hoess, P., Matti, U., Obara, C. J., Legant, W. R., Kreshuk, A., Macke, J. H., Ries, J., Turaga, S. C. Nature Methods, 18:1082-1090, Nature Publishing Group, New York, NY, September 2021, *equal contribution (Published) bioRxiv DOI URL BibTeX

Empirical Inference Article Detection of diabetes from whole-body MRI using deep learning Dietz*, B., Machann*, J., Agrawal, V., Heni, M., Schwab, P., Dienes, J., Reichert, S., Birkenfeld, A. L., Häring, H., Schick, F., et al. JCI Insight, 6(21), September 2021, *equal contribution (Published) DOI URL BibTeX

Empirical Inference Conference Paper Estimation of Spontaneous Transient Dynamics based on Peri-event Data Shao, K., Logothetis, N. K., Besserve, M. Bernstein Conference 2021, September 2021 (Published) DOI BibTeX

Empirical Inference Conference Paper Generalized phase locking analysis: a multivariate technique for investigating spike-field coupling Safavi, S., Panagiotaropoulos, T. I., Kapoor, V., Ramirez-Villegas, J. F., Logothetis, N. K., Besserve, M. Bernstein Conference 2021, September 2021 (Published) DOI BibTeX

Empirical Inference Article Overcoming Barriers to Data Sharing with Medical Image Generation: A Comprehensive Evaluation DuMont Schütte, A., Hetzel, J., Gatidis, S., Hepp, T., Dietz, B., Bauer, S., Schwab, P. npj Digital Medicine, 4, September 2021 (Published) arXiv DOI URL BibTeX

Movement Generation and Control Conference Paper Rapid Convex Optimization of Centroidal Dynamics using Block Coordinate Descent Shah, P., Meduri, A., Merkt, W., Khadiv, M., Havoutis, I., Righetti, L. In Proceedings of the International Conference on Intelligent Robots and Systems (IROS 2021) , IEEE, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021) in Prague, Czech Republic., September 2021, Accepted (Accepted) URL BibTeX

Haptic Intelligence Conference Paper Sensorimotor-Inspired Tactile Feedback and Control Improve Consistency of Prosthesis Manipulation in the Absence of Direct Vision Thomas, N., Fazlollahi, F., Brown, J. D., Kuchenbecker, K. J. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), :6174-6181, Prague, Czech Republic, September 2021 (Published) DOI BibTeX

Perceiving Systems Article Separated and overlapping neural coding of face and body identity Foster, C., Zhao, M., Bolkart, T., Black, M. J., Bartels, A., Bülthoff, I. Human Brain Mapping, 42(13):4242-4260, September 2021 (Published) on-line DOI BibTeX

Perceiving Systems Patent Skinned multi-infant linear body model Hesse, N., Pujades, S., Romero, J., Black, M. (US Patent 11,127,163, 2021), September 2021 (Published) BibTeX

Haptic Intelligence Miscellaneous Teaching Safe Social Touch Interactions Using a Robot Koala Burns, R. B. Workshop paper (1 page) presented at the IROS Workshop on Proximity Perception in Robotics: Increasing Safety for Human-Robot Interaction Using Tactile and Proximity Perception, Prague, Czech Republic, September 2021 (Published) URL BibTeX

Empirical Inference Article Uncertainty estimation and explainability in deep learning-based age estimation of the human brain: Results from the German National Cohort MRI study Hepp, T., Blum, D., Armanious, K., Schölkopf, B., Stern, D., Yang, B., Gatidis, S. Computerized Medical Imaging and Graphics, 92, New York, NY, September 2021 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Uncertainty-Guided Progressive GANs for Medical Image Translation Upadhyay, U., Chen, Y., Hepp, T., Gatidis, S., Akata, Z. International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), 12903:614-624, Lecture Notes in Computer Science, (Editors: Marleen de Bruijne etal.), Springer, International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), September 2021 (Published) DOI BibTeX

Haptic Intelligence Ph.D. Thesis HuggieBot: An Interactive Hugging Robot With Visual and Haptic Perception Block, A. E. ETH Zürich, Zürich, August 2021, Department of Computer Science (Published) DOI BibTeX

Robotic Materials Book Chapter Electriflow: Augmenting Books With Tangible Animation Using Soft Electrohydraulic Actuators Purnendu, , Novack, S., Acome, E., Alistar, M., Keplinger, C., Gross, M. D., Bruns, C., Leithinger, D. In ACM SIGGRAPH 2021 Labs, :1-2, Association for Computing Machinery, SIGGRAPH, August 2021 (Published) Supplemental Material DOI URL BibTeX

Perceiving Systems Article The role of sexual orientation in the relationships between body perception, body weight dissatisfaction, physical comparison, and eating psychopathology in the cisgender population Meneguzzo, P., Collantoni, E., Bonello, E., Vergine, M., Behrens, S. C., Tenconi, E., Favaro, A. Eating and Weight Disorders - Studies on Anorexia, Bulimia and Obesity , 26(6):1985-2000, Springer, August 2021 (Published) DOI BibTeX

Empirical Inference Conference Paper Boosting Variational Inference With Locally Adaptive Step-Sizes Dresdner, G., Shekhar, S., Pedregosa, F., Locatello, F., Rätsch, G. Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI), :2337-2343, (Editors: Zhi-Hua Zhou), August 2021 (Published) arXiv DOI BibTeX

Conference Paper Efficient Sampling of Transition Constraints for Motion Planning under Sliding Contacts Khoury, M., Orthey, A., Toussaint, M. In 2021 IEEE 17th International Conference on Automation Science and Engineering (CASE 2021), :154-1553, IEEE, Piscataway, NJ, IEEE 17th International Conference on Automation Science and Engineering (CASE 2021), August 2021 (Published) DOI BibTeX

Empirical Inference Conference Paper How Good Is NLP? A Sober Look at NLP Tasks through the Lens of Social Impact Jin, Z., Chauhan, G., Tse, B., Sachan, M., Mihalcea, R. 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP), :3099-3113, Findings of ACL, (Editors: Chengqing Zong and Fei Xia and Wenjie Li and Roberto Navigli), Association for Computational Linguistics, August 2021, also accepted at 1st Workshop on NLP for Positive Impact@ACL-IJCNLP (Published) PDF DOI BibTeX

Perceiving Systems Article Learning an Animatable Detailed 3D Face Model from In-the-Wild Images Feng, Y., Feng, H., Black, M. J., Bolkart, T. ACM Transactions on Graphics, 40(4):88:1-88:13, August 2021 (Published) pdf Sup Mat code video talk DOI BibTeX

Physical Intelligence Miscellaneous Method for producing a structure with spatial encoded functionality Sitti, M., Ceylan, H., Yasa, I. C. August 2021, US Patent 11,084,718, 2021 () BibTeX