Events & Talks

Haptic Intelligence Talk Andrew Schulz 23-01-2023 Mechanics and Materials of the Elephant Trunk with Applications to Conservation Technology An elephant trunk is both flexible and strong, able to pick up peanuts and uproot entire trees. This versatility has made the elephant a model for soft robotics studies that seek to build strong, flexible manipulators. By observing elephant behaviors during different mechanical tasks including elongation, wrapping, and suction feeding we can begin to understand the limitations and capabilities of this hydrostat. We further the understanding of these behaviors by looking into the mechanical properties of the elephant trunk’s skin including the wrinkled behavior commonly seen externally. Us... Katherine J. Kuchenbecker
Thumb ticker sm picture 1
Perceiving Systems Talk Mingyuan Zhang 19-01-2023 Human Motion Generation with Diffusion Models Human motion modeling is important for many modern graphics applications, which typically require professional skills. In order to remove the skill barriers for laymen, recent motion generation methods can directly generate human motions conditioned on natural languages, speech, and music. However, it remains challenging to achieve diverse and fine-grained motion generation with comprehensive condition signals. Inspired by the success in image generation, recent works attempt to apply diffusion models to motion generation tasks (Motion Diffusion Models) and achieve impressive progress in as... Shashank Tripathi
Thumb ticker sm mingyuan
Symposium 17-01-2023 - 20-01-2023 IMPRS-IS 2023 Interview Symposium Keynotes All members of the IMPRS-IS community are invited to attend the seventh annual interview symposium taking place from Tuesday, January 17, to Friday, January 20, 2023. The event will feature two keynote presentations from IMPRS-IS faculty Dr. Daniel Häufle of the University of Tübingen and Dr. Mathias Niepert of the University of Stuttgart.   Leila Masri Katherine J. Kuchenbecker Sara Sorce
Thumb ticker sm interviews feature
Perceiving Systems Talk Zhongang Cai 12-01-2023 Data Infrastructure for Scaling up Human Understanding and Modelling to the Real World Human sensing and modelling are fundamental tasks in vision and graphics with numerous applications. However, due to the prohibitive cost, existing datasets are often limited in scale and diversity. This talk shares two of our recent works to tackle data scarcity. First, with the advances of new sensors and algorithms, paired data can be obtained from an inexpensive set-up and an automatic annotation pipeline. Specifically, we demonstrate the data collection solution by introducing HuMMan, a large-scale multimodal 4D human dataset. HuMMan has several appealing properties: 1) multimodal data... Shashank Tripathi
Thumb ticker sm me
Haptic Intelligence PhD Thesis Defense 21-12-2022 Multi-Timescale Representation Learning of Human and Robot Haptic Interactions The sense of touch is one of the most crucial components of the human sensory system. It allows us to safely and intelligently interact with the physical objects and environment around us. By simply touching or dexterously manipulating an object, we can quickly infer a multitude of its properties. For more than fifty years, researchers have studied how humans physically explore and form perceptual representations of objects. Some of these works proposed the paradigm through which human haptic exploration is presently understood: humans use a particular set of exploratory procedures to... Katherine J. Kuchenbecker Ben Richardson
Thumb ticker sm thumb ticker benrichardson
Haptic Intelligence Talk Andreas Noll 16-12-2022 Vibrotactile Communications: Delivering Immersive Remote Touch Experiences Vibrotactile signals play an important role in human perception of haptic interactions and object surfaces. Thus, conveying these cues with high quality is vital for an immersive and pleasant experience. In order to create true immersion, many points of interaction need to be conveyed to human users. Thus, when conveying vibrotactile cues over the internet, a large number of signal channels must be transmitted that results in a high data throughput. In order to enable this, we design efficient data compression methods. For the human user receiving the signal to perceive these signals at hig... Katherine J. Kuchenbecker
Thumb ticker sm 0 img 7162
Conference 12-12-2022 - 13-12-2022 Max Planck & Amazon Science Hub Inauguration On December 12 and 13, 2022, Amazon and the Max Planck Society (MPG) will jointly host an inauguration event, celebrating the launch of our new collaboration, the Max Planck & Amazon Science Hub, and bringing together our research communities.
Thumb ticker sm sh eventsartboard 1 copy 6draft
Haptic Intelligence IS Colloquium Jun.-Prof. Dr. rer.nat. Maria Wirzberger 08-12-2022 Interdisciplinary Pathways to Responsible Human-Technology Partnership How can we design technology in a way that optimally supports human demands in everyday life? And how can we mitigate system-generated biases to facilitate a trustworthy human-technology partnership? At the intersection of cognitive psychology, human-machine interaction, education, and artificial intelligence, my team and I apply a broad portfolio of experimental lab, field, and online studies, user-centered software development, and modeling and simulation techniques. Together with collaborators from academia, industry, and education, our ultimate goal is to design and evaluate responsible... Katherine J. Kuchenbecker
Thumb ticker sm wirzberger 1
Haptic Intelligence IS Colloquium Nicolas Gerig 11-11-2022 Bio-inspired Robotics for Minimal-Invasive Surgery At the BIROMED-Lab, we work on developing novel technology to advance robot-assisted medical interventions. I will provide a short overview on our current research challenges with a focus on robot-assisted, minimally-invasive surgery. Minimal-invasive surgery results in faster patient recovery and using robotic tools allows to further enhance surgery outcome. Such robot-assisted minimal-invasive surgery is typically realized by replacing the direct manual guidance of instruments with telemanipulated or robot-guided instruments. For example, hand tremor can be filtered or the surgeons’ mo... Nataliya Rokhmanova Katherine J. Kuchenbecker
Thumb ticker sm gerig
Haptic Intelligence IS Colloquium Prof. Dr. Annegret Mündermann 11-11-2022 Digital Biomarkers and Functional Biomechanics in Orthopaedics Developments in assessing joint loading during locomotion and human movement are influenced by fast-pace technological advances. Simple technical solutions for capturing human movement using wearables and cloud-based solutions lead to applications in fields less related to biomechanics. Our group generates clinical evidence for using these technical solutions for assessing relevant parameters in large cohorts, collecting data outside of the laboratory and as digital biomarkers. Moreover, we investigate the functional biomechanics of orthopaedic conditions, evaluate established and novel tre... Nataliya Rokhmanova Katherine J. Kuchenbecker
Thumb ticker sm mundermann
Haptic Intelligence IS Colloquium Dr. Anna-Maria Liphardt 11-11-2022 Musculoskeletal Function in Immobilization and Rheumatic Disease Immobilization and disease both affect musculoskeletal function. At the same time, functional parameters may be an indicator of disease activity in rheumatic disease and changes in the mechanical environment cause acute and long term adaptation of tissue morphology and function. This presentation will summarize effects of immobilization using bed rest or microgravity on cartilage metabolism as well es introduce experimental setups to assess musculoskeletal function in rheumatic disease. Nataliya Rokhmanova Katherine J. Kuchenbecker
Thumb ticker sm liphardt am portrait
Event 10-11-2022 Robot Bionic Intelligence Colloquium University of Stuttgart's Autonomous Systems and Biomedical Systems Research Units together with Max Planck Institute for Intelligent Systems proudly present three leading researchers in Robot Bionic Intelligence. Please join us for this unique and interesting colloquium.
Thumb ticker sm ataro pointing
Haptic Intelligence PhD Thesis Defense 12-10-2022 Understanding the Influence of Moisture on Fingerpad-Surface Interactions This dissertation investigates the influence of moisture on fingerpad-surface interactions from diverse perspectives. First, we examine the extent to which moisture on the finger contributes to the sensation of stickiness during contact with glass. Second, we investigate the representative material properties of a finger at three distinct moisture levels, since the softness of human skin varies significantly with moisture. The third perspective is friction; we examine how the contact conditions, including the moisture of a finger, determine the available friction force opposing lateral slid... Katherine J. Kuchenbecker Saekwang Nam
Thumb ticker sm thumb ticker saekwang crop2
Physical Intelligence Talk Prof. Dietmar Hutmacher 26-09-2022 Ultrafast, Miniature Soft Actuators The quest for an advanced soft robotic actuator technology that is fast and can execute a wide range of application-specific tasks at multiple length scales is still ongoing. Here, we demonstrate a new design and manufacturing strategy that leads to high-speed inflatable actuators exhibiting diverse movements. Our approach leverages the concept of miniaturisation to reduce the required volume of fluid for actuation as well as fibre-reinforcement to improve the efficiency of actuators in converting delivered fluids into fast and predictable movement. To fabricate the designs, we employ a cla... Metin Sitti
Thumb ticker sm image001
Perceiving Systems Talk Yuge Shi 22-09-2022 Combine and conquer: representation learning from multiple data distributions It is becoming less and less controversial to say that the days of learning representations through label supervision are over. Recent work discovers that such regimes are not only expensive, but also suffer from various generalisation/robustness issues. This is somewhat unsurprising, as perceptual data (vision, language) are rich and cannot be well represented by a single label --- doing so inevitably result in the model learning spurious features that trivially correlates to the label. In this talk, I will introduce my work during my PhD at Oxford, which looks at representation learning... Yao Feng
Thumb ticker sm yugeshi
Physical Intelligence Talk Prof. Kaushik Jayaram 22-09-2022 Towards robust and autonomous locomotion in cluttered terrain using insect-scale robots Animals such as mice, cockroaches and spiders have the remarkable ability to maneuver through challenging cluttered natural terrain and have been inspiration for adaptable legged robotic systems. Recent biological research further indicates that body reorientation along pathways of minimal energy is a key factor influencing such locomotion. We propose to extend this idea by hypothesizing that body compliance of soft bodied animals and robots might be an alternate yet effective locomotion strategy to squeeze through cluttered obstacles. We present some early results related to the above usin... Metin Sitti
Thumb ticker sm jayaram feb22 square small
Haptic Intelligence Talk Laurence Willemet 20-09-2022 On the tactile perception of friction in humans and robots Humans excel at grasping and manipulating an impressive range of objects of different sizes, shapes, and surface properties. This incredible ability is subserved by a refined tactile perception of friction that informs the central nervous system whether the object is firmly grasped or on the verge of falling. In this talk, I will first dive into how minute lateral displacement enables humans to feel the frictional strength of the contact and how far they are from it in order to adjust their grip force in real time. I will then show how these findings are applied to robotic tactile sensors t... Katherine J. Kuchenbecker Saekwang Nam
Thumb ticker sm laurencewillemet
Haptic Intelligence Talk Yarden Sharon 19-09-2022 Robotic surgical skill evaluation and acquisition Robot-assisted minimally invasive surgery (RAMIS) has many advantages over open surgery. However, surgeons must be well trained to use the robotic systems to reap the benefits of RAMIS. Many efforts have been invested in optimizing the way RAMIS surgeons acquire technical skills, but the knowledge of how to measure technical skills and optimize training protocols is still limited. The goal of my Ph.D. study is to improve the way surgeons acquire RAMIS skills by (1) developing surgical skill metrics to evaluate the current state of a surgeon; (2) developing and testing novel training protoco... Katherine J. Kuchenbecker Guido Caccianiga
Thumb ticker sm yardensharon
Talk Alejandro Pardo 08-09-2022 Computer Vision for Automated Video Editing and Understanding. Video content creation has boomed in recent years. Every day hundreds of thousands of video hours are uploaded to the internet. Thus, video content editing has become more popular and accessible to amateur users. However, current Computer Vision (CV) techniques have not studied technologies to help video editing become a less tedious task. Currently, editors spend hours cutting and stitching videos to deliver final edited videos that convey stories. This cutting process is creative but is often repetitive. With the recent advances in CV, one would expect that a system could learn some cutti... Hongwei Yi
Thumb ticker sm 1592385342531
Perceiving Systems Talk Alejandro Pardo 08-09-2022 Computer Vision for Automated Video Editing and Understanding. Video content creation has boomed in recent years. Every day hundreds of thousands of video hours are uploaded to the internet. Thus, video content editing has become more popular and accessible to amateur users. However, current Computer Vision (CV) techniques have not studied technologies to help video editing become a less tedious task. Currently, editors spend hours cutting and stitching videos to deliver final edited videos that convey stories. This cutting process is creative but is often repetitive. With the recent advances in CV, one would expect that a system could learn some cutti... Hongwei Yi
Thumb ticker sm 1592385342531
Haptic Intelligence Talk Zhaoyang Li 01-09-2022 Soft Transducers for Human-Machine Interaction Human-machine and human-human virtual interactions have presented a growing area for different kinds of soft transducers including sensors and actuators. However, there are still challenges for soft transducers in their performance. For soft sensors, one key challenge is how to make them super sensitive to external stimuli (pressing, stretching, etc) and small (lightweight and thin). For soft actuators, one key challenge is to drive them with low voltage amplitude and generate high output force. In this talk, I will present my work on electret materials based soft transducers that can serve... Katherine J. Kuchenbecker Natalia Sanchez-Tamayo
Thumb ticker sm zhaoyang li
Haptic Intelligence IS Colloquium Prof. dr. J. B. J. (Jeroen) Smeets 18-08-2022 Grasping like Humans Do Humans and robots frequently pick up objects. Neuroscientists try to understand how humans control the non-linear musculoskeletal system to do so, and roboticists try to design control to mimic human dexterity. Both groups of scientists tend to decompose grasping based on the characteristics of the hardware, which is clearly separated in a part for positioning the hand/gripper in space and a part for the actual griping. It is therefore generally assumed that mastering these two parts constitutes efficient control of the reach-to-grasp movement. I will argue that human motor control is not f... Katherine J. Kuchenbecker Ilona Jacobi
Thumb ticker sm foto20221a small
Perceiving Systems Talk Zenghao Chai 04-08-2022 REALY: Rethinking the Evaluation of 3D Face Reconstruction The evaluation of 3D face reconstruction results typically relies on a rigid shape alignment between the estimated 3D model and the ground-truth scan. We observe that aligning two shapes with different reference points can largely affect the evaluation results. This poses difficulties for precisely diagnosing and improving a 3D face reconstruction method. In this paper, we propose a novel evaluation approach with a new benchmark REALY, consisting of 100 globally aligned face scans with accurate facial keypoints, high-quality region masks, and topology-consistent meshes. Our approach perform... Yandong Wen
Thumb ticker sm wechat image 20220802122414
Perceiving Systems Talk Lingchen Yang 28-07-2022 Implicit Neural Representation for Physics-driven Actuated Soft Bodies Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for actuation signals parameterized by neural networks. Our key contribution is a general and implicit formulation to control active soft bodies by defining a function that enables a continuous mapping from a spatial point in the material space to the actuation value. This property allows us to capture the signal's dominant frequencies, making the method discre... Yao Feng
Thumb ticker sm me
Perceiving Systems Talk Supreeth Narasimhaswamy 28-07-2022 Understanding Human Hands in Visual Data Hands are the central means by which humans interact with their surroundings. Understanding human hands help human behavior analysis and facilitate other visual analysis tasks such as action and gesture recognition. Recently, there has been a surge of interest in understanding first-person visual data, and hands are the dominant interaction entities in such activities. Also, there is an explosion of interest in developing computer vision methods for augmented and virtual reality. To deliver an authentic augmented and virtual reality experience, we need to enable humans to interact with the ... Sai Kumar Dwivedi Dimitris Tzionas
Thumb ticker sm supreeth photo min
Perceiving Systems Talk Michael Zollhoefer 27-07-2022 Complete Codec Telepresence Imagine two people, each of them within their own home, being able to communicate and interact virtually with each other as if they are both present in the same shared physical space. Enabling such an experience, i.e., building a telepresence system that is indistinguishable from reality, is one of the goals of Reality Labs Research (RLR) in Pittsburgh. To this end, we develop key technology that combines fundamental computer vision, machine learning, and graphics techniques based on a novel neural reconstruction and rendering paradigm. In this talk, I will cover our advances towards a neur... Yao Feng
Thumb ticker sm michi3 crop
Robotic Materials Talk Prof. Reimund Gerhard 25-07-2022 ELECTRETS (Dielectrics with quasi-permanent Charges or Dipoles) A long History and a bright Future Electrets have a long history starting more 2600 years ago and a bright future in the areas of soft transducers, plastic electronics, radiation dosimeters, air filters, etc. From the beginning, the similarities, the differences, and the combinations of dielectric and magnetic materials, of positive and negative “electricities”, of internal hetero-charges and external homo-charges, etc. have been puzzling natural philosophers and scientists. At the same time, rather slow, but continuous progress in the understanding and the application of electrets has been made. Recently, the essential role... Christoph Keplinger
Thumb ticker sm rg flute
Event 22-07-2022 2022 Max Planck Lecture & Intelligent Systems Summer Colloquium The Max Planck Institute for Intelligent Systems is delighted to invite you to its <br> 2022 Max Planck Lecture and annual scientific summer colloquium. Metin Sitti Matthias Tröndle Barbara Kettemann
Thumb ticker sm mp lecture   summer k 2022 1 1
Max Planck Lecture Zhenan Bao 22-07-2022 Skin-Inspired Organic Electronics Zhenan Bao is an inspiring scientist who is a world-renowned chemist, chemical engineer and material scientist and who has received so many awards it becomes challenging to count. She teaches at Stanford University in the heart of Silicon Valley where she and her team develop the most dazzling flexible and stretchable materials, electronics and energy devices which are inspired by human skin. On Friday, July 22, 2022 from 1:30pm, Zhenan Bao will hold this year’s Max Planck Lecture titled "Skin-Inspired Organic Electronics" at the Stuttgart site of the MPI-IS – live and in-person just as bef... Metin Sitti Matthias Tröndle Barbara Kettemann
Thumb ticker sm thumbnail is items
Learning and Dynamical Systems Talk Anastasios Angelopoulos 14-07-2022 Beyond Conformal Prediction: Distribution-Free Uncertainty Quantification for Complex Machine Learning Tasks As we begin deploying machine learning models in consequential settings like medical diagnostics or self-driving vehicles, we need ways of knowing when the model may make a consequential error (for example, that the car doesn't hit a human). Michael Muehlebach
Thumb ticker sm headshot 2
Workshop 12-07-2022 Movie Screening "Coded Bias" and Discussion CODED BIAS explores the fallout of MIT Media Lab researcher Joy Buolamwini’s discovery that facial recognition does not see dark-skinned faces accurately, and her journey to push for the first-ever legislation in the U.S. to govern against bias in the algorithms that impact us all. Ksenia Keplinger Monika Kotz Oliwia Gust Claudia Daefler
Thumb ticker sm 2022 coded bias
Physical Intelligence Talk Prof. Xuanhe Zhao 07-07-2022 Soft Materials Innovation for Health and Sustainability Polymers and water are the major components that constitute most living species on the earth, ranging from animals, plants, and fungi to bacteria. Polymers are also pervasive and indispensable in almost every aspect of our daily life, ranging from food, clothing, housing, and healthcare to transportation, communication and entertainment. Furthermore, over 6% of global electricity generated from coal is used to make plastics, and microplastics are already ubiquitous in global biosphere. Intrigued by their ubiquity and impacts, MIT Zhao Lab is focused on the study and development of soft mate...
Thumb ticker sm zhao
Event 02-07-2022 2022 Science & Innovation Days Tübingen MPI-IS Tübingen präsentiert Forschungsaktivitäten am 2. Juli 2022: <br> Capture Hall, Robotic Lab, Sensor Finger, Kinderuni-Video Claudia Daefler Georg Martius Huanbo Sun Tsvetelina Alexiadis Claudia Gallatz Felix Grimminger Majid Khadiv
Thumb ticker sm 2204 08 l slider 1920x492 science   innov days gvb 72dpi
Conference 28-06-2022 - 29-06-2022 IMPRS-IS Prolongation: On-Site Evaluation The IMPRS-IS Ph.D. program is currently undergoing a prolongation process to apply for six more years of funding. This process involves an on-site visit from a team of external evaluators. During this visit, the evaluation committee will visit the two sites of MPI-IS. MPI-IS community members are welcome to join for the event’s scientific talks and poster sessions. Katherine J. Kuchenbecker Leila Masri Sara Sorce
Thumb ticker sm header
Robotic Materials Workshop 15-06-2022 - 18-06-2022 Shaping the Future of Robotics through Materials Innovation The goal of this workshop is to bring together a group of international experts working at the intersection of materials science and robotics to discuss how materials innovation can shape the future of robotics. The workshop will feature invited talks that stimulate subsequent organized breakout sessions to discuss key future research themes and to set the course in the field. The meeting will take place at Castle Ringberg in the south of Germany, which offers an inspiring setting to discuss cutting edge research, to initiate new collaborations, and to reinvigorate existing connections. Philipp Rothemund Christoph Keplinger
Thumb ticker sm castle2
Perceiving Systems Talk Rana Hanocka 13-06-2022 Shape editing, generation, and stylization Manual authoring of 3D content is a laborious and tedious task. In this talk, I present some of 3DL's recent and on-going efforts toward building tools which provide intuitive control for editing, manipulating, and generating 3D shapes. I will discuss how recent advancements, such as joint vision-language embedding spaces can be used to stylize 3D objects, driven by natural language. Finally, I will conclude with ongoing and future work in this direction, as well as other related areas. Omid Taheri
Thumb ticker sm rana
Perceiving Systems Talk Youngjoong Kwon 09-06-2022 Learning to create Digital Humans: Generalizable Radiance Fields for Human Performance Rendering In this work, we aim at synthesizing a free-viewpoint video of an arbitrary human performance using sparse multi-view cameras. Recently, several works have addressed this problem by learning person-specific neural radiance fields (NeRF) to capture the appearance of a particular human, In parallel, some work proposed to use pixel-aligned features to generalize radiance fields to arbitrary new scenes and objects. Adopting such generalization approaches to humans, however, is highly challenging due to the heavy occlusions and dynamic articulations of body parts. To tackle this, we propose a no... Yuliang Xiu
Thumb ticker sm screenshot 2022 06 03 at 15.32.21
Physical Intelligence Talk Renee Zhao 31-05-2022 Multifunctional magnetic origami robots Millimeter/centimeter-scale origami robots have recently been explored for biomedical applications due to their inherent shape-morphing capability. However, they mainly rely on passive or/and irreversible deformation that significantly hinders the clinic functions in an on-demand manner. Here, we report magnetically actuated origami robots that can crawl and swim for effective locomotion and targeted drug delivery in severely confined spaces and aqueous environments. We design our robots based on the Kresling origami, whose thin shell structure 1) provides an internal cavity for drug storag... Metin Sitti
Thumb ticker sm zhao
Perceiving Systems Talk Jiashi Feng 02-05-2022 Learning to estimate 3D human poses without labeled data Estimating 3D human poses from images or videos is a fundamental task in computer vision. However, the limitation of training data with high-quality 3D pose annotations largely hinder its development and deployment in real applications. In this talk, I will introduce our recent works on training 3D pose estimation models without requiring 3D labeled data. Our first step is to present PoseAug, a new auto-augmentation framework that learns to augment the available training poses towards a greater diversity and thus improve generalization of the trained 2D-to-3D pose estimator. Specifically, P... Michael Black
Thumb ticker sm wechat image 20171123091532
Perceiving Systems Talk Lixin Yang 25-04-2022 Leverage Kinematic and Contact constraints for understanding hand-object interaction My works focus on inferring and understanding the human hand’s interaction with objects from visual inputs, which include several tasks like pose estimation, grasping pose generation, and interacting pose transfer. Unlike the single-body pose estimation task, understanding the Hand-object (multi-bodies) interactions in 3D spaces is more challenging, due to its high degree of articulations, the projection ambiguity, self or mutual occlusions, and the complicated physical constraints. Designing algorithms to tackle these challenges is my goal. We find that the mutual contact can provide rich ... Yuliang Xiu
Thumb ticker sm lixin circle
Perceiving Systems Talk Chunlu Li 19-04-2022 Model-based Face Reconstruction and Occlusion Segmentation from Weak Supervision 3D face reconstruction under occlusions is highly challenging because of the large variability of the appearance and location of occluders. Currently, the most successful methods fit a 3D face model through inverse rendering and assume a given segmentation of the occluder to avoid fitting the occluder. However, the segmentation annotations are costly since training an occlusion segmentation model requires large amounts of annotated data. To overcome this, we introduce a model-based approach for 3D face reconstruction that is highly robust to occlusions but does not require any occlusion ann... Victoria Fernandez Abrevaya
Thumb ticker sm img 3439
Perceiving Systems Talk Angela Yao 12-04-2022 Mixing Synthetic and Real-World Captures for RGB Hand Pose Estimation How can we learn models for hand pose estimation without any (real-world) labels? This talk presents our recent efforts in tackling the challenging scenario of learning from labelled synthetic data and unlabelled real-world data. I will focus on two strategies that we find to be effective: (1) cross-modal consistency and alignment for representation learning and (2) pseudo-label corrections and refinement. The second part of the talk will introduce Assembly101, our newly recorded dataset that tackles 3D hand pose and action understanding over time. Assembly101 is a new procedural activit... Dimitris Tzionas
Thumb ticker sm angela yao
Physical Intelligence Talk David J. Cappelleri 11-04-2022 Microrobotics to Micro Aerial Vehicles: Robots Interacting with the Environment The Multi-Scale Robotics & Automation Lab (MSRAL) at Purdue University performs cutting-edge research on robotic and automation systems at various length scales: macro-scale (cm to m), meso-scale (~100's of um to a few mm's), and micro-scale (10's of um to 100's of um). All of the developed systems are designed to interact with the environment in unique ways. In this talk, I will discuss some recent MSRAL microrobotics projects on developing learned models for 2D micromanipulation tasks and different types of families of wireless mobile microrobots driven by external magnetic fields that w... Metin Sitti
Thumb ticker sm cappelleri photo
Haptic Intelligence Talk Dominika Lisy 07-04-2022 Boundary-Crossing Empathy: The Figuration of the Skin, Bodies, and Boundaries What does it mean to have empathic interactions with robots? What is the role of a body, its surface, and the sense of self for building relations? And how does it change what it means to be human? These could be seen as overarching questions of my PhD project which aims to provide a feminist ethical framework for designing and imagining interactions with robots. I am interested in thinking about the role of binary divides such as human/non-human, self/other or reason/emotion in affective human-robot interaction. I want to look closely at their conceptual and material relations and under... Katherine J. Kuchenbecker
Thumb ticker sm picture 1
Perceiving Systems Talk Henry Clever 07-04-2022 Modeling Humans at Rest with Applications to Robotic Assistance Humans spend a large part of their lives resting. Machine perception of this class of body poses would be beneficial to numerous applications, but it is complicated by line-of-sight occlusion from bedding. Pressure sensing mats are a promising alternative, but data is challenging to collect at scale. To overcome this, we use modern physics engines to simulate bodies resting on a soft bed with a pressure sensing mat. This method can efficiently generate data at scale for training deep neural networks. We present a deep model trained on this data that infers 3D human pose and body shape from ... Dimitris Tzionas Chun-Hao Paul Huang
Thumb ticker sm img 4586 scaled
Perceiving Systems Talk Sida Peng 07-04-2022 Reconstructing Static Scenes and Dynamic Humans with Implicit Neural Representations 3D reconstruction is a long-standing problem in computer vision and has a variety of applications such as virtual reality, 3D content generation, and telepresence. In this talk, I will present our progress on 3D reconstruction of static scenes and dynamic humans with implicit neural representations. The first part of the talk introduces an effective regularization when optimizing implicit neural representations on indoor scenes based on the Manhattan-world Assumption. In the second part, I will show some animatable implicit neural representations for modeling dynamic humans from videos. Hongwei Yi
Thumb ticker sm photo
Haptic Intelligence Talk Alborz Aghamaleki Sarvestani 05-04-2022 Mechanical Design, Development and Testing of Bioinspired Legged Robots for Dynamic Locomotion Animals like ostriches perform complex locomotion tasks in the presence of large neurocontrol delays and potentially with limited central command. It is surprising that legged robots with high control frequencies and microsecond-range control delays are still unable to compete with legged animals in terms of agility, robustness, performance, and energy efficiency. These observations led us to look closely at animals to draw inspiration and improve robotic leg designs. For example, we observed that certain leg joints moved in a coordinated manner but without neural command when manually flex... Katherine J. Kuchenbecker
Thumb ticker sm alborzpic
Haptic Intelligence Talk Giulia Ballardini 18-03-2022 Assessment and Enhancement of Proprioceptive Performance In daily living activities, proprioception – information about limbs’ position and movement and the force that they applied - is fundamental to respond to the environment and rapidly react to changing circumstances. For example, it allows us to maneuver and find our way around obstacles in the dark and manipulate objects out of view, preventing their slippage. Many neurological conditions and traumatic events affect motor and somatosensory functions. Reliable methods to quantify proprioceptive deficits are crucial for better understanding the pathophysiology of disability, enhancing the det... Katherine J. Kuchenbecker
Thumb ticker sm gemma
Haptic Intelligence Talk Buse Aktaş 17-03-2022 Multidimensional Tunable Mechanics Using Jamming Jamming is a structural phenomenon that provides tunable mechanical behavior. A jamming structure typically consists of a collection of elements with low effective stiffness and damping. When a pressure gradient, such as vacuum, is applied, kinematic and frictional coupling increase, resulting in dramatically altered mechanical properties. This results in a number of functional capabilities useful for robotics applications including: tunable stiffness, tunable force threshold, tunable dynamic response, reversible plasticity, shape locking, and variable kinematics. Engineers have used jammin... Katherine J. Kuchenbecker
Thumb ticker sm screen shot 2022 03 08 at 10.14.18 am