Back
Humans spend a large part of their lives resting. Machine perception of this class of body poses would be beneficial to numerous applications, but it is complicated by line-of-sight occlusion from bedding. Pressure sensing mats are a promising alternative, but data is challenging to collect at scale. To overcome this, we use modern physics engines to simulate bodies resting on a soft bed with a pressure sensing mat. This method can efficiently generate data at scale for training deep neural networks. We present a deep model trained on this data that infers 3D human pose and body shape from a pressure image, and show that it transfers well to real world data. We also present a model that infers pose, shape and contact pressure from a depth image facing the person in bed, and it does so in the presence of blankets. This model similarly benefits from synthetic data, which is created by simulating blankets on the bodies in bed. We evaluate this model on real world data and compare it to an existing method that requires RGB, depth, thermal and pressure imagery in the input. Our model only requires an input depth image, yet it is 12% more accurate. Our methods are relevant to applications in healthcare, including patient acuity monitoring and pressure injury prevention. We demonstrate this work in the context of robotic caregiving assistance, by using it to control a robot to move to locations on a person’s body in bed.
Henry Clever (Georgia Institute of Technology)
Ph.D.
Henry M. Clever received B.S. and M.S. degrees in mechanical engineering, and recently graduated with a Ph.D. in robotics at the Georgia Institute of Technology in the Healthcare Robotics Lab. Henry's research has explored modeling and perception of humans in complex environments, and improving the ability of robots to interact with them and provide meaningful assistance. It crosses the fields of mechanics, haptics, computer vision, machine learning, optimization, and physics simulation, to improve how robots behave in complex environments.