Title:
Modeling Humans at Rest with Applications to Robot Assistance
Modeling Humans at Rest with Applications to Robot Assistance
| dc.contributor.advisor | Kemp, Charles C. | |
| dc.contributor.author | Clever, Henry M. | |
| dc.contributor.committeeMember | Hays, James | |
| dc.contributor.committeeMember | Howard, Ayanna | |
| dc.contributor.committeeMember | Liu, C. Karen | |
| dc.contributor.committeeMember | Turk, Greg | |
| dc.contributor.department | Biomedical Engineering (Joint GT/Emory Department) | |
| dc.date.accessioned | 2022-01-14T16:13:45Z | |
| dc.date.available | 2022-01-14T16:13:45Z | |
| dc.date.created | 2021-12 | |
| dc.date.issued | 2021-12-10 | |
| dc.date.submitted | December 2021 | |
| dc.date.updated | 2022-01-14T16:13:45Z | |
| dc.description.abstract | Humans spend a large part of their lives resting. Machine perception of this class of body poses would be beneficial to numerous applications, but it is complicated by line-of-sight occlusion from bedding. Pressure sensing mats are a promising alternative, but data is challenging to collect at scale. To overcome this, we use modern physics engines to simulate bodies resting on a soft bed with a pressure sensing mat. This method can efficiently generate data at scale for training deep neural networks. We present a deep model trained on this data that infers 3D human pose and body shape from a pressure image, and show that it transfers well to real world data. We also present a model that infers pose, shape and contact pressure from a depth image facing the person in bed, and it does so in the presence of blankets. This model similarly benefits from synthetic data, which is created by simulating blankets on the bodies in bed. We evaluate this model on real world data and compare it to an existing method that requires RGB, depth, thermal and pressure imagery in the input. Our model only requires an input depth image, yet it is 12% more accurate. Our methods are relevant to applications in healthcare, including patient acuity monitoring and pressure injury prevention. We demonstrate this work in the context of robotic caregiving assistance, by using it to control a robot to move to locations on a person’s body in bed. | |
| dc.description.degree | Ph.D. | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | http://hdl.handle.net/1853/66175 | |
| dc.language.iso | en_US | |
| dc.publisher | Georgia Institute of Technology | |
| dc.subject | Humans at rest | |
| dc.subject | Bodies at rest | |
| dc.subject | Computer vision, Machine learning, Physics simulation, Position-based dynamics, Sim2real transfer learning, Machine perception, Deep learning, Human pose estimation, Body shape estimation, Mechanics, Dynamics, Depth sensing, Pressure sensing, System identification, Soft object modeling, Kinematics, Pressure injury prevention, Caregiving robotics, Healthcare Robotics | |
| dc.title | Modeling Humans at Rest with Applications to Robot Assistance | |
| dc.type | Text | |
| dc.type.genre | Dissertation | |
| dspace.entity.type | Publication | |
| local.contributor.advisor | Kemp, Charles C. | |
| local.contributor.corporatename | Wallace H. Coulter Department of Biomedical Engineering | |
| local.contributor.corporatename | College of Engineering | |
| relation.isAdvisorOfPublication | e4f743b9-0557-4889-a16e-00afe0715f4c | |
| relation.isOrgUnitOfPublication | da59be3c-3d0a-41da-91b9-ebe2ecc83b66 | |
| relation.isOrgUnitOfPublication | 7c022d60-21d5-497c-b552-95e489a06569 | |
| thesis.degree.level | Doctoral |