Haptische Intelligenz Miscellaneous 2022

Dense 3D Reconstruction Through Lidar: A New Perspective on Computer-Integrated Surgery

Technical innovations in sensing and computation are quickly advancing the field of computer-integrated surgery. In this fast-evolving panorama, we strongly believe there is still a need for robust geometric reconstruction of the surgical field. 3D reconstruction in surgery has been investigated almost only in the space of mono and stereoscopic visual imaging because surgeons always view the procedure through a clinical endoscope. Meanwhile, lidar (light detection and ranging) has greatly expanded in use, especially in SLAM for robotics, terrestrial vehicles, and drones. In parallel to these developments, the concept of multiple-viewpoint surgical imaging was proposed in the early 2010's in the context of magnetic actuation and micro-invasive surgery. We here propose an approach in which each surgical cannula can potentially hold a miniature lidar. Direct comparison between lidar from different viewpoints and a state-of-the-art 3D reconstruction method on stereoendoscope images showed that lidar-generated point clouds achieve better accuracy and scene coverage. This experiment especially hints at the potential of lidar imaging when deployed in a multiple-viewpoint approach.

Author(s): Guido Caccianiga and Katherine J. Kuchenbecker
Year: 2022
Month: June
Project(s):
Bibtex Type: Miscellaneous (misc)
Address: London, UK
Electronic Archiving: grant_archive
How Published: Short paper (2 pages) presented at the Hamlyn Symposium on Medical Robotics (HSMR)
Organization: The Hamlyn Centre for Robotic Surgery
State: Published

BibTex

@misc{Caccianiga22-HSMR-Reconstruction,
  title = {Dense 3D Reconstruction Through Lidar: A New Perspective on Computer-Integrated Surgery},
  abstract = {Technical innovations in sensing and computation are quickly advancing the field of computer-integrated surgery. In this fast-evolving panorama, we strongly believe there is still a need for robust geometric reconstruction of the surgical field. 3D reconstruction in surgery has been investigated almost only in the space of mono and stereoscopic visual imaging because surgeons always view the procedure through a clinical endoscope. Meanwhile, lidar (light detection and ranging) has greatly expanded in use, especially in SLAM for robotics, terrestrial vehicles, and drones. In parallel to these developments, the concept of multiple-viewpoint surgical imaging was proposed in the early 2010's in the context of magnetic actuation and micro-invasive surgery. We here propose an approach in which each surgical cannula can potentially hold a miniature lidar. Direct comparison between lidar from different viewpoints and a state-of-the-art 3D reconstruction method on stereoendoscope images showed that lidar-generated point clouds achieve better accuracy and scene coverage. This experiment especially hints at the potential of lidar imaging when deployed in a multiple-viewpoint approach.},
  howpublished = {Short paper (2 pages) presented at the Hamlyn Symposium on Medical Robotics (HSMR)},
  organization = {The Hamlyn Centre for Robotic Surgery},
  address = {London, UK},
  month = jun,
  year = {2022},
  slug = {caccianiga22-hsmr-reconstruction},
  author = {Caccianiga, Guido and Kuchenbecker, Katherine J.},
  month_numeric = {6}
}