Haptische Intelligenz Conference Paper 2023

Enhancing Surgical Team Collaboration and Situation Awareness through Multimodal Sensing

Surgery, typically seen as the surgeon's sole responsibility, requires a broader perspective acknowledging the vital roles of other operating room (OR) personnel. The interactions among team members are crucial for delivering quality care and depend on shared situation awareness. I propose a two-phase approach to design and evaluate a multimodal platform that monitors OR members, offering insights into surgical procedures. The first phase focuses on designing a data-collection platform, tailored to surgical constraints, to generate novel collaboration and situation-awareness metrics using synchronous recordings of the participants' voices, positions, orientations, electrocardiograms, and respiration signals. The second phase concerns the creation of intuitive dashboards and visualizations, aiding surgeons in reviewing recorded surgery, identifying adverse events and contributing to proactive measures. This work aims to demonstrate an innovative approach to data collection and analysis, augmenting the surgical team's capabilities. The multimodal platform has the potential to enhance collaboration, foster situation awareness, and ultimately mitigate surgical adverse events. This research sets the stage for a transformative shift in the OR, enabling a more holistic and inclusive perspective that recognizes that surgery is a team effort.

Author(s): Arnaud Allemang–Trivalle
Book Title: Proceedings of the ACM International Conference on Multimodal Interaction
Pages: 716--720
Year: 2023
Month: October
Project(s):
Bibtex Type: Conference Paper (inproceedings)
Address: Paris, France
DOI: 10.1145/3577190.3614233
State: Published
Electronic Archiving: grant_archive
How Published: Extended abstract (5 pages) presented at the ACM International Conference on Multimodal Interaction (ICMI) Doctoral Consortium

BibTex

@inproceedings{Allemang--Trivalle23-ICMI-Sensing,
  title = {Enhancing Surgical Team Collaboration and Situation Awareness through Multimodal Sensing},
  booktitle = {Proceedings of the ACM International Conference on Multimodal Interaction},
  abstract = {Surgery, typically seen as the surgeon's sole responsibility, requires a broader perspective acknowledging the vital roles of other operating room (OR) personnel. The interactions among team members are crucial for delivering quality care and depend on shared situation awareness. I propose a two-phase approach to design and evaluate a multimodal platform that monitors OR members, offering insights into surgical procedures. The first phase focuses on designing a data-collection platform, tailored to surgical constraints, to generate novel collaboration and situation-awareness metrics using synchronous recordings of the participants' voices, positions, orientations, electrocardiograms, and respiration signals. The second phase concerns the creation of intuitive dashboards and visualizations, aiding surgeons in reviewing recorded surgery, identifying adverse events and contributing to proactive measures. This work aims to demonstrate an innovative approach to data collection and analysis, augmenting the surgical team's capabilities. The multimodal platform has the potential to enhance collaboration, foster situation awareness, and ultimately mitigate surgical adverse events. This research sets the stage for a transformative shift in the OR, enabling a more holistic and inclusive perspective that recognizes that surgery is a team effort.},
  pages = {716--720},
  howpublished = {Extended abstract (5 pages) presented at the ACM International Conference on Multimodal Interaction (ICMI) Doctoral Consortium},
  address = {Paris, France},
  month = oct,
  year = {2023},
  slug = {allemang-trivalle23-icmi-sensing},
  author = {Allemang--Trivalle, Arnaud},
  month_numeric = {10}
}