Haptische Intelligenz Article 2023

Effects of Automated Skill Assessment on Robotic Surgery Training

Background: Several automated skill-assessment approaches have been proposed for robotic surgery, but their utility is not well understood. This article investigates the effects of one machine-learning-based skill-assessment approach on psychomotor skill development in robotic surgery training. Methods: N=29 trainees (medical students and residents) with no robotic surgery experience performed five trials of inanimate peg transfer with an Intuitive Surgical da Vinci Standard robot. Half of the participants received no post-trial feedback. The other half received automatically calculated scores from five Global Evaluative Assessment of Robotic Skill (GEARS) domains post-trial. Results: There were no significant differences between the groups regarding overall improvement or skill improvement rate. However, participants who received post-trial feedback rated their overall performance improvement significantly lower than participants who did not receive feedback. Conclusions: These findings indicate that automated skill evaluation systems might improve trainee selfawareness but not accelerate early-stage psychomotor skill development in robotic surgery training.

Author(s): Jeremy D. Brown and Katherine J. Kuchenbecker
Journal: The International Journal of Medical Robotics and Computer Assisted Surgery
Volume: 19
Number (issue): 2
Pages: e2492
Year: 2023
Month: April
Project(s):
Bibtex Type: Article (article)
DOI: 10.1002/rcs.2492
State: Published
Electronic Archiving: grant_archive

BibTex

@article{Brown23-IJMRCAS-Assessment,
  title = {Effects of Automated Skill Assessment on Robotic Surgery Training},
  journal = {The International Journal of Medical Robotics and Computer Assisted Surgery},
  abstract = {Background: Several automated skill-assessment approaches have been proposed for robotic surgery, but their utility is not well understood. This article investigates the effects of one machine-learning-based skill-assessment approach on psychomotor skill development in robotic surgery training. Methods: N=29 trainees (medical students and residents) with no robotic surgery experience performed five trials of inanimate peg transfer with an Intuitive Surgical da Vinci Standard robot. Half of the participants received no post-trial feedback. The other half received automatically calculated scores from five Global Evaluative Assessment of Robotic Skill (GEARS) domains post-trial. Results: There were no significant differences between the groups regarding overall improvement or skill improvement rate. However, participants who received post-trial feedback rated their overall performance improvement significantly lower than participants who did not receive feedback. Conclusions: These findings indicate that automated skill evaluation systems might improve trainee selfawareness but not accelerate early-stage psychomotor skill development in robotic surgery training.},
  volume = {19},
  number = {2},
  pages = {e2492},
  month = apr,
  year = {2023},
  slug = {brown23-ijmrcas-assessment},
  author = {Brown, Jeremy D. and Kuchenbecker, Katherine J.},
  month_numeric = {4}
}