1
|
Arcamo K, Murugappan S, Larkins K, Mohan H, Costello A, Pendlebury A, McNally O, McBain R. Determining the metrics of competence in robotic hysterectomy: a systematic review. J Robot Surg 2025; 19:286. [PMID: 40514589 DOI: 10.1007/s11701-025-02471-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2025] [Accepted: 06/03/2025] [Indexed: 06/16/2025]
Abstract
With the rapidly increasing use of robotic-assisted surgery in gynecology, there is a clear need for a structured robotic hysterectomy curriculum. To develop an effective training program, valid performance metrics that reliably assess skill level is required. As part of robotic curriculum development with IMRA using Kern's framework, this systematic review aims to identify proposed metrics of competence and assess their validity within the context of robotic hysterectomy training. A systematic literature search of OVID MEDLINE and EMBASE was conducted following the PRISMA guidelines, with keywords related to 'hysterectomy', 'robot-assisted', and 'metric'. The study aims, methods, outcomes, description of metrics, measurements of metrics, and metrics validity were extracted and analyzed. The initial search yielded 531 articles, of which 3 were included. Three additional articles were identified through citation and website searching, resulting in a total of six articles being included in this review. Development and identification of both simulator and intraoperative metrics greatly varied between the studies. Several studies utilized an expert consensus-based methodology, such as a modified Delphi methodology, to develop performance metrics. All metrics were assessed for content, construct, and predictive validity. Two studies were able to demonstrate predictive validity; however, there was limited correlation between virtual reality simulator metrics and intraoperative scores. This review highlights the lack of standardized and validated metrics specific to robotic hysterectomy, as well as the inability of established assessment tools to differentiate between robotic surgical skill level. This forms the context for ongoing work at IMRA to develop a granular assessment tool to assess skill acquisition as part of a robotic hysterectomy curriculum.
Collapse
Affiliation(s)
- Kayla Arcamo
- International Medical Robotics Academy, Parkville, Melbourne, Australia.
- University of Melbourne, Parkville, Melbourne, Australia.
| | - Sita Murugappan
- International Medical Robotics Academy, Parkville, Melbourne, Australia
| | - Kirsten Larkins
- Peter MacCallum Cancer Centre, Parkville, Melbourne, Australia
| | - Helen Mohan
- University of Melbourne, Parkville, Melbourne, Australia
- Peter MacCallum Cancer Centre, Parkville, Melbourne, Australia
| | - Anthony Costello
- International Medical Robotics Academy, Parkville, Melbourne, Australia
- Peter MacCallum Cancer Centre, Parkville, Melbourne, Australia
| | - Adam Pendlebury
- International Medical Robotics Academy, Parkville, Melbourne, Australia
- Peter MacCallum Cancer Centre, Parkville, Melbourne, Australia
| | - Orla McNally
- International Medical Robotics Academy, Parkville, Melbourne, Australia
- The Royal Women's Hospital, Melbourne, Australia
| | - Rosie McBain
- International Medical Robotics Academy, Parkville, Melbourne, Australia.
- The Royal Women's Hospital, Melbourne, Australia.
| |
Collapse
|
2
|
Frati RMC, Maltez RG, Neto VJFDA, Porto BC, Passerotti CC, Sardenberg RADS, Artifon EL, Otoch JP, da Cruz JAS. Impact of Preoperative Warm-Up on Surgical Performance of Resident Physicians: A Randomized Controlled Trial. JOURNAL OF SURGICAL EDUCATION 2025; 82:103501. [PMID: 40184830 DOI: 10.1016/j.jsurg.2025.103501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2024] [Revised: 12/18/2024] [Accepted: 02/23/2025] [Indexed: 04/07/2025]
Abstract
INTRODUCTION Surgical learning is a complex process that involves resident characteristics, instructional methods, and technological tools. As surgical residency programs become more diverse, there is a growing need for adaptable training methods that align with various learning styles and backgrounds. Manual dexterity and self-assessment skills are essential for residents, and recent studies highlight those residents with refined manual skills perform better in surgery. Preoperative warm-up is emerging as a potential strategy to improve immediate surgical performance. The study aimed to analyze whether preoperative warm-up in low-cost surgical simulators (training boxes) is related to an immediate improvement in the intraoperative performance of general surgery residents inexperienced in laparoscopy. METHODS The study used a swine model for surgical simulations in a controlled training environment. 105 first-year general surgery residents were divided into 2 groups: the control group (performed procedures without warm-up) and the intervention group (performed a 10-minute preoperative warm-up using a training box). RESULTS The Intervention group demonstrated improved efficiency in cholecystectomy (2.97 ± 0.4 vs 2.41 ± 0.91, p = 0.03), with reductions of 41.5% in cholecystectomy dissection time (4.82 ± 4.94 vs 8.23 ± 5.15 minutes, p = 0.02) and 15.6% in left radical nephrectomy dissection time (13.03 ± 4.49 vs 16.77 ± 3.90 minutes, p = 0.012). CONCLUSIONS Preoperative warm-up using a training box significantly improved the qualitative and quantitative surgical performance of general surgery residents with no prior laparoscopic experience, particularly by increasing efficiency in cholecystectomy and reducing dissection times in both cholecystectomy and left radical nephrectomy.
Collapse
Affiliation(s)
- Rodrigo Marcus Cunha Frati
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil; Universidade Nove de Julho, Surgery Department, Sao Bernardo do Campos (SP), São Paulo, Brazil
| | - Rafael Guisalberte Maltez
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil; Universidade Nove de Julho, Surgery Department, Sao Bernardo do Campos (SP), São Paulo, Brazil
| | | | - Breno Cordeiro Porto
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil
| | - Carlo Camargo Passerotti
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil
| | - Rodrigo Afonso da Silva Sardenberg
- Universidade Nove de Julho, Surgery Department, Sao Bernardo do Campos (SP), São Paulo, Brazil; International Teaching and Research Institute, Hapvida NotreDame Intermédica, São Paulo, Brazil
| | - Everson Luiz Artifon
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil
| | - José Pinhata Otoch
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil
| | - José Arnaldo Shiomi da Cruz
- Universidade de São Paulo, School of Medicine, Surgical Technique and Experimental Surgery, São Paulo, Brazil; Universidade Nove de Julho, Surgery Department, Sao Bernardo do Campos (SP), São Paulo, Brazil; International Teaching and Research Institute, Hapvida NotreDame Intermédica, São Paulo, Brazil.
| |
Collapse
|
3
|
Ju S, Jiang P, Jin Y, Fu Y, Wang X, Tan X, Han Y, Yin R, Pu D, Li K. Automatic gesture recognition and evaluation in peg transfer tasks of laparoscopic surgery training. Surg Endosc 2025; 39:3749-3759. [PMID: 40316752 DOI: 10.1007/s00464-025-11730-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2024] [Accepted: 04/06/2025] [Indexed: 05/04/2025]
Abstract
BACKGROUND Laparoscopic surgery training is gaining increasing importance. To release doctors from the burden of manually annotating videos, we proposed an automatic surgical gesture recognition model based on the Fundamentals of Laparoscopic Surgery (FLS) and the Chinese Laparoscopic Skills Testing and Assessment (CLSTA) tools. Furthermore, statistical analysis was conducted based on a gesture vocabulary that had been designed to examine differences between groups at different levels. METHODS Based on the CLSTA, the training process of peg transfer can be represented by a standard sequence of seven surgical gestures defined in our gesture vocabulary. The dataset used for model training and testing included eighty videos recorded at 30 fps. All videos were rated by senior medical professionals from our medical training center. The dataset was processed using cross-validation to ensure robust model performance. The model applied is 3D ResNet-18, a convolutional neural network (CNN). An LSTM neural network was utilized to refine the output sequence. RESULTS The overall accuracy for the recognition model was 83.8% and the F1 score was 84%. The LSTM network improved model performance to 85.84% accuracy and an 85% F1 score. Every operative process starts with Gesture 1 (G1) and ends with G5, with wrong placement is labeled as G6. The average training time is 92 s (SD = 36). Variance was observed between groups for G1, G3, and G6, indicating that trainees may benefit from focusing their efforts on these relevant operations, while assisting doctors also in more effectively analyzing the training outcome. CONCLUSION An automatic surgical gesture recognition model was developed for the peg transfer task. We also defined a gesture vocabulary along with the artificial intelligence model to sequentially describe the training operation. This provides an opportunity for artificial intelligence-enabled objective and automatic evaluation based on CLSTA in the clinic implementation.
Collapse
Affiliation(s)
- Shujun Ju
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Department of Industrial Engineering, Sichuan University, Chengdu, China
| | - Penglin Jiang
- Department of Industrial Engineering, Sichuan University, Chengdu, China
| | - Yutong Jin
- Department of Industrial Engineering, Sichuan University, Chengdu, China
| | - Yaoyu Fu
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
| | - Xiandi Wang
- West China Medical Simulation Center, West China Hospital, Chengdu, China
| | - Xiaomei Tan
- Department of Industrial Engineering, Sichuan University, Chengdu, China
| | - Ying Han
- West China Medical Simulation Center, West China Hospital, Chengdu, China.
| | - Rong Yin
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China.
- Department of Industrial Engineering, Sichuan University, Chengdu, China.
| | - Dan Pu
- West China Medical Simulation Center, West China Hospital, Chengdu, China
| | - Kang Li
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Department of Industrial Engineering, Sichuan University, Chengdu, China
| |
Collapse
|
4
|
Cizmic A, Schwabe N, Häberle F, Killat D, Giannou AD, Preukschas AA, Nießen A, Pianka F, Billmann F, Mehrabi A, Müller-Stich BP, Hackert T, Nickel F. Cognitive learning versus practical "hands-on" training for acquisition of laparoscopic surgical skills: an optimal combination study. Surg Endosc 2025; 39:3068-3078. [PMID: 40146258 PMCID: PMC12041110 DOI: 10.1007/s00464-025-11673-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2024] [Accepted: 03/14/2025] [Indexed: 03/28/2025]
Abstract
BACKGROUND Most minimally invasive surgery (MIS) training curricula involve practical training (PT) and cognitive learning (CL) to different extents. It has been proven that acquiring and training specific skills through CL can improve MIS skills. This study aimed to discover the most efficient combination of these two approaches and examine their effects on acquiring MIS skills in novices. METHODS Sixty medical students without MIS experience participated in this randomized controlled study and were divided into three groups. The first group received the same amount of PT (50%) as CL (50%). The second group focused on PT (75%) compared to the CL (25%). The third group focused more on CL (75%), with less PT implemented (25%). Before and after training, participants performed an ex vivo laparoscopic cholecystectomy (LCHE). Objective Structured Assessment of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores were used for MIS skill evaluation. RESULTS Group 1 improved all four performance assessments (global GOALS 14.3 vs. 18.0, p < 0.001, LCHE-specific GOALS 5.9 vs. 6.9, p = 0.016, global OSATS 19.4 vs. 26.4, p < 0.001, LCHE-specific OSATS 37.9 vs. 46.5, p = 0.004). Group 2 and Group 3 improved three of four performance scores (Group 2: global GOALS 15.0 vs. 18.4, p < 0.001, LCHE-specific GOALS 7.0 vs. 7.7, p = 0.115, global OSATS 19.6 vs. 25.8, p < 0.001, LCHE-specific OSATS 41.3 vs. 50.7, p = 0.001; Group 3: global GOALS 13.8 vs. 17.9, p < 0.001, LCHE-specific GOALS 5.8 vs. 6.6, p = 0.148, global OSATS 18.9 vs. 25.5, p < 0.001, LCHE-specific OSATS 36.8 vs. 43.5, p = 0.034). CONCLUSIONS A balanced combination of PT and CL seems to offer the most effective training compared to predominantly PT or CL training. All three training modes improved MIS skills in novices.
Collapse
Affiliation(s)
- Amila Cizmic
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Nils Schwabe
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Frida Häberle
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - David Killat
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Anastasios D Giannou
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Anas A Preukschas
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Anna Nießen
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Frank Pianka
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Franck Billmann
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Arianeb Mehrabi
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
| | - Beat P Müller-Stich
- Department of Digestive Surgery, University Digestive Healthcare Center Basel, Kleinriehenstrasse 30, 4058, Basel, Switzerland
| | - Thilo Hackert
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Felix Nickel
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
| |
Collapse
|
5
|
Thomaschewski M, Vonthein R, Keck T, Laubert T, Benecke C. Laparoscopic simulation training improves operating room performance of surgical residents: a multicenter randomized trial (NOVICE). Int J Surg 2025; 111:2923-2932. [PMID: 39998559 DOI: 10.1097/js9.0000000000002304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Accepted: 02/02/2025] [Indexed: 02/27/2025]
Abstract
BACKGROUND Learning basic laparoscopic skills can be efficiently performed ex vivo in a safe environment using simulation devices. However, in many countries, the broad and mandatory implementation of ex vivo laparoscopic simulation training in surgical residency is still lacking. The aim of the study was to evaluate the efficacy of laparoscopic basic skills simulation training on the surgical performance of residents during their first laparoscopic procedures in the operating room. METHODS This was a multicenter, prospective, randomized, two-arm, single-blind trial. The study recruited first-year surgical residents (NOVICE) with no previous personal experience in laparoscopic surgery. After the participants had performed their first laparoscopic cholecystectomy, they were randomized into two groups: the intervention group underwent six weeks of standardized laparoscopic basic skills simulation training (Lübeck Toolbox Curriculum), whereas the control group did not. After six weeks, both groups performed a second cholecystectomy. The videotapes of the first and second cholecystectomies were evaluated blinded based on the Global Operative Assessment of Laparoscopic Skill (GOALS) score. The primary endpoint was the changes in the GOALS scores between the first and second cholecystectomies. RESULTS 22 surgical residents from 11 surgical clinics in Germany were included, and 4 residents dropped out. The median improvement in the LTB-Curriculum group between CHE I and CHE II was 8.5 GOALS score points in contrast to 2 points in the control group. This difference was statistically significant (95%CI: 1-15 points, P = 0.013). CONCLUSION Ex-vivo training in basic laparoscopic skills significantly improved the surgical performance of residents during their first laparoscopic cholecystectomies in the operating room.
Collapse
Affiliation(s)
- Michael Thomaschewski
- Department of Surgery, University Medical Center Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
| | - Reinhard Vonthein
- Institute of Medical Biometry and Statistics, University Medical Center Schleswig-Holstein, Campus Lübeck, University of Lübeck, Lübeck, Germany
| | - Tobias Keck
- Department of Surgery, University Medical Center Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
| | - Tilman Laubert
- Department of Surgical Proctology, Proctological Office Kiel, Kiel, Germany
| | - Claudia Benecke
- Department of Surgery, University Medical Center Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
| |
Collapse
|
6
|
Seeger P, Kaldis N, Nickel F, Hackert T, Lykoudis PM, Giannou AD. Surgical training simulation modalities in minimally invasive surgery: How to achieve evidence-based curricula by translational research. Am J Surg 2025; 242:116197. [PMID: 39889386 DOI: 10.1016/j.amjsurg.2025.116197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2024] [Revised: 12/19/2024] [Accepted: 01/09/2025] [Indexed: 02/03/2025]
Abstract
BACKGROUND Surgery has evolved from a hands-on discipline where skills were acquired via the "learning by doing" principle to a surgical science with attention to patient safety, health care effectiveness and evidence-based research. A variety of simulation modalities have been developed to meet the need for effective resident training. So far, research regarding surgical training for minimally invasive surgery has been extensive but also heterogenous in grade of evidence. METHODS A literature search was conducted to summarize current knowledge about simulation training and to guide research towards evidence-based curricula with translational effects. This was conducted using a variety of terms in PubMed for English articles up to October 2024. Results are presented in a structured narrative review. RESULTS For virtual reality simulators, there is sound evidence for effective training outcomes. The required instruments for the development of minimally invasive surgery curricula combining different simulation modalities to create a clinical benefit are known and published. CONCLUSION Surgeons are the main creators for minimally invasive surgery training curricula and often follow a hands-on oriented approach that leaves out equally important aspects of assessment, evaluation, and feedback. Further high-quality research that includes available evidence in this field promises to improve patient safety in surgical disciplines.
Collapse
Affiliation(s)
- Philipp Seeger
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Nikolaos Kaldis
- 3rd Department of Surgery, Attiko University Hospital, National and Kapodistrian University of Athens, Athens, Greece
| | - Felix Nickel
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Thilo Hackert
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Panagis M Lykoudis
- 3rd Department of Surgery, Attiko University Hospital, National and Kapodistrian University of Athens, Athens, Greece; Division of Surgery and Interventional Science, University College London (UCL), London, UK.
| | - Anastasios D Giannou
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Section of Molecular Immunology und Gastroenterology, I. Department of Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
7
|
Fu D, Wei W, Wang D, Shen Y, Feng L, Liu H, Wei L, Konge L, Han Y, Li S, Li W. Remote Hands-on Training versus On-site Hands-on Training for Flexible Optical Intubation: A Noninferiority Randomized Controlled Trial. Anesth Analg 2025:00000539-990000000-01243. [PMID: 40163841 DOI: 10.1213/ane.0000000000007491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/02/2025]
Abstract
BACKGROUND Simulation-based training for flexible optical intubation (FOI) is effective but costly and often unavailable in remote areas. Online, hands-on training using affordable, shippable models could be a feasible alternative. METHODS In this noninferiority randomized controlled trial, 30 participants with fewer than 5 FOI experiences were assigned randomly to either remote or on-site hands-on training groups at a 1:1 ratio. The remote group received online theoretical teaching and supervised training and hands-on practice using a modified "Choose-the-Hole" model and a three-dimensional (3D)-printed airway manikin shipped to them. The on-site group received theoretical teaching and hands-on FOI practice in the Eye & ENT Hospital Training Center. Within 1 week after training, all participants performed the FOIs on anesthetized patients with normal airway anatomy. The performances were video recorded and evaluated. The primary outcome was the global rating scale (GRS) scores of the FOI performance on the patient. Secondary outcomes included the checklist scores of FOI performance, first attempt and total success rate, mean intubation time, self-assessment, and training satisfaction. RESULTS From July 2022 to December 2022, 30 participants were randomly assigned to receive either remote training (n = 15) or on-site training (n = 15), of whom 28 participants were included in the analyses (17 females, 11 males, average age of 30.0 years). The baseline characteristics of the participants were comparable between 2 groups. No significant difference was found in GRS scores (14.2 ± 3.95 vs. 12.0 ± 3.60, P = .146, mean difference, 2.14, 95% confidence interval [CI], -0.79 - 5.08) between the remote and on-site groups. Statistically similar mean checklist scores (9.32 ± 0.78 vs. 8.89 ± 1.08, P = .238) and intubation time (123 ± 68 vs. 117 ± 54 seconds, P = .780) were noted, respectively, in the remote and on-site groups. The total success rate was 100% in both groups. No significant difference was found in the remote and on-site groups regarding self-assessment and training satisfaction scores. CONCLUSIONS Remote FOI hands-on training using shippable models was as effective as on-site training, with similar performance, checklist scores, success rate, and intubation time. This suggests that remote training can serve as a viable, cost-effective alternative to traditional on-site methods.
Collapse
Affiliation(s)
- Danyun Fu
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Wei Wei
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Dingding Wang
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Yilei Shen
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Lili Feng
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Hongjun Liu
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Li Wei
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES), Rigshospitalet, Capital, Region of Denmark, Copenhagen, Denmark
- Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Yuan Han
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Shuangshuang Li
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| | - Wenxian Li
- From the Department of Anesthesiology, Eye & ENT Hospital of Fudan University, Shanghai, China
| |
Collapse
|
8
|
Swift BE, Axelrod C, Benseler A, Kobylianskii A, Vicus D, Laframboise S, Walker M, Sobel M, Tannenbaum E. A Multicenter, Randomized Controlled Trial to Assess Video-based Surgical Coaching in Gynecology. J Minim Invasive Gynecol 2025:S1553-4650(25)00086-X. [PMID: 40139267 DOI: 10.1016/j.jmig.2025.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2024] [Revised: 01/13/2025] [Accepted: 03/12/2025] [Indexed: 03/29/2025]
Abstract
STUDY OBJECTIVE To evaluate the effect of video-based coaching on technical skill development in surgical education. DESIGN Randomized controlled trial with video-based coaching (intervention group) in addition to standard surgical curriculum or the standard surgical curriculum alone (control group). SETTING Laparoscopic vaginal vault closure in the operating room at 3 academic hospitals. PARTICIPANTS Senior Obstetrics and Gynecology residents (year 3-5) on their chief resident or gynecologic oncology rotation. INTERVENTIONS All residents were recorded performing laparoscopic closure of the vaginal cuff prior to randomization. Surgical coaching sessions followed the Wisconsin Surgical Coaching Framework over 30 minutes on Zoom with one surgical coach. All residents were recorded subsequently performing the same surgical technical skill. Blinded, expert surgeons performed the video assessment using the OSATS, GOALS, and global rating scale. The mean change in operative time and the mean change in video-assessment score between the 2 video-recorded attempts were compared between groups. Qualitative semi-structured interviews were conducted to understand the residents' perspective on video-based surgical coaching. MEASUREMENTS AND MAIN RESULTS Twenty residents participated with 10 in the coaching and 10 in the control group. Mean operative time to complete the suturing task was reduced by 32.8% (SD = 21.3%) in the coached group vs 7.2% (SD = 25.1%) in the control group (p = .025). There was no significant change in surgical assessment scores within the coached or control group. Residents identified the core components of a surgical coaching program to include: (1) the resident: focused skill development, (2) the coach: focused on feedback, (3) and the coaching program: a structured activity. Residents envisioned monthly coaching with the opportunity for deliberate practice, the importance of a positive relationship between the coach and coachee, and the importance of faculty development in surgical coaching. CONCLUSION Video-based surgical coaching is an effective tool to enhance technical skill development in surgical education.
Collapse
Affiliation(s)
- Brenna E Swift
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; Sunnybrook Health Sciences Center, Division of Gynecologic Oncology, (Drs. Swift and Vicus) Toronto, Ontario.
| | - Charlotte Axelrod
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario
| | - Anouk Benseler
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario
| | - Anna Kobylianskii
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario
| | - Danielle Vicus
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; Sunnybrook Health Sciences Center, Division of Gynecologic Oncology, (Drs. Swift and Vicus) Toronto, Ontario
| | - Stephane Laframboise
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; University Health Network, Division of Gynecologic Oncology, (Dr. Laframboise), Toronto, Ontario
| | - Melissa Walker
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; Mount Sinai Hospital, Department of Obstetrics and Gynecology, (Drs. Walker, Sobel, and Tannenbaum), Toronto, Ontario
| | - Mara Sobel
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; Mount Sinai Hospital, Department of Obstetrics and Gynecology, (Drs. Walker, Sobel, and Tannenbaum), Toronto, Ontario
| | - Evan Tannenbaum
- University of Toronto Department of Obstetrics and Gynecology, (Drs. Swift, Axelrod, Vicus, Laframboise, Walker, Sobel, and Tannenbaum), Toronto, Ontario; Mount Sinai Hospital, Department of Obstetrics and Gynecology, (Drs. Walker, Sobel, and Tannenbaum), Toronto, Ontario
| |
Collapse
|
9
|
Cannata G, Leone N, Salzano A, Rebecchi F, Morino M. Training in the use of basic functions of the daVinci Xi ® robot: a comparative study of residents' skills. Updates Surg 2025:10.1007/s13304-025-02150-z. [PMID: 40088400 DOI: 10.1007/s13304-025-02150-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 02/26/2025] [Indexed: 03/17/2025]
Abstract
The rapid spread of the robotic surgical system has not been accompanied by an equally rapid creation of standardized training courses for the use of this technology.The purpose of our study was to evaluate skill acquisition in the handling and use of the daVinci Xi by comparing two groups of surgical residents. Surgical residents from the University of Turin were enrolled. The participants were divided into two groups: Group A: residents who had participated in at least 8 robotic surgical procedures, and Group B: residents who had never attended robotic surgery. All were administered two instructional videos on the patient cart and console exercises to be performed. Subsequently, the residents were tested and recorded to be evaluated by a senior surgeon experienced in robotic surgery, according to a previously assessed evaluation score. The time of the procedure was also recorded for each test. Patient cart exercises were completed by all participants. We found statistically significant differences between two groups for the first (p = 0.0000) and third (p = 0.0002) patient cart tests and for every test on the surgeon's console except the endoscope handling exercise. Group A scored higher on the patient cart exercises, and the difference reached statistical significance (p = 0.0001). The placement of a single hand-sewn knot on the silicone suture pad was the only exercise that was not fully completed by all participants and showed no statistical difference. The correlation analysis between surgical experience and final score was significant in Group A. The daVinci Xi robotic platform can be properly operated in its basic functions by young surgeons after a short training program even in the absence of previous exposure to robotic clinical procedure.
Collapse
Affiliation(s)
- Gaspare Cannata
- Department of Surgical Sciences, University of Turin, Turin, Italy
| | - Nicola Leone
- Department of Surgical Sciences, University of Turin, Turin, Italy.
- Department of Surgical Sciences, University of Torino, C.So Dogliotti 14, 10126, Turin, Italy.
| | | | - Fabrizio Rebecchi
- Department of Surgical Sciences, University of Torino, C.So Dogliotti 14, 10126, Turin, Italy
| | - Mario Morino
- Department of Surgical Sciences, University of Torino, C.So Dogliotti 14, 10126, Turin, Italy
| |
Collapse
|
10
|
Wood NJ, Cheng LJ, Buller D, Volkin D, O'Sullivan DM, Tunitsky-Bitton E. Development and Validation of a Simulation Model for Ureteral Stent Placement. UROGYNECOLOGY (PHILADELPHIA, PA.) 2025; 31:201-209. [PMID: 39527711 DOI: 10.1097/spv.0000000000001598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
IMPORTANCE Currently, there are no validated training models for cystoscopy with ureteral stent placement. OBJECTIVES The objectives of this study were to develop and validate a novel endoscopic simulation model for training in ureteral stent placement. STUDY DESIGN A low-cost, low-fidelity training model was developed to simulate ureteral stent placement. Recruited participants were divided into 3 groups: novices (postgraduate year 3/4 gynecology residents), advanced learners (urogynecology and reconstructive pelvic surgery fellows), and experts (urology residents, urogynecology faculty, and urology faculty). Construct validity was measured using de-identified video-recorded performances on the model, which were evaluated by 2 expert reviewers using validated scales (Global Operative Assessment of Laparoscopic Skills [GOALS], Global Rating Scale [GRS]) and procedure-specific metrics. RESULTS The model was created using a hollow Styrofoam sphere, plastic tubing from a retropubic sling, and a silicone pacifier. Thirty-six surgeons were assessed performing the procedure using the model with cystoscopic equipment. The experts (n = 12) performed significantly better than the advanced learners (n = 17) and novices (n = 7) in total scores (max 75, median [IQR]: 75 [75-75], 61 [56.5-68.5], 45 [43-46], respectively; P < 0.001) and within each individual scale domain. Increasing experience with ureteral stent placement had a significant correlation ( P < 0.001) with better performance on the model. A minimum total passing score of 63 was established. On post simulation assessment, most participants "agreed" or "strongly agreed" that the model closely approximates the feel of ureteral stent placement. CONCLUSION This ureteral stenting simulation model is easy to construct, affordable, and reproducible. The model is valid and reliable for practicing the procedure in preparation for live surgery.
Collapse
Affiliation(s)
- Nicole J Wood
- From the Department of Urogynecology, Hartford Hospital, Hartford, CT
| | - Laura J Cheng
- Department of Obstetrics and Gynecology, University of Connecticut, Farmington, CT
| | - Dylan Buller
- Department of Urology, University of Connecticut, Farmington, CT
| | - Dmitry Volkin
- Department of Urology, Hartford HealthCare, Waterford, CT
| | | | | |
Collapse
|
11
|
Huaulmé A, Tronchot A, Thomazeau H, Jannin P. Automated assessment of non-technical skills by heart-rate data. Int J Comput Assist Radiol Surg 2025; 20:561-568. [PMID: 39495359 DOI: 10.1007/s11548-024-03287-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 10/18/2024] [Indexed: 11/05/2024]
Abstract
PURPOSE Observer-based scoring systems, or automatic methods, based on features or kinematic data analysis, are used to perform surgical skill assessments. These methods have several limitations, observer-based ones are subjective, and the automatic ones mainly focus on technical skills or use data strongly related to technical skills to assess non-technical skills. In this study, we are exploring the use of heart-rate data, a non-technical-related data, to predict values of an observer-based scoring system thanks to random forest regressors. METHODS Heart-rate data from 35 junior resident orthopedic surgeons were collected during the evaluation of a meniscectomy performed on a bench-top simulator. Each participant has been evaluated by two assessors using the Arthroscopic Surgical Skill Evaluation Tool (ASSET) score. A preprocessing stage on heart-rate data, composed of threshold filtering and a detrending method, was considered before extracting 41 features. Then a random forest regressor has been optimized thanks to a randomized search cross-validation strategy to predict each score component. RESULTS The prediction of the partially non-technical-related components presents promising results, with the best result obtained for the safety component with a mean absolute error of 0.24, which represents a mean absolute percentage error of 5.76%. The analysis of feature important allowed us to determine which features are the more related to each ASSET component, and therefore determine the underlying impact of the sympathetic and parasympathetic nervous systems. CONCLUSION In this preliminary work, a random forest regressor train on feature extract from heart-rate data could be used for automatic skill assessment and more especially for the partially non-technical-related components. Combined with more traditional data, such as kinematic data, it could help to perform accurate automatic skill assessment.
Collapse
Affiliation(s)
- Arnaud Huaulmé
- Univ Rennes, INSERM, LTSI - UMR 1099, Rennes, F35000, France.
| | - Alexandre Tronchot
- Univ Rennes, INSERM, LTSI - UMR 1099, Rennes, F35000, France
- Orthopedics and Trauma Department, Rennes University Hospital, Rennes, 35000, France
| | - Hervé Thomazeau
- Univ Rennes, INSERM, LTSI - UMR 1099, Rennes, F35000, France
- Orthopedics and Trauma Department, Rennes University Hospital, Rennes, 35000, France
| | - Pierre Jannin
- Univ Rennes, INSERM, LTSI - UMR 1099, Rennes, F35000, France
| |
Collapse
|
12
|
Kankanamge D, Wijeweera C, Ong Z, Preda T, Carney T, Wilson M, Preda V. Artificial intelligence based assessment of minimally invasive surgical skills using standardised objective metrics - A narrative review. Am J Surg 2025; 241:116074. [PMID: 39561477 DOI: 10.1016/j.amjsurg.2024.116074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Revised: 10/17/2024] [Accepted: 11/05/2024] [Indexed: 11/21/2024]
Abstract
INTRODUCTION Many studies display significant heterogeneity in the reliability of artificial intelligence (AI) assessment of minimally invasive surgical (MIS) skills. Our objective is to investigate whether AI systems utilising standardised objective metrics (SOMs) as the basis of skill assessment can provide a clearer understanding of the current state of such technology. METHODS We systematically searched Medline, Embase, Scopus, CENTRAL and Web of Science from March 2023 to September 2023. Results were compiled as a narrative review. RESULTS Twenty-four citations were analysed. Overall accuracy of AI systems in predicting overall SOM score of a procedure ranged from 63 % to 100 %. The most frequently used SOM by AI algorithms were Objective Structured Assessment of Technical Skills (OSATS) (8/24) and Global Evaluative Assessment of Robotic Skills (GEARS) (8/24). CONCLUSIONS Stratifying for AI studies which employed SOMs to assess surgical skill did not reduce heterogeneity of reported reliability. Our study identifies key issues within the current literature, which, once addressed, could allow more meaningful comparisons between studies.
Collapse
Affiliation(s)
- D Kankanamge
- Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Sydney, Australia.
| | - C Wijeweera
- Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Sydney, Australia
| | - Z Ong
- Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Sydney, Australia
| | - T Preda
- Department of Surgery, School of Medicine, University of Notre Dame Australia (Sydney), Australia; Royal North Shore Virtual Care Service, St Leonards, Sydney, Australia
| | - T Carney
- Surgical XR, 2 Technology Place, Macquarie Park, Sydney, Australia
| | - M Wilson
- Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Sydney, Australia; Surgical XR, 2 Technology Place, Macquarie Park, Sydney, Australia
| | - V Preda
- Faculty of Medicine, Health and Human Sciences, Macquarie University, Macquarie Park, Sydney, Australia
| |
Collapse
|
13
|
Nakajima K, Takenaka S, Kitaguchi D, Tanaka A, Ryu K, Takeshita N, Kinugasa Y, Ito M. Artificial intelligence assessment of tissue-dissection efficiency in laparoscopic colorectal surgery. Langenbecks Arch Surg 2025; 410:80. [PMID: 39984705 PMCID: PMC11845557 DOI: 10.1007/s00423-025-03641-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2024] [Accepted: 02/06/2025] [Indexed: 02/23/2025]
Abstract
PURPOSE Several surgical-skill assessment tools emphasize the importance of efficient tissue-dissection, whose assessment relies on human judgment and is thus subject to bias. Automated assessment may help solve this problem. This study aimed to verify the feasibility of surgical-skill assessment using a deep learning-based recognition model. METHODS This retrospective study used multicenter intraoperative videos of laparoscopic colorectal surgery (sigmoidectomy or high anterior resection) for colorectal cancer obtained from 766 cases across Japan. Three groups with different skill levels were distinguished: high-, intermediate-, and low-skill. We developed a model to recognize tissue dissection by the monopolar device using deep learning-based computer-vision technology. Tissue-dissection time per monopolar device appearance time (efficient-dissection time ratio) was extracted as a quantitative parameter describing efficient dissection. We automatically measured the efficient-dissection time ratio using the recognition model of 8 surgical instruments and tissue-dissection on/off classification model. The efficient-dissection time ratio was compared among groups; the feasibility of distinguishing them was explored using the model. The model-calculated parameters were evaluated to determine whether they could differentiate high-, intermediate-, and low-skill groups. RESULTS The tissue-dissection recognition model had an overall accuracy of 0.91. There was a moderate correlation (0.542; 95% confidence interval, 0.288-0.724; P < 0.001) between manually and automatically measured efficient-dissection time ratios. Efficient-dissection time ratios by this model were significantly higher in the high-skill than in intermediate-skill (P = 0.0081) and low-skill (P = 0.0249) groups. CONCLUSION An automated efficient-dissection assessment model using a monopolar device was constructed with a feasible automated skill-assessment method.
Collapse
Affiliation(s)
- Kei Nakajima
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45, Yushima, Bunkyo-Ku, Tokyo, 113-8510, Japan
| | - Shin Takenaka
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Daichi Kitaguchi
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Atsuki Tanaka
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Kyoko Ryu
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Nobuyoshi Takeshita
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Yusuke Kinugasa
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45, Yushima, Bunkyo-Ku, Tokyo, 113-8510, Japan
| | - Masaaki Ito
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan.
| |
Collapse
|
14
|
Oviedo-Peñata CA, Lemos-Duque JD, Maldonado-Estrada JG. Training total laparoscopic gastropexy using a composed simulator and evaluating the significant transfer of surgical skills performed in growing pigs in vivo. BMC Vet Res 2025; 21:64. [PMID: 39948675 PMCID: PMC11823162 DOI: 10.1186/s12917-024-04463-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 12/30/2024] [Indexed: 02/17/2025] Open
Abstract
BACKGROUND An advanced curriculum for training Total Laparoscopic Gastropexy (TLG) was developed using the CVLTS-composed simulator based on an ergonomic model of a canine abdominal cavity. The performance of Veterinary surgeons trained in basic laparoscopic surgical skills during 15 training TLG sessions (experimental group, n = 10) was compared to the TLG performance of veterinary surgeons with intermediate (n = 10) or advanced (n = 6) laparoscopic skills. The transfer of surgical skills to a live model was assessed by performing TLG in fattening pigs under operating room conditions using barbed sutures. Experimental group performance after accomplishing the TLG training curriculum and all groups' performance during TLG in the in vivo model were videotaped and evaluated by external Minimally Invasive Surgery (MIS) experts using the GOALS and TLG-specific ranking (SRS) scales. Also, a quantitative assessment comprising time, smoothness of movements, and angular displacement using a Hand Movement Assessment System (HMAS) was performed. Besides, a postmortem biopsy recovered from the gastropexy site three months after surgery to evaluate gross and microscopic characteristics by histopathology was analyzed. RESULTS GOALS and SRS scores (P < 0.05), and time, smoothness of movements, and angular displacement during TLG (P < 0.01) significantly improved in the Experimental group after training. They also compared their performance with expert and intermediate groups (P < 0.05) performances. The learning curve for intracorporeal suture stabilized since the tenth (out of 15) training session. Besides, trainees achieved significant TLG skills' in vivo transfer, with no significant difference from the intermediate and expert group performances. The presence of mature collagen (100% of cases), cartilage and bone metaplasia, and foreign body reaction (25% of cases) were found at histopathology evaluation of the gastropexy site, evidencing normal healing. CONCLUSION The TLG training curriculum supported the acquisition of TLG surgical skills in the training box and their transfer to the in vivo model. The experimental group's TLG performance in vivo did not significantly differ from the intermediate and expert groups. The clinical outcome and histopathological findings evidenced complete gastropexy-site healing.
Collapse
Affiliation(s)
- Carlos A Oviedo-Peñata
- OVRI-Research Group, College of Veterinary Medicine, Faculty of Agrarian Sciences, University of Antioquia, Medellín, 050034, Colombia
- Tropical Animal Production Research Group, Faculty of Veterinary Medicine and Zootechny, University of Cordoba, Ciénaga de Oro, 232527, Colombia
| | - Juan D Lemos-Duque
- Bioinstrumentation and Clinical Engineering Research Group-GIBIC, Bioengineering Department, Engineering Faculty, University of Antioquia, Medellín, 050010, Colombia
| | - Juan G Maldonado-Estrada
- OVRI-Research Group, College of Veterinary Medicine, Faculty of Agrarian Sciences, University of Antioquia, Medellín, 050034, Colombia.
- Hospital Veterinario, Pequeñas Especies Animales, Universidad de Antioquia, Medellín, 050034, Colombia.
- Small Animals Veterinary Hospital, College of Veterinary Medicine, Faculty of Agricultural Sciences, University of Antioquia, Medellín, 050034, Colombia.
| |
Collapse
|
15
|
Winn HM, Tunitsky-Bitton E, O'Meara A, Myers EM, Anderson-Montoya BL, Tarr ME. Development and Validation of a Laparoscopic Sacrocolpopexy Training Model. UROGYNECOLOGY (PHILADELPHIA, PA.) 2025; 31:123-130. [PMID: 39394828 DOI: 10.1097/spv.0000000000001583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/14/2024]
Abstract
IMPORTANCE Proper training is necessary to develop the highly specialized skills required to safely perform laparoscopic sacrocolpopexy. Currently, there is no validated training model for laparoscopic sacrocolpopexy that includes dissection of the presacral space, both vaginal and presacral mesh attachments, and peritoneal closure. OBJECTIVES This study aimed to create a procedure specific hierarchical task analysis for laparoscopic sacrocolpopexy and then develop and validate a corresponding laparoscopic sacrocolpopexy pelvic training model for the simulation environment. STUDY DESIGN This was an observational simulation study that was divided into 5 phases: (1) development of hierarchical task analysis, (2) model construction, (3) participant recruitment and simulation testing, (4) reliability and validity testing, and (5) creation of a standard passing performance measure. RESULTS Construct, face, and content validity were established for this model. According to the participating experts, the model was able to replicate the steps of presacral dissection, anterior vaginal and sacral mesh attachment, and peritoneal closure. Thirteen trainees and 5 experts completed the simulation, and all "agreed" or "strongly agreed" that the model seemed useful for improving suturing technique and learning the procedure. Additionally, a passing performance measure was determined through contrasting groups methodology. CONCLUSIONS We developed a novel, reusable, and validated training model that can be utilized as a training resource for the many critical skills necessary to safely and efficiently perform laparoscopic sacrocolpopexy.
Collapse
Affiliation(s)
- Heather M Winn
- From the Division of Urogynecology and Reconstructive Pelvic Surgery, Department of Obstetrics and Gynecology, Atrium Health, Charlotte, NC
| | - Elena Tunitsky-Bitton
- Division of Urogynecology, Department of Obstetrics and Gynecology, Hartford Hospital, Hartford, CT
| | - Amanda O'Meara
- Division of Urogynecology, Department of Obstetrics and Gynecology, Hartford Hospital, Hartford, CT
| | - Erinn M Myers
- From the Division of Urogynecology and Reconstructive Pelvic Surgery, Department of Obstetrics and Gynecology, Atrium Health, Charlotte, NC
| | | | - Megan E Tarr
- From the Division of Urogynecology and Reconstructive Pelvic Surgery, Department of Obstetrics and Gynecology, Atrium Health, Charlotte, NC
| |
Collapse
|
16
|
Sato K, Takenaka S, Kitaguchi D, Zhao X, Yamada A, Ishikawa Y, Takeshita N, Takeshita N, Sakamoto S, Ichikawa T, Ito M. Objective surgical skill assessment based on automatic recognition of dissection and exposure times in robot-assisted radical prostatectomy. Langenbecks Arch Surg 2025; 410:39. [PMID: 39812861 PMCID: PMC11735544 DOI: 10.1007/s00423-024-03598-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 12/24/2024] [Indexed: 01/16/2025]
Abstract
PURPOSE Assessing surgical skills is vital for training surgeons, but creating objective, automated evaluation systems is challenging, especially in robotic surgery. Surgical procedures generally involve dissection and exposure (D/E), and their duration and proportion can be used for skill assessment. This study aimed to develop an AI model to acquire D/E parameters in robot-assisted radical prostatectomy (RARP) and verify if these parameters could distinguish between novice and expert surgeons. METHODS This retrospective study used 209 RARP videos from 18 Japanese institutions. Dissection time was defined as the duration of forceps energy activation, and exposure time as the combined duration of manipulating the third arm and camera. To measure these times, an AI-based interface recognition model was developed to automatically extract instrument status from the da Vinci Surgical System® UI. We compared novices and experts by measuring dissection and exposure times from the model's output. RESULTS The overall accuracies of the UI recognition model for recognizing the forceps type, energy activation status, and camera usage status were 0.991, 0.998, and 0.991, respectively. Dissection time was 45.2 vs. 35.1 s (novice vs. expert, p = 0.374), exposure time was 195.7 vs. 89.7 s (novice vs. expert, p < 0.001), and the D/E ratio was 0.174 vs. 0.315 (novice vs. expert, p = 0.003). CONCLUSIONS We successfully developed a model to automatically acquire dissection and exposure parameters for RARP. Exposure time may serve as an objective parameter to distinguish between novices and experts in RARP, and automated technical evaluation in RARP is feasible. TRIAL REGISTRATION NUMBER AND DATE This study was approved by the Institutional Review Board of the National Cancer Center Hospital East (No.2020 - 329) on January 28, 2021.
Collapse
Affiliation(s)
- Kodai Sato
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Urology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Shin Takenaka
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Daichi Kitaguchi
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan
| | - Xue Zhao
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Urology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Atsushi Yamada
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Yuto Ishikawa
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Nobushige Takeshita
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Nobuyoshi Takeshita
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan
| | - Shinichi Sakamoto
- Department of Urology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Tomohiko Ichikawa
- Department of Urology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Masaaki Ito
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1, Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan.
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan.
| |
Collapse
|
17
|
Athanasiadis DI, Makhecha K, Blundell N, Mizota T, Anderson-Montoya B, Fanelli RD, Scholz S, Vazquez R, Gill S, Stefanidis D. How Accurate Are Surgeons at Assessing the Quality of Their Critical View of Safety During Laparoscopic Cholecystectomy? J Surg Res 2025; 305:36-40. [PMID: 39642744 DOI: 10.1016/j.jss.2024.10.048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 10/11/2024] [Accepted: 10/26/2024] [Indexed: 12/09/2024]
Abstract
INTRODUCTION Obtaining the critical view of safety (CVS) is considered an important step to reduce bile duct injuries during laparoscopic cholecystectomy (LC). However, existing literature suggests that few surgeons obtain adequate CVS when LC videos are directly evaluated by experts. This discrepancy calls for effective, standardized CVS teaching methods. While self-assessment (SA) remains the principal tool utilized by practicing surgeons for performance improvement, its effectiveness is controversial. The aim of this study was to compare surgeon SAs of repeated LC performance and attainment of the CVS with that of expert raters. METHODS Multi-institutional study of surgeon members from the Society of American Gastrointestinal and Endoscopic Surgeons who volunteered to participate. All surgeons were asked to submit an LC video and complete a SA of the CVS quality using the Strasberg scale (0-6 score with ≥5 score indicating appropriate CVS). The same videos were reviewed by two blinded expert raters, members of the Society of American Gastrointestinal and Endoscopic Surgeons safe cholecystectomy task force, who had received prior rater training. Surgeon self-ratings and expert ratings were compared with a Wilcoxon signed-rank test. RESULTS Twenty-five surgeon-participants were recruited, 13 of whom submitted an LC video. Surgeons did not achieve adequate CVS in their first submitted video based on expert ratings. Surgeons in the SA group overestimated their performance across all four scales: Operative Performance Rating System (z = -0.36, P = 0.715), Global Operative Assessment of Laparoscopic Skills (z = -0.37, P = 0.712), Strasberg (z = -1.84, P = 0.066), and Competency Assessment Tool (z = -0.73, P = 0.465). Surgeons in the coaching group overestimated their performance on each scale as well: Operative Performance Rating System (z = -0.67, P = 0.500), Global Operative Assessment of Laparoscopic Skills (z = -1.48, P = 0.138), Strasberg (z = -1.07, P = 0.285), and Competency Assessment Tool (z = -1.21, P = 0.225). CONCLUSIONS Our study confirms that an adequate CVS is infrequently obtained during LC in a small but national sample of general surgeons. It further adds to the existing body of literature that suggests that SA alone may be inadequate for performance improvement. Effective teaching methods such as expert or artificial intelligence coaching are needed to improve the use of appropriate CVS by surgeons that may help decrease bile duct injury risk.
Collapse
Affiliation(s)
| | - Keith Makhecha
- Indiana University Medical School, Indianapolis, Indiana
| | | | - Tomoko Mizota
- Department of Surgery, National Hospital Organization Hakodate Hospital, Hakodate, Japan
| | | | - Robert D Fanelli
- Minimally Invasive Surgery and Surgical Endoscopy, The Guthrie Clinic, Sayre, Pennsylvania
| | - Stefan Scholz
- Department of Pediatric General and Thoracic Surgery, UPMC Children's Hospital, Pittsburgh, Pennsylvania
| | - Richard Vazquez
- Department of Surgery, Northwestern Memorial Hospital, Chicago, Illinois
| | - Sujata Gill
- Department of Surgery, Northeast Georgia Physicians Group, Gainesville, Georgia
| | - Dimitrios Stefanidis
- Department of Surgery, Indiana University School of Medicine, Indianapolis, Indiana
| |
Collapse
|
18
|
Haber JJ, Helou E. A Comparative Study of Laparoscopic Skills Between Novices and Experts: How to Steepen the Learning Curve. Cureus 2024; 16:e75069. [PMID: 39759683 PMCID: PMC11695803 DOI: 10.7759/cureus.75069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/03/2024] [Indexed: 01/07/2025] Open
Abstract
Introduction and aim Laparoscopic surgery has revolutionized the field of surgery over the past few decades. The learning curve in laparoscopy is known to be slow, flat, and complex. This study aims to conduct a comparative analysis of laparoscopic skills, specifically focusing on suturing, knot tying, and needle handling, between novices and experts. The purpose is to objectively quantify the disparities in skill proficiency, identify specific areas needing improvement in training curricula, and contribute to the development of more effective training methodologies for emerging laparoscopic surgeons. Methods Residents from different specialties and institutions had their laparoscopic training and evaluation sessions recorded during their curriculum and compared with the performance of experienced surgeons from the Hôtel-Dieu de France University Hospital (Beirut, LBN) during live surgeries. This comparative study was based on the universally recognized Global Operative Assessment of Laparoscopic Skills (GOALS) score and an assessment of a detailed set of laparoscopic skills and techniques used during needle handling and knot tying. Results Twenty-one tasks performed by novices and 11 tasks performed by experts were considered. A significant difference was found in the GOALS score between the two groups (experts: 23.4/25; novices: 15.9/25). Moreover, a statistically significant difference was found to be present in favor of the experts in the following skills/techniques: using thread handling and forceps rotation for needle manipulation, laying the needle on a fixed driver arm before grasping it, using needle curvature for knot tying, using upward-facing forceps convexity when tying, using an open thread loop before tying, thread handling capacity, knot tying capacity, and number of needle skills performed per task. Conclusion This study demonstrates that many micro-steps in laparoscopic suturing are more prevalent among expert surgeons than among trainees. Incorporating these micro-steps into training could significantly accelerate learning curves, enabling trainees to refine their skills more efficiently and keep pace with the latest surgical advancements in their specialties.
Collapse
Affiliation(s)
- Julien J Haber
- Urology, Université Saint-Joseph, Hôtel-Dieu de France University Hospital, Beirut, LBN
| | - Elie Helou
- Urology, Université Saint-Joseph, Hôtel-Dieu de France University Hospital, Beirut, LBN
| |
Collapse
|
19
|
Shin HR, Oh HK, Ahn HM, Lee TG, Choi MJ, Jo MH, Singhi AN, Kim DW, Kang SB. Comparison of surgical performance using articulated (ArtiSential®) and conventional instruments for colorectal laparoscopic surgery: A single-centre, open, before-and-after, prospective study. Colorectal Dis 2024; 26:2092-2100. [PMID: 39456117 DOI: 10.1111/codi.17205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 09/11/2024] [Accepted: 09/12/2024] [Indexed: 10/28/2024]
Abstract
AIM Rigid surgical instruments limit movement whereas articulated instruments offer better control in small spaces and allow for intuitive and ergonomic movements. However, the effectiveness of the use of articulated instruments in improving colorectal laparoscopic outcomes remains unclear. The aim of this work was to determine whether colorectal laparoscopic surgical proficiency improved when multijoint instruments were used instead of conventional ones. METHOD We enrolled 70 consecutive patients (n = 20 for conventional instruments) aged 19-80 years who underwent elective laparoscopic surgery for colorectal diseases. Unedited surgery videos were validated using the modified Global Operative Assessment of Laparoscopic Skills (mGOALS) scale. Learning curves were analysed using a cumulative sum control chart for mGOALS grades. RESULTS The surgery type, length of hospital stay and 30-day postoperative complication rates were comparable between the groups, and the surgeon's mGOALS grades were similar (p = 0.190). However, in the articulated group, the scores were significantly higher for depth perception (p = 0.012) and tissue-handling domains (p = 0.046), while surgical duration was significantly shorter and intraoperative blood loss was significantly lower (p = 0.022), compared with those in the conventional (p = 0.002) group. Learning curve findings indicated that the first 10 and subsequent 40 surgeries in the articulated group were within the inexperienced and experienced phases, respectively. The mGOALS score in the experienced phase improved in the articulated group compared with that in the conventional group (p = 0.036). CONCLUSIONS The use of articulated instruments in laparoscopic colorectal surgery showed potential benefits. Further studies are needed to confirm these findings.
Collapse
Affiliation(s)
- Hye Rim Shin
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Heung-Kwon Oh
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
- Department of Surgery, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Hong-Min Ahn
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Tae-Gyun Lee
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Mi Jeoung Choi
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Min Hyeong Jo
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Anuj Naresh Singhi
- Department of General Surgery, Saifee Hospital, Mumbai, Maharashtra, India
| | - Duck-Woo Kim
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
- Department of Surgery, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Sung-Bum Kang
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
- Department of Surgery, Seoul National University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
20
|
Sunakawa T, Kitaguchi D, Kobayashi S, Aoki K, Kujiraoka M, Sasaki K, Azuma L, Yamada A, Kudo M, Sugimoto M, Hasegawa H, Takeshita N, Gotohda N, Ito M. Deep learning-based automatic bleeding recognition during liver resection in laparoscopic hepatectomy. Surg Endosc 2024:10.1007/s00464-024-11331-7. [PMID: 39557646 DOI: 10.1007/s00464-024-11331-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Accepted: 09/30/2024] [Indexed: 11/20/2024]
Abstract
BACKGROUND Intraoperative hemorrhage during laparoscopic hepatectomy (LH) is a risk factor for negative postoperative outcomes. Ensuring appropriate hemostasis enhances the safety of surgical procedures. An automatic bleeding recognition system based on deep learning can lead to safer surgeries; however, deep learning models that are useful for detecting and stopping bleeding in LH have not yet been reported. In this study, we aimed to develop a deep learning model to automatically recognize bleeding regions during liver transection in LH. METHODS In this retrospective feasibility study, bleeding scenes were randomly selected from LH videos, and the videos were divided into frames at 30 frames per second. Bleeding regions within the images were annotated by pixels, and subsequently, all images were assigned to the training, validation, and test datasets to develop the deep learning model. A convolutional neural network algorithm was used to perform semantic segmentation. After training and validation, the model was evaluated using images from the test dataset. Precision, recall, and Dice coefficients served as the evaluation metrics for the model. RESULTS In total, 2203 annotated images from 44 LH videos were utilized and divided into 1500, 400, and 303 frames for the training, validation, and test datasets, respectively. The precision, recall, and Dice coefficient values of the model were 0.76, 0.79, and 0.77, respectively. CONCLUSIONS We developed an automatic bleeding recognition model based on semantic segmentation and verified its performance. The proposed model is potentially useful for intraoperative alerting or evaluating surgical skills in the future.
Collapse
Affiliation(s)
- Taiki Sunakawa
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Course of Advanced Clinical Research of Cancer, Juntendo University Graduate School of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Daichi Kitaguchi
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Shin Kobayashi
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Keishiro Aoki
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Manabu Kujiraoka
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Kimimasa Sasaki
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Lena Azuma
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Atsushi Yamada
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Masashi Kudo
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Motokazu Sugimoto
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Hiro Hasegawa
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Nobuyoshi Takeshita
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Naoto Gotohda
- Department of Hepatobiliary and Pancreatic Surgery, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Course of Advanced Clinical Research of Cancer, Juntendo University Graduate School of Medicine, 2-1-1, Hongo, Bunkyo-Ku, Tokyo, 113-8421, Japan
| | - Masaaki Ito
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan.
| |
Collapse
|
21
|
Rovira R, Mereu L, Planchamp F, Falconer H, El-Balat A, Barahona M, Fagotti A, Querleu D, Taskiran C. ESGE/ESGO/SERGS consensus statement on surgical steps in minimally invasive surgery in gynecologic oncology: transperitoneal and extraperitioneal approach for paraaortic lymphadenectomy. Int J Gynecol Cancer 2024; 34:1673-1676. [PMID: 39317443 PMCID: PMC11671909 DOI: 10.1136/ijgc-2024-005796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/20/2024] [Indexed: 09/26/2024] Open
Abstract
INTRODUCTION Assessment of retroperitoneal nodes is an important part of the surgical staging of gynecologic cancers. Although pelvic and paraaortic lymphadenectomy have been widely described by different authors, there is little consensus on the description of the different surgical steps for each procedure. An Intergroup Committee on Onco-Gyn Minimally Invasive Surgery has been established with members of the European Society for Gynecological Endoscopy (ESGE), European Society of Gynaecological Oncology (ESGO) and the Society of European Robotic Gynaecological Surgery (SERGS). The Intergroup Committee has various objectives: writing down a surgical description of the technique, which will be assessed by a group of experts following a formal consensus method and developing a specific Objective Structured Assessment of Technical Skills (OSATS) scale for each procedure. METHODS A hierarchical task analysis was conducted by a working group of eight experts from the three societies in order to identify the surgical steps of transperitoneal and extraperitoneal approach in paraaortic lymphadenectomy. The selection of the definitive surgical steps was confirmed by a group of 19 experts from the different societies, following a formal consensus method. Two rounds of Delphi panel rating were considered necessary for achieving an agreement. The consensus agreement identified 29 surgical steps in transperitoneal and 17 surgical steps in extraperitoneal approach to complete a paraaortic lymphadenectomy. Once the description of the procedure and the consensus were established, an Objective specific Scale for the Assessment of Technical Skills for Paraaortic lymphadenectomy (PA-OSATS) in the transperitoneal and extraperitoneal approach was developed. RESULTS In the first round of rating we found that 28 steps out of 29 in the transperitoneal approach and 13 out of 17 in the extraperitoneal approach did not reach a strong degree of agreement. They were reformulated based on comments made by the experts, and submitted to a second round of rating and this finally achieved an agreement. CONCLUSION We defined a list of surgical steps in transperitoneal and extraperitoneal approach in paraaortic lymphadenectomy and a specific PA-OSATS scale for these procedures. This tool will be useful for teaching, assessing and standardizing this surgical procedure.
Collapse
Affiliation(s)
- Ramon Rovira
- Hospital de la Santa Creu i Sant Pau, Barcelona, Spain
| | - Liliana Mereu
- Santa Chiara Hospital of Trento, Trento, Trentino-Alto Adige, Italy
| | | | - Henrik Falconer
- Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden
| | - Ahmed El-Balat
- Klinikum der Johann Wolfgang Goethe-Universität, Frankfurt, Germany
| | - Marc Barahona
- Department of Gynecology, University Bellvitge’s Hospital, Barcelona, Spain
| | - Anna Fagotti
- Dipartimento Scienze della Salute della Donna, del Bambino e di Sanità Pubblica, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Lazio, Italy
| | - Denis Querleu
- Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Roma, Lazio, Italy
| | - Cagatay Taskiran
- Koç University School of Medicine, Istanbul, Turkey
- Vehbi Koç Vakfı American Hospital, Istanbul, Turkey
| |
Collapse
|
22
|
Nakajima K, Kitaguchi D, Takenaka S, Tanaka A, Ryu K, Takeshita N, Kinugasa Y, Ito M. Automated surgical skill assessment in colorectal surgery using a deep learning-based surgical phase recognition model. Surg Endosc 2024; 38:6347-6355. [PMID: 39214877 DOI: 10.1007/s00464-024-11208-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 08/19/2024] [Indexed: 09/04/2024]
Abstract
BACKGROUND There is an increasing demand for automated surgical skill assessment to solve issues such as subjectivity and bias that accompany manual assessments. This study aimed to verify the feasibility of assessing surgical skills using a surgical phase recognition model. METHODS A deep learning-based model that recognizes five surgical phases of laparoscopic sigmoidectomy was constructed, and its ability to distinguish between three skill-level groups-the expert group, with a high Endoscopic Surgical Skill Qualification System (ESSQS) score (26 videos); the intermediate group, with a low ESSQS score (32 videos); and the novice group, with an experience of < 5 colorectal surgeries (27 videos)-was assessed. Furthermore, 1 272 videos were divided into three groups according to the ESSQS score: ESSQS-high, ESSQS-middle, and ESSQS-low groups, and whether they could be distinguished by the score calculated by multiple regression analysis of the parameters from the model was also evaluated. RESULTS The time for mobilization of the colon, time for dissection of the mesorectum plus transection of the rectum plus anastomosis, and phase transition counts were significantly shorter or less in the expert group than in the intermediate (p = 0.0094, 0.0028, and < 0.001, respectively) and novice groups (all p < 0.001). Mesorectal excision time was significantly shorter in the expert group than in the novice group (p = 0.0037). The group with higher ESSQS scores also had higher AI scores. CONCLUSION This model has the potential to be applied to automated skill assessments.
Collapse
Affiliation(s)
- Kei Nakajima
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45, Yushima, Bunkyo-Ku, Tokyo, 113-8510, Japan
| | - Daichi Kitaguchi
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Shin Takenaka
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Atsuki Tanaka
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Kyoko Ryu
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Nobuyoshi Takeshita
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan
| | - Yusuke Kinugasa
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45, Yushima, Bunkyo-Ku, Tokyo, 113-8510, Japan
| | - Masaaki Ito
- Department for the Promotion of Medical Device Innovation, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan.
- Surgical Device Innovation Office, National Cancer Center Hospital East, 6-5-1 Kashiwanoha, Kashiwa, Chiba, 277-8577, Japan.
| |
Collapse
|
23
|
Liang Y, Huang H, Tan YB, Li T, Huang W, Zhang QL, Liu ZW, Kuang M. Construction and implementation of a laparoscopic skill training course based on a smartphone application and virtual reality. BMC MEDICAL EDUCATION 2024; 24:1111. [PMID: 39385228 PMCID: PMC11462737 DOI: 10.1186/s12909-024-06066-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Accepted: 09/20/2024] [Indexed: 10/12/2024]
Abstract
BACKGROUND To develop a laparoscopic training course that combines a smartphone application (APP) and virtual reality (VR), and initially evaluate the feasibility and effectiveness of its implementation. METHODS The Exploring Laparoscopy (Ex-Lap) app was developed to meet training demands. The course was designed by integrating the app with a VR simulator (LapSim®) and animal organ perfusion simulators. From January 2021 to December 2023, 91 participants were enrolled in the study and then divided into 5 separate batches to undergo the first stage of the course. The performance of the participants was evaluated by rating scale, the overall Training and Assessment of Basic Laparoscopic Techniques (TABLT) scores, and pass rates. Statistical analyses were conducted using SPSS 26.0, employing Kruskal-Wallis tests, Chi-squared analysis, and Fisher's exact test, depending on the data type. RESULTS The Staged Training and Assessment of Laparoscopic Skills (STALS) course was developed, consisting of three stages. The overall pass rates for the first stage across the five batches ranged from 85 to 100%, with no significant difference (P = 0.387). No significant differences were found in the scale scores or TABLT scores for the training tasks among students from different batches (all P > 0.05). CONCLUSIONS The STALS course is applicable in residency training, demonstrating satisfactory teaching effectiveness and replicability.
Collapse
Affiliation(s)
- Yao Liang
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China
- Department of Gastric Surgery, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Hua Huang
- Office of the President, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yu-Bao Tan
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China
- Clinical Skills Training Center, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Tang Li
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China
- Clinical Skills Training Center, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Wan Huang
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China
- Clinical Skills Training Center, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Qing-Long Zhang
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China
- Department of Science and Education, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Zhuo-Wei Liu
- State Key Laboratory of Oncology in South China, Guangdong Provincial Clinical Research Center for Cancer, Guangzhou, China.
- Department of Urinary Surgery, Sun Yat-sen University Cancer Center, Guangzhou, China.
| | - Ming Kuang
- Zhong-shan School of Medicine, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
24
|
Tee YS, Cheng CT, Li PH, Hsieh MJ, Liao CH, Fu CY. Optimizing modern surgical simulation through instructor feedback - insights from a retrospective observational study in a tertiary hospital. BMC MEDICAL EDUCATION 2024; 24:1109. [PMID: 39379925 PMCID: PMC11459801 DOI: 10.1186/s12909-024-06090-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2024] [Accepted: 09/26/2024] [Indexed: 10/10/2024]
Abstract
BACKGROUND Laparoscopic surgery is associated with a prolonged learning curve for emerging surgeons, and simulation-based training (SBT) has become increasingly prominent in this context due to stringent working time regulations and heightened concerns regarding patient safety. While SBT offers a safe and ethical learning environment, the accuracy of simulators in the context of evaluating surgical skills remains uncertain. This study aims to assess the precision of a laparoscopic simulator with regard to evaluating surgical performance and to identify the instructor's role in SBT. MATERIALS AND METHODS This retrospective study focused on surgical residents in their 1st through 5th years at the Department of Surgery of Linkou Chang Gung Memorial Hospital. The residents participated in a specially designed SBT program using the LapSim laparoscopic simulator. Following the training session, each resident was required to perform a laparoscopic procedure and received individualized feedback from an instructor. Both simulator and instructor evaluated trainees' performance on the LapSim, focusing on identifying correlations between the simulator's metrics and traditional assessments. RESULTS Senior residents (n = 15), who employed more complex laparoscopic procedures, exhibited more significant improvements after receiving instructor feedback than did junior residents (n = 17). Notably, a stronger correlation between the simulator and instructor assessments was observed in the junior group (junior Global Operative Assessment of Laparoscopic Skills (GOALS) adjusted R2 = 0.285, p = 0.016), while no such correlations were observed among the senior group. CONCLUSION A well-designed, step-by-step SBT can be a valuable tool in laparoscopic surgical training. LapSim simulator has demonstrated its potential in assessing surgical performances during the early stages of surgical training. However, instructors must provide intuitive feedback to ensure appropriate learning in later stages.
Collapse
Affiliation(s)
- Yu-San Tee
- Division of Trauma and Emergency Surgery, Department of Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan
| | - Chi-Tung Cheng
- Division of Trauma and Emergency Surgery, Department of Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan
| | - Pei-Hua Li
- Division of Trauma and Emergency Surgery, Department of Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan
| | - Ming-Ju Hsieh
- Department of Thoracic and Cardiovascular Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan
- Chang Gung Memorial Hospital Surgical Training Academy and Research Center, Taoyuan City, Taiwan
- Chang Gung University, Taoyuan City, Taiwan
| | - Chien-Hung Liao
- Division of Trauma and Emergency Surgery, Department of Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan
- Chang Gung University, Taoyuan City, Taiwan
| | - Chih-Yuan Fu
- Division of Trauma and Emergency Surgery, Department of Surgery, Linkou Chang Gung Memorial Hospital, Taoyuan City, Taiwan.
- Chang Gung Memorial Hospital Surgical Training Academy and Research Center, Taoyuan City, Taiwan.
- Chang Gung University, Taoyuan City, Taiwan.
| |
Collapse
|
25
|
Chen Y, Tan Q, Zhu J, Zhou L, Li S, Zheng J. Development and validation of a simulation training platform for the ligation of deep dorsal vein complex in radical prostatectomy. Front Oncol 2024; 14:1407393. [PMID: 39429469 PMCID: PMC11486645 DOI: 10.3389/fonc.2024.1407393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Accepted: 09/09/2024] [Indexed: 10/22/2024] Open
Abstract
Objective This study aimed to design a low-cost, simulation training platform for the ligation of deep dorsal vein (DVC) complex in radical prostatectomy and validate its training effectiveness. Methods A simplified prostate urethra model was produced by 0-degree silica gel and pulse pressure banding. This model was placed on a slope of about 30 degrees using cardboard to thus creating a narrow environment of the pelvis. The DVC ligation was performed by a 2D laparoscopy simulator. A total of 27 participants completed the study include 13 novices, 10 surgical residents and 4 urology experts. The novices were trained five trails with 24 hours interval, the residents and experts completed the DVC ligation once. The construct validity of this simulation training platform was performed by completing time, the GOALS (Global Operative Assessment of Laparoscopic Skills) and TSA (i.e. Task Specific Assessments) score. The face validity and content validity were performed by a specific closed-ended questionnaire. Results There was no significant difference among three groups in demographic or psychometric variables (p > 0.05). Compared to the novices, the residents spend a shorter time to complete the DVC ligation (p < 0.05) and had higher GOALS scores (p < 0.05), but had no significant difference in TSA scores (p > 0.05). Additionally, the experts groups had a better performance compared to residents group in the completing time (p < 0.05), GOALS score (p < 0.05) and TSA score (p < 0.05). The learning curve of novices significantly promoted along with the increased times of training. Almost 90 percent of subjects considered that this simulator had a good performance in the realism and practicability. Conclusion We developed a novel low-cost a simulation training platform for the ligation of deep dorsal vein complex in radical prostatectomy, and this simulator had a good performance in the construct validity, face validity and content validity.
Collapse
Affiliation(s)
| | | | | | | | | | - Ji Zheng
- Army Medical University, Chongqing, China
| |
Collapse
|
26
|
Yan L, Ebina K, Abe T, Kon M, Higuchi M, Hotta K, Furumido J, Iwahara N, Komizunai S, Tsujita T, Sase K, Chen X, Kurashima Y, Kikuchi H, Miyata H, Matsumoto R, Osawa T, Murai S, Shichinohe T, Murakami S, Senoo T, Watanabe M, Konno A, Shinohara N. Validation and motion analyses of laparoscopic radical nephrectomy with Thiel-embalmed cadavers. Curr Probl Surg 2024; 61:101559. [PMID: 39266126 DOI: 10.1016/j.cpsurg.2024.101559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Revised: 04/23/2024] [Accepted: 07/01/2024] [Indexed: 09/14/2024]
Abstract
PURPOSE Our aim was to develop practical training for laparoscopic surgery using Thielembalmed cadavers. Furthermore, in order to verbalize experts' motion characteristics and provide objective feedback to trainees, we initiated motion capture analyses of multiple surgical instruments simultaneously during the cadaveric trainings. In the present study, we report our preliminary results. METHODS Participants voluntarily joined the present cadaveric simulation trainings, and performed laparoscopic radical nephrectomy. After the trainings, scores for tissue similarity (face validity) and impression of educational merit (content validity) were collected from participants based on a 5-point Likert scale (tissue similarity: 5: very similar, 3: average, 1: very different; educational merit: 5: very high, 3: average, 1: very low). In addition, after the additional IRB approval, we started motion capture (Mocap) analyses of 6 surgical instruments (scissors, vessel sealing system, grasping forceps, clip applier, right-angled forceps, and suction), using an infrared trinocular camera (120-Hz location record). Mocap-metrics were compared according to the previous surgical experiences (experts: ≧50 laparoscopic surgeries, intermediates: 10-49, novices: 0-9), using the Kruskal-Wallis test. RESULTS A total of 9 experts, 19 intermediates, and 15 novices participated in the present study. In terms of face validity, the mean scores were higher than 3, other than for the Vena cava(mean score of 2.89). Participants agreed with the training value (usefulness for future skill improvement: mean score of 4.57). In terms of Mocap analysis, faster speed-related metrics (e.g., velocity, the distribution of tip velocity, acceleration, and jerk) in the scissors and vessel sealing system, a shorter path length of grasping forceps, and fewer dimensionless squared jerks, which indicated more purposeful motion of 4 surgical instruments (vessel sealing system, grasping forceps, clip applier and suction), were observed in the more experienced group. CONCLUSIONS The Thiel-embalmed cadaver provides an excellent training opportunity for complex laparoscopic procedures with participants' high level of satisfaction, and may become a promising tool for a better objective understanding of surgical dexterity. In order to enrich formative feedback to trainees, we are now proceeding with Mocap analysis.
Collapse
Affiliation(s)
- Lingbo Yan
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Koki Ebina
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Takashige Abe
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan.
| | - Masafumi Kon
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Madoka Higuchi
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Kiyohiko Hotta
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Jun Furumido
- Department of Urology, Asahikawa Kousei Hospital, Asahikawa, Japan
| | - Naoya Iwahara
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | | | - Teppei Tsujita
- Department of Mechanical Engineering, National Defense Academy of Japan, Yokosuka, Japan
| | - Kazuya Sase
- Department of Mechanical Engineering and Intelligent Systems, Tohoku Gakuin University, Sendai, Japan
| | - Xiaoshuai Chen
- Graduate School of Science and Technology, Hirosaki University, Hirosaki, Japan
| | - Yo Kurashima
- Clinical Simulation Center, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Hiroshi Kikuchi
- Department of Urology, Teine Keijinkai Hospital, Sapporo, Japan
| | - Haruka Miyata
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Ryuji Matsumoto
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Takahiro Osawa
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Sachiyo Murai
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Toshiaki Shichinohe
- Department of Gastroenterological Surgery II, Faculty of Medicine, Hokkaido University, Sapporo, Japan; Center for Education Research and Innovation of Advanced Medical Technology, Hokkaido University Hospital, Sapporo, Japan
| | - Soichi Murakami
- Center for Education Research and Innovation of Advanced Medical Technology, Hokkaido University Hospital, Sapporo, Japan
| | - Taku Senoo
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Masahiko Watanabe
- Department of Anatomy, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Atsushi Konno
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Nobuo Shinohara
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| |
Collapse
|
27
|
Jones-Carr ME, McLeod C, Baker S, Lindeman B. Framing our Expectations: Variability in Entrustable Professional Activity Assessments. JOURNAL OF SURGICAL EDUCATION 2024; 81:1355-1361. [PMID: 39163720 DOI: 10.1016/j.jsurg.2024.07.025] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 06/30/2024] [Accepted: 07/28/2024] [Indexed: 08/22/2024]
Abstract
OBJECTIVE To determine the ability of surgical trainees and faculty to correctly interpret entrustability of a resident learner in a modeled patient care scenario. DESIGN Prospective study utilizing a web-based survey including 4 previously-recorded short videos of resident learners targeted to specific levels of the American Board of Surgery's (ABS) Entrustment Scale. Respondents were asked to choose the entrustment level that best corresponded to their observations of the learner in the video. Responses were subcategorized by low and high entrustment. SETTING Online, utilizing the Qualtrics survey platform. PARTICIPANTS Survey targeting US surgical trainees and surgical faculty via email and social media. We received 31 complete responses and 2 responses which completed > 1 video assessment question without demographic information (n = 33). Respondents included 10 trainees (32%) and 21 attending surgeons (68%). RESULTS Neither faculty nor trainees readily identified the targeted entrustment level for Question 1 (preoperative care of a patient with acute appendicitis with high entrustment, 36% correct), though evaluations of the remaining questions (2 through 4) demonstrated more accuracy (70, 84, and 75% correct, respectively). Faculty were more readily able than trainees to identify low entrustment (level Limited Participation) in intraoperative inguinal hernia repair (95% vs 60%, p = 0.03). After subcategorization to high and low entrustment, both residents and faculty were able to accurately identify entrustment 95% overall. CONCLUSIONS Both trainees and attending surgeons were able to identify high- and low-performing residents on short video demonstrations using the ABS EPA entrustment scale. This provides additional evidence in support of the need for frequent observations of EPAs to account for the variability in raters' perceptions in addition to complexity of clinical scenarios. Frame-of-reference training via a video-based platform may also be beneficial for both residents and faculty as an ongoing EPA implementation strategy.
Collapse
Affiliation(s)
| | - Chandler McLeod
- Department of Surgery, University of Alabama at Birmingham, Birmingham, AL
| | - Samantha Baker
- Department of Surgery, Louisiana State University Health Sciences Center, New Orleans, LA
| | - Brenessa Lindeman
- Department of Surgery, University of Alabama at Birmingham, Birmingham, AL.
| |
Collapse
|
28
|
Yamamoto T, Goto K, Kitano S, Maeshima Y, Yamada T, Azuma Y, Okumura S, Kawakubo N, Tanaka E, Obama K, Taura K, Terajima H, Tajiri T. Current insights on social media as a tool for the dissemination of research and education in surgery: a narrative review. Surg Today 2024; 54:1113-1123. [PMID: 38980332 DOI: 10.1007/s00595-024-02891-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Accepted: 06/06/2024] [Indexed: 07/10/2024]
Abstract
The purpose of our narrative review is to summarize the utilization of social media (SoMe) platforms for research communication within the field of surgery. We searched the PubMed database for articles in the last decade that discuss the utilization of SoMe in surgery and then categorized the diverse purposes of SoMe. SoMe proved to be a powerful tool for disseminating articles. Employing strategic methods like visual abstracts enhances article citation rates, the impact factor, h-index, and Altmetric score (an emerging alternative metric that comprehensively and instantly quantifies the social impact of scientific papers). SoMe also proved valuable for surgical education, with online videos shared widely for surgical training. However, it is essential to acknowledge the associated risk of inconsistency in quality. Moreover, SoMe facilitates discussion on specific topics through hashtags or closed groups and is instrumental in recruiting surgeons, with over half of general surgery residency programs in the US efficiently leveraging these platforms to attract the attention of potential candidates. Thus, there is a wealth of evidence supporting the effective use of SoMe for surgeons. In the contemporary era where SoMe is widely utilized, surgeons should be well-versed in this evidence.
Collapse
Affiliation(s)
- Takehito Yamamoto
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan.
- Department of Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan.
- Department of Gastroenterological Surgery and Oncology, Medical Research Institute Kitano Hospital, Osaka, Japan.
| | - Kentaro Goto
- Department of Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Shoichi Kitano
- Department of Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Yurina Maeshima
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan
- Department of Breast Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Toshiyuki Yamada
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan
- Department of Cardiovascular Surgery, Nagoya City University Midori Municipal Hospital, Nagoya, Japan
| | - Yoko Azuma
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan
- Division of Chest Surgery, Department of Surgery, Toho University School of Medicine, Tokyo, Japan
| | - Shintaro Okumura
- Department of Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Naonori Kawakubo
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan
- Department of Pediatric Surgery, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Eiji Tanaka
- Department of Gastroenterological Surgery and Oncology, Medical Research Institute Kitano Hospital, Osaka, Japan
| | - Kazutaka Obama
- Department of Surgery, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Kojiro Taura
- Department of Gastroenterological Surgery and Oncology, Medical Research Institute Kitano Hospital, Osaka, Japan
| | - Hiroaki Terajima
- Department of Gastroenterological Surgery and Oncology, Medical Research Institute Kitano Hospital, Osaka, Japan
| | - Tatsuro Tajiri
- Public Relations Committee, Japan Surgical Society, Tokyo, Japan
- Department of Pediatric Surgery, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| |
Collapse
|
29
|
Chatziisaak D, Sparn M, Krstic D, Bauci G, Warschkow R, Brunner W, Schmied B, Hahnloser D, Bischofberger S. Be prepared! Impact of structured video-assisted coaching on performance in a simulated bleeding exercise during laparoscopic surgery. Surg Endosc 2024; 38:6120-6127. [PMID: 39187730 PMCID: PMC11458636 DOI: 10.1007/s00464-024-11173-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Accepted: 08/05/2024] [Indexed: 08/28/2024]
Abstract
BACKGROUND Bleeding during laparoscopic surgery is stressful and requires immediate efficient management. Skills for complication management are rarely trained. This study aims to investigate the impact of video-assisted coaching on laparoscopic skills acquisition and performance in emergency bleeding situations. METHODS Participants faced simulated emergency scenarios during laparoscopy involving bleeding management in porcine aorta/kidney specimens. Four sequences were conducted over two days, with a structured video-assisted coaching provided between sequences. Performance was assessed using the Global Operative Assessment of Laparoscopic Skills (GOALS) score. The study involved 27 participants attending the advanced colorectal surgery module at the 40th Annual Davos Course in 2023. RESULTS 54 video sequences were analyzed. Structured video-assisted coaching improved the GOALS sum score by 0.36 (95%CI: 0.21-0.50, P < 0.001) in contrast to simple repetition (0.05 with 95%CI: -0.43 to 0.53, P = 0.826). This association was observed for depth of perception (P < 0.001), bimanual dexterity (P < 0.001), tissue handling (P < 0.001), overall performance (P < 0.001), and efficiency (P < 0.001). Autonomy did not significantly improve (P = 0.55). Findings were consistent regardless of age, gender, and overall laparoscopic experience of the participants. However, a weaker effect of structured video-assisted coaching was observed in participants with experience in laparoscopic surgery. CONCLUSION Structured video-assisted coaching improved performance in laparoscopic skills in complex and stress-inducing bleeding scenarios. The findings of this study support the incorporation of video-assisted coaching and complication management exercises into surgical training curricula.
Collapse
Affiliation(s)
- Dimitrios Chatziisaak
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
- Department of Visceral Surgery, University Hospital Lausanne, Lausanne, Switzerland
| | - Moritz Sparn
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
| | - Daniel Krstic
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
| | - Gabriele Bauci
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
| | - Réne Warschkow
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
| | - Walter Brunner
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
- Paracelsus Medical University, Salzburg, Austria
| | - Bruno Schmied
- Department of Surgery, Kantonsspital St. Gallen, St. Gallen, Switzerland
| | - Dieter Hahnloser
- Department of Visceral Surgery, University Hospital Lausanne, Lausanne, Switzerland.
| | | |
Collapse
|
30
|
Fernandes CFK, Ruano JMC, Sartori MGF, Zucchi RM, Capo MFM. Current status of laparoscopy teaching in gynecology and obstetrics medical residency in Brazil. EINSTEIN-SAO PAULO 2024; 22:eAO0458. [PMID: 39230156 PMCID: PMC11461001 DOI: 10.31744/einstein_journal/2024ao0458] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 02/09/2024] [Indexed: 09/05/2024] Open
Abstract
OBJECTIVE To characterize laparoscopy teaching in Medical Residency Programs in Gynecology and Obstetrics in Brazil, and to evaluate preceptors' characteristics in laparoscopy programs and map laparoscopic training practice scenarios. METHODS This descriptive cross-sectional study evaluated questionnaire responses from coordinators of the Medical Residency Programs in Gynecology and Obstetrics from 2019 to 2021. RESULTS The questionnaire was sent to 175 programs, and 90 responses were received (51.4%). From the 85 valid responses, it was noted that 67 programs had laparoscopic training. Of the 64 responses received regarding location, 32 replies (50%) indicated the Southeast of Brazil, particularly some country's capitals. In 37.3% (n=25) of the cases, the program coordinator performed laparoscopy. The chief of the laparoscopy sector has advanced experience in most 52.5% (n=10) medical residency services; the preceptors also had advanced experience in 89.4% (n=59) of the services. Residents received laboratory training in 39.4% (n=26) of the services. In most cases, training was performed using a physical simulator. Of the 26 medical residency services with laparoscopy training outside the operating room, 80.8% (n=21) performed them as part of the curriculum, 61.5% (n=16) had a schedule for the same, and only 3.9% (n=1) were objectively evaluated. CONCLUSION Laparoscopy teaching in Brazil is heterogeneous, with only a few programs offering any training in laparoscopy. The preceptors had advanced experience and participated in laboratory and operating room training. Only a few programs have their own laboratories or training centers, and most teaching programs do not plan to set up training centers.
Collapse
|
31
|
Ebina K, Abe T, Higuchi M, Hotta K, Furumido J, Iwahara N, Senoo T, Komizunai S, Tsujita T, Sase K, Chen X, Kurashima Y, Kikuchi H, Miyata H, Matsumoto R, Osawa T, Murai S, Konno A, Shinohara N. Surgical skill analysis focused on tissue traction in laparoscopic wet lab training. Surg Open Sci 2024; 21:7-13. [PMID: 39677833 PMCID: PMC11639329 DOI: 10.1016/j.sopen.2024.08.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Revised: 07/26/2024] [Accepted: 08/19/2024] [Indexed: 12/17/2024] Open
Abstract
Background Tissue handling is one of the pivotal parts of surgical procedures. We aimed to elucidate the characteristics of experts' left-hand during laparoscopic tissue dissection. Methods Participants performed tissue dissection around the porcine aorta. The grasping force/point of the grasping forceps were measured using custom-made sensor forceps, and the forceps location was also recorded by motion capture system (Mocap). According to the global operative assessment of laparoscopic skills (GOALS), two experts scored the recorded movies, and based on the mean scores, participants were divided into three groups: novice (<10), intermediate (10≤ to <20), and expert (≤20). Force-based metrics were compared among the three groups using the Kruskal-Wallis test. Principal component analysis (PCA) using significant metrics was also performed. Results A total of 42 trainings were successfully recorded. The statistical test revealed that novices frequently regrasped a tissue (median total number of grasps, novices: 268.0 times, intermediates: 89.5, experts: 52.0, p < 0.0001), the traction angle became stable against the aorta (median weighted standard deviation of traction angle, novices: 30.74°, intermediates: 26.80, experts: 23.75, p = 0.0285), and the grasping point moved away from the aorta according to skill competency [median percentage of grasping force applied in close zone (0 to 2.0 cm from aorta), novices: 34.96 %, intermediates: 21.61 %, experts: 10.91 %, p = 0.0032]. PCA showed that the efficiency-related (total number of grasps) and effective tissue traction-related (weighted average grasping position in Y-axis and distribution of grasping area) metrics mainly contributed to the skill difference (proportion of variance of first principal component: 60.83 %). Conclusion The present results revealed experts' left-hand characteristics, including correct tissue grasping, sufficient tissue traction from the aorta, and stable traction angle. Our next challenge is the provision of immediate and visual feedback onsite after the present wet-lab training, and shortening the learning curve of trainees.
Collapse
Affiliation(s)
- Koki Ebina
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Takashige Abe
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Madoka Higuchi
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Kiyohiko Hotta
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Jun Furumido
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Naoya Iwahara
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Taku Senoo
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | | | - Teppei Tsujita
- Department of Mechanical Engineering, National Defense Academy of Japan, Yokosuka, Japan
| | - Kazuya Sase
- Department of Mechanical Engineering and Intelligent Systems, Tohoku Gakuin University, Sendai, Japan
| | - Xiaoshuai Chen
- Graduate School of Science and Technology, Hirosaki University, Hirosaki, Japan
| | - Yo Kurashima
- Clinical Simulation Center, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Hiroshi Kikuchi
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Haruka Miyata
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Ryuji Matsumoto
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Takahiro Osawa
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Sachiyo Murai
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| | - Atsushi Konno
- Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan
| | - Nobuo Shinohara
- Department of Renal and Genitourinary Surgery, Faculty of Medicine, Hokkaido University, Sapporo, Japan
| |
Collapse
|
32
|
Muir TM, Pruszynski J, Kho KA, Ramirez CI, Donnellan NM, Chao L. Video-Based Coaching for Laparoscopic Salpingectomy: A Randomized Controlled Trial. Obstet Gynecol 2024; 144:358-365. [PMID: 39053009 DOI: 10.1097/aog.0000000000005677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Accepted: 05/23/2024] [Indexed: 07/27/2024]
Abstract
OBJECTIVE To evaluate the effect of video-based coaching on the gynecology resident performance of laparoscopic salpingectomy. METHODS PGY-1 and PGY-2 residents were randomized before their gynecology rotations to standard gynecology curriculum (control group) or standard curriculum plus two video-coaching sessions by a fellowship-trained minimally invasive gynecologic surgeon (VBC group). Residents were video recorded intraoperatively performing three unilateral laparoscopic salpingectomies. Participants in the VBC group were coached between the procedures. The primary outcome was the improvement in modified GOALS (Global Operative Assessment of Laparoscopic Skills) and OSA-LS (Objective Structured Assessment of Laparoscopic Salpingectomy) scores, compared with baseline, in the VBC and control groups, with videos independently graded by three blinded minimally invasive gynecologic surgeons. A minimum sample size of 18 participants (nine per group) was needed to achieve 90% power to detect a difference of 5.0 points. RESULTS From October 2021 to December 2022, 28 PGY-1 and PGY-2 residents completed the study with 14 participants per group. Baseline characteristics were similar between groups. In the VBC group, modified GOALS scores significantly improved by 3.0 points from video 1 to video 2 ( P =.04) and by 3.2 points from video 1 to video 3 ( P =.02). Modified OSA-LS scores also increased significantly in the VBC group, by 6.1 points from video 1 to video 3 ( P =.02). In the control group, modified GOALS and OSA-LS scores improved from baseline but were not significant ( P =.2, P =.5). Video-based coaching also enhanced resident comfort and confidence in performing laparoscopic surgery. CONCLUSION Video-based coaching improves resident performance of laparoscopic salpingectomy and can be used as an adjunct to resident surgical training. CLINICAL TRIAL REGISTRATION ClinicalTrials.gov , NCT05103449.
Collapse
Affiliation(s)
- Teale M Muir
- Department of Obstetrics & Gynecology, University of Texas Southwestern Medical Center, Dallas, and the Department of Gynecologic Surgery and Obstetrics, Brooke Army Medical Center, Fort Sam Houston, Texas; the Department of Obstetrics, Gynecology and Reproductive Sciences, Magee-Womens Hospital, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; and the Department of Obstetrics and Gynecology, Stanford University School of Medicine, Stanford, California
| | | | | | | | | | | |
Collapse
|
33
|
Gigena C, Díaz I, Valverde S, Portu AM, Fortunato AC, Kaller R, Bosich M, Bellía Munzon G, Millán C. Results of a Novel Long-Term Method for Laparoscopic Skills Online Training. J Laparoendosc Adv Surg Tech A 2024; 34:866-870. [PMID: 38526573 DOI: 10.1089/lap.2023.0464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/26/2024] Open
Abstract
Introduction: Ensuring patient safety in minimally invasive surgery (MIS) within the field of pediatric surgery requires systematic and extensive practice. Many groups have proposed mastery learning programs encompassing a range of training methods. However, short courses often have a narrow focus on specific objectives, limiting opportunities for sustained training. Our aim was to analyze our results with an online long-term competency-based and supervised training. Methods: This is a retrospective cohort study with prospective data collection of scores and performance of trainees during online courses from October 2020 to April 2023. Results: All participants (n = 76) were able to set up their personal training gym and complete the intensive stage of the course. The total score evolved from 2.60 ± 0.56 at the first meeting to 3.67 ± 0.61 at the fourth meeting, exhibiting a significant difference (P < .013). A considerable drop out was observed in the follow-up stage, with only 53.8% of the participants completing the course. When compared with the first meeting, they also showed a significant improvement with a mean general score of 3.85 ± 0.25 (P < .013) Conclusion: We have presented a novel online training program, based on continuous training that demonstrated that the unlimited access to a personal training gym allows surgeons to improve and maintain MIS skills.
Collapse
Affiliation(s)
- Cecilia Gigena
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
- Deparment of Pediatric Surgery, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA
| | - Ignacio Díaz
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Soledad Valverde
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Agustina Mariana Portu
- School of Science and Technology, National University of San Martín (UNSAM), Buenos Aires, Argentina
- National Research Council (CONICET), Buenos Aires, Argentina
| | - Ana Clara Fortunato
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Ruth Kaller
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Mariano Bosich
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Gastón Bellía Munzon
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| | - Carolina Millán
- Deparment of Pediatric Surgery, Mother and Child Medical Center, Fundación Hospitalaria, Buenos Aires, Argentina
| |
Collapse
|
34
|
Ovinnikov I, Beuret A, Cavaliere F, Buhmann JM. Fundamentals of Arthroscopic Surgery Training and beyond: a reinforcement learning exploration and benchmark. Int J Comput Assist Radiol Surg 2024; 19:1773-1781. [PMID: 38684559 PMCID: PMC11365860 DOI: 10.1007/s11548-024-03116-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 03/20/2024] [Indexed: 05/02/2024]
Abstract
PURPOSE This work presents FASTRL, a benchmark set of instrument manipulation tasks adapted to the domain of reinforcement learning and used in simulated surgical training. This benchmark enables and supports the design and training of human-centric reinforcement learning agents which assist and evaluate human trainees in surgical practice. METHODS Simulation tasks from the Fundamentals of Arthroscopic Surgery Training (FAST) program are adapted to the reinforcement learning setting for the purpose of training virtual agents that are capable of providing assistance and scoring to the surgical trainees. A skill performance assessment protocol is presented based on the trained virtual agents. RESULTS The proposed benchmark suite presents an API for training reinforcement learning agents in the context of arthroscopic skill training. The evaluation scheme based on both heuristic and learned reward functions robustly recovers the ground truth ranking on a diverse test set of human trajectories. CONCLUSION The presented benchmark enables the exploration of a novel reinforcement learning-based approach to skill performance assessment and in-procedure assistance for simulated surgical training scenarios. The evaluation protocol based on the learned reward model demonstrates potential for evaluating the performance of surgical trainees in simulation.
Collapse
Affiliation(s)
- Ivan Ovinnikov
- Department of Computer Science, ETH Zürich, Zurich, Switzerland.
| | - Ami Beuret
- Department of Computer Science, ETH Zürich, Zurich, Switzerland
| | | | | |
Collapse
|
35
|
Porto BC, Frati RMC, Maltez RG, Lima AFDS, Ferreira TA, Baron LC, Passerotti CC, Artifon EL, Otoch JP, da Cruz JAS. Description of the Dunning-Kruger effect in general surgery residents during laparoscopic cholecystectomy: a blinded prospective study. Acta Cir Bras 2024; 39:e393224. [PMID: 38958306 PMCID: PMC11216530 DOI: 10.1590/acb393224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 04/04/2024] [Indexed: 07/04/2024] Open
Abstract
PURPOSE The purpose of this study is to assess whether the Dunning-Kruger effect occurs in surgical residents when performing laparoscopic cholecystectomy in a porcine model. METHODS Prospective blinded study, which counted with forty PGY-1 general surgery residents who agreed to participate in the study were blindly recruited to perform a laparoscopic cholecystectomy in a porcine model. At the end of the procedure, the participants assigned a score of 0-10 for their own performance and the video of the operation was independently assessed by 2 experienced laparoscopic surgeons using a validated tool. RESULTS Participants were divided into groups of 10 individuals according to objective performance and compared. The group with the worst objective result was inferior to the group with the best objective result (3.77 ± 0.44 vs. 8.1 ± 0.44, p < 0.001), but they were similar in self-perception of performance (5.11 ± 1.69 vs. 6.1 ± 1.79, p = 0.999). CONCLUSIONS In the studied sample, it was possible to demonstrate the presence of the Dunning-Kruger effect.
Collapse
Affiliation(s)
- Breno Cordeiro Porto
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
| | - Rodrigo Marcus Cunha Frati
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
- Universidade Nove de Julho – School of Medicine – São Paulo (SP), Brazil
| | | | | | | | | | - Carlo Camargo Passerotti
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
- Hospital Alemão Oswaldo Cruz – Urology Department – São Paulo (SP), Brazil
| | - Everson Luiz Artifon
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
| | - José Pinhata Otoch
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
| | - Jose Arnaldo Shiomi da Cruz
- Universidade de São Paulo – Faculdade de Medicina – Surgical Technique & Experimental Surgery –São Paulo (SP), Brazil
- Universidade Nove de Julho – School of Medicine – São Paulo (SP), Brazil
- Hospital Alemão Oswaldo Cruz – Urology Department – São Paulo (SP), Brazil
| |
Collapse
|
36
|
Cizmic A, Häberle F, Wise PA, Müller F, Gabel F, Mascagni P, Namazi B, Wagner M, Hashimoto DA, Madani A, Alseidi A, Hackert T, Müller-Stich BP, Nickel F. Structured feedback and operative video debriefing with critical view of safety annotation in training of laparoscopic cholecystectomy: a randomized controlled study. Surg Endosc 2024; 38:3241-3252. [PMID: 38653899 PMCID: PMC11133174 DOI: 10.1007/s00464-024-10843-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/02/2024] [Indexed: 04/25/2024]
Abstract
BACKGROUND The learning curve in minimally invasive surgery (MIS) is lengthened compared to open surgery. It has been reported that structured feedback and training in teams of two trainees improves MIS training and MIS performance. Annotation of surgical images and videos may prove beneficial for surgical training. This study investigated whether structured feedback and video debriefing, including annotation of critical view of safety (CVS), have beneficial learning effects in a predefined, multi-modal MIS training curriculum in teams of two trainees. METHODS This randomized-controlled single-center study included medical students without MIS experience (n = 80). The participants first completed a standardized and structured multi-modal MIS training curriculum. They were then randomly divided into two groups (n = 40 each), and four laparoscopic cholecystectomies (LCs) were performed on ex-vivo porcine livers each. Students in the intervention group received structured feedback after each LC, consisting of LC performance evaluations through tutor-trainee joint video debriefing and CVS video annotation. Performance was evaluated using global and LC-specific Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores. RESULTS The participants in the intervention group had higher global and LC-specific OSATS as well as global and LC-specific GOALS scores than the participants in the control group (25.5 ± 7.3 vs. 23.4 ± 5.1, p = 0.003; 47.6 ± 12.9 vs. 36 ± 12.8, p < 0.001; 17.5 ± 4.4 vs. 16 ± 3.8, p < 0.001; 6.6 ± 2.3 vs. 5.9 ± 2.1, p = 0.005). The intervention group achieved CVS more often than the control group (1. LC: 20 vs. 10 participants, p = 0.037, 2. LC: 24 vs. 8, p = 0.001, 3. LC: 31 vs. 8, p < 0.001, 4. LC: 31 vs. 10, p < 0.001). CONCLUSIONS Structured feedback and video debriefing with CVS annotation improves CVS achievement and ex-vivo porcine LC training performance based on OSATS and GOALS scores.
Collapse
Affiliation(s)
- Amila Cizmic
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20251, Hamburg, Germany
| | - Frida Häberle
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Philipp A Wise
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Felix Müller
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Felix Gabel
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Pietro Mascagni
- Fondazione Policlinico Universitario Agostino Gemelli IRCCS, Rome, Italy
- Institute of Image-Guided Surgery, IHU-Strasbourg, Strasbourg, France
| | - Babak Namazi
- Center for Evidence-Based Simulation, Baylor University Medical Center, Dallas, USA
| | - Martin Wagner
- Department of Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Daniel A Hashimoto
- Penn Computer Assisted Surgery and Outcomes (PCASO) Laboratory, Department of Surgery, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, USA
| | - Amin Madani
- Surgical Artificial Intelligence Research Academy (SARA), Department of Surgery, University Health Network, Toronto, Canada
| | - Adnan Alseidi
- Department of Surgery, University of California - San Francisco, San Francisco, USA
| | - Thilo Hackert
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20251, Hamburg, Germany
| | - Beat P Müller-Stich
- Department of Surgery, Clarunis - University Centre for Gastrointestinal and Liver Diseases, Basel, Switzerland
| | - Felix Nickel
- Department of General, Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Martinistraße 52, 20251, Hamburg, Germany.
- Department of General, Visceral and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany.
| |
Collapse
|
37
|
Horita K, Hida K, Itatani Y, Fujita H, Hidaka Y, Yamamoto G, Ito M, Obama K. Real-time detection of active bleeding in laparoscopic colectomy using artificial intelligence. Surg Endosc 2024; 38:3461-3469. [PMID: 38760565 DOI: 10.1007/s00464-024-10874-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 04/20/2024] [Indexed: 05/19/2024]
Abstract
BACKGROUND Most intraoperative adverse events (iAEs) result from surgeons' errors, and bleeding is the majority of iAEs. Recognizing active bleeding timely is important to ensure safe surgery, and artificial intelligence (AI) has great potential for detecting active bleeding and providing real-time surgical support. This study aimed to develop a real-time AI model to detect active intraoperative bleeding. METHODS We extracted 27 surgical videos from a nationwide multi-institutional surgical video database in Japan and divided them at the patient level into three sets: training (n = 21), validation (n = 3), and testing (n = 3). We subsequently extracted the bleeding scenes and labeled distinctively active bleeding and blood pooling frame by frame. We used pre-trained YOLOv7_6w and developed a model to learn both active bleeding and blood pooling. The Average Precision at an Intersection over Union threshold of 0.5 (AP.50) for active bleeding and frames per second (FPS) were quantified. In addition, we conducted two 5-point Likert scales (5 = Excellent, 4 = Good, 3 = Fair, 2 = Poor, and 1 = Fail) questionnaires about sensitivity (the sensitivity score) and number of overdetection areas (the overdetection score) to investigate the surgeons' assessment. RESULTS We annotated 34,117 images of 254 bleeding events. The AP.50 for active bleeding in the developed model was 0.574 and the FPS was 48.5. Twenty surgeons answered two questionnaires, indicating a sensitivity score of 4.92 and an overdetection score of 4.62 for the model. CONCLUSIONS We developed an AI model to detect active bleeding, achieving real-time processing speed. Our AI model can be used to provide real-time surgical support.
Collapse
Affiliation(s)
- Kenta Horita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Koya Hida
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan.
| | - Yoshiro Itatani
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Haruku Fujita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Yu Hidaka
- Department of Biomedical Statistics and Bioinformatics, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Goshiro Yamamoto
- Division of Medical Information Technology and Administration Planning, Kyoto University, Kyoto, Japan
| | - Masaaki Ito
- Surgical Device Innovation Office, National Cancer Center Hospital East, Chiba, Japan
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan
| | - Kazutaka Obama
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| |
Collapse
|
38
|
Matsumoto S, Kawahira H, Fukata K, Doi Y, Kobayashi N, Hosoya Y, Sata N. Laparoscopic distal gastrectomy skill evaluation from video: a new artificial intelligence-based instrument identification system. Sci Rep 2024; 14:12432. [PMID: 38816459 PMCID: PMC11139867 DOI: 10.1038/s41598-024-63388-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 05/28/2024] [Indexed: 06/01/2024] Open
Abstract
The advent of Artificial Intelligence (AI)-based object detection technology has made identification of position coordinates of surgical instruments from videos possible. This study aimed to find kinematic differences by surgical skill level. An AI algorithm was developed to identify X and Y coordinates of surgical instrument tips accurately from video. Kinematic analysis including fluctuation analysis was performed on 18 laparoscopic distal gastrectomy videos from three expert and three novice surgeons (3 videos/surgeon, 11.6 h, 1,254,010 frames). Analysis showed the expert surgeon cohort moved more efficiently and regularly, with significantly less operation time and total travel distance. Instrument tip movement did not differ in velocity, acceleration, or jerk between skill levels. The evaluation index of fluctuation β was significantly higher in experts. ROC curve cutoff value at 1.4 determined sensitivity and specificity of 77.8% for experts and novices. Despite the small sample, this study suggests AI-based object detection with fluctuation analysis is promising because skill evaluation can be calculated in real time with potential for peri-operational evaluation.
Collapse
Affiliation(s)
- Shiro Matsumoto
- Department of Surgery, Division of Gastroenterological, General and Transplant Surgery, Jichi Medical University, Tochigi, Japan.
| | - Hiroshi Kawahira
- Medical Simulation Center, Jichi Medical University, Tochigi, Japan
| | | | | | | | - Yoshinori Hosoya
- Department of Surgery, Division of Gastroenterological, General and Transplant Surgery, Jichi Medical University, Tochigi, Japan
| | - Naohiro Sata
- Department of Surgery, Division of Gastroenterological, General and Transplant Surgery, Jichi Medical University, Tochigi, Japan
| |
Collapse
|
39
|
Dos Santos Almeida Farinha RJ, Piro A, Mottaran A, Paciotti M, Puliatti S, Breda A, Porter J, Van Cleynenbreugel B, Vander Sloten J, Mottrie A, Gallagher AG. Development and validation of metrics for a new RAPN training model. J Robot Surg 2024; 18:153. [PMID: 38563887 DOI: 10.1007/s11701-024-01911-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 03/13/2024] [Indexed: 04/04/2024]
Abstract
Robot-assisted partial nephrectomy (RAPN) is a complex and index procedure that urologists need to learn how to perform safely. No validated performance metrics specifically developed for a RAPN training model (TM) exist. A Core Metrics Group specifically adapted human RAPN metrics to be used in a newly developed RAPN TM, explicitly defining phases, steps, errors, and critical errors. A modified Delphi meeting concurred on the face and content validation of the new metrics. One hundred percent consensus was achieved by the Delphi panel on 8 Phases, 32 Steps, 136 Errors and 64 Critical Errors. Two trained assessors evaluated recorded video performances of novice and expert RAPN surgeons executing an emulated RAPN in the newly developed TM. There were no differences in procedure Steps completed by the two groups. Experienced RAPN surgeons made 34% fewer Total Errors than the Novice group. Performance score for both groups was divided at the median score using Total Error scores, into HiError and LoError subgroups. The LowErrs Expert RAPN surgeons group made 118% fewer Total Errors than the Novice HiErrs group. Furthermore, the LowErrs Expert RAPN surgeons made 77% fewer Total Errors than the HiErrs Expert RAPN surgeons. These results established construct and discriminative validity of the metrics. The authors described a novel RAPN TM and its associated performance metrics with evidence supporting their face, content, construct, and discriminative validation. This report and evidence support the implementation of a simulation-based proficiency-based progression (PBP) training program for RAPN.
Collapse
Affiliation(s)
| | - Adele Piro
- Division of Urology, University of Modena and Reggio Emilia, Modena, Italy
| | - Angelo Mottaran
- Division of Urology, IRCCS Azienda Ospedaliero - Universitaria di Bologna, Bologna, Italy
| | - Marco Paciotti
- Department of Urology, IRCCS Humanitas Research Hospital, Rozzano, Milan, Italy
| | - Stefano Puliatti
- Division of Urology, University of Modena and Reggio Emilia, Modena, Italy
| | - Alberto Breda
- Department of Urology, Universitat Autonoma de Barcelona, Fundació Puigvert, Barcelona, Spain
| | - James Porter
- Swedish Urology Group, Swedish Medical Center, Seattle, WA, USA
| | - Ben Van Cleynenbreugel
- Department of Urology, University Hospitals Leuven, Leuven, Belgium
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
| | - Jos Vander Sloten
- Department of Mechanical Engineering, Section of Biomechanics, KU Leuven, Leuven, Belgium
| | - Alexandre Mottrie
- Orsi Academy, Proefhoevestraat 12, 9090, Ghent, Belgium
- Department of Urology, Onze-Lieve-Vrouw Ziekenhuis, Aalst, Belgium
| | - Anthony G Gallagher
- Orsi Academy, Proefhoevestraat 12, 9090, Ghent, Belgium
- Faculty of Medicine, KU Leuven, Leuven, Belgium
- Faculty of Life and Health Sciences, Ulster University, Derry, Northern Ireland, UK
| |
Collapse
|
40
|
Schneyer RJ, Scheib SA, Green IC, Molina AL, Mara KC, Wright KN, Siedhoff MT, Truong MD. Validation of a Simulation Model for Robotic Myomectomy. J Minim Invasive Gynecol 2024; 31:330-340.e1. [PMID: 38307222 DOI: 10.1016/j.jmig.2024.01.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 01/15/2024] [Accepted: 01/17/2024] [Indexed: 02/04/2024]
Abstract
STUDY OBJECTIVE Several simulation models have been evaluated for gynecologic procedures such as hysterectomy, but there are limited published data for myomectomy. This study aimed to assess the validity of a low-cost robotic myomectomy model for surgical simulation training. DESIGN Prospective cohort simulation study. SETTING Surgical simulation laboratory. PARTICIPANTS Twelve obstetrics and gynecology residents and 4 fellowship-trained minimally invasive gynecologic surgeons were recruited for a 3:1 novice-to-expert ratio. INTERVENTIONS A robotic myomectomy simulation model was constructed using <$5 worth of materials: a foam cylinder, felt, a stress ball, bandage wrap, and multipurpose sealing wrap. Participants performed a simulation task involving 2 steps: fibroid enucleation and hysterotomy repair. Video-recorded performances were timed and scored by 2 blinded reviewers using the validated Global Evaluative Assessment of Robotic Skills (GEARS) scale (5-25 points) and a modified GEARS scale (5-40 points), which adds 3 novel domains specific to robotic myomectomy. Performance was also scored using predefined task errors. Participants completed a post-task questionnaire assessing the model's realism and utility. MEASUREMENTS AND MAIN RESULTS Median task completion time was shorter for experts than novices (9.7 vs 24.6 min, p = .001). Experts scored higher than novices on both the GEARS scale (median 23 vs 12, p = .004) and modified GEARS scale (36 vs 20, p = .004). Experts made fewer task errors than novices (median 15.5 vs 37.5, p = .034). For interrater reliability of scoring, the intraclass correlation coefficient was calculated to be 0.91 for the GEARS assessment, 0.93 for the modified GEARS assessment, and 0.60 for task errors. Using the contrasting groups method, the passing mark for the simulation task was set to a minimum modified GEARS score of 28 and a maximum of 28 errors. Most participants agreed that the model was realistic (62.5%) and useful for training (93.8%). CONCLUSION We have demonstrated evidence supporting the validity of a low-cost robotic myomectomy model. This simulation model and the performance assessments developed in this study provide further educational tools for robotic myomectomy training.
Collapse
Affiliation(s)
- Rebecca J Schneyer
- Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Los Angeles, California (Drs. Schneyer, Molina, Wright, Siedhoff, and Truong).
| | - Stacey A Scheib
- Department of Obstetrics and Gynecology, Louisiana State University Health Sciences Center, New Orleans, Lousiana (Dr. Scheib)
| | - Isabel C Green
- Department of Obstetrics and Gynecology (Dr. Green), Mayo Clinic, Rochester, Minnesota
| | - Andrea L Molina
- Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Los Angeles, California (Drs. Schneyer, Molina, Wright, Siedhoff, and Truong)
| | - Kristin C Mara
- Department of Quantitative Health Sciences (Ms. Mara), Mayo Clinic, Rochester, Minnesota
| | - Kelly N Wright
- Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Los Angeles, California (Drs. Schneyer, Molina, Wright, Siedhoff, and Truong)
| | - Matthew T Siedhoff
- Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Los Angeles, California (Drs. Schneyer, Molina, Wright, Siedhoff, and Truong)
| | - Mireille D Truong
- Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Los Angeles, California (Drs. Schneyer, Molina, Wright, Siedhoff, and Truong)
| |
Collapse
|
41
|
Desir A, Marques C, Farah E, R Hegde S, Holcomb C, Scott DJ, Sankaranarayanan G. Validity and reliability evidence support task-specific metrics for laparoscopic fundoplication. Surg Endosc 2024; 38:2219-2230. [PMID: 38383688 DOI: 10.1007/s00464-024-10675-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 12/30/2023] [Indexed: 02/23/2024]
Abstract
BACKGROUND Laparoscopic hiatal hernia repair (LHHR) is a complex operation requiring advanced surgical training. Surgical simulation offers a potential solution for learning complex operations without the need for high surgical volume. Our goal is to develop a virtual reality (VR) simulator for LHHR; however, data supporting task-specific metrics for this procedure are lacking. The purpose of this study was to develop and assess validity and reliability evidence of task-specific metrics for the fundoplication phase of LHHR. METHODS In phase I, structured interviews with expert foregut surgeons were conducted to develop task-specific metrics (TSM). In phase II, participants with varying levels of surgical expertise performed a laparoscopic Nissen fundoplication procedure on a porcine stomach explant. Video recordings were independently assessed by two blinded graders using global and TSM. An intraclass correlation coefficient (ICC) was used to assess interrater reliability (IRR). Performance scores were compared using a Kruskal-Wallis test. Spearman's rank correlation was used to evaluate the association between global and TSM. RESULTS Phase I of the study consisted of 12 interviews with expert foregut surgeons. Phase II engaged 31 surgery residents, a fellow, and 6 attendings in the simulation. Phase II results showed high IRR for both global (ICC = 0.84, p < 0.001) and TSM (ICC = 0.75, p < 0.001). Significant between-group differences were detected for both global (χ2 = 24.01, p < 0.001) and TSM (χ2 = 18.4, p < 0.001). Post hoc analysis showed significant differences in performance between the three groups for both metrics (p < 0.05). There was a strong positive correlation between the global and TSM (rs = 0.86, p < 0.001). CONCLUSION We developed task-specific metrics for LHHR and using a fundoplication model, we documented significant reliability and validity evidence. We anticipate that these LHHR task-specific metrics will be useful in our planned VR simulator.
Collapse
Affiliation(s)
- Alexis Desir
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
- Artificial Intelligence and Medical Simulation Lab, Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Carolina Marques
- Artificial Intelligence and Medical Simulation Lab, Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Emile Farah
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Shruti R Hegde
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
- Artificial Intelligence and Medical Simulation Lab, Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Carla Holcomb
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Daniel J Scott
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA
| | - Ganesh Sankaranarayanan
- Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA.
- Artificial Intelligence and Medical Simulation Lab, Department of Surgery, University of Texas Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390, USA.
| |
Collapse
|
42
|
Balvardi S, Kaneva P, Semsar-Kazerooni K, Vassiliou M, Al Mahroos M, Mueller C, Fiore JF, Schwartzman K, Feldman LS. Effect of video-based self-reflection on intraoperative skills: A pilot randomized controlled trial. Surgery 2024; 175:1021-1028. [PMID: 38154996 DOI: 10.1016/j.surg.2023.11.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/13/2023] [Accepted: 11/26/2023] [Indexed: 12/30/2023]
Abstract
BACKGROUND The value of video-based self-assessment in enhancing surgical skills is uncertain. This study investigates the feasibility and estimates sample size for a full-scale randomized controlled trial to evaluate the effectiveness of video-based self-assessment to improve surgical performance of laparoscopic cholecystectomy in trainees. METHODS This parallel pilot randomized controlled trial included general surgery trainees performing supervised laparoscopic cholecystectomy randomized 1:1 to control (traditional intraoperative teaching) or intervention group (traditional teaching plus video-based self-assessment). Operative performance was measured by the attending surgeon blinded to group assignment at the time of surgery using standardized assessment tools (Global Operative Assessment of Laparoscopic Skills and Operative Performance Rating System). The intervention group had access to their video recordings on a web-based platform for review and self-assessment using the same instruments. The primary outcome for the estimation of sample size was the difference in faculty-assessed final operative performance (third submitted case). Feasibility criteria included >85% participation, >85% adherence to case submission and >85% completion of self-assessment. RESULTS Of 37 eligible trainees approached, 32 consented and were randomized (86%). There were 16 in the intervention group, 15 in the control group (55% male, 55% junior trainees), and 1 was excluded for protocol violation. Twenty-four (75%) of participants submitted 3 cases. Thirteen trainees (81%) accessed the platform and completed 26 (63.2%) case self-assessments. Fifty-five trainees per arm will be needed to power a full-scale laparoscopic cholecystectomy with Global Operative Assessment of Laparoscopic Skills and 130 trainees per arm with Operative Performance Rating System as the assessment tool. CONCLUSION This pilot study contributes important data to inform the design of an adequately powered randomized controlled trial of video-based self-assessment to improve trainee performance of laparoscopic cholecystectomy. Although a priori trial feasibility criteria were not achieved, automated video capture and storage could significantly improve adherence in future trials.
Collapse
Affiliation(s)
- Saba Balvardi
- Department of Surgery, McGill University, Montreal, Quebec, Canada; Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Pepa Kaneva
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Koorosh Semsar-Kazerooni
- Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Melina Vassiliou
- Department of Surgery, McGill University, Montreal, Quebec, Canada; Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | | | - Carmen Mueller
- Department of Surgery, McGill University, Montreal, Quebec, Canada; Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Julio F Fiore
- Department of Surgery, McGill University, Montreal, Quebec, Canada; Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada
| | - Kevin Schwartzman
- Respiratory Division, Department of Medicine, McGill University and McGill International Tuberculosis Centre, Research Institute of the McGill University Health Centre, Montreal, Quebec, Canada
| | - Liane S Feldman
- Department of Surgery, McGill University, Montreal, Quebec, Canada; Steinberg-Bernstein Centre for Minimally Invasive Surgery and Innovation, McGill University Health Centre, Montreal, Quebec, Canada.
| |
Collapse
|
43
|
Kaijser MA, van Ramshorst GH, van Wagensveld BA, Veeger NJGM, Pierie JPEN. A New Procedure-Based Assessment of Operative Skills in Gastric Bypass Surgery, Evaluated by Video Fragment Rating. Obes Surg 2024; 34:1113-1121. [PMID: 38400947 PMCID: PMC11026254 DOI: 10.1007/s11695-023-07020-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 12/16/2023] [Accepted: 12/17/2023] [Indexed: 02/26/2024]
Abstract
PURPOSE Feedback on technical and procedural skills is essential during the training of residents and fellows. The aim of this study was to assess the performance of a newly created instrument for the assessment of operative skills using laparoscopic Roux-en-Y gastric bypass (LRYGB) video fragments. MATERIALS AND METHODS A new procedure-based assessment (PBA) was created by combining LRYGB key steps with a 5-point independence scale. LRYGB performed by residents and surgeons with different levels of expertise were video recorded. Fragments of the pouch creation, gastro-jejunostomy and jejunojejunostomy, were review by 12 expert bariatric surgeons and the operative skills assessed with the PBA, Objective Structured Assessment of Technical Skill (OSATS), and the Bariatric OSATS (BOSATS). The PBA was compared to the OSATS and BOSATS. Mean scores for all items of the different assessments were summarized and compared using a T-test. RESULTS The scores of the procedural steps were combined and compared for all levels. The mean scores for beginner, intermediate, and expert level were 2.71, 3.70, and 3.90 for the PBA; for the OSATS 1.84, 2.86, and 3.44; and for the BOSATS 2.78, 3.56, and 4.19. Each of these assessments differentiated between the three skill levels (all p < 0.05). CONCLUSION The PBA discriminates well between different levels of operative skills. Similar patterns were found for the OSATS and BOSATS, showing that the randomly selected video fragments are representative samples for assessing skill level. Future research will demonstrate whether these results can be extrapolated to clinical training, and which scores allow for procedure certification.
Collapse
Affiliation(s)
- Mirjam A Kaijser
- School of Medicine, University of Groningen, University Medical Centre Groningen, Groningen, The Netherlands.
- Department of Surgery, Medical Centre Leeuwarden, Leeuwarden, The Netherlands.
- Center for Obesity Northern Netherlands, Medical Center Leeuwarden, Henri Dunantweg 2, 8934 AD, Leeuwarden, The Netherlands.
| | - Gabrielle H van Ramshorst
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
- Department of Human Structure and Repair, Ghent University, Ghent, Belgium
| | - Bart A van Wagensveld
- Weight Management Center, Department of Surgery, NMC Royal Hospital, Khalifa City, Abu Dhabi, United Arab Emirates
| | - Nic J G M Veeger
- Department of Epidemiology, Medical Center Leeuwarden, Leeuwarden, The Netherlands
- Department of Epidemiology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Jean-Pierre E N Pierie
- School of Medicine, University of Groningen, University Medical Centre Groningen, Groningen, The Netherlands
- Department of Surgery, Medical Centre Leeuwarden, Leeuwarden, The Netherlands
| |
Collapse
|
44
|
Kambakamba P, Naiem A, Betz E, Hotz AS, Richetti K, Stein M, Abry L, Meier A, Seeger N, Grochola F, Grieder F, Breitenstein S. Applying augmented reality in teaching of surgical residents-telementoring, a "stress-free" way to surgical autonomy? Langenbecks Arch Surg 2024; 409:100. [PMID: 38504065 DOI: 10.1007/s00423-024-03287-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 03/11/2024] [Indexed: 03/21/2024]
Abstract
BACKGROUND Achieving surgical autonomy can be considered the ultimate goal of surgical training. Innovative head-mounted augmented reality (AR) devices enable visualization of the operating field and teaching from remote. Therefore, utilization of AR glasses may be a novel approach to achieve autonomy. The aim of this pilot study is to analyze the feasibility of AR application in surgical training and to assess its impact on intraoperative stress. METHODS A head-mounted RealWear Navigator® 500 glasses and the TeamViewer software were used. Initial "dry lab" testing of AR glasses was performed in combination with the Symbionix LAP Mentor™. Subsequently, residents performed various stage-adapted surgical procedures semi-autonomously (SA) (on-demand consultation of senior surgeon, who is in theatre but not scrubbed) versus permanent remote supervision (senior surgeon not present) via augmented reality (AR) glasses, worn by the resident in theatre. Stress was measured by intraoperative heart rate (Polar® pulse belt) and State-Trait Anxiety Inventory (STAI) questionnaire. RESULTS After "dry lab" testing, N = 5 senior residents performed equally N = 25 procedures SA and with AR glasses. For both, open and laparoscopic procedure AR remote assistance showed satisfactory applicability. Utilization of AR significantly reduced intraoperative peak pulse rate from 131 to 119 bpm (p = 0.004), as compared with the semi-autonomous group. Likewise, subjectively perceived stress according to STAI was significantly lower in the AR group (p = 0.011). CONCLUSION AR can be applied in surgical training and may help to reduce stress in theatre. In the future, AR has a huge potential to become a stepping stone to surgical autonomy.
Collapse
Affiliation(s)
- Patryk Kambakamba
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland.
| | - Amir Naiem
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Elise Betz
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Anne-Sophie Hotz
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Katharina Richetti
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Moritz Stein
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Lisa Abry
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Aline Meier
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Nico Seeger
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Filip Grochola
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Felix Grieder
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Stefan Breitenstein
- Department of Surgery, Cantonal Hospital Winterthur, Winterthur, Switzerland
| |
Collapse
|
45
|
Gonçalves MR, Morales-Conde S, Gaspar Reis S, Carlos Alves P, Novo de Matos J, Oliveira A, Marinho R, Cadime I, Castelo-Branco Sousa M. RAWS4all project: validation of a new silicone model for robotic TAPP inguinal hernia repair. Surg Endosc 2024; 38:1329-1341. [PMID: 38110794 PMCID: PMC10881695 DOI: 10.1007/s00464-023-10592-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 11/11/2023] [Indexed: 12/20/2023]
Abstract
BACKGROUND Trans-abdominal pre-peritoneal (TAPP) hernia repair is a complex procedure that presents several challenges. Even though, due to the high prevalence of inguinal hernia, TAPP technique is increasing in frequency and robotic Abdominal Wall Surgery (rAWS) is emerging as a valuable tool in this regard. Although inguinal TAPP procedure principles have been published and simulation is needed, the availability of validated models remains scarce. METHODS A new low-cost model was developed to simulate inguinal rTAPP repair. For validity assessment, a new TAPP-specific fidelity questionnaire and assessment scale were developed to compare the performance of novices and experts in the simulated procedure. The models used were assessed at 60 min for execution and quality score. RESULTS Twenty-five residents and specialists from all over the country participated in this study. Execution, quality, and global performance was higher in the seniors group compared to juniors (8.91 vs 6.36, p = 0.02; 8.09 vs 5.14, p < .001; and 17 vs. 11,5, p < .001, respectively). Overall fidelity was assessed as being very high [4.41 (3.5-5.0), α = .918] as well as face [4.31 (3.0-5.0), α = .867] and content validity [4.44 (3.2-5.0), α = .803]. Participants strongly agreed that the model is adequate to be used with the DaVinci® Robot [4.52 (3.5-5.0), α = .758]. CONCLUSION This study shows face, content, and construct validity of the model for inguinal TAPP simulation, including for robotic surgery. Therefore, the model can be a valuable tool for learning, understanding, practicing, and mastering the TAPP technique prior to participating in the operating room.
Collapse
Affiliation(s)
- Mário Rui Gonçalves
- Faculty of Health Sciences, University of Beira Interior, Av. Infante D. Henrique, 6200-506, Covilhã, Portugal.
| | - Salvador Morales-Conde
- Department of Surgery, University Hospital Virgen Macarena, University of Sevilla, Seville, Spain
| | - Sofia Gaspar Reis
- Centro Hospitalar Barreiro Montijo, Avenida Movimento das Forças Armadas, 2830-003, Barreiro, Portugal
| | - Palmira Carlos Alves
- Curricular Studies and Educational Technology, Institute of Education, University of Minho, Campus de Gualtar, 4710-093, Braga, Portugal
| | - José Novo de Matos
- Centro Hospitalar Universitário Lisboa Central, Hospital de São José, Rua José Serrano, 1150-199, Lisbon, Portugal
| | - António Oliveira
- Centro Hospitalar de Trás-Os-Montes e Alto Douro, E.P.E, Av. da Noruega, 5000-508, Vila Real, Portugal
| | - Ricardo Marinho
- Centro Hospitalar de Leiria, Hospital de Santo André, Rua das Olhalvas, 2410-197, Leiria, Portugal
| | - Irene Cadime
- Research Centre on Child Studies, Institute of Education, University of Minho, Campus de Gualtar, 4710-057, Braga, Portugal
| | - Miguel Castelo-Branco Sousa
- Faculty of Health Sciences, University of Beira Interior, Av. Infante D. Henrique, 6200-506, Covilhã, Portugal
- Centro Academico Clinico das Beiras (Academic Clinical Center of Beiras), Faculty of Health Sciences, University of Beira Interior, Av. Infante D. Henrique, 6200-506, Covilhã, Portugal
| |
Collapse
|
46
|
Ketel MHM, Klarenbeek BR, Eddahchouri Y, Cheong E, Cuesta MA, van Daele E, Ferri LE, Gisbertz SS, Gutschow CA, Hubka M, Hölscher AH, Law S, Luyer MDP, Merritt RE, Morse CR, Mueller CL, Nieuwenhuijzen GAP, Nilsson M, Pattyn P, Shen Y, van den Wildenberg FJH, Abma IL, Rosman C, van Workum F. A Video-Based Procedure-Specific Competency Assessment Tool for Minimally Invasive Esophagectomy. JAMA Surg 2024; 159:297-305. [PMID: 38150247 PMCID: PMC10753443 DOI: 10.1001/jamasurg.2023.6522] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 09/11/2023] [Indexed: 12/28/2023]
Abstract
IMPORTANCE Minimally invasive esophagectomy (MIE) is a complex procedure with substantial learning curves. In other complex minimally invasive procedures, suboptimal surgical performance has convincingly been associated with less favorable patient outcomes as assessed by peer review of the surgical procedure. OBJECTIVE To develop and validate a procedure-specific competency assessment tool (CAT) for MIE. DESIGN, SETTING, AND PARTICIPANTS In this international quality improvement study, a procedure-specific MIE-CAT was developed and validated. The MIE-CAT contains 8 procedural phases, and 4 quality components per phase are scored with a Likert scale ranging from 1 to 4. For evaluation of the MIE-CAT, intraoperative MIE videos performed by a single surgical team in the Esophageal Center East Netherlands were peer reviewed by 18 independent international MIE experts (with more than 120 MIEs performed). Each video was assessed by 2 or 3 blinded experts to evaluate feasibility, content validity, reliability, and construct validity. MIE-CAT version 2 was composed with refined content aimed at improving interrater reliability. A total of 32 full-length MIE videos from patients who underwent MIE between 2011 and 2020 were analyzed. Data were analyzed from January 2021 to January 2023. EXPOSURE Performance assessment of transthoracic MIE with an intrathoracic anastomosis. MAIN OUTCOMES AND MEASURES Feasibility, content validity, interrater and intrarater reliability, and construct validity, including correlations with both experience of the surgical team and clinical parameters, of the developed MIE-CAT. RESULTS Experts found the MIE-CAT easy to understand and easy to use to grade surgical performance. The MIE-CAT demonstrated good intrarater reliability (range of intraclass correlation coefficients [ICCs], 0.807 [95% CI, 0.656 to 0.892] for quality component score to 0.898 [95% CI, 0.846 to 0.932] for phase score). Interrater reliability was moderate (range of ICCs, 0.536 [95% CI, -0.220 to 0.994] for total MIE-CAT score to 0.705 [95% CI, 0.473 to 0.846] for quality component score), and most discrepancies originated in the lymphadenectomy phases. Hypothesis testing for construct validity showed more than 75% of hypotheses correct: MIE-CAT performance scores correlated with experience of the surgical team (r = 0.288 to 0.622), blood loss (r = -0.034 to -0.545), operative time (r = -0.309 to -0.611), intraoperative complications (r = -0.052 to -0.319), and severe postoperative complications (r = -0.207 to -0.395). MIE-CAT version 2 increased usability. Interrater reliability improved but remained moderate (range of ICCs, 0.666 to 0.743), and most discrepancies between raters remained in the lymphadenectomy phases. CONCLUSIONS AND RELEVANCE The MIE-CAT was developed and its feasibility, content validity, reliability, and construct validity were demonstrated. By providing insight into surgical performance of MIE, the MIE-CAT might be used for clinical, training, and research purposes.
Collapse
Affiliation(s)
- Mirte H. M. Ketel
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | | | - Yassin Eddahchouri
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Edward Cheong
- The PanAsia Surgery Group, Mount Elizabeth Hospital, Singapore
| | - Miguel A. Cuesta
- Department of Surgery, Amsterdam University Medical Centers, Location VUmc, Amsterdam, the Netherlands
| | - Elke van Daele
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
| | - Lorenzo E. Ferri
- Department of Surgery, McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
| | - Suzanne S. Gisbertz
- Amsterdam UMC location University of Amsterdam, Surgery, Amsterdam, the Netherlands
- Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, the Netherlands
| | - Christian A. Gutschow
- Department of Surgery and Transplantation, University Hospital Zurich, Zurich, Switzerland
| | - Michal Hubka
- Department of Thoracic Surgery, Virginia Mason Medical Center, Seattle, Washington
| | - Arnulf H. Hölscher
- Department for General, Visceral and Trauma Surgery, Elisabeth-Krankenhaus-Essen GmbH, Essen, Germany
| | - Simon Law
- Department of Surgery, Queen Mary Hospital, School of Clinical Medicine, The University of Hong Kong, Hong Kong
| | - Misha D. P. Luyer
- Department of Surgery, Catharina Hospital, Eindhoven, the Netherlands
| | - Robert E. Merritt
- Department of Surgery, Ohio State University Wexner Medical Center, Columbus
| | | | - Carmen L. Mueller
- Department of Surgery, McGill University Health Centre, Montreal General Hospital, Montreal, Quebec, Canada
| | | | - Magnus Nilsson
- Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden
- Department of Upper Abdominal Diseases, Karolinska University Hospital, Stockholm, Sweden
| | - Piet Pattyn
- Department of Gastrointestinal Surgery, Ghent University Hospital, Ghent, Belgium
| | - Yaxing Shen
- Department of Thoracic Surgery, Zhongshan Hospital, Fudan University, Shanghai, China
| | | | - Inger L. Abma
- IQ Healthcare, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Camiel Rosman
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Frans van Workum
- Department of Surgery, Radboud University Medical Center, Nijmegen, the Netherlands
- Department of Surgery, Canisius-Wilhelmina Hospital, Nijmegen, the Netherlands
| |
Collapse
|
47
|
Nikolian VC, Camacho D, Earle D, Lehmann R, Nau P, Ramshaw B, Stulberg J. Development and preliminary validation of a new task-based objective procedure-specific assessment of inguinal hernia repair procedural safety. Surg Endosc 2024; 38:1583-1591. [PMID: 38332173 DOI: 10.1007/s00464-024-10677-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 12/30/2023] [Indexed: 02/10/2024]
Abstract
BACKGROUND Surgical videos coupled with structured assessments enable surgical training programs to provide independent competency evaluations and align with the American Board of Surgery's entrustable professional activities initiative. Existing assessment instruments for minimally invasive inguinal hernia repair (IHR) have limitations with regards to reliability, validity, and usability. A cross-sectional study of six surgeons using a novel objective, procedure-specific, 8-item competency assessment for minimally invasive inguinal hernia repair (IHR-OPSA) was performed to assess inter-rater reliability using a "safe" vs. "unsafe" scoring rubric. METHODS The IHR-OPSA was developed by three expert IHR surgeons, field tested with five IHR surgeons, and revised based upon feedback. The final instrument included: (1) incision/port placement; (2) dissection of peritoneal flap (TAPP) or dissection of peritoneal flap (TEP); (3) exposure; (4) reducing the sac; (5) full dissection of the myopectineal orifice; (6) mesh insertion; (7) mesh fixation; and (8) operation flow. The IHR-OPSA was applied by six expert IHR surgeons to 20 IHR surgical videos selected to include a spectrum of hernia procedures (15 laparoscopic, 5 robotic), anatomy (14 indirect, 5 direct, 1 femoral), and Global Case Difficulty (easy, average, hard). Inter-rater reliability was assessed against Gwet's AC2. RESULTS The IHR-OPSA inter-rater reliability was good to excellent, ranging from 0.65 to 0.97 across the eight items. Assessments of robotic procedures had higher reliability with near perfect agreement for 7 of 8 items. In general, assessments of easier cases had higher levels of agreement than harder cases. CONCLUSIONS A novel 8-item minimally invasive IHR assessment tool was developed and tested for inter-rater reliability using a "safe" vs. "unsafe" rating system with promising results. To promote instrument validity the IHR-OPSA was designed and evaluated within the context of intended use with iterative engagement with experts and testing of constructs against real-world operative videos.
Collapse
Affiliation(s)
- Vahagn C Nikolian
- Department of Surgery, Oregon Health & Science University, 3181 S.W. Sam Jackson Park Rd., Portland, OR, 97239, USA.
| | - Diego Camacho
- Minimally Invasive and Endoscopic Surgery at Montefiore Medical Center, New York, NY, USA
| | - David Earle
- New England Hernia Center, Lowell, MA, USA
- Tufts University School of Medicine, Boston, MA, USA
| | - Ryan Lehmann
- Department of Surgery, Section of Bariatric Surgery, University of Iowa Hospitals & Clinics, Iowa City, IA, USA
| | - Peter Nau
- Department of Surgery, Section of Bariatric Surgery, University of Iowa Hospitals & Clinics, Iowa City, IA, USA
| | - Bruce Ramshaw
- CQInsights PBC, Knoxville, TN, USA
- Caresyntax Corporation, Boston, MA, USA
| | - Jonah Stulberg
- Department of Surgery, McGovern Medical School University of Texas Health Science Center at Houston, Houston, TX, USA
| |
Collapse
|
48
|
Chen Z, Yang D, Li A, Sun L, Zhao J, Liu J, Liu L, Zhou X, Chen Y, Cai Y, Wu Z, Cheng K, Cai H, Tang M, Peng B, Wang X. Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies. Int J Surg 2024; 110:1441-1449. [PMID: 38079605 PMCID: PMC10942222 DOI: 10.1097/js9.0000000000000975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 11/21/2023] [Indexed: 03/16/2024]
Abstract
BACKGROUND Various surgical skills lead to differences in patient outcomes and identifying poorly skilled surgeons with constructive feedback contributes to surgical quality improvement. The aim of the study was to develop an algorithm for evaluating surgical skills in laparoscopic cholecystectomy based on the features of elementary functional surgical gestures (Surgestures). MATERIALS AND METHODS Seventy-five laparoscopic cholecystectomy videos were collected from 33 surgeons in five hospitals. The phase of mobilization hepatocystic triangle and gallbladder dissection from the liver bed of each video were annotated with 14 Surgestures. The videos were grouped into competent and incompetent based on the quantiles of modified global operative assessment of laparoscopic skills (mGOALS). Surgeon-related information, clinical data, and intraoperative events were analyzed. Sixty-three Surgesture features were extracted to develop the surgical skill classification algorithm. The area under the receiver operating characteristic curve of the classification and the top features were evaluated. RESULTS Correlation analysis revealed that most perioperative factors had no significant correlation with mGOALS scores. The incompetent group has a higher probability of cholecystic vascular injury compared to the competent group (30.8 vs 6.1%, P =0.004). The competent group demonstrated fewer inefficient Surgestures, lower shift frequency, and a larger dissection-exposure ratio of Surgestures during the procedure. The area under the receiver operating characteristic curve of the classification algorithm achieved 0.866. Different Surgesture features contributed variably to overall performance and specific skill items. CONCLUSION The computer algorithm accurately classified surgeons with different skill levels using objective Surgesture features, adding insight into designing automatic laparoscopic surgical skill assessment tools with technical feedback.
Collapse
Affiliation(s)
- Zixin Chen
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Dewei Yang
- Chongqing University of Posts and Telecommunications, School of Advanced Manufacturing Engineering, Chongqing
| | - Ang Li
- Department of General Surgery, Division of Pancreatic Surgery
- Guang’an People’s Hospital, Guang’an
| | - Louzong Sun
- Department of Hepatobiliary Surgery, Zigong First People’s Hospital, Zigong
| | - Jifan Zhao
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Jie Liu
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Linxun Liu
- Department of General Surgery, Qinghai Provincial People’s Hospital, Xining, People’s Republic of China
| | - Xiaobo Zhou
- School of Biomedical Informatics, McGovern Medical School, University of Texas Health Science Center, Houston, USA
| | - Yonghua Chen
- Department of General Surgery, Division of Pancreatic Surgery
| | - Yunqiang Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Zhong Wu
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ke Cheng
- Department of General Surgery, Division of Pancreatic Surgery
| | - He Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ming Tang
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Bing Peng
- Department of General Surgery, Division of Pancreatic Surgery
| | - Xin Wang
- Department of General Surgery, Division of Pancreatic Surgery
| |
Collapse
|
49
|
Paschold M, Kneist W, Soufiah E, Nissen A, Nikolay J, Seilheimer N, Watzka F, Zimniak L. Keep it simple: a crosshair on the screen during proctored laparoscopic surgeries. Langenbecks Arch Surg 2024; 409:69. [PMID: 38376630 DOI: 10.1007/s00423-024-03255-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 02/07/2024] [Indexed: 02/21/2024]
Abstract
INTRODUCTION Inside the operating room, experts use verbal instructions to guide surgical novices through laparoscopic procedures. In this study, we evaluated the use of a crosshair attached to the video monitor, as a hands-free pointing tool to simplify instructions during operation. METHODS Ten surgical novices performed two elective laparoscopic cholecystectomies within a week of each other, randomized such that one was performed with and the other without using the crosshair. Directly after operation, questionnaires were completed by the novices and the consultant surgeons. Measures including the comprehensibility of instructions, subjective feeling of safety during preparation, time delays due to different instruction options, and disruptive influence while instructors used the crosshair. Differences in operative performance were evaluated based on the global operative assessment of laparoscopic skills (GOALS) scores. RESULTS When the crosshair was used, surgical novices had a better understanding of which anatomical structure should be shown (p = 0.028). Operating time (p = 0.222) and feeling of confidence during preparation did not differ with versus without crosshair use (p = 0.081). All participants stated that the crosshair did not negatively affect the field of vision. In terms of the median GOALS score, the operative performance was improved when the crosshair was used compared with verbal instructions only (median 15, IQR (11; 21) vs. median 12, IQR (5; 19), p < 0.001). CONCLUSION The crosshair is a simple, inexpensive, and widely available method to improve communication between instructors and novices in everyday training.
Collapse
Affiliation(s)
- Markus Paschold
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany.
| | - Werner Kneist
- Department of General and Visceral Surgery, Klinikum Darmstadt, Grafenstraße 9, 64283, Darmstadt, Germany
| | - Edwar Soufiah
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| | - Arnold Nissen
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| | - Johannes Nikolay
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| | - Natalie Seilheimer
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| | - Felix Watzka
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| | - Lennart Zimniak
- Department of General and Visceral Surgery, St. Marienwoerth Hospital, Muehlenstr. 39, 55543, Bad Kreuznach, Germany
| |
Collapse
|
50
|
Malisetty S, Rastegari E, Siu KC, Ali HH. Exploring the Impact of Hand Dominance on Laparoscopic Surgical Skills Development Using Network Models. J Clin Med 2024; 13:1150. [PMID: 38398463 PMCID: PMC10889549 DOI: 10.3390/jcm13041150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 02/12/2024] [Accepted: 02/17/2024] [Indexed: 02/25/2024] Open
Abstract
BACKGROUND Laparoscopic surgery demands high precision and skill, necessitating effective training protocols that account for factors such as hand dominance. This study investigates the impact of hand dominance on the acquisition and proficiency of laparoscopic surgical skills, utilizing a novel assessment method that combines Network Models and electromyography (EMG) data. METHODS Eighteen participants, comprising both medical and non-medical students, engaged in laparoscopic simulation tasks, including peg transfer and wire loop tasks. Performance was assessed using Network Models to analyze EMG data, capturing muscle activity and learning progression. The NASA Task Load Index (TLX) was employed to evaluate subjective task demands and workload perceptions. RESULTS Our analysis revealed significant differences in learning progression and skill proficiency between dominant and non-dominant hands, suggesting the need for tailored training approaches. Network Models effectively identified patterns of skill acquisition, while NASA-TLX scores correlated with participants' performance and learning progression, highlighting the importance of considering both objective and subjective measures in surgical training. CONCLUSIONS The study underscores the importance of hand dominance in laparoscopic surgical training and suggests that personalized training protocols could enhance surgical precision, efficiency, and patient outcomes. By leveraging advanced analytical techniques, including Network Models and EMG data analysis, this research contributes to optimizing clinical training methodologies, potentially revolutionizing surgical education and improving patient care.
Collapse
Affiliation(s)
- Saiteja Malisetty
- College of Information Science & Technology, University of Nebraska at Omaha, Omaha, NE 68182, USA;
| | - Elham Rastegari
- Business Intelligence & Analytics Department, Creighton University, Omaha, NE 68178, USA;
| | - Ka-Chun Siu
- Department of Health & Rehabilitation Sciences, University of Nebraska Medical Center, Omaha, NE 68198, USA;
| | - Hesham H. Ali
- College of Information Science & Technology, University of Nebraska at Omaha, Omaha, NE 68182, USA;
| |
Collapse
|