1
|
Su F, Su M, Wei W, Wu J, Chen L, Sun X, Liu M, Sun S, Mao R, Bourgonje AR, Hu S. Integrating multi-omics data to reveal the host-microbiota interactome in inflammatory bowel disease. Gut Microbes 2025; 17:2476570. [PMID: 40063366 PMCID: PMC11901428 DOI: 10.1080/19490976.2025.2476570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/17/2024] [Revised: 02/14/2025] [Accepted: 03/03/2025] [Indexed: 03/14/2025] Open
Abstract
Numerous studies have accelerated the knowledge expansion on the role of gut microbiota in inflammatory bowel disease (IBD). However, the precise mechanisms behind host-microbe cross-talk remain largely undefined, due to the complexity of the human intestinal ecosystem and multiple external factors. In this review, we introduce the interactome concept to systematically summarize how intestinal dysbiosis is involved in IBD pathogenesis in terms of microbial composition, functionality, genomic structure, transcriptional activity, and downstream proteins and metabolites. Meanwhile, this review also aims to present an updated overview of the relevant mechanisms, high-throughput multi-omics methodologies, different types of multi-omics cohort resources, and computational methods used to understand host-microbiota interactions in the context of IBD. Finally, we discuss the challenges pertaining to the integration of multi-omics data in order to reveal host-microbiota cross-talk and offer insights into relevant future research directions.
Collapse
Affiliation(s)
- Fengyuan Su
- Institute of Precision Medicine, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
- Department of Gastroenterology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| | - Meng Su
- The First Clinical Medical School, Nanfang Hospital of Southern Medical University, Guangzhou, China
| | - Wenting Wei
- Zhongshan School of Medicine, Sun Yat-Sen University, Guangzhou, China
| | - Jiayun Wu
- Zhongshan School of Medicine, Sun Yat-Sen University, Guangzhou, China
| | - Leyan Chen
- Zhongshan School of Medicine, Sun Yat-Sen University, Guangzhou, China
| | - Xiqiao Sun
- Zhongshan School of Medicine, Sun Yat-Sen University, Guangzhou, China
| | - Moyan Liu
- Amsterdam UMC location Academic Medical Center, Department of Experimental Vascular Medicine, Amsterdam, The Netherlands
| | - Shiqiang Sun
- Department of Gastroenterology and Hepatology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Ren Mao
- Department of Gastroenterology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| | - Arno R. Bourgonje
- Department of Gastroenterology and Hepatology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- The Henry D. Janowitz Division of Gastroenterology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Shixian Hu
- Institute of Precision Medicine, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
- Department of Gastroenterology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| |
Collapse
|
2
|
Holt NM, Byrne MF. The Role of Artificial Intelligence and Big Data for Gastrointestinal Disease. Gastrointest Endosc Clin N Am 2025; 35:291-308. [PMID: 40021230 DOI: 10.1016/j.giec.2024.09.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2025]
Abstract
Artificial intelligence (AI) is a rapidly evolving presence in all fields and industries, with the ability to both improve quality and reduce the burden of human effort. Gastroenterology is a field with a focus on diagnostic techniques and procedures, and AI and big data have established and growing roles to play. Alongside these opportunities are challenges, which will evolve in parallel.
Collapse
Affiliation(s)
- Nicholas Mathew Holt
- Gastroenterology and Hepatology Unit, The Canberra Hospital, Yamba Drive, Garran, ACT 2605, Australia.
| | - Michael Francis Byrne
- Division of Gastroenterology, Vancouver General Hospital, University of British Columbia, UBC Division of Gastroenterology, 5153 - 2775 Laurel Street, Vancouver, British Columbia V5Z 1M9, Canada
| |
Collapse
|
3
|
Maan S, Agrawal R, Singh S, Thakkar S. Artificial Intelligence in Endoscopy Quality Measures. Gastrointest Endosc Clin N Am 2025; 35:431-444. [PMID: 40021239 DOI: 10.1016/j.giec.2024.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2025]
Abstract
Quality of gastrointestinal endoscopy is a major determinant of its effectiveness. Artificial intelligence (AI) has the potential to enhance quality monitoring and improve endoscopy outcomes. This article reviews the current literature on AI algorithms that have been developed for endoscopy quality assessment.
Collapse
Affiliation(s)
- Soban Maan
- Division of Gastroenterology & Hepatology, Department of Medicine, West Virginia University, Morgantown, WV, USA
| | - Rohit Agrawal
- Division of Gastroenterology & Hepatology, Department of Medicine, West Virginia University, Morgantown, WV, USA
| | - Shailendra Singh
- Division of Gastroenterology & Hepatology, Department of Medicine, West Virginia University, Morgantown, WV, USA
| | - Shyam Thakkar
- Division of Gastroenterology & Hepatology, Department of Medicine, West Virginia University, Morgantown, WV, USA.
| |
Collapse
|
4
|
Shi JY, Yue SJ, Chen HS, Fang FY, Wang XL, Xue JJ, Zhao Y, Li Z, Sun C. Global output of clinical application research on artificial intelligence in the past decade: a scientometric study and science mapping. Syst Rev 2025; 14:62. [PMID: 40089747 PMCID: PMC11909824 DOI: 10.1186/s13643-025-02779-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2024] [Accepted: 01/27/2025] [Indexed: 03/17/2025] Open
Abstract
BACKGROUND Artificial intelligence (AI) has shown immense potential in the field of medicine, but its actual effectiveness and safety still need to be validated through clinical trials. Currently, the research themes, methodologies, and development trends of AI-related clinical trials remain unclear, and further exploration of these studies will be crucial for uncovering AI's practical application potential and promoting its broader adoption in clinical settings. OBJECTIVE To analyze the current status, hotspots, and trends of published clinical research on AI applications. METHODS Publications related to AI clinical applications were retrieved from the Web of Science database. Relevant data were extracted using VOSviewer 1.6.17 to generate visual cooperation network maps for countries, organizations, authors, and keywords. Burst citation detection for keywords and citations was performed using CiteSpace 5.8.R3 to identify sudden surges in citation frequency within a short period, and the theme evolution was analyzed using SciMAT to track the development and trends of research topics over time. RESULTS A total of 22,583 articles were obtained from the Web of Science database. Seven-hundred and thirty-five AI clinical application research were published by 1764 institutions from 53 countries. The majority of publications were contributed by the United States, China, and the UK. Active collaborations were noted among leading authors, particularly those from developed countries. The publications mainly focused on evaluating the application value of AI technology in the fields of disease diagnosis and classification, disease risk prediction and management, assisted surgery, and rehabilitation. Deep learning and chatbot technologies were identified as emerging research hotspots in recent studies on AI applications. CONCLUSIONS A total of 735 articles on AI in clinical research were analyzed, with publication volume and citation counts steadily increasing each year. Institutions and researchers from the United States contributed the most to the research output in this field. Key areas of focus included AI applications in surgery, rehabilitation, disease diagnosis, risk prediction, and health management, with emerging trends in deep learning and chatbots. This study also provides detailed and intuitive information about important articles, journals, core authors, institutions, and topics in the field through visualization maps, which will help researchers quickly understand the current status, hotspots, and trends of artificial intelligence clinical application research. Future clinical trials of artificial intelligence should strengthen scientific design, ethical compliance, and interdisciplinary and international cooperation and pay more attention to its practical clinical value and reliable application in diverse scenarios.
Collapse
Affiliation(s)
- Ji-Yuan Shi
- School of Nursing, Beijing University of Chinese Medicine, Beijing, China
- Collaborating Centre of Joanna Briggs Institute, Beijing University of Chinese Medicine, Beijing, China
| | - Shu-Jin Yue
- School of Nursing, Beijing University of Chinese Medicine, Beijing, China
| | - Hong-Shuang Chen
- Nursing Department, Chinese Academy of Medical Sciences and Peking Union Medical Hospital, Beijing, 100144, China
| | - Fei-Yu Fang
- School of Nursing, Chinese Academy of Medical Sciences and Peking Union Medical School, Beijing, China
| | - Xue-Lian Wang
- Nursing Department, Institute of Geriatric Medicine, National Center of Gerontology, Beijing Hospital, Chinese Academy of Medical Sciences, Beijing, China
| | - Jia-Jun Xue
- School of Nursing, Chinese Academy of Medical Sciences and Peking Union Medical School, Beijing, China
| | - Yang Zhao
- School of Nursing, Southern Medical University, Guangzhou, China
| | - Zheng Li
- School of Nursing, Chinese Academy of Medical Sciences and Peking Union Medical School, Beijing, China.
| | - Chao Sun
- School of Nursing, Beijing University of Chinese Medicine, Beijing, China.
- Nursing Department, Institute of Geriatric Medicine, National Center of Gerontology, Beijing Hospital, Chinese Academy of Medical Sciences, Beijing, China.
| |
Collapse
|
5
|
Jong MR, Jaspers TJM, van Eijck van Heslinga RAH, Jukema JB, Kusters CHJ, Boers TGW, Pouw RE, Duits LC, de With PHN, van der Sommen F, de Groof AJ, Bergman JJGHM. The development and ex vivo evaluation of a computer-aided quality control system for Barrett's esophagus endoscopy. Endoscopy 2025. [PMID: 39933729 DOI: 10.1055/a-2537-3510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/13/2025]
Abstract
BACKGROUND : Timely detection of neoplasia in Barrett's esophagus (BE) remains challenging. While computer-aided detection (CADe) systems have been developed to assist endoscopists, their effectiveness depends heavily on the quality of the endoscopic procedure. This study introduces a novel computer-aided quality (CAQ) system for BE, evaluating its stand-alone performance and integration with a CADe system. METHOD : The CAQ system was developed using 7,463 images from 359 BE patients. It assesses objective quality parameters (e. g., blurriness, illumination) and subjective parameters (mucosal cleanliness, esophageal expansion) and can exclude low-quality images when integrated with a CADe system.To evaluate CAQ stand-alone performance, the Endoscopic Image Quality test set, consisting of 647 images from 51 BE patients across 8 hospitals, was labeled for objective and subjective quality. To assess the benefit of the CAQ system as a preprocessing filter of a CADe system, the Barrett CADe test set was developed. It consisted of 956 video frames from 62 neoplastic patients and 557 frames from 35 non-dysplastic patients, in 12 Barrett referral centers. RESULTS : As stand-alone tool, the CAQ system achieved Cohen's Kappa scores of 0.73, 0.91, and 0.89 for objective quality, mucosal cleanliness, and esophageal expansion, comparable to inter-annotator scores of 0.73, 0.93, and 0.83. As preprocessing filter, the CAQ system improved CADe sensitivity from 82 % to 90 % and AUC from 87 % to 91 %, while maintaining specificity at 75 %. CONCLUSION : This study presents the first CAQ system for automated quality control in BE. The system effectively distinguishes poorly from well-visualized mucosa and enhances neoplasia detection when integrated with CADe.
Collapse
Affiliation(s)
- Martijn R Jong
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Tim J M Jaspers
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Rixta A H van Eijck van Heslinga
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Jelmer B Jukema
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Carolus H J Kusters
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Tim G W Boers
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Roos E Pouw
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Lucas C Duits
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Peter H N de With
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Fons van der Sommen
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Albert Jeroen de Groof
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Jacques J G H M Bergman
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
6
|
Cold KM, Vamadevan A, Heen A, Vilmann AS, Rasmussen M, Konge L, Svendsen MBS. Is the Transverse Colon Overlooked? Establishing a Comprehensive Colonoscopy Database from a Multicenter Cluster-Randomized Controlled Trial. Diagnostics (Basel) 2025; 15:591. [PMID: 40075838 PMCID: PMC11898687 DOI: 10.3390/diagnostics15050591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2024] [Revised: 02/21/2025] [Accepted: 02/25/2025] [Indexed: 03/14/2025] Open
Abstract
Background and Study Aim: Colonoscopy holds the highest volume of all endoscopic procedures, allowing for large colonoscopy databases to serve as valuable datasets for quality assurance. We aimed to build a comprehensive colonoscopy database for quality assurance and the training of future AIs. Materials and Methods: As part of a cluster-randomized controlled trial, a designated, onsite medical student was used to acquire procedural and patient-specific data, ensuring a high level of data integrity. The following data were thereby collected for all colonoscopies: full colonoscopy vides, colonoscope position (XYZ-coordinates), intraprocedural timestamps, pathological report, endoscopist description, endoscopist planning, and patient-reported discomfort. Results: A total of 1447 patients were included from the 1st of February 2022 to the 21st of November 2023; 1191 colonoscopies were registered as completed, 88 were stopped due to inadequate bowel cleansing, and 41 were stopped due to patient discomfort. Of the 1191 completed colonoscopies, 601 contained polypectomies (50.4%), and 590 did not (49.6%). Comparing colonoscopies with polypectomies to those without the withdrawal time (caecum to extubating the scope) was significantly longer for all parts of the colon (p values < 0.001), except the transverse colon (p value = 0.92). The database was used to train an AI, automatically and objectively evaluating bowel preparation. Conclusions: We established the most thorough database in colonoscopy with previously inaccessible information, indicating that the transverse colon differs from the other parts of the colon in terms of withdrawal time for procedures with polypectomies. To further explore these findings and reach the full potential of the database, an AI evaluating bowel preparation was developed. Several research partners have been identified to collaborate in the development of future AIs.
Collapse
Affiliation(s)
- Kristoffer Mazanti Cold
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
- Faculty of Health Sciences, University of Copenhagen, 2200 Copenhagen, Denmark
| | - Anishan Vamadevan
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
| | - Amihai Heen
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
| | - Andreas Slot Vilmann
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
- Department of Gastrointestinal and Hepatic Diseases, Copenhagen University Hospital—Herlev and Gentofte, 2730 Herlev, Denmark
| | - Morten Rasmussen
- Danish Colorectal Cancer Screening Database (DCCSD) Steering Committee, 8200 Aarhus, Denmark;
- Bispebjerg University Hospital, 2400 Copenhagen, Denmark
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
- Faculty of Health Sciences, University of Copenhagen, 2200 Copenhagen, Denmark
| | - Morten Bo Søndergaard Svendsen
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet, Capital Region of Denmark, 2100 Copenhagen, Denmark; (K.M.C.); (A.V.); (A.H.); (A.S.V.); (L.K.)
- Department of Computer Science, Faculty of Science, University of Copenhagen, 2200 Copenhagen, Denmark
| |
Collapse
|
7
|
Lagström RMB, Bräuner KB, Bielik J, Rosen AW, Crone JG, Gögenur I, Bulut M. Improvement in adenoma detection rate by artificial intelligence-assisted colonoscopy: Multicenter quasi-randomized controlled trial. Endosc Int Open 2025; 13:a25215169. [PMID: 40018072 PMCID: PMC11866038 DOI: 10.1055/a-2521-5169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Accepted: 01/15/2025] [Indexed: 03/01/2025] Open
Abstract
Background and study aims Adenoma detection rate (ADR) is a key performance measure with variability among endoscopists. Artificial intelligence (AI) in colonoscopy could reduce this variability and has shown to improve ADR. This study assessed the impact of AI on ADR among Danish endoscopists of varying experience levels. Patients and methods We conducted a prospective, quasi-randomized, controlled, multicenter trial involving patients aged 18 and older undergoing screening, surveillance, and diagnostic colonoscopy at four centers. Participants were assigned to AI-assisted colonoscopy (GI Genius, Medtronic) or conventional colonoscopy. Endoscopists were classified as experts (> 1000 colonoscopies) or non-experts (≤ 1000 colonoscopies). The primary outcome was ADR. We performed a subgroup analysis stratified on endoscopist experience and a subset analysis of the screening population. Results A total of 795 patients were analyzed: 400 in the AI group and 395 in the control group. The AI group demonstrated a significantly higher ADR than the control group (59.1% vs. 46.6%, P < 0.001). The increase was significant among experts (59.9% vs. 47.3%, P < 0.002) but not among non-experts. AI assistance significantly improved ADR (74.4% vs. 58.1%, P = 0.003) in screening colonoscopies. Polyp detection rate (PDR) was also higher in the AI group (69.8% vs. 56.2%, P < 0.001). There was no significant difference in the non-neoplastic resection rate (NNRR) (15.1% vs. 17.1%, P = 0.542). Conclusions AI-assisted colonoscopy significantly increased ADR by 12.5% overall, with a notable 16.3% increase in the screening population. The unchanged NNRR indicates that the higher PDR was due to increased ADR, not unnecessary resections.
Collapse
Affiliation(s)
| | - Karoline Bendix Bräuner
- Department of Surgery, Zealand University Hospital Koge, Køge, Denmark
- Department of Surgery, Slagelse Hospital, Slagelse, Denmark
| | - Julia Bielik
- Department of Surgery, Holbæk Sygehus, Holbæk, Denmark
| | | | | | - Ismail Gögenur
- Department of Surgery, Zealand University Hospital Koge, Køge, Denmark
- Department of Clinical Medicine, University of Copenhagen Faculty of Health and Medical Sciences, Copenhagen, Denmark
| | - Mustafa Bulut
- Department of Surgery, Zealand University Hospital Koge, Køge, Denmark
- Department of Clinical Medicine, University of Copenhagen Faculty of Health and Medical Sciences, Copenhagen, Denmark
- Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Denmark
| |
Collapse
|
8
|
Al Sulais E, AlAmeel T, Alenzi M, Shehab M, AlMutairdi A, Al-Bawardy B. Colorectal Neoplasia in Inflammatory Bowel Disease. Cancers (Basel) 2025; 17:665. [PMID: 40002259 PMCID: PMC11853504 DOI: 10.3390/cancers17040665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2025] [Revised: 02/10/2025] [Accepted: 02/13/2025] [Indexed: 02/27/2025] Open
Abstract
Patients with inflammatory bowel disease (IBD), including ulcerative colitis and colonic Crohn's disease, are at an increased risk of developing colonic dysplasia and neoplasia. Multiple risk factors have been identified that increase the risk of colonic neoplasia in IBD, including but not limited to underlying disease extent, severity, duration, and concomitant primary sclerosing cholangitis. The overall risk of colonic neoplasia in IBD is decreasing but surveillance is still warranted in patients with high-risk features. In this review, we will discuss the epidemiology, pathogenesis, risk factors, approach to surveillance, and management of colonic neoplasia in IBD.
Collapse
Affiliation(s)
- Eman Al Sulais
- Department of Medicine, King Fahad Specialist Hospital, Dammam 32253, Saudi Arabia; (E.A.S.)
| | - Turki AlAmeel
- Department of Medicine, King Fahad Specialist Hospital, Dammam 32253, Saudi Arabia; (E.A.S.)
| | - Maram Alenzi
- Department of Medicine, Division of Gastroenterology, Hepatology and Nutrition, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA 02215, USA
| | - Mohammad Shehab
- Division of Gastroenterology, Department of Internal Medicine, Mubarak Alkabeer University Hospital, Kuwait University, Aljabreyah 47060, Kuwait
| | - Abdulelah AlMutairdi
- Department of Internal Medicine, Division of Gastroenterology and Hepatology, King Faisal Specialist Hospital and Research Center, Riyadh 11121, Saudi Arabia
- College of Medicine, Alfaisal University, Riyadh 11533, Saudi Arabia
| | - Badr Al-Bawardy
- Department of Internal Medicine, Division of Gastroenterology and Hepatology, King Faisal Specialist Hospital and Research Center, Riyadh 11121, Saudi Arabia
- College of Medicine, Alfaisal University, Riyadh 11533, Saudi Arabia
- Department of Internal Medicine, Section of Digestive Diseases, Yale School of Medicine, New Haven, CT 06510, USA
| |
Collapse
|
9
|
Spadaccini M, Hassan C, Mori Y, Massimi D, Correale L, Facciorusso A, Patel HK, Rizkala T, Khalaf K, Ramai D, Rondonotti E, Maselli R, Rex DK, Bhandari P, Sharma P, Repici A. Variability in computer-aided detection effect on adenoma detection rate in randomized controlled trials: A meta-regression analysis. Dig Liver Dis 2025:S1590-8658(25)00205-1. [PMID: 39924430 DOI: 10.1016/j.dld.2025.01.192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Revised: 12/16/2024] [Accepted: 01/21/2025] [Indexed: 02/11/2025]
Abstract
BACKGROUND Computer-aided detection (CADe) systems may increase adenoma detection rate (ADR) during colonoscopy. However, the variable results of CADe effects in different RCTs warrant investigation into factors influencing these results. AIMS Investigate the different variables possibly affecting the impact of CADe-assisted colonoscopy and its effect on ADR. METHODS We searched MEDLINE, EMBASE, and Scopus databases until July 2023 for RCTs reporting performance of CADe systems in the detection of colorectal neoplasia. The main outcome was pooled ADR. A random-effects meta-analysis was performed to obtain the pooled risk ratios (RR) with 95 % confidence intervals (CI)). To explore sources of heterogeneity, we conducted a meta-regression analysis using both univariable and multivariable mixed-effects models. Potential explanatory variables included factors influencing adenoma prevalence, such as patient gender, age, and colonoscopy indication. We also included both key (ADR), and minor (Withdrawal time) performance measures considered as quality indicators for colonoscopy. RESULTS Twenty-three randomized controlled trials (RCTs) on 19,077 patients were include. ADR was higher in the CADe group (46 % [95 % CI 39-52]) than in the standard colonoscopy group (38 % [95 % CI 31-46]) with a risk ratio of 1.22 [95 % CI 1.14-1.29]); and a substantial level of heterogeneity (I2 = 67.69 %). In the univariable meta-regression analysis, patient age, ADR in control arms, and withdrawal time were the strongest predictors of CADe effect on ADR (P < .001). In multivariable meta-regression, ADR in control arms, and withdrawal time were simultaneous significant predictors of the proportion of the CADe effect on ADR. CONCLUSION The substantial level of heterogeneity found appeared to be associated with variability in colonoscopy quality performances across the studies, namely ADR in control arm, and withdrawal time.
Collapse
Affiliation(s)
- Marco Spadaccini
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy.
| | - Cesare Hassan
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy
| | - Yuichi Mori
- University of Oslo, Clinical Effectiveness Research Group, Oslo, Norway; Showa University Northern Yokohama Hospital, Digestive Disease Center, Yokohama, Japan
| | - Davide Massimi
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy
| | - Loredana Correale
- Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy
| | - Antonio Facciorusso
- University of Oslo, Clinical Effectiveness Research Group, Oslo, Norway; University of Salento, Gastroenterology Unit, Department of Experimental Medicine, Lecce, Italy
| | - Harsh K Patel
- Kansas City VA Medical Center, Gastroenterology and Hepatology, Kansas City, United States
| | - Tommy Rizkala
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy
| | - Kareem Khalaf
- St. Michael's Hospital, University of Toronto, Division of Gastroenterology, Toronto, Ontario, Canada
| | - Daryl Ramai
- University of Utah Health, Gastroenterology and Hepatology, Salt Lake City, UT, USA
| | | | - Roberta Maselli
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy
| | - Douglas K Rex
- Indiana University School of Medicine, Division of Gastroenterology, Indianapolis, Indiana, USA
| | - Pradeep Bhandari
- Queen Alexandra Hospital, Department of Gastroenterology, Portsmouth, UK
| | - Prateek Sharma
- Kansas City VA Medical Center, Gastroenterology and Hepatology, Kansas City, United States
| | - Alessandro Repici
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center -IRCCS-, Endoscopy Unit, Rozzano, Italy
| |
Collapse
|
10
|
Wang Z, Lin K, Zheng M, Gong L, Chen Z, Wu M. Accurate measurement of key structures in CBD patients using deep learning. Biomed Signal Process Control 2025; 100:106979. [DOI: 10.1016/j.bspc.2024.106979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2025]
|
11
|
Parikh M, Tejaswi S, Girotra T, Chopra S, Ramai D, Tabibian JH, Jagannath S, Ofosu A, Barakat MT, Mishra R, Girotra M. Use of Artificial Intelligence in Lower Gastrointestinal and Small Bowel Disorders: An Update Beyond Polyp Detection. J Clin Gastroenterol 2025; 59:121-128. [PMID: 39774596 DOI: 10.1097/mcg.0000000000002115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/11/2025]
Abstract
Machine learning and its specialized forms, such as Artificial Neural Networks and Convolutional Neural Networks, are increasingly being used for detecting and managing gastrointestinal conditions. Recent advancements involve using Artificial Neural Network models to enhance predictive accuracy for severe lower gastrointestinal (LGI) bleeding outcomes, including the need for surgery. To this end, artificial intelligence (AI)-guided predictive models have shown promise in improving management outcomes. While much literature focuses on AI in early neoplasia detection, this review highlights AI's role in managing LGI and small bowel disorders, including risk stratification for LGI bleeding, quality control, evaluation of inflammatory bowel disease, and video capsule endoscopy reading. Overall, the integration of AI into routine clinical practice is still developing, with ongoing research aimed at addressing current limitations and gaps in patient care.
Collapse
Affiliation(s)
| | - Sooraj Tejaswi
- University of California, Davis
- Sutter Health, Sacramento
| | | | | | | | | | | | | | | | | | | |
Collapse
|
12
|
Liu J, Zhou R, Liu C, Liu H, Cui Z, Guo Z, Zhao W, Zhong X, Zhang X, Li J, Wang S, Xing L, Zhao Y, Ma R, Ni J, Li Z, Li Y, Zuo X. Automatic Quality Control System and Adenoma Detection Rates During Routine Colonoscopy: A Randomized Clinical Trial. JAMA Netw Open 2025; 8:e2457241. [PMID: 39883463 PMCID: PMC11783196 DOI: 10.1001/jamanetworkopen.2024.57241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/17/2024] [Accepted: 11/25/2024] [Indexed: 01/31/2025] Open
Abstract
Importance High-quality colonoscopy reduces the risks of colorectal cancer by increasing the adenoma detection rate. Routine use of an automatic quality control system (AQCS) to assist in colorectal adenoma detection should be considered. Objective To evaluate the effect of an AQCS on the adenoma detection rate among colonoscopists who were moderate- and low-level detectors during routine colonoscopy. Design, Setting, and Participants This multicenter, single-blind, randomized clinical trial was conducted at 6 centers in China from August 1, 2021, to September 30, 2022. Data were analyzed from March 1 to June 30, 2023. Individuals aged 18 to 80 years were enrolled. Exclusion criteria were a history of inflammatory bowel disease, advanced colorectal cancer, and polyposis syndromes; known colorectal polyps without complete removal previously; a history of colorectal surgery; known stenosis or obstruction with contraindication for biopsy or prior failed colonoscopy; pregnancy or lactation; and refusal to participate. Intention-to-treat and per-protocol analysis was used. Interventions Standard colonoscopy or AQCS-assisted colonoscopy. Main Outcomes and Measures Adenoma detection rate. Results A total of 1254 participants (mean [SD] age, 51.21 [12.10] years; 674 [53.7%] male) were randomized (627 standard colonoscopy, 627 AQCS-assisted colonoscopy). Intention-to-treat analysis showed a significantly higher adenoma detection rate in the AQCS-assisted group vs standard colonoscopy group (32.7% vs 22.6%; relative risk [RR], 1.60; 95% CI, 1.23-2.09; P < .001). The adenoma detection rates were significantly higher in the AQCS group when considering pathology (nonadvanced adenomas, 30.1% vs 21.2%; RR, 1.52; 95% CI, 1.16-1.99; P = .002), and morphology (flat or sessile, 29.3% vs 20.4%, RR, 1.52; 95% CI, 1.16-2.00; P = .003). Use of AQCS significantly increased the adenoma detection rate of both the lower-level detectors (30.0% vs 20.0%; RR, 1.71; 95% CI, 1.24-2.35; P = .001) and the medium-level detectors (38.1% vs 27.7%; RR, 1.61; 95% CI, 1.07-2.43; P = .02). Similar increases were found for adenoma detection rates in the academic and nonacademic centers (academic: 29.3% vs 20.8%; RR, 1.58; 95% CI, 1.10-2.29; P = .01; nonacademic: 36.1% vs 24.5%; RR, 1.74; 95% CI, 1.23-2.46; P = .002). The number of adenomas per colonoscopy was significantly higher in the AQCS-assisted group (0.86 vs 0.48; RR, 1.50; 95% CI, 1.17-1.91; P = .001). The mean withdrawal time without intervention was slightly increased with AQCS assistance (6.78 vs 6.46 minutes; RR, 1.38; 95% CI, 1.26-1.52; P < .001). No serious adverse events were reported. Conclusions and Relevance In this randomized clinical trial, AQCS assistance during routine colonoscopy increased adenoma detection rates and several related polyp parameters compared with standard colonoscopy in the lower- and medium-level detectors in academic and nonacademic settings. Routine use of AQCS to assist in colorectal adenoma detection and quality improvement should be considered. Trial Registration ClinicalTrials.gov Identifier: NCT04901130.
Collapse
Affiliation(s)
- Jing Liu
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Department of Gastroenterology, Qilu Hospital of Shandong University, Qingdao, Shandong, China
| | - Ruchen Zhou
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Chengxia Liu
- Department of Gastroenterology, Binzhou Medical University Hospital, Binzhou, Shandong, China
| | - Haiyan Liu
- Department of Gastroenterology, Binzhou Medical University Hospital, Binzhou, Shandong, China
- Department of Gastroenterology, The First School of Clinical Medicine of Binzhou Medical University, Binzhou, Shandong, China
| | - Zhenqin Cui
- Department of Gastroenterology, Central Hospital of Shengli Oilfield, Dongying, Shandong, China
| | - Zhuang Guo
- Department of Gastroenterology, Central Hospital of Shengli Oilfield, Dongying, Shandong, China
| | - Weidong Zhao
- Department of Gastroenterology, Zibo Municipal Hospital, Zibo, Shandong, China
| | - Xiaoqin Zhong
- Department of Gastroenterology, Zibo Municipal Hospital, Zibo, Shandong, China
| | - Xiaodong Zhang
- Department of Gastroenterology, Linyi People’s Hospital, Dezhou, Shandong, China
| | - Jing Li
- Department of Gastroenterology, Linyi People’s Hospital, Dezhou, Shandong, China
| | - Shihuan Wang
- Department of Gastroenterology, The People’s Hospital of Zhaoyuan City, Yantai, Shandong, China
| | - Li Xing
- Department of Gastroenterology, The People’s Hospital of Zhaoyuan City, Yantai, Shandong, China
| | - Yusha Zhao
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Ruiguang Ma
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Jiekun Ni
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Zhen Li
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Yanqing Li
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
| | - Xiuli Zuo
- Department of Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Shandong Provincial Clinical Research Center for Digestive Disease, Jinan, Shandong, China
- Laboratory of Translational Gastroenterology, Qilu Hospital of Shandong University, Jinan, Shandong, China
- Department of Gastroenterology, Qilu Hospital of Shandong University, Qingdao, Shandong, China
| |
Collapse
|
13
|
Park JB, Bae JH. Effectiveness of a novel artificial intelligence-assisted colonoscopy system for adenoma detection: a prospective, propensity score-matched, non-randomized controlled study in Korea. Clin Endosc 2025; 58:112-120. [PMID: 39107138 PMCID: PMC11837574 DOI: 10.5946/ce.2024.168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 07/18/2024] [Accepted: 07/21/2024] [Indexed: 08/09/2024] Open
Abstract
BACKGROUND/AIMS The real-world effectiveness of computer-aided detection (CADe) systems during colonoscopies remains uncertain. We assessed the effectiveness of the novel CADe system, ENdoscopy as AI-powered Device (ENAD), in enhancing the adenoma detection rate (ADR) and other quality indicators in real-world clinical practice. METHODS We enrolled patients who underwent elective colonoscopies between May 2022 and October 2022 at a tertiary healthcare center. Standard colonoscopy (SC) was compared to ENAD-assisted colonoscopy. Eight experienced endoscopists performed the procedures in randomly assigned CADe- and non-CADe-assisted rooms. The primary outcome was a comparison of ADR between the ENAD and SC groups. RESULTS A total of 1,758 sex- and age-matched patients were included and evenly distributed into two groups. The ENAD group had a significantly higher ADR (45.1% vs. 38.8%, p=0.010), higher sessile serrated lesion detection rate (SSLDR) (5.7% vs. 2.5%, p=0.001), higher mean number of adenomas per colonoscopy (APC) (0.78±1.17 vs. 0.61±0.99; incidence risk ratio, 1.27; 95% confidence interval, 1.13-1.42), and longer withdrawal time (9.0±3.4 vs. 8.3±3.1, p<0.001) than the SC group. However, the mean withdrawal times were not significantly different between the two groups in cases where no polyps were detected (6.9±1.7 vs. 6.7±1.7, p=0.058). CONCLUSIONS ENAD-assisted colonoscopy significantly improved the ADR, APC, and SSLDR in real-world clinical practice, particularly for smaller and nonpolypoid adenomas.
Collapse
Affiliation(s)
- Jung-Bin Park
- Department of Gastroenterology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| |
Collapse
|
14
|
Wilhelm C, Steckelberg A, Rebitschek FG. Benefits and harms associated with the use of AI-related algorithmic decision-making systems by healthcare professionals: a systematic review. THE LANCET REGIONAL HEALTH. EUROPE 2025; 48:101145. [PMID: 39687669 PMCID: PMC11648885 DOI: 10.1016/j.lanepe.2024.101145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2024] [Revised: 11/06/2024] [Accepted: 11/08/2024] [Indexed: 12/18/2024]
Abstract
Background Despite notable advancements in artificial intelligence (AI) that enable complex systems to perform certain tasks more accurately than medical experts, the impact on patient-relevant outcomes remains uncertain. To address this gap, this systematic review assesses the benefits and harms associated with AI-related algorithmic decision-making (ADM) systems used by healthcare professionals, compared to standard care. Methods In accordance with the PRISMA guidelines, we included interventional and observational studies published as peer-reviewed full-text articles that met the following criteria: human patients; interventions involving algorithmic decision-making systems, developed with and/or utilizing machine learning (ML); and outcomes describing patient-relevant benefits and harms that directly affect health and quality of life, such as mortality and morbidity. Studies that did not undergo preregistration, lacked a standard-of-care control, or pertained to systems that assist in the execution of actions (e.g., in robotics) were excluded. We searched MEDLINE, EMBASE, IEEE Xplore, and Google Scholar for studies published in the past decade up to 31 March 2024. We assessed risk of bias using Cochrane's RoB 2 and ROBINS-I tools, and reporting transparency with CONSORT-AI and TRIPOD-AI. Two researchers independently managed the processes and resolved conflicts through discussion. This review has been registered with PROSPERO (CRD42023412156) and the study protocol has been published. Findings Out of 2,582 records identified after deduplication, 18 randomized controlled trials (RCTs) and one cohort study met the inclusion criteria, covering specialties such as psychiatry, oncology, and internal medicine. Collectively, the studies included a median of 243 patients (IQR 124-828), with a median of 50.5% female participants (range 12.5-79.0, IQR 43.6-53.6) across intervention and control groups. Four studies were classified as having low risk of bias, seven showed some concerns, and another seven were assessed as having high or serious risk of bias. Reporting transparency varied considerably: six studies showed high compliance, four moderate, and five low compliance with CONSORT-AI or TRIPOD-AI. Twelve studies (63%) reported patient-relevant benefits. Of those with low risk of bias, interventions reduced length of stay in hospital and intensive care unit (10.3 vs. 13.0 days, p = 0.042; 6.3 vs. 8.4 days, p = 0.030), in-hospital mortality (9.0% vs. 21.3%, p = 0.018), and depression symptoms in non-complex cases (45.1% vs. 52.3%, p = 0.03). However, harms were frequently underreported, with only eight studies (42%) documenting adverse events. No study reported an increase in adverse events as a result of the interventions. Interpretation The current evidence on AI-related ADM systems provides limited insights into patient-relevant outcomes. Our findings underscore the essential need for rigorous evaluations of clinical benefits, reinforced compliance with methodological standards, and balanced consideration of both benefits and harms to ensure meaningful integration into healthcare practice. Funding This study did not receive any funding.
Collapse
Affiliation(s)
- Christoph Wilhelm
- International Graduate Academy (InGrA), Institute of Health and Nursing Science, Medical Faculty, Martin Luther University Halle-Wittenberg, Magdeburger Str. 8, Halle (Saale) 06112, Germany
- Harding Center for Risk Literacy, Faculty of Health Sciences Brandenburg, University of Potsdam, Virchowstr. 2, Potsdam 14482, Germany
| | - Anke Steckelberg
- Institute of Health and Nursing Science, Medical Faculty, Martin Luther University Halle-Wittenberg, Magdeburger Str. 8, Halle (Saale) 06112, Germany
| | - Felix G. Rebitschek
- Harding Center for Risk Literacy, Faculty of Health Sciences Brandenburg, University of Potsdam, Virchowstr. 2, Potsdam 14482, Germany
- Max Planck Institute for Human Development, Lentzeallee 94, Berlin 14195, Germany
| |
Collapse
|
15
|
Parasa S, Berzin T, Leggett C, Gross S, Repici A, Ahmad OF, Chiang A, Coelho-Prabhu N, Cohen J, Dekker E, Keswani RN, Kahn CE, Hassan C, Petrick N, Mountney P, Ng J, Riegler M, Mori Y, Saito Y, Thakkar S, Waxman I, Wallace MB, Sharma P. Consensus statements on the current landscape of artificial intelligence applications in endoscopy, addressing roadblocks, and advancing artificial intelligence in gastroenterology. Gastrointest Endosc 2025; 101:2-9.e1. [PMID: 38639679 DOI: 10.1016/j.gie.2023.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Accepted: 12/02/2023] [Indexed: 04/20/2024]
Abstract
BACKGROUND AND AIMS The American Society for Gastrointestinal Endoscopy (ASGE) AI Task Force along with experts in endoscopy, technology space, regulatory authorities, and other medical subspecialties initiated a consensus process that analyzed the current literature, highlighted potential areas, and outlined the necessary research in artificial intelligence (AI) to allow a clearer understanding of AI as it pertains to endoscopy currently. METHODS A modified Delphi process was used to develop these consensus statements. RESULTS Statement 1: Current advances in AI allow for the development of AI-based algorithms that can be applied to endoscopy to augment endoscopist performance in detection and characterization of endoscopic lesions. Statement 2: Computer vision-based algorithms provide opportunities to redefine quality metrics in endoscopy using AI, which can be standardized and can reduce subjectivity in reporting quality metrics. Natural language processing-based algorithms can help with the data abstraction needed for reporting current quality metrics in GI endoscopy effortlessly. Statement 3: AI technologies can support smart endoscopy suites, which may help optimize workflows in the endoscopy suite, including automated documentation. Statement 4: Using AI and machine learning helps in predictive modeling, diagnosis, and prognostication. High-quality data with multidimensionality are needed for risk prediction, prognostication of specific clinical conditions, and their outcomes when using machine learning methods. Statement 5: Big data and cloud-based tools can help advance clinical research in gastroenterology. Multimodal data are key to understanding the maximal extent of the disease state and unlocking treatment options. Statement 6: Understanding how to evaluate AI algorithms in the gastroenterology literature and clinical trials is important for gastroenterologists, trainees, and researchers, and hence education efforts by GI societies are needed. Statement 7: Several challenges regarding integrating AI solutions into the clinical practice of endoscopy exist, including understanding the role of human-AI interaction. Transparency, interpretability, and explainability of AI algorithms play a key role in their clinical adoption in GI endoscopy. Developing appropriate AI governance, data procurement, and tools needed for the AI lifecycle are critical for the successful implementation of AI into clinical practice. Statement 8: For payment of AI in endoscopy, a thorough evaluation of the potential value proposition for AI systems may help guide purchasing decisions in endoscopy. Reliable cost-effectiveness studies to guide reimbursement are needed. Statement 9: Relevant clinical outcomes and performance metrics for AI in gastroenterology are currently not well defined. To improve the quality and interpretability of research in the field, steps need to be taken to define these evidence standards. Statement 10: A balanced view of AI technologies and active collaboration between the medical technology industry, computer scientists, gastroenterologists, and researchers are critical for the meaningful advancement of AI in gastroenterology. CONCLUSIONS The consensus process led by the ASGE AI Task Force and experts from various disciplines has shed light on the potential of AI in endoscopy and gastroenterology. AI-based algorithms have shown promise in augmenting endoscopist performance, redefining quality metrics, optimizing workflows, and aiding in predictive modeling and diagnosis. However, challenges remain in evaluating AI algorithms, ensuring transparency and interpretability, addressing governance and data procurement, determining payment models, defining relevant clinical outcomes, and fostering collaboration between stakeholders. Addressing these challenges while maintaining a balanced perspective is crucial for the meaningful advancement of AI in gastroenterology.
Collapse
Affiliation(s)
| | | | | | - Seth Gross
- NYU Langone Health, New York, New York, USA
| | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4 20072 Pieve Emanuele, Milan, Italy; IRCCS Humanitas Research Hospital, via Manzoni 56 20089 Rozzano, Milan, Italy
| | | | - Austin Chiang
- Medtronic Gastrointestinal, Santa Clara, California, USA
| | | | | | | | | | - Charles E Kahn
- University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4 20072 Pieve Emanuele, Milan, Italy; IRCCS Humanitas Research Hospital, via Manzoni 56 20089 Rozzano, Milan, Italy
| | - Nicholas Petrick
- Center for Devices and Radiological Health, U.S. Food and Drug Administration
| | | | - Jonathan Ng
- Iterative Health, Boston, Massachusetts, USA
| | | | | | | | - Shyam Thakkar
- West Virginia University Medicine, Morgantown, West Virginia, USA
| | - Irving Waxman
- Rush University Medical Center, Chicago, Illinois, USA
| | | | | |
Collapse
|
16
|
Wang YP, Jheng YC, Hou MC, Lu CL. The optimal labelling method for artificial intelligence-assisted polyp detection in colonoscopy. J Formos Med Assoc 2024:S0929-6646(24)00582-5. [PMID: 39730273 DOI: 10.1016/j.jfma.2024.12.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2023] [Revised: 12/12/2024] [Accepted: 12/16/2024] [Indexed: 12/29/2024] Open
Abstract
BACKGROUND The methodology in colon polyp labeling in establishing database for ma-chine learning is not well-described and standardized. We aimed to find out the best annotation method to generate the most accurate model in polyp detection. METHODS 3542 colonoscopy polyp images were obtained from endoscopy database of a tertiary medical center. Two experienced endoscopists manually annotated the polyp with (1) exact outline segmentation and (2) using a standard rectangle box close to the polyp margin, and extending 10%, 20%, 30%, 40% and 50% longer in both width and length of the standard rectangle for AI modeling setup. The images were randomly divided into training and validation sets in 4:1 ratio. U-Net convolutional network architecture was used to develop automatic segmentation machine learning model. Another unrelated verification set was established to evaluate the performance of polyp detection by different segmentation methods. RESULTS Extending the bounding box to 20% of the polyp margin represented the best performance in accuracy (95.42%), sensitivity (94.84%) and F1-score (95.41%). Exact outline segmentation model showed the excellent performance in sensitivity (99.6%) and the worst precision (77.47%). The 20% model was the best among the 6 models. (confidence interval = 0.957-0.985; AUC = 0.971). CONCLUSIONS Labelling methodology affect the predictability of AI model in polyp detection. Extending the bounding box to 20% of the polyp margin would result in the best polyp detection predictive model based on AUC data. It is mandatory to establish a standardized way in colon polyp labeling for comparison of the precision of different AI models.
Collapse
Affiliation(s)
- Yen-Po Wang
- Endoscopy Center for Diagnosis and Treatment, Taipei Veterans General Hospital, Taiwan; Division of Gastroenterology, Taipei Veterans General Hospital, Taiwan; Institute of Brain Science, National Yang Ming Chiao Tung University School of Medicine, Taiwan; Faculty of Medicine, National Yang Ming Chiao Tung University School of Medicine, Taiwan
| | - Ying-Chun Jheng
- Department of Medical Research, Taipei Veterans General Hospital, Taiwan; Big Data Center, Taipei Veterans General Hospital, Taiwan
| | - Ming-Chih Hou
- Endoscopy Center for Diagnosis and Treatment, Taipei Veterans General Hospital, Taiwan; Division of Gastroenterology, Taipei Veterans General Hospital, Taiwan; Faculty of Medicine, National Yang Ming Chiao Tung University School of Medicine, Taiwan
| | - Ching-Liang Lu
- Endoscopy Center for Diagnosis and Treatment, Taipei Veterans General Hospital, Taiwan; Division of Gastroenterology, Taipei Veterans General Hospital, Taiwan; Institute of Brain Science, National Yang Ming Chiao Tung University School of Medicine, Taiwan.
| |
Collapse
|
17
|
Misawa M, Kudo SE. Current Status of Artificial Intelligence Use in Colonoscopy. Digestion 2024; 106:138-145. [PMID: 39724867 DOI: 10.1159/000543345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2024] [Accepted: 12/24/2024] [Indexed: 12/28/2024]
Abstract
BACKGROUND Artificial intelligence (AI) has significantly impacted medical imaging, particularly in gastrointestinal endoscopy. Computer-aided detection and diagnosis systems (CADe and CADx) are thought to enhance the quality of colonoscopy procedures. SUMMARY Colonoscopy is essential for colorectal cancer screening but often misses a significant percentage of adenomas. AI-assisted systems employing deep learning offer improved detection and differentiation of colorectal polyps, potentially increasing adenoma detection rates by 8%-10%. The main benefit of CADe is in detecting small adenomas, whereas it has a limited impact on advanced neoplasm detection. Recent advancements include real-time CADe systems and CADx for histopathological predictions, aiding in the differentiation of neoplastic and nonneoplastic lesions. Biases such as the Hawthorne effect and potential overdiagnosis necessitate large-scale clinical trials to validate the long-term benefits of AI. Additionally, novel concepts such as computer-aided quality improvement systems are emerging to address limitations facing current CADe systems. KEY MESSAGES Despite the potential of AI for enhancing colonoscopy outcomes, its effectiveness in reducing colorectal cancer incidence and mortality remains unproven. Further prospective studies are essential to establish the overall utility and clinical benefits of AI in colonoscopy.
Collapse
Affiliation(s)
- Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Tsuzuki, Yokohama, Japan
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Tsuzuki, Yokohama, Japan
| |
Collapse
|
18
|
Lee H, Chung JW, Kim KO, Kwon KA, Kim JH, Yun SC, Jung SW, Sheeraz A, Yoon YJ, Kim JH, Kayasseh MA. Validation of Artificial Intelligence Computer-Aided Detection of Colonic Neoplasm in Colonoscopy. Diagnostics (Basel) 2024; 14:2762. [PMID: 39682670 DOI: 10.3390/diagnostics14232762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Revised: 12/02/2024] [Accepted: 12/04/2024] [Indexed: 12/18/2024] Open
Abstract
BACKGROUND/OBJECTIVES Controlling colonoscopic quality is important in the detection of colon polyps during colonoscopy as it reduces the overall long-term colorectal cancer risk. Artificial intelligence has recently been introduced in various medical fields. In this study, we aimed to validate a previously developed artificial intelligence (AI) computer-aided detection (CADe) algorithm called ALPHAON® and compare outcomes with previous studies that showed that AI outperformed and assisted endoscopists of diverse levels of expertise in detecting colon polyps. METHODS We used the retrospective data of 500 still images, including 100 polyp images and 400 healthy colon images. In addition, we validated the CADe algorithm and compared its diagnostic performance with that of two expert endoscopists and six trainees from Gachon University Gil Medical Center. After a washing-out period of over 2 weeks, endoscopists performed polyp detection on the same dataset with the assistance of ALPHAON®. RESULTS The CADe algorithm presented a high capability in detecting colon polyps, with an accuracy of 0.97 (95% CI: 0.96 to 0.99), sensitivity of 0.91 (95% CI: 0.85 to 0.97), specificity of 0.99 (95% CI: 0.97 to 0.99), and AUC of 0.967. When evaluating and comparing the polyp detection ability of ALPHAON® with that of endoscopists with different levels of expertise (regarding years of endoscopic experience), it was found that ALPHAON® outperformed the experts in accuracy (0.97, 95% CI: 0.96 to 0.99), sensitivity (0.91, 95% CI: 0.85 to 0.97), and specificity (0.99, 95% CI: 0.97 to 0.99). After a washing-out period of over 2 weeks, the overall capability significantly improved for both experts and trainees with the assistance of ALPHAON®. CONCLUSIONS The high performance of the CADe algorithm system in colon polyp detection during colonoscopy was verified. The sensitivity of ALPHAON® led to it outperforming the experts, and it demonstrated the ability to enhance the polyp detection ability of both experts and trainees, which suggests a significant possibility of ALPHAON® being able to provide endoscopic assistance.
Collapse
Affiliation(s)
- Hannah Lee
- Division of Gastroenterology, Department of Internal Medicine, Gachon University Gil Medical Center, Incheon 21565, Republic of Korea
| | - Jun-Won Chung
- Division of Gastroenterology, Department of Internal Medicine, Gachon University Gil Medical Center, Incheon 21565, Republic of Korea
| | - Kyoung Oh Kim
- Division of Gastroenterology, Department of Internal Medicine, Gachon University Gil Medical Center, Incheon 21565, Republic of Korea
| | - Kwang An Kwon
- Division of Gastroenterology, Department of Internal Medicine, Gachon University Gil Medical Center, Incheon 21565, Republic of Korea
| | - Jung Ho Kim
- Division of Gastroenterology, Department of Internal Medicine, Gachon University Gil Medical Center, Incheon 21565, Republic of Korea
| | - Sung-Cheol Yun
- Division of Biostatistics, Center for Medical Research and Information, University of Ulsan College of Medicine, Seoul 05505, Republic of Korea
| | - Sung Woo Jung
- Division of Gastroenterology, Department of Internal Medicine, Korea University College of Medicine, Ansan 15355, Republic of Korea
| | | | | | - Ji Hee Kim
- CAIMI Co., Ltd., Incheon 22004, Republic of Korea
| | - Mohd Azzam Kayasseh
- Division of Gastroenterology, Dr. Sulaiman AI Habib Medical Group, Dubai Healthcare City, Dubai 51431, United Arab Emirates
| |
Collapse
|
19
|
Labaki C, Uche-Anya EN, Berzin TM. Artificial Intelligence in Gastrointestinal Endoscopy. Gastroenterol Clin North Am 2024; 53:773-786. [PMID: 39489586 DOI: 10.1016/j.gtc.2024.08.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2024]
Abstract
Recent advancements in artificial intelligence (AI) have significantly impacted the field of gastrointestinal (GI) endoscopy, with applications spanning a wide range of clinical indications. The central goals for AI in GI endoscopy are to improve endoscopic procedural performance and quality assessment, optimize patient outcomes, and reduce administrative burden. Despite early progress, such as Food and Drug Administration approval of the first computer-aided polyp detection system in 2021, there are numerous important challenges to be faced on the path toward broader adoption of AI algorithms in clinical endoscopic practice.
Collapse
Affiliation(s)
- Chris Labaki
- Department of Internal Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, 300 Brookline Avenue, Boston, MA, USA
| | - Eugenia N Uche-Anya
- Division of Gastroenterology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA, USA
| | - Tyler M Berzin
- Center for Advanced Endoscopy, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Avenue, Boston, MA, USA.
| |
Collapse
|
20
|
Soleymanjahi S, Huebner J, Elmansy L, Rajashekar N, Lüdtke N, Paracha R, Thompson R, Grimshaw AA, Foroutan F, Sultan S, Shung DL. Artificial Intelligence-Assisted Colonoscopy for Polyp Detection : A Systematic Review and Meta-analysis. Ann Intern Med 2024; 177:1652-1663. [PMID: 39531400 DOI: 10.7326/annals-24-00981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Randomized clinical trials (RCTs) of computer-aided detection (CADe) system-enhanced colonoscopy compared with conventional colonoscopy suggest increased adenoma detection rate (ADR) and decreased adenoma miss rate (AMR), but the effect on detection of advanced colorectal neoplasia (ACN) is unclear. PURPOSE To conduct a systematic review to compare performance of CADe-enhanced and conventional colonoscopy. DATA SOURCES Cochrane Library, Google Scholar, Ovid EMBASE, Ovid MEDLINE, PubMed, Scopus, and Web of Science Core Collection databases were searched through February 2024. STUDY SELECTION Published RCTs comparing CADe-enhanced and conventional colonoscopy. DATA EXTRACTION Average adenoma per colonoscopy (APC) and ACN per colonoscopy were primary outcomes. Adenoma detection rate, AMR, and ACN detection rate (ACN DR) were secondary outcomes. Balancing outcomes included withdrawal time and resection of nonneoplastic polyps (NNPs). Subgroup analyses were done by neural network architecture. DATA SYNTHESIS Forty-four RCTs with 36 201 cases were included. Computer-aided detection-enhanced colonoscopies have higher average APC (12 090 of 12 279 [0.98] vs. 9690 of 12 292 [0.78], incidence rate difference [IRD] = 0.22 [95% CI, 0.16 to 0.28]) and higher ADR (7098 of 16 253 [44.7%] vs. 5825 of 15 855 [36.7%], rate ratio [RR] = 1.21 [CI, 1.15 to 1.28]). Average ACN per colonoscopy was similar (1512 of 9296 [0.16] vs. 1392 of 9121 [0.15], IRD = 0.01 [CI, -0.01 to 0.02]), but ACN DR was higher with CADe system use (1260 of 9899 [12.7%] vs. 1119 of 9746 [11.5%], RR = 1.16 [CI, 1.02 to 1.32]). Using CADe systems resulted in resection of almost 2 extra NNPs per 10 colonoscopies and longer total withdrawal time (0.53 minutes [CI, 0.30 to 0.77]). LIMITATION Statistically significant heterogeneity in quality and sample size and inability to blind endoscopists to the intervention in included studies may affect the performance estimates. CONCLUSION Computer-aided detection-enhanced colonoscopies have increased APC and detection rate but no difference in ACN per colonoscopy and a small increase in ACN DR. There is minimal increase in procedure time and no difference in performance across neural network architectures. PRIMARY FUNDING SOURCE None. (PROSPERO: CRD42023422835).
Collapse
Affiliation(s)
- Saeed Soleymanjahi
- Division of Gastroenterology, Mass General Brigham, Harvard School of Medicine, Boston, Massachusetts (S.Soleymanjahi)
| | - Jack Huebner
- Department of Medicine, Yale School of Medicine, New Haven, Connecticut (J.H., L.E., N.R., R.P., R.T.)
| | - Lina Elmansy
- Department of Medicine, Yale School of Medicine, New Haven, Connecticut (J.H., L.E., N.R., R.P., R.T.)
| | - Niroop Rajashekar
- Department of Medicine, Yale School of Medicine, New Haven, Connecticut (J.H., L.E., N.R., R.P., R.T.)
| | - Nando Lüdtke
- Section of Digestive Diseases, Department of Medicine, Yale School of Medicine, New Haven, Connecticut (N.L.)
| | - Rumzah Paracha
- Department of Medicine, Yale School of Medicine, New Haven, Connecticut (J.H., L.E., N.R., R.P., R.T.)
| | - Rachel Thompson
- Department of Medicine, Yale School of Medicine, New Haven, Connecticut (J.H., L.E., N.R., R.P., R.T.)
| | - Alyssa A Grimshaw
- Cushing/Whitney Medical Library, Yale University, New Haven, Connecticut (A.A.G.)
| | | | - Shahnaz Sultan
- Division of Gastroenterology, Hepatology and Nutrition, University of Minnesota, Minneapolis, Minnesota (S.Sultan)
| | - Dennis L Shung
- Section of Digestive Diseases, Clinical and Translational Research Accelerator, and Department of Biomedical Informatics and Data Science, Department of Medicine, Yale School of Medicine, New Haven, Connecticut (D.L.S.)
| |
Collapse
|
21
|
Sinonquel P, Eelbode T, Pech O, De Wulf D, Dewint P, Neumann H, Antonelli G, Iacopini F, Tate D, Lemmers A, Pilonis ND, Kaminski MF, Roelandt P, Hassan C, Ingrid D, Maes F, Bisschops R. Clinical consequences of computer-aided colorectal polyp detection. Gut 2024; 73:1974-1983. [PMID: 38876773 DOI: 10.1136/gutjnl-2024-331943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 06/02/2024] [Indexed: 06/16/2024]
Abstract
BACKGROUND AND AIM Randomised trials show improved polyp detection with computer-aided detection (CADe), mostly of small lesions. However, operator and selection bias may affect CADe's true benefit. Clinical outcomes of increased detection have not yet been fully elucidated. METHODS In this multicentre trial, CADe combining convolutional and recurrent neural networks was used for polyp detection. Blinded endoscopists were monitored in real time by a second observer with CADe access. CADe detections prompted reinspection. Adenoma detection rates (ADR) and polyp detection rates were measured prestudy and poststudy. Histological assessments were done by independent histopathologists. The primary outcome compared polyp detection between endoscopists and CADe. RESULTS In 946 patients (51.9% male, mean age 64), a total of 2141 polyps were identified, including 989 adenomas. CADe was not superior to human polyp detection (sensitivity 94.6% vs 96.0%) but outperformed them when restricted to adenomas. Unblinding led to an additional yield of 86 true positive polyp detections (1.1% ADR increase per patient; 73.8% were <5 mm). CADe also increased non-neoplastic polyp detection by an absolute value of 4.9% of the cases (1.8% increase of entire polyp load). Procedure time increased with 6.6±6.5 min (+42.6%). In 22/946 patients, the additional detection of adenomas changed surveillance intervals (2.3%), mostly by increasing the number of small adenomas beyond the cut-off. CONCLUSION Even if CADe appears to be slightly more sensitive than human endoscopists, the additional gain in ADR was minimal and follow-up intervals rarely changed. Additional inspection of non-neoplastic lesions was increased, adding to the inspection and/or polypectomy workload.
Collapse
Affiliation(s)
- Pieter Sinonquel
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Tom Eelbode
- Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Oliver Pech
- Gastroenterology and Hepatology, Krankenhaus Barmherzige Bruder Regensburg, Regensburg, Germany
| | - Dominiek De Wulf
- Gastroenterology and Hepatology, AZ Delta vzw, Roeselare, Belgium
| | - Pieter Dewint
- Gastroenterology and Hepatology, AZ Maria Middelares vzw, Gent, Belgium
| | - Helmut Neumann
- Gastroenterology and Hepatology, Gastrozentrum Lippe, Bad Salzuflen, Germany
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale Nuovo Regina Margherita, Roma, Italy
| | - Federico Iacopini
- Gastroenterology and Digestive endoscopy, Ospedale dei Castelli, Ariccia, Italy
| | - David Tate
- Gastroenterology and Hepatology, UZ Gent, Gent, Belgium
| | - Arnaud Lemmers
- Gastroenterology and Hepatology, ULB Erasme, Bruxelles, Belgium
| | | | - Michal Filip Kaminski
- Department of Gastroenterology, Hepatology and Oncology, Medical Centre fo Postgraduate Education, Warsaw, Poland
- Department of Gastroenterological Oncology, The Maria Sklodowska-Curie Memorial Cancer Centre, Instytute of Oncology, Warsaw, Poland
| | - Philip Roelandt
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Milan, Italy
- IRCCS Humanitas Research Hospital, Milan, Italy
| | - Demedts Ingrid
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| | - Frederik Maes
- Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Raf Bisschops
- Gastroenterology and Hepatology, UZ Leuven, Leuven, Belgium
- Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven Biomedical Sciences Group, Leuven, Belgium
| |
Collapse
|
22
|
Avanzo M, Stancanello J, Pirrone G, Drigo A, Retico A. The Evolution of Artificial Intelligence in Medical Imaging: From Computer Science to Machine and Deep Learning. Cancers (Basel) 2024; 16:3702. [PMID: 39518140 PMCID: PMC11545079 DOI: 10.3390/cancers16213702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 10/26/2024] [Accepted: 10/29/2024] [Indexed: 11/16/2024] Open
Abstract
Artificial intelligence (AI), the wide spectrum of technologies aiming to give machines or computers the ability to perform human-like cognitive functions, began in the 1940s with the first abstract models of intelligent machines. Soon after, in the 1950s and 1960s, machine learning algorithms such as neural networks and decision trees ignited significant enthusiasm. More recent advancements include the refinement of learning algorithms, the development of convolutional neural networks to efficiently analyze images, and methods to synthesize new images. This renewed enthusiasm was also due to the increase in computational power with graphical processing units and the availability of large digital databases to be mined by neural networks. AI soon began to be applied in medicine, first through expert systems designed to support the clinician's decision and later with neural networks for the detection, classification, or segmentation of malignant lesions in medical images. A recent prospective clinical trial demonstrated the non-inferiority of AI alone compared with a double reading by two radiologists on screening mammography. Natural language processing, recurrent neural networks, transformers, and generative models have both improved the capabilities of making an automated reading of medical images and moved AI to new domains, including the text analysis of electronic health records, image self-labeling, and self-reporting. The availability of open-source and free libraries, as well as powerful computing resources, has greatly facilitated the adoption of deep learning by researchers and clinicians. Key concerns surrounding AI in healthcare include the need for clinical trials to demonstrate efficacy, the perception of AI tools as 'black boxes' that require greater interpretability and explainability, and ethical issues related to ensuring fairness and trustworthiness in AI systems. Thanks to its versatility and impressive results, AI is one of the most promising resources for frontier research and applications in medicine, in particular for oncological applications.
Collapse
Affiliation(s)
- Michele Avanzo
- Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy; (G.P.); (A.D.)
| | | | - Giovanni Pirrone
- Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy; (G.P.); (A.D.)
| | - Annalisa Drigo
- Medical Physics Department, Centro di Riferimento Oncologico di Aviano (CRO) IRCCS, 33081 Aviano, Italy; (G.P.); (A.D.)
| | - Alessandra Retico
- National Institute for Nuclear Physics (INFN), Pisa Division, 56127 Pisa, Italy;
| |
Collapse
|
23
|
Mota J, Almeida MJ, Martins M, Mendes F, Cardoso P, Afonso J, Ribeiro T, Ferreira J, Fonseca F, Limbert M, Lopes S, Macedo G, Castro Poças F, Mascarenhas M. Artificial Intelligence in Coloproctology: A Review of Emerging Technologies and Clinical Applications. J Clin Med 2024; 13:5842. [PMID: 39407902 PMCID: PMC11477032 DOI: 10.3390/jcm13195842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2024] [Revised: 09/21/2024] [Accepted: 09/22/2024] [Indexed: 10/20/2024] Open
Abstract
Artificial intelligence (AI) has emerged as a transformative tool across several specialties, namely gastroenterology, where it has the potential to optimize both diagnosis and treatment as well as enhance patient care. Coloproctology, due to its highly prevalent pathologies and tremendous potential to cause significant mortality and morbidity, has drawn a lot of attention regarding AI applications. In fact, its application has yielded impressive outcomes in various domains, colonoscopy being one prominent example, where it aids in the detection of polyps and early signs of colorectal cancer with high accuracy and efficiency. With a less explored path but equivalent promise, AI-powered capsule endoscopy ensures accurate and time-efficient video readings, already detecting a wide spectrum of anomalies. High-resolution anoscopy is an area that has been growing in interest in recent years, with efforts being made to integrate AI. There are other areas, such as functional studies, that are currently in the early stages, but evidence is expected to emerge soon. According to the current state of research, AI is anticipated to empower gastroenterologists in the decision-making process, paving the way for a more precise approach to diagnosing and treating patients. This review aims to provide the state-of-the-art use of AI in coloproctology while also reflecting on future directions and perspectives.
Collapse
Affiliation(s)
- Joana Mota
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Maria João Almeida
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Miguel Martins
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Francisco Mendes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Pedro Cardoso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, 4200-065 Porto, Portugal;
- DigestAID—Digestive Artificial Intelligence Development, Rua Alfredo Allen n.° 455/461, 4200-135 Porto, Portugal
| | - Filipa Fonseca
- Instituto Português de Oncologia de Lisboa Francisco Gentil (IPO Lisboa), 1099-023 Lisboa, Portugal; (F.F.); (M.L.)
| | - Manuel Limbert
- Instituto Português de Oncologia de Lisboa Francisco Gentil (IPO Lisboa), 1099-023 Lisboa, Portugal; (F.F.); (M.L.)
- Artificial Intelligence Group of the Portuguese Society of Coloproctology, 1050-117 Lisboa, Portugal;
| | - Susana Lopes
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Artificial Intelligence Group of the Portuguese Society of Coloproctology, 1050-117 Lisboa, Portugal;
- Faculty of Medicine, University of Porto, 4200-047 Porto, Portugal
| | - Guilherme Macedo
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-047 Porto, Portugal
| | - Fernando Castro Poças
- Artificial Intelligence Group of the Portuguese Society of Coloproctology, 1050-117 Lisboa, Portugal;
- Department of Gastroenterology, Santo António University Hospital, 4099-001 Porto, Portugal
- Abel Salazar Biomedical Sciences Institute (ICBAS), 4050-313 Porto, Portugal
| | - Miguel Mascarenhas
- Precision Medicine Unit, Department of Gastroenterology, São João University Hospital, 4200-427 Porto, Portugal; (J.M.); (M.J.A.); (M.M.); (F.M.); (P.C.); (J.A.); (T.R.); (S.L.); (G.M.)
- WGO Gastroenterology and Hepatology Training Center, 4200-047 Porto, Portugal
- Artificial Intelligence Group of the Portuguese Society of Coloproctology, 1050-117 Lisboa, Portugal;
- Faculty of Medicine, University of Porto, 4200-047 Porto, Portugal
| |
Collapse
|
24
|
Lee J, Cho WS, Kim BS, Yoon D, Kim J, Song JH, Yang SY, Lim SH, Chung GE, Choi JM, Han YM, Kong HJ, Lee JC, Kim S, Bae JH. Impact of User's Background Knowledge and Polyp Characteristics in Colonoscopy with Computer-Aided Detection. Gut Liver 2024; 18:857-866. [PMID: 39054913 PMCID: PMC11391145 DOI: 10.5009/gnl240068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Revised: 05/03/2024] [Accepted: 05/09/2024] [Indexed: 07/27/2024] Open
Abstract
Background/Aims We investigated how interactions between humans and computer-aided detection (CADe) systems are influenced by the user's experience and polyp characteristics. Methods We developed a CADe system using YOLOv4, trained on 16,996 polyp images from 1,914 patients and 1,800 synthesized sessile serrated lesion (SSL) images. The performance of polyp detection with CADe assistance was evaluated using a computerized test module. Eighteen participants were grouped by colonoscopy experience (nurses, fellows, and experts). The value added by CADe based on the histopathology and detection difficulty of polyps were analyzed. Results The area under the curve for CADe was 0.87 (95% confidence interval [CI], 0.83 to 0.91). CADe assistance increased overall polyp detection accuracy from 69.7% to 77.7% (odds ratio [OR], 1.88; 95% CI, 1.69 to 2.09). However, accuracy decreased when CADe inaccurately detected a polyp (OR, 0.72; 95% CI, 0.58 to 0.87). The impact of CADe assistance was most and least prominent in the nurses (OR, 1.97; 95% CI, 1.71 to 2.27) and the experts (OR, 1.42; 95% CI, 1.15 to 1.74), respectively. Participants demonstrated better sensitivity with CADe assistance, achieving 81.7% for adenomas and 92.4% for easy-to-detect polyps, surpassing the standalone CADe performance of 79.7% and 89.8%, respectively. For SSLs and difficult-to-detect polyps, participants' sensitivities with CADe assistance (66.5% and 71.5%, respectively) were below those of standalone CADe (81.1% and 74.4%). Compared to the other two groups (56.1% and 61.7%), the expert group showed sensitivity closest to that of standalone CADe in detecting SSLs (79.7% vs 81.1%, respectively). Conclusions CADe assistance boosts polyp detection significantly, but its effectiveness depends on the user's experience, particularly for challenging lesions.
Collapse
Affiliation(s)
- Jooyoung Lee
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Woo Sang Cho
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, Korea
| | - Jung Kim
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Ji Hyun Song
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Sun Young Yang
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Seon Hee Lim
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Goh Eun Chung
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Ji Min Choi
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Yoo Min Han
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| | - Hyoun-Joong Kong
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Medical Big Data Research Center, Seoul National University College of Medicine, Seoul, Korea
- Artificial Intelligence Institute, Seoul National University, Seoul, Korea
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
- Institute of Bioengineering, Seoul National University, Seoul, Korea
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
- Institute of Bioengineering, Seoul National University, Seoul, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, Korea
| |
Collapse
|
25
|
Cold KM, Vamadevan A, Vilmann AS, Svendsen MBS, Konge L, Bjerrum F. Computer-aided quality assessment of endoscopist competence during colonoscopy: a systematic review. Gastrointest Endosc 2024; 100:167-176.e1. [PMID: 38580134 DOI: 10.1016/j.gie.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 03/28/2024] [Accepted: 03/28/2024] [Indexed: 04/07/2024]
Abstract
BACKGROUND AND AIMS Endoscopists' competence can vary widely, as shown in the variation in the adenoma detection rate (ADR). Computer-aided quality assessment (CAQ) can automatically assess performance during individual procedures. In this review we identified and described different CAQ systems for colonoscopy. METHODS A systematic review of the literature was done using MEDLINE, EMBASE, and Scopus based on 3 blocks of terms according to the inclusion criteria: colonoscopy, competence assessment, and automatic evaluation. Articles were systematically reviewed by 2 reviewers, first by abstract and then in full text. The methodological quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI). RESULTS Of 12,575 identified studies, 6831 remained after removal of duplicates and 6806 did not pass the eligibility criteria and were excluded, leaving 25 studies, of which 13 studies were included in the final analysis. Five categories of CAQ systems were identified: withdrawal speedometer (7 studies), endoscope movement analysis (3 studies), effective withdrawal time (1 study), fold examination quality (1 study), and visual gaze pattern (1 study). The withdrawal speedometer was the only CAQ system that tested its feedback by examining changes in ADR. Three studies observed an improvement in ADR, and 2 studies did not. The methodological quality of the studies was high (mean MERSQI, 15.2 points; maximum, 18 points). CONCLUSIONS Thirteen studies developed or tested CAQ systems, most frequently by correlating it to the ADR. Only 5 studies tested feedback by implementing the CAQ system. A meta-analysis was impossible because of the heterogeneous study designs, and more studies are warranted.
Collapse
Affiliation(s)
- Kristoffer Mazanti Cold
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Anishan Vamadevan
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark
| | - Andreas Slot Vilmann
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark; Gastrounit, Surgical Section, Copenhagen University Hospital-Herlev and Gentofte, Herlev, Denmark
| | - Morten Bo Søndergaard Svendsen
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Computer Science, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Lars Konge
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Flemming Bjerrum
- Copenhagen Academy for Medical Education and Simulation (CAMES), Center for HR & Education, the Capital Region of Denmark, Copenhagen, Denmark; Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark; Gastrounit, Surgical Section, Copenhagen University Hospital-Amager and Hvidovre, Hvidovre, Denmark
| |
Collapse
|
26
|
Li J, Peng Z, Wang X, Zhang S, Sun J, Li Y, Zhang Q, Shi L, Li H, Tian Z, Feng Y, Mu J, Tang N, Wang X, Li W, Pei Z. Development and validation of a novel colonoscopy withdrawal time indicator based on YOLOv5. J Gastroenterol Hepatol 2024; 39:1613-1622. [PMID: 38710592 DOI: 10.1111/jgh.16596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 04/02/2024] [Accepted: 04/16/2024] [Indexed: 05/08/2024]
Abstract
BACKGROUND AND AIM The study aims to introduce a novel indicator, effective withdrawal time (WTS), which measures the time spent actively searching for suspicious lesions during colonoscopy and to compare WTS and the conventional withdrawal time (WT). METHODS Colonoscopy video data from 472 patients across two hospitals were retrospectively analyzed. WTS was computed through a combination of artificial intelligence (AI) and manual verification. The results obtained through WTS were compared with those generated by the AI system. Patients were categorized into four groups based on the presence of polyps and whether resections or biopsies were performed. Bland Altman plots were utilized to compare AI-computed WTS with manually verified WTS. Scatterplots were used to illustrate WTS within the four groups, among different hospitals, and across various physicians. A parallel box plot was employed to depict the proportions of WTS relative to WT within each of the four groups. RESULTS The study included 472 patients, with a median age of 55 years, and 57.8% were male. A significant correlation with manually verified WTS (r = 0.918) was observed in AI-computed WTS. Significant differences in WTS/WT among the four groups were revealed by the parallel box plot (P < 0.001). The group with no detected polyps had the highest WTS/WT, with a median of 0.69 (interquartile range: 0.40, 0.97). WTS patterns were found to be varied between the two hospitals and among senior and junior physicians. CONCLUSIONS A promising alternative to traditional WT for quality control and training assessment in colonoscopy is offered by AI-assisted computation of WTS.
Collapse
Affiliation(s)
- Jiaxin Li
- Medical School, Tianjin University, Tianjin, China
| | - Ziye Peng
- Medical School, Tianjin University, Tianjin, China
| | - Xiangyu Wang
- Medical School, Tianjin University, Tianjin, China
| | - Shuyi Zhang
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Jiayi Sun
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Yanru Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Qi Zhang
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Lei Shi
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Hongzhou Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Zhenggang Tian
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Yue Feng
- TEDA Yujin Digestive Health Industry Research Institute. Ltd., Tianjin, China
| | - Jinbao Mu
- TEDA Yujin Digestive Health Industry Research Institute. Ltd., Tianjin, China
| | - Nan Tang
- Tianjin Center for Medical Devices Evaluation and Inspection, Tianjin, China
| | - Ximo Wang
- Tianjin Third Central Hospital, Tianjin, China
| | - Wen Li
- Department of Endoscopy, Tianjin Union Medical Center, Tianjin, China
| | - Zhengcun Pei
- Medical School, Tianjin University, Tianjin, China
| |
Collapse
|
27
|
Luo X, Wang J, Tan C, Dou Q, Han Z, Wang Z, Tasnim F, Wang X, Zhan Q, Li X, Zhou Q, Cheng J, Liao F, Yip HC, Jiang J, Tan RT, Liu S, Yu H. Rapid Endoscopic Diagnosis of Benign Ulcerative Colorectal Diseases With an Artificial Intelligence Contextual Framework. Gastroenterology 2024; 167:591-603.e9. [PMID: 38583724 DOI: 10.1053/j.gastro.2024.03.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 03/22/2024] [Accepted: 03/28/2024] [Indexed: 04/09/2024]
Abstract
BACKGROUND & AIMS Benign ulcerative colorectal diseases (UCDs) such as ulcerative colitis, Crohn's disease, ischemic colitis, and intestinal tuberculosis share similar phenotypes with different etiologies and treatment strategies. To accurately diagnose closely related diseases like UCDs, we hypothesize that contextual learning is critical in enhancing the ability of the artificial intelligence models to differentiate the subtle differences in lesions amidst the vastly divergent spatial contexts. METHODS White-light colonoscopy datasets of patients with confirmed UCDs and healthy controls were retrospectively collected. We developed a Multiclass Contextual Classification (MCC) model that can differentiate among the mentioned UCDs and healthy controls by incorporating the tissue object contexts surrounding the individual lesion region in a scene and spatial information from other endoscopic frames (video-level) into a unified framework. Internal and external datasets were used to validate the model's performance. RESULTS Training datasets included 762 patients, and the internal and external testing cohorts included 257 patients and 293 patients, respectively. Our MCC model provided a rapid reference diagnosis on internal test sets with a high averaged area under the receiver operating characteristic curve (image-level: 0.950 and video-level: 0.973) and balanced accuracy (image-level: 76.1% and video-level: 80.8%), which was superior to junior endoscopists (accuracy: 71.8%, P < .0001) and similar to experts (accuracy: 79.7%, P = .732). The MCC model achieved an area under the receiver operating characteristic curve of 0.988 and balanced accuracy of 85.8% using external testing datasets. CONCLUSIONS These results enable this model to fit in the routine endoscopic workflow, and the contextual framework to be adopted for diagnosing other closely related diseases.
Collapse
Affiliation(s)
- Xiaobei Luo
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China.
| | - Jiahao Wang
- Mechanobiology Institute, National University of Singapore, Singapore; Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore
| | - Chuanchuan Tan
- The First Hospital of Hunan University of Chinese Medicine, Hunan, China
| | - Qi Dou
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Zelong Han
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Zhenjiang Wang
- Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China
| | - Farah Tasnim
- Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore
| | - Xiyu Wang
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Qiang Zhan
- Department of Gastroenterology, The Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi People's Hospital, Wuxi Medical Center, Nanjing Medical University, Wuxi, Jiangsu, China
| | - Xiang Li
- Digestive Department of The Second Affiliated Hospital, School of Medicine, The Chinese University of Hong Kong, Shenzhen & Longgang District People's Hospital of Shenzhen, Shenzhen, China
| | - Qunyan Zhou
- Department of Gastroenterology, The Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi People's Hospital, Wuxi Medical Center, Nanjing Medical University, Wuxi, Jiangsu, China
| | - Jianbin Cheng
- Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China
| | - Fabiao Liao
- Digestive Department of The Second Affiliated Hospital, School of Medicine, The Chinese University of Hong Kong, Shenzhen & Longgang District People's Hospital of Shenzhen, Shenzhen, China
| | - Hon Chi Yip
- Division of Upper Gastrointestinal and Metabolic Surgery, Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong
| | - Jiayi Jiang
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China
| | - Robby T Tan
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore
| | - Side Liu
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Department of Gastroenterology, Zhuhai People's Hospital (Zhuhai Clinical Medical College of Jinan University), Zhuhai, Guangdong, China.
| | - Hanry Yu
- Guangdong Provincial Key Laboratory of Gastroenterology, Department of Gastroenterology, Nanfang Hospital, Southern Medical University, Guangzhou, Guangdong, China; Mechanobiology Institute, National University of Singapore, Singapore; Institute of Bioengineering and Bioimaging, Agency for Science, Technology and Research (A∗STAR), Singapore; CAMP, Singapore-MIT Alliance for Research and Technology, Singapore; Department of Physiology, The Institute for Digital Medicine (WisDM), Yong Loo Lin School of Medicine, Singapore.
| |
Collapse
|
28
|
Kikuchi R, Okamoto K, Ozawa T, Shibata J, Ishihara S, Tada T. Endoscopic Artificial Intelligence for Image Analysis in Gastrointestinal Neoplasms. Digestion 2024; 105:419-435. [PMID: 39068926 DOI: 10.1159/000540251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 07/02/2024] [Indexed: 07/30/2024]
Abstract
BACKGROUND Artificial intelligence (AI) using deep learning systems has recently been utilized in various medical fields. In the field of gastroenterology, AI is primarily implemented in image recognition and utilized in the realm of gastrointestinal (GI) endoscopy. In GI endoscopy, computer-aided detection/diagnosis (CAD) systems assist endoscopists in GI neoplasm detection or differentiation of cancerous or noncancerous lesions. Several AI systems for colorectal polyps have already been applied in colonoscopy clinical practices. In esophagogastroduodenoscopy, a few CAD systems for upper GI neoplasms have been launched in Asian countries. The usefulness of these CAD systems in GI endoscopy has been gradually elucidated. SUMMARY In this review, we outline recent articles on several studies of endoscopic AI systems for GI neoplasms, focusing on esophageal squamous cell carcinoma (ESCC), esophageal adenocarcinoma (EAC), gastric cancer (GC), and colorectal polyps. In ESCC and EAC, computer-aided detection (CADe) systems were mainly developed, and a recent meta-analysis study showed sensitivities of 91.2% and 93.1% and specificities of 80% and 86.9%, respectively. In GC, a recent meta-analysis study on CADe systems demonstrated that their sensitivity and specificity were as high as 90%. A randomized controlled trial (RCT) also showed that the use of the CADe system reduced the miss rate. Regarding computer-aided diagnosis (CADx) systems for GC, although RCTs have not yet been conducted, most studies have demonstrated expert-level performance. In colorectal polyps, multiple RCTs have shown the usefulness of the CADe system for improving the polyp detection rate, and several CADx systems have been shown to have high accuracy in colorectal polyp differentiation. KEY MESSAGES Most analyses of endoscopic AI systems suggested that their performance was better than that of nonexpert endoscopists and equivalent to that of expert endoscopists. Thus, endoscopic AI systems may be useful for reducing the risk of overlooking lesions and improving the diagnostic ability of endoscopists.
Collapse
Affiliation(s)
- Ryosuke Kikuchi
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Kazuaki Okamoto
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Tsuyoshi Ozawa
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| | - Junichi Shibata
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| | - Soichiro Ishihara
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
| | - Tomohiro Tada
- Department of Surgical Oncology, Faculty of Medicine, The University of Tokyo, Tokyo, Japan
- Tomohiro Tada the Institute of Gastroenterology and Proctology, Saitama, Japan
- AI Medical Service Inc., Tokyo, Japan
| |
Collapse
|
29
|
Wang Y, He C. ENDOANGEL improves detection of missed colorectal adenomas in second colonoscopy: A retrospective study. Medicine (Baltimore) 2024; 103:e38938. [PMID: 38996141 PMCID: PMC11245239 DOI: 10.1097/md.0000000000038938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 06/24/2024] [Indexed: 07/14/2024] Open
Abstract
The ENDOANGEL (EN) computer-assisted detection technique has emerged as a promising tool for enhancing the detection rate of colorectal adenomas during colonoscopies. However, its efficacy in identifying missed adenomas during subsequent colonoscopies remains unclear. Thus, we herein aimed to compare the adenoma miss rate (AMR) between EN-assisted and standard colonoscopies. Data from patients who underwent a second colonoscopy (EN-assisted or standard) within 6 months between September 2022 and May 2023 were analyzed. The EN-assisted group exhibited a significantly higher AMR (24.3% vs 11.9%, P = .005) than the standard group. After adjusting for potential confounders, multivariable analysis revealed that the EN-assisted group had a better ability to detect missed adenomas than the standard group (odds ratio = 2.89; 95% confidence interval = 1.14-7.80, P = .029). These findings suggest that EN-assisted colonoscopy represents a valuable advancement in improving AMR compared with standard colonoscopy. The integration of EN-assisted colonoscopy into routine clinical practice may offer significant benefits to patients requiring hospital resection of lesions following adenoma detection during their first colonoscopy.
Collapse
Affiliation(s)
- Yundong Wang
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, Wuhu, Anhui, People’s Republic of China
| | - Chiyi He
- Department of Gastroenterology, Yijishan Hospital of Wannan Medical College, Wuhu, Anhui, People’s Republic of China
| |
Collapse
|
30
|
Introzzi L, Zonca J, Cabitza F, Cherubini P, Reverberi C. Enhancing human-AI collaboration: The case of colonoscopy. Dig Liver Dis 2024; 56:1131-1139. [PMID: 37940501 DOI: 10.1016/j.dld.2023.10.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 10/19/2023] [Accepted: 10/23/2023] [Indexed: 11/10/2023]
Abstract
Diagnostic errors impact patient health and healthcare costs. Artificial Intelligence (AI) shows promise in mitigating this burden by supporting Medical Doctors in decision-making. However, the mere display of excellent or even superhuman performance by AI in specific tasks does not guarantee a positive impact on medical practice. Effective AI assistance should target the primary causes of human errors and foster effective collaborative decision-making with human experts who remain the ultimate decision-makers. In this narrative review, we apply these principles to the specific scenario of AI assistance during colonoscopy. By unraveling the neurocognitive foundations of the colonoscopy procedure, we identify multiple bottlenecks in perception, attention, and decision-making that contribute to diagnostic errors, shedding light on potential interventions to mitigate them. Furthermore, we explored how existing AI devices fare in clinical practice and whether they achieved an optimal integration with the human decision-maker. We argue that to foster optimal Human-AI collaboration, future research should expand our knowledge of factors influencing AI's impact, establish evidence-based cognitive models, and develop training programs based on them. These efforts will enhance human-AI collaboration, ultimately improving diagnostic accuracy and patient outcomes. The principles illuminated in this review hold more general value, extending their relevance to a wide array of medical procedures and beyond.
Collapse
Affiliation(s)
- Luca Introzzi
- Department of Psychology, Università Milano - Bicocca, Milano, Italy
| | - Joshua Zonca
- Department of Psychology, Università Milano - Bicocca, Milano, Italy; Milan Center for Neuroscience, Università Milano - Bicocca, Milano, Italy
| | - Federico Cabitza
- Department of Informatics, Systems and Communication, Università Milano - Bicocca, Milano, Italy; IRCCS Istituto Ortopedico Galeazzi, Milano, Italy
| | - Paolo Cherubini
- Department of Brain and Behavioral Sciences, Università Statale di Pavia, Pavia, Italy
| | - Carlo Reverberi
- Department of Psychology, Università Milano - Bicocca, Milano, Italy; Milan Center for Neuroscience, Università Milano - Bicocca, Milano, Italy.
| |
Collapse
|
31
|
Lui TKL, Lam CPM, To EWP, Ko MKL, Tsui VWM, Liu KSH, Hui CKY, Cheung MKS, Mak LLY, Hui RWH, Wong SY, Seto WK, Leung WK. Endocuff With or Without Artificial Intelligence-Assisted Colonoscopy in Detection of Colorectal Adenoma: A Randomized Colonoscopy Trial. Am J Gastroenterol 2024; 119:1318-1325. [PMID: 38305278 PMCID: PMC11208055 DOI: 10.14309/ajg.0000000000002684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 12/19/2023] [Indexed: 02/03/2024]
Abstract
INTRODUCTION Both artificial intelligence (AI) and distal attachment devices have been shown to improve adenoma detection rate and reduce miss rate during colonoscopy. We studied the combined effect of Endocuff and AI on enhancing detection rates of various colonic lesions. METHODS This was a 3-arm prospective randomized colonoscopy study involving patients aged 40 years or older. Participants were randomly assigned in a 1:1:1 ratio to undergo Endocuff with AI, AI alone, or standard high-definition (HD) colonoscopy. The primary outcome was adenoma detection rate (ADR) between the Endocuff-AI and AI groups while secondary outcomes included detection rates of polyp (PDR), sessile serrated lesion (sessile detection rate [SDR]), and advanced adenoma (advanced adenoma detection rate) between the 2 groups. RESULTS A total of 682 patients were included (mean age 65.4 years, 52.3% male), with 53.7% undergoing diagnostic colonoscopy. The ADR for the Endocuff-AI, AI, and HD groups was 58.7%, 53.8%, and 46.3%, respectively, while the corresponding PDR was 77.0%, 74.0%, and 61.2%. A significant increase in ADR, PDR, and SDR was observed between the Endocuff-AI and AI groups (ADR difference: 4.9%, 95% CI: 1.4%-8.2%, P = 0.03; PDR difference: 3.0%, 95% CI: 0.4%-5.8%, P = 0.04; SDR difference: 6.4%, 95% CI: 3.4%-9.7%, P < 0.01). Both Endocuff-AI and AI groups had a higher ADR, PDR, SDR, and advanced adenoma detection rate than the HD group (all P < 0.01). DISCUSSION Endocuff in combination with AI further improves various colonic lesion detection rates when compared with AI alone.
Collapse
Affiliation(s)
- Thomas Ka-Luen Lui
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | | | - Elvis Wai-Pan To
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
- Department of Medicine, Tung Wah Hospital, Hong Kong, China.
| | | | | | | | | | - Michael Ka-Shing Cheung
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Loey Lung-Yi Mak
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Rex Wan-Hin Hui
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Siu-Yin Wong
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Wai Kay Seto
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| | - Wai K. Leung
- Department of Medicine, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
- Department of Medicine, Queen Mary Hospital, Hong Kong, China;
| |
Collapse
|
32
|
Davis JMK, Niazi MKK, Ricker AB, Tavolara TE, Robinson JN, Annanurov B, Smith K, Mantha R, Hwang J, Shrestha R, Iannitti DA, Martinie JB, Baker EH, Gurcan MN, Vrochides D. Predicting response to neoadjuvant chemotherapy for colorectal liver metastasis using deep learning on prechemotherapy cross-sectional imaging. J Surg Oncol 2024; 130:93-101. [PMID: 38712939 DOI: 10.1002/jso.27673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 04/13/2024] [Accepted: 04/28/2024] [Indexed: 05/08/2024]
Abstract
BACKGROUND AND OBJECTIVES Deep learning models (DLMs) are applied across domains of health sciences to generate meaningful predictions. DLMs make use of neural networks to generate predictions from discrete data inputs. This study employs DLM on prechemotherapy cross-sectional imaging to predict patients' response to neoadjuvant chemotherapy. METHODS Adult patients with colorectal liver metastasis who underwent surgery after neoadjuvant chemotherapy were included. A DLM was trained on computed tomography images using attention-based multiple-instance learning. A logistic regression model incorporating clinical parameters of the Fong clinical risk score was used for comparison. Both model performances were benchmarked against the Response Evaluation Criteria in Solid Tumors criteria. A receiver operating curve was created and resulting area under the curve (AUC) was determined. RESULTS Ninety-five patients were included, with 33,619 images available for study inclusion. Ninety-five percent of patients underwent 5-fluorouracil-based chemotherapy with oxaliplatin and/or irinotecan. Sixty percent of the patients were categorized as chemotherapy responders (30% reduction in tumor diameter). The DLM had an AUC of 0.77. The AUC for the clinical model was 0.41. CONCLUSIONS Image-based DLM for prediction of response to neoadjuvant chemotherapy in patients with colorectal cancer liver metastases was superior to a clinical-based model. These results demonstrate potential to identify nonresponders to chemotherapy and guide select patients toward earlier curative resection.
Collapse
Affiliation(s)
- Joshua M K Davis
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Muhammad Khalid Khan Niazi
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Ansley B Ricker
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Thomas E Tavolara
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Jordan N Robinson
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Bayram Annanurov
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Kaylee Smith
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Rohit Mantha
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Jimmy Hwang
- Department of Medical Oncology, Atrium Health Carolinas Medical Center, Levine Cancer Institute, Charlotte, North Carolina, USA
| | - Ruchi Shrestha
- Department of Radiology, Atrium Health, Charlotte, North Carolina, USA
| | - David A Iannitti
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - John B Martinie
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Erin H Baker
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| | - Metin N Gurcan
- Center for Artificial Intelligence Research and the Clinical Image Analysis Lab, Wake Forest University School of Medicine, Winston-Salem, North Carolina, USA
| | - Dionisios Vrochides
- Department of Surgery, Atrium Health Carolinas Medical Center, Charlotte, North Carolina, USA
| |
Collapse
|
33
|
Spadaccini M, Troya J, Khalaf K, Facciorusso A, Maselli R, Hann A, Repici A. Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going? Dig Liver Dis 2024; 56:1148-1155. [PMID: 38458884 DOI: 10.1016/j.dld.2024.01.203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 01/22/2024] [Accepted: 01/23/2024] [Indexed: 03/10/2024]
Abstract
Colorectal cancer is a significant global health concern, necessitating effective screening strategies to reduce its incidence and mortality rates. Colonoscopy plays a crucial role in the detection and removal of colorectal neoplastic precursors. However, there are limitations and variations in the performance of endoscopists, leading to missed lesions and suboptimal outcomes. The emergence of artificial intelligence (AI) in endoscopy offers promising opportunities to improve the quality and efficacy of screening colonoscopies. In particular, AI applications, including computer-aided detection (CADe) and computer-aided characterization (CADx), have demonstrated the potential to enhance adenoma detection and optical diagnosis accuracy. Additionally, AI-assisted quality control systems aim to standardize the endoscopic examination process. This narrative review provides an overview of AI principles and discusses the current knowledge on AI-assisted endoscopy in the context of screening colonoscopies. It highlights the significant role of AI in improving lesion detection, characterization, and quality assurance during colonoscopy. However, further well-designed studies are needed to validate the clinical impact and cost-effectiveness of AI-assisted colonoscopy before its widespread implementation.
Collapse
Affiliation(s)
- Marco Spadaccini
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy.
| | - Joel Troya
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Kareem Khalaf
- Division of Gastroenterology, St. Michael's Hospital, University of Toronto, Toronto, Canada
| | - Antonio Facciorusso
- Gastroenterology Unit, Department of Surgical and Medical Sciences, University of Foggia, Foggia, Italy
| | - Roberta Maselli
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Alessandro Repici
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| |
Collapse
|
34
|
Chow KW, Bell MT, Cumpian N, Amour M, Hsu RH, Eysselein VE, Srivastava N, Fleischman MW, Reicher S. Long-term impact of artificial intelligence on colorectal adenoma detection in high-risk colonoscopy. World J Gastrointest Endosc 2024; 16:335-342. [PMID: 38946853 PMCID: PMC11212514 DOI: 10.4253/wjge.v16.i6.335] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 04/16/2024] [Accepted: 04/28/2024] [Indexed: 06/13/2024] Open
Abstract
BACKGROUND Improved adenoma detection rate (ADR) has been demonstrated with artificial intelligence (AI)-assisted colonoscopy. However, data on the real-world application of AI and its effect on colorectal cancer (CRC) screening outcomes is limited. AIM To analyze the long-term impact of AI on a diverse at-risk patient population undergoing diagnostic colonoscopy for positive CRC screening tests or symptoms. METHODS AI software (GI Genius, Medtronic) was implemented into the standard procedure protocol in November 2022. Data was collected on patient demographics, procedure indication, polyp size, location, and pathology. CRC screening outcomes were evaluated before and at different intervals after AI introduction with one year of follow-up. RESULTS We evaluated 1008 colonoscopies (278 pre-AI, 255 early post-AI, 285 established post-AI, and 190 late post-AI). The ADR was 38.1% pre-AI, 42.0% early post-AI (P = 0.77), 40.0% established post-AI (P = 0.44), and 39.5% late post-AI (P = 0.77). There were no significant differences in polyp detection rate (PDR, baseline 59.7%), advanced ADR (baseline 16.2%), and non-neoplastic PDR (baseline 30.0%) before and after AI introduction. CONCLUSION In patients with an increased pre-test probability of having an abnormal colonoscopy, the current generation of AI did not yield enhanced CRC screening metrics over high-quality colonoscopy. Although the potential of AI in colonoscopy is undisputed, current AI technology may not universally elevate screening metrics across all situations and patient populations. Future studies that analyze different AI systems across various patient populations are needed to determine the most effective role of AI in optimizing CRC screening in clinical practice.
Collapse
Affiliation(s)
- Kenneth W Chow
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Matthew T Bell
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Nicholas Cumpian
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Maryanne Amour
- Department of Medicine, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Ryan H Hsu
- Department of Bioengineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, CA 92093, United States
| | - Viktor E Eysselein
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Neetika Srivastava
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Michael W Fleischman
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| | - Sofiya Reicher
- Department of Gastroenterology, Harbor-UCLA Medical Center, Torrance, CA 90502, United States
| |
Collapse
|
35
|
Reitsam NG, Enke JS, Vu Trung K, Märkl B, Kather JN. Artificial Intelligence in Colorectal Cancer: From Patient Screening over Tailoring Treatment Decisions to Identification of Novel Biomarkers. Digestion 2024; 105:331-344. [PMID: 38865982 PMCID: PMC11457979 DOI: 10.1159/000539678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 06/04/2024] [Indexed: 06/14/2024]
Abstract
BACKGROUND Artificial intelligence (AI) is increasingly entering and transforming not only medical research but also clinical practice. In the last 10 years, new AI methods have enabled computers to perform visual tasks, reaching high performance and thereby potentially supporting and even outperforming human experts. This is in particular relevant for colorectal cancer (CRC), which is the 3rd most common cancer type in general, as along the CRC patient journey many complex visual tasks need to be performed: from endoscopy over imaging to histopathology; the screening, diagnosis, and treatment of CRC involve visual image analysis tasks. SUMMARY In all these clinical areas, AI models have shown promising results by supporting physicians, improving accuracy, and providing new biological insights and biomarkers. By predicting prognostic and predictive biomarkers from routine images/slides, AI models could lead to an improved patient stratification for precision oncology approaches in the near future. Moreover, it is conceivable that AI models, in particular together with innovative techniques such as single-cell or spatial profiling, could help identify novel clinically as well as biologically meaningful biomarkers that could pave the way to new therapeutic approaches. KEY MESSAGES Here, we give a comprehensive overview of AI in colorectal cancer, describing and discussing these developments as well as the next steps which need to be taken to incorporate AI methods more broadly into the clinical care of CRC.
Collapse
Affiliation(s)
- Nic Gabriel Reitsam
- Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany,
- Bavarian Cancer Research Center (BZKF), Augsburg, Germany,
| | - Johanna Sophie Enke
- Nuclear Medicine, Faculty of Medicine, University of Augsburg, Augsburg, Germany
| | - Kien Vu Trung
- Division of Gastroenterology, Medical Department II, University of Leipzig Medical Center, Leipzig, Germany
| | - Bruno Märkl
- Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
- Bavarian Cancer Research Center (BZKF), Augsburg, Germany
| | - Jakob Nikolas Kather
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
- Pathology and Data Analytics, Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
- Department of Medicine I, University Hospital Dresden, Dresden, Germany
- Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| |
Collapse
|
36
|
Horita K, Hida K, Itatani Y, Fujita H, Hidaka Y, Yamamoto G, Ito M, Obama K. Real-time detection of active bleeding in laparoscopic colectomy using artificial intelligence. Surg Endosc 2024; 38:3461-3469. [PMID: 38760565 DOI: 10.1007/s00464-024-10874-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 04/20/2024] [Indexed: 05/19/2024]
Abstract
BACKGROUND Most intraoperative adverse events (iAEs) result from surgeons' errors, and bleeding is the majority of iAEs. Recognizing active bleeding timely is important to ensure safe surgery, and artificial intelligence (AI) has great potential for detecting active bleeding and providing real-time surgical support. This study aimed to develop a real-time AI model to detect active intraoperative bleeding. METHODS We extracted 27 surgical videos from a nationwide multi-institutional surgical video database in Japan and divided them at the patient level into three sets: training (n = 21), validation (n = 3), and testing (n = 3). We subsequently extracted the bleeding scenes and labeled distinctively active bleeding and blood pooling frame by frame. We used pre-trained YOLOv7_6w and developed a model to learn both active bleeding and blood pooling. The Average Precision at an Intersection over Union threshold of 0.5 (AP.50) for active bleeding and frames per second (FPS) were quantified. In addition, we conducted two 5-point Likert scales (5 = Excellent, 4 = Good, 3 = Fair, 2 = Poor, and 1 = Fail) questionnaires about sensitivity (the sensitivity score) and number of overdetection areas (the overdetection score) to investigate the surgeons' assessment. RESULTS We annotated 34,117 images of 254 bleeding events. The AP.50 for active bleeding in the developed model was 0.574 and the FPS was 48.5. Twenty surgeons answered two questionnaires, indicating a sensitivity score of 4.92 and an overdetection score of 4.62 for the model. CONCLUSIONS We developed an AI model to detect active bleeding, achieving real-time processing speed. Our AI model can be used to provide real-time surgical support.
Collapse
Affiliation(s)
- Kenta Horita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Koya Hida
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan.
| | - Yoshiro Itatani
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Haruku Fujita
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| | - Yu Hidaka
- Department of Biomedical Statistics and Bioinformatics, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Goshiro Yamamoto
- Division of Medical Information Technology and Administration Planning, Kyoto University, Kyoto, Japan
| | - Masaaki Ito
- Surgical Device Innovation Office, National Cancer Center Hospital East, Chiba, Japan
- Department of Colorectal Surgery, National Cancer Center Hospital East, Chiba, Japan
| | - Kazutaka Obama
- Department of Surgery, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8507, Japan
| |
Collapse
|
37
|
Varghese C, Harrison EM, O'Grady G, Topol EJ. Artificial intelligence in surgery. Nat Med 2024; 30:1257-1268. [PMID: 38740998 DOI: 10.1038/s41591-024-02970-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Accepted: 04/03/2024] [Indexed: 05/16/2024]
Abstract
Artificial intelligence (AI) is rapidly emerging in healthcare, yet applications in surgery remain relatively nascent. Here we review the integration of AI in the field of surgery, centering our discussion on multifaceted improvements in surgical care in the preoperative, intraoperative and postoperative space. The emergence of foundation model architectures, wearable technologies and improving surgical data infrastructures is enabling rapid advances in AI interventions and utility. We discuss how maturing AI methods hold the potential to improve patient outcomes, facilitate surgical education and optimize surgical care. We review the current applications of deep learning approaches and outline a vision for future advances through multimodal foundation models.
Collapse
Affiliation(s)
- Chris Varghese
- Department of Surgery, University of Auckland, Auckland, New Zealand
| | - Ewen M Harrison
- Centre for Medical Informatics, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Greg O'Grady
- Department of Surgery, University of Auckland, Auckland, New Zealand
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
| | - Eric J Topol
- Scripps Research Translational Institute, La Jolla, CA, USA.
| |
Collapse
|
38
|
Okumura T, Imai K, Misawa M, Kudo SE, Hotta K, Ito S, Kishida Y, Takada K, Kawata N, Maeda Y, Yoshida M, Yamamoto Y, Minamide T, Ishiwatari H, Sato J, Matsubayashi H, Ono H. Evaluating false-positive detection in a computer-aided detection system for colonoscopy. J Gastroenterol Hepatol 2024; 39:927-934. [PMID: 38273460 DOI: 10.1111/jgh.16491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 12/21/2023] [Accepted: 01/03/2024] [Indexed: 01/27/2024]
Abstract
BACKGROUND AND AIM Computer-aided detection (CADe) systems can efficiently detect polyps during colonoscopy. However, false-positive (FP) activation is a major limitation of CADe. We aimed to compare the rate and causes of FP using CADe before and after an update designed to reduce FP. METHODS We analyzed CADe-assisted colonoscopy videos recorded between July 2022 and October 2022. The number and causes of FPs and excessive time spent by the endoscopist on FP (ET) were compared pre- and post-update using 1:1 propensity score matching. RESULTS During the study period, 191 colonoscopy videos (94 and 97 in the pre- and post-update groups, respectively) were recorded. Propensity score matching resulted in 146 videos (73 in each group). The mean number of FPs and median ET per colonoscopy were significantly lower in the post-update group than those in the pre-update group (4.2 ± 3.7 vs 18.1 ± 11.1; P < 0.001 and 0 vs 16 s; P < 0.001, respectively). Mucosal tags, bubbles, and folds had the strongest association with decreased FP post-update (pre-update vs post-update: 4.3 ± 3.6 vs 0.4 ± 0.8, 0.32 ± 0.70 vs 0.04 ± 0.20, and 8.6 ± 6.7 vs 1.6 ± 1.7, respectively). There was no significant decrease in the true positive rate (post-update vs pre-update: 95.0% vs 99.2%; P = 0.09) or the adenoma detection rate (post-update vs pre-update: 52.1% vs 49.3%; P = 0.87). CONCLUSIONS The updated CADe can reduce FP without impairing polyp detection. A reduction in FP may help relieve the burden on endoscopists.
Collapse
Affiliation(s)
- Taishi Okumura
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Kenichiro Imai
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Kinichi Hotta
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Sayo Ito
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Kazunori Takada
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Noboru Kawata
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yuki Maeda
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Masao Yoshida
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | - Yoichi Yamamoto
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | | | - Junya Sato
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| | | | - Hiroyuki Ono
- Division of Endoscopy, Shizuoka Cancer Center, Shizuoka, Japan
| |
Collapse
|
39
|
Guo F, Meng H. Application of artificial intelligence in gastrointestinal endoscopy. Arab J Gastroenterol 2024; 25:93-96. [PMID: 38228443 DOI: 10.1016/j.ajg.2023.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 09/06/2023] [Accepted: 12/30/2023] [Indexed: 01/18/2024]
Abstract
Endoscopy is an important method for diagnosing gastrointestinal (GI) diseases. In this study, we provide an overview of the advances in artificial intelligence (AI) technology in the field of GI endoscopy over recent years, including esophagus, stomach, large intestine, and capsule endoscopy (small intestine). AI-assisted endoscopy shows high accuracy, sensitivity, and specificity in the detection and diagnosis of GI diseases at all levels. Hence, AI will make a breakthrough in the field of GI endoscopy in the near future. However, AI technology currently has some limitations and is still in the preclinical stages.
Collapse
Affiliation(s)
- Fujia Guo
- The first Affiliated Hospital, Dalian Medical University, Dalian 116044, China
| | - Hua Meng
- The first Affiliated Hospital, Dalian Medical University, Dalian 116044, China.
| |
Collapse
|
40
|
Lee MCM, Parker CH, Liu LWC, Farahvash A, Jeyalingam T. Impact of study design on adenoma detection in the evaluation of artificial intelligence-aided colonoscopy: a systematic review and meta-analysis. Gastrointest Endosc 2024; 99:676-687.e16. [PMID: 38272274 DOI: 10.1016/j.gie.2024.01.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Revised: 12/19/2023] [Accepted: 01/10/2024] [Indexed: 01/27/2024]
Abstract
BACKGROUND AND AIMS Randomized controlled trials (RCTs) have reported that artificial intelligence (AI) improves endoscopic polyp detection. Different methodologies-namely, parallel and tandem designs-have been used to evaluate the efficacy of AI-assisted colonoscopy in RCTs. Systematic reviews and meta-analyses have reported a pooled effect that includes both study designs. However, it is unclear whether there are inconsistencies in the reported results of these 2 designs. Here, we aimed to determine whether study characteristics moderate between-trial differences in outcomes when evaluating the effectiveness of AI-assisted polyp detection. METHODS A systematic search of Ovid MEDLINE, Embase, Cochrane Central, Web of Science, and IEEE Xplore was performed through March 1, 2023, for RCTs comparing AI-assisted colonoscopy with routine high-definition colonoscopy in polyp detection. The primary outcome of interest was the impact of study type on the adenoma detection rate (ADR). Secondary outcomes included the impact of the study type on adenomas per colonoscopy and withdrawal time, as well as the impact of geographic location, AI system, and endoscopist experience on ADR. Pooled event analysis was performed using a random-effects model. RESULTS Twenty-four RCTs involving 17,413 colonoscopies (AI assisted: 8680; non-AI assisted: 8733) were included. AI-assisted colonoscopy improved overall ADR (risk ratio [RR], 1.24; 95% confidence interval [CI], 1.17-1.31; I2 = 53%; P < .001). Tandem studies collectively demonstrated improved ADR in AI-aided colonoscopies (RR, 1.18; 95% CI, 1.08-1.30; I2 = 0%; P < .001), as did parallel studies (RR, 1.26; 95% CI, 1.17-1.35; I2 = 62%; P < .001), with no statistical subgroup difference between study design. Both tandem and parallel study designs revealed improvement in adenomas per colonoscopy in AI-aided colonoscopies, but this improvement was more marked among tandem studies (P < .001). AI assistance significantly increased withdrawal times for parallel (P = .002), but not tandem, studies. ADR improvement was more marked among studies conducted in Asia compared to Europe and North America in a subgroup analysis (P = .007). Type of AI system used or endoscopist experience did not affect overall improvement in ADR. CONCLUSIONS Either parallel or tandem study design can capture the improvement in ADR resulting from the use of AI-assisted polyp detection systems. Tandem studies powered to detect differences in endoscopic performance through paired comparison may be a resource-efficient method of evaluating new AI-assisted technologies.
Collapse
Affiliation(s)
- Michelle C M Lee
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Colleen H Parker
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Louis W C Liu
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Armin Farahvash
- Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Thurarshen Jeyalingam
- Division of Gastroenterology and Hepatology, Department of Medicine, University Health Network, University of Toronto, Toronto, Ontario, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
41
|
Gangwani MK, Haghbin H, Ishtiaq R, Hasan F, Dillard J, Jaber F, Dahiya DS, Ali H, Salim S, Lee-Smith W, Sohail AH, Inamdar S, Aziz M, Hart B. Single Versus Second Observer vs Artificial Intelligence to Increase the ADENOMA Detection Rate of Colonoscopy-A Network Analysis. Dig Dis Sci 2024; 69:1380-1388. [PMID: 38436866 PMCID: PMC11026252 DOI: 10.1007/s10620-024-08341-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 02/07/2024] [Indexed: 03/05/2024]
Abstract
BACKGROUND AND AIMS Screening colonoscopy has significantly contributed to the reduction of the incidence of colorectal cancer (CRC) and its associated mortality, with adenoma detection rate (ADR) as the quality marker. To increase the ADR, various solutions have been proposed including the utilization of Artificial Intelligence (AI) and employing second observers during colonoscopies. In the interest of AI improving ADR independently, without a second observer, and the operational similarity between AI and second observer, this network meta-analysis aims at evaluating the effectiveness of AI, second observer, and a single observer in improving ADR. METHODS We searched the Medline, Embase, Cochrane, Web of Science Core Collection, Korean Citation Index, SciELO, Global Index Medicus, and Cochrane. A direct head-to-head comparator analysis and network meta-analysis were performed using the random-effects model. The odds ratio (OR) was calculated with a 95% confidence interval (CI) and p-value < 0.05 was considered statistically significant. RESULTS We analyzed 26 studies, involving 22,560 subjects. In the direct comparative analysis, AI demonstrated higher ADR (OR: 0.668, 95% CI 0.595-0.749, p < 0.001) than single observer. Dual observer demonstrated a higher ADR (OR: 0.771, 95% CI 0.688-0.865, p < 0.001) than single operator. In network meta-analysis, results were consistent on the network meta-analysis, maintaining consistency. No statistical difference was noted when comparing AI to second observer. (RR 1.1 (0.9-1.2, p = 0.3). Results were consistent when evaluating only RCTs. Net ranking provided higher score to AI followed by second observer followed by single observer. CONCLUSION Artificial Intelligence and second-observer colonoscopy showed superior success in Adenoma Detection Rate when compared to single-observer colonoscopy. Although not statistically significant, net ranking model favors the superiority of AI to the second observer.
Collapse
Affiliation(s)
| | - Hossein Haghbin
- Department of Gastroenterology and Hepatology, Ascension Providence Hospital, Southfield, MI, USA
| | - Rizwan Ishtiaq
- Department of Medicine, St Francis Hospital and Medical Center, Hartford, CT, USA
| | - Fariha Hasan
- Department of Internal Medicine, Cooper University Hospital, Camden, NJ, USA
| | - Julia Dillard
- Department of Medicine, University of Toledo Medical Center, Toledo, OH, USA
| | - Fouad Jaber
- Department of Internal Medicine, University of Missouri-Kansas City, Kansas City, MO, USA
| | - Dushyant Singh Dahiya
- Department of Medicine, Central Michigan University College of Medicine, Mount Pleasant, MI, USA
| | - Hassam Ali
- Department of Gastroenterology and Hepatology, East Carolina University Health, Greenville, NC, USA
| | - Shaharyar Salim
- Department of Internal Medicine, Aga Khan University Hospital, Karachi, Pakistan
| | - Wade Lee-Smith
- University of Toledo Libraries, University of Toledo, Toledo, OH, USA
| | - Amir Humza Sohail
- Department of General Surgery, New York University Langone Health, Long Island, NY, USA
| | - Sumant Inamdar
- Department of Gastroenterology and Hepatology, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Muhammad Aziz
- Department of Gastroenterology and Hepatology, University of Toledo Medical Center, Toledo, OH, USA
| | - Benjamin Hart
- Depertment of Hepatology and Gastroenterology, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
42
|
Liu X, Reigle J, Prasath VBS, Dhaliwal J. Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review. Comput Biol Med 2024; 171:108093. [PMID: 38354499 DOI: 10.1016/j.compbiomed.2024.108093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 01/04/2024] [Accepted: 01/30/2024] [Indexed: 02/16/2024]
Abstract
BACKGROUND There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies. METHODS We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST). RESULTS Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images. CONCLUSION The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.
Collapse
Affiliation(s)
- Xiaoxuan Liu
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA
| | - James Reigle
- Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA
| | - V B Surya Prasath
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA
| | - Jasbir Dhaliwal
- Department of Biomedical Informatics, College of Medicine, University of Cincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of Medicine, Cincinnati, OH, USA; Cincinnati Children's Hospital Medical Center, Division of Gastroenterology, Hepatology and Nutrition, USA.
| |
Collapse
|
43
|
Lau LHS, Ho JCL, Lai JCT, Ho AHY, Wu CWK, Lo VWH, Lai CMS, Scheppach MW, Sia F, Ho KHK, Xiao X, Yip TCF, Lam TYT, Kwok HYH, Chan HCH, Lui RN, Chan TT, Wong MTL, Ho MF, Ko RCW, Hon SF, Chu S, Futaba K, Ng SSM, Yip HC, Tang RSY, Wong VWS, Chan FKL, Chiu PWY. Effect of Real-Time Computer-Aided Polyp Detection System (ENDO-AID) on Adenoma Detection in Endoscopists-in-Training: A Randomized Trial. Clin Gastroenterol Hepatol 2024; 22:630-641.e4. [PMID: 37918685 DOI: 10.1016/j.cgh.2023.10.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 10/12/2023] [Accepted: 10/19/2023] [Indexed: 11/04/2023]
Abstract
BACKGROUND The effect of computer-aided polyp detection (CADe) on adenoma detection rate (ADR) among endoscopists-in-training remains unknown. METHODS We performed a single-blind, parallel-group, randomized controlled trial in Hong Kong between April 2021 and July 2022 (NCT04838951). Eligible subjects undergoing screening/surveillance/diagnostic colonoscopies were randomized 1:1 to receive colonoscopies with CADe (ENDO-AID[OIP-1]) or not (control) during withdrawal. Procedures were performed by endoscopists-in-training with <500 procedures and <3 years' experience. Randomization was stratified by patient age, sex, and endoscopist experience (beginner vs intermediate level, <200 vs 200-500 procedures). Image enhancement and distal attachment devices were disallowed. Subjects with incomplete colonoscopies or inadequate bowel preparation were excluded. Treatment allocation was blinded to outcome assessors. The primary outcome was ADR. Secondary outcomes were ADR for different adenoma sizes and locations, mean number of adenomas, and non-neoplastic resection rate. RESULTS A total of 386 and 380 subjects were randomized to CADe and control groups, respectively. The overall ADR was significantly higher in the CADe group than in the control group (57.5% vs 44.5%; adjusted relative risk, 1.41; 95% CI, 1.17-1.72; P < .001). The ADRs for <5 mm (40.4% vs 25.0%) and 5- to 10-mm adenomas (36.8% vs 29.2%) were higher in the CADe group. The ADRs were higher in the CADe group in both the right colon (42.0% vs 30.8%) and left colon (34.5% vs 27.6%), but there was no significant difference in advanced ADR. The ADRs were higher in the CADe group among beginner (60.0% vs 41.9%) and intermediate-level (56.5% vs 45.5%) endoscopists. Mean number of adenomas (1.48 vs 0.86) and non-neoplastic resection rate (52.1% vs 35.0%) were higher in the CADe group. CONCLUSIONS Among endoscopists-in-training, the use of CADe during colonoscopies was associated with increased overall ADR. (ClinicalTrials.gov, Number: NCT04838951).
Collapse
Affiliation(s)
- Louis H S Lau
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Jacky C L Ho
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Jimmy C T Lai
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Agnes H Y Ho
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Claudia W K Wu
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Vincent W H Lo
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Carol M S Lai
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Markus W Scheppach
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Gastroenterology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
| | - Felix Sia
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR
| | - Kyle H K Ho
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR
| | - Xiang Xiao
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Medical Data Analytic Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Terry C F Yip
- Medical Data Analytic Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Thomas Y T Lam
- Stanley Ho Big Data Decision Analytics Research Centre, The Chinese University of Hong Kong, Hong Kong SAR
| | - Hanson Y H Kwok
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Heyson C H Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Rashid N Lui
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Ting-Ting Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Marc T L Wong
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Man-Fung Ho
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Rachel C W Ko
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Sok-Fei Hon
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Simon Chu
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Koari Futaba
- Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Simon S M Ng
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Hon-Chi Yip
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR
| | - Raymond S Y Tang
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Vincent W S Wong
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Francis K L Chan
- Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR; Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; State Key Laboratory of Digestive Disease, Li Ka Shing Institute of Health Sciences, The Chinese University of Hong Kong, Hong Kong SAR
| | - Philip W Y Chiu
- Institute of Digestive Disease, The Chinese University of Hong Kong, Hong Kong SAR; Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR.
| |
Collapse
|
44
|
Uchikov P, Khalid U, Kraev K, Hristov B, Kraeva M, Tenchev T, Chakarov D, Sandeva M, Dragusheva S, Taneva D, Batashki A. Artificial Intelligence in the Diagnosis of Colorectal Cancer: A Literature Review. Diagnostics (Basel) 2024; 14:528. [PMID: 38472999 DOI: 10.3390/diagnostics14050528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Revised: 02/26/2024] [Accepted: 02/27/2024] [Indexed: 03/14/2024] Open
Abstract
BACKGROUND The aim of this review is to explore the role of artificial intelligence in the diagnosis of colorectal cancer, how it impacts CRC morbidity and mortality, and why its role in clinical medicine is limited. METHODS A targeted, non-systematic review of the published literature relating to colorectal cancer diagnosis was performed with PubMed databases that were scouted to help provide a more defined understanding of the recent advances regarding artificial intelligence and their impact on colorectal-related morbidity and mortality. Articles were included if deemed relevant and including information associated with the keywords. RESULTS The advancements in artificial intelligence have been significant in facilitating an earlier diagnosis of CRC. In this review, we focused on evaluating genomic biomarkers, the integration of instruments with artificial intelligence, MR and hyperspectral imaging, and the architecture of neural networks. We found that these neural networks seem practical and yield positive results in initial testing. Furthermore, we explored the use of deep-learning-based majority voting methods, such as bag of words and PAHLI, in improving diagnostic accuracy in colorectal cancer detection. Alongside this, the autonomous and expansive learning ability of artificial intelligence, coupled with its ability to extract increasingly complex features from images or videos without human reliance, highlight its impact in the diagnostic sector. Despite this, as most of the research involves a small sample of patients, a diversification of patient data is needed to enhance cohort stratification for a more sensitive and specific neural model. We also examined the successful application of artificial intelligence in predicting microsatellite instability, showcasing its potential in stratifying patients for targeted therapies. CONCLUSIONS Since its commencement in colorectal cancer, artificial intelligence has revealed a multitude of functionalities and augmentations in the diagnostic sector of CRC. Given its early implementation, its clinical application remains a fair way away, but with steady research dedicated to improving neural architecture and expanding its applicational range, there is hope that these advanced neural software could directly impact the early diagnosis of CRC. The true promise of artificial intelligence, extending beyond the medical sector, lies in its potential to significantly influence the future landscape of CRC's morbidity and mortality.
Collapse
Affiliation(s)
- Petar Uchikov
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Usman Khalid
- Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Krasimir Kraev
- Department of Propaedeutics of Internal Diseases "Prof. Dr. Anton Mitov", Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Bozhidar Hristov
- Section "Gastroenterology", Second Department of Internal Diseases, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Maria Kraeva
- Department of Otorhinolaryngology, Medical Faculty, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Tihomir Tenchev
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Dzhevdet Chakarov
- Department of Propaedeutics of Surgical Diseases, Section of General Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| | - Milena Sandeva
- Department of Midwifery, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Snezhanka Dragusheva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Daniela Taneva
- Department of Nursing Care, Faculty of Public Health, Medical University of Plovdiv, 4000 Plovdiv, Bulgaria
| | - Atanas Batashki
- Department of Special Surgery, Faculty of Medicine, Medical University of Plovdiv, 4002 Plovdiv, Bulgaria
| |
Collapse
|
45
|
Chen Z, Yang D, Li A, Sun L, Zhao J, Liu J, Liu L, Zhou X, Chen Y, Cai Y, Wu Z, Cheng K, Cai H, Tang M, Peng B, Wang X. Decoding surgical skill: an objective and efficient algorithm for surgical skill classification based on surgical gesture features -experimental studies. Int J Surg 2024; 110:1441-1449. [PMID: 38079605 PMCID: PMC10942222 DOI: 10.1097/js9.0000000000000975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2023] [Accepted: 11/21/2023] [Indexed: 03/16/2024]
Abstract
BACKGROUND Various surgical skills lead to differences in patient outcomes and identifying poorly skilled surgeons with constructive feedback contributes to surgical quality improvement. The aim of the study was to develop an algorithm for evaluating surgical skills in laparoscopic cholecystectomy based on the features of elementary functional surgical gestures (Surgestures). MATERIALS AND METHODS Seventy-five laparoscopic cholecystectomy videos were collected from 33 surgeons in five hospitals. The phase of mobilization hepatocystic triangle and gallbladder dissection from the liver bed of each video were annotated with 14 Surgestures. The videos were grouped into competent and incompetent based on the quantiles of modified global operative assessment of laparoscopic skills (mGOALS). Surgeon-related information, clinical data, and intraoperative events were analyzed. Sixty-three Surgesture features were extracted to develop the surgical skill classification algorithm. The area under the receiver operating characteristic curve of the classification and the top features were evaluated. RESULTS Correlation analysis revealed that most perioperative factors had no significant correlation with mGOALS scores. The incompetent group has a higher probability of cholecystic vascular injury compared to the competent group (30.8 vs 6.1%, P =0.004). The competent group demonstrated fewer inefficient Surgestures, lower shift frequency, and a larger dissection-exposure ratio of Surgestures during the procedure. The area under the receiver operating characteristic curve of the classification algorithm achieved 0.866. Different Surgesture features contributed variably to overall performance and specific skill items. CONCLUSION The computer algorithm accurately classified surgeons with different skill levels using objective Surgesture features, adding insight into designing automatic laparoscopic surgical skill assessment tools with technical feedback.
Collapse
Affiliation(s)
- Zixin Chen
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Dewei Yang
- Chongqing University of Posts and Telecommunications, School of Advanced Manufacturing Engineering, Chongqing
| | - Ang Li
- Department of General Surgery, Division of Pancreatic Surgery
- Guang’an People’s Hospital, Guang’an
| | - Louzong Sun
- Department of Hepatobiliary Surgery, Zigong First People’s Hospital, Zigong
| | - Jifan Zhao
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Jie Liu
- Chengdu Withai Innovations Technology Company, Chengdu
| | - Linxun Liu
- Department of General Surgery, Qinghai Provincial People’s Hospital, Xining, People’s Republic of China
| | - Xiaobo Zhou
- School of Biomedical Informatics, McGovern Medical School, University of Texas Health Science Center, Houston, USA
| | - Yonghua Chen
- Department of General Surgery, Division of Pancreatic Surgery
| | - Yunqiang Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Zhong Wu
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ke Cheng
- Department of General Surgery, Division of Pancreatic Surgery
| | - He Cai
- Department of General Surgery, Division of Pancreatic Surgery
| | - Ming Tang
- Department of General Surgery, Division of Pancreatic Surgery
- West China School of Medicine, West China Hospital of Sichuan University
| | - Bing Peng
- Department of General Surgery, Division of Pancreatic Surgery
| | - Xin Wang
- Department of General Surgery, Division of Pancreatic Surgery
| |
Collapse
|
46
|
Lui TKL, Ko MKL, Liu JJ, Xiao X, Leung WK. Artificial intelligence-assisted real-time monitoring of effective withdrawal time during colonoscopy: a novel quality marker of colonoscopy. Gastrointest Endosc 2024; 99:419-427.e6. [PMID: 37858761 DOI: 10.1016/j.gie.2023.10.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 10/06/2023] [Accepted: 10/11/2023] [Indexed: 10/21/2023]
Abstract
BACKGROUND AND AIMS The importance of withdrawal time during colonoscopy cannot be overstated in mitigating the risk of missed lesions and postcolonoscopy colorectal cancer. We evaluated a novel colonoscopy quality metric called the effective withdrawal time (EWT), which is an artificial intelligence (AI)-derived quantitative measure of quality withdrawal time, and its association with various colonic lesion detection rates as compared with standard withdrawal time (SWT). METHODS Three hundred fifty video recordings of colonoscopy withdrawal (from the cecum to the anus) were assessed by the new AI model. The primary outcome was adenoma detection rate (ADR) according to different quintiles of EWT. Multivariate logistic regression, adjusting for baseline covariates, was used to determine the adjusted odd ratios (ORs) for EWT on lesion detection rates, with the lowest quintile as reference. The area under the receiver-operating characteristic curve of EWT was compared with SWT. RESULTS The crude ADR in different quintiles of EWT, from lowest to highest, was 10.0%, 31.4%, 33.3%, 53.5%, and 85.7%. The ORs of detecting adenomas and polyps were significantly higher in all top 4 quintiles when compared with the lowest quintile. Each minute increase in EWT was associated with a 49% increase in ADR (aOR, 1.49; 95% confidence interval [CI], 1.36-1.65). The area under the receiver-operating characteristic curve of EWT was also significantly higher than SWT on adenoma detection (.80 [95% CI, .75-.84] vs .70 [95% CI, .64-.74], P < .01). CONCLUSIONS AI-derived monitoring of EWT is a promising novel quality indicator for colonoscopy, which is more associated with ADR than SWT.
Collapse
Affiliation(s)
- Thomas K L Lui
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| | - Michael K L Ko
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| | | | | | - Wai K Leung
- Department of Medicine, Queen Mary Hospital, University of Hong Kong, Hong Kong, China
| |
Collapse
|
47
|
Zhang H, Wu Q, Sun J, Wang J, Zhou L, Cai W, Zou D. A computer-aided system improves the performance of endoscopists in detecting colorectal polyps: a multi-center, randomized controlled trial. Front Med (Lausanne) 2024; 10:1341259. [PMID: 38327275 PMCID: PMC10847558 DOI: 10.3389/fmed.2023.1341259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 12/28/2023] [Indexed: 02/09/2024] Open
Abstract
Background Up to 45.9% of polyps are missed during colonoscopy, which is the major cause of post-colonoscopy colorectal cancer (CRC). Computer-aided detection (CADe) techniques based on deep learning might improve endoscopists' performance in detecting polyps. We aimed to evaluate the effectiveness of the CADe system in assisting endoscopists in a real-world clinical setting. Methods The CADe system was trained to detect colorectal polyps, recognize the ileocecal region, and monitor the speed of withdrawal during colonoscopy in real-time. Between 17 January 2021 and 16 July 2021. We recruited consecutive patients aged 18-75 years from three centers in China. We randomized patients in 1:1 groups to either colonoscopy with the CADe system or unassisted (control). The primary outcomes were the sensitivity and specificity of the endoscopists. We used subgroup analysis to examine the polyp detection rate (PDR) and the miss detection rate of endoscopists. Results A total of 1293 patients were included. The sensitivity of the endoscopists in the experimental group was significantly higher than that of the control group (84.97 vs. 72.07%, p < 0.001), and the specificity of the endoscopists in these two groups was comparable (100.00 vs. 100.00%). In a subgroup analysis, the CADe system improved the PDR of the 6-9 mm polyps (18.04 vs. 13.85%, p < 0.05) and reduced the miss detection rate, especially at 10:00-12:00 am (12.5 vs. 39.81%, p < 0.001). Conclusion The CADe system can potentially improve the sensitivity of endoscopists in detecting polyps, reduce the missed detection of polyps in colonoscopy, and reduce the risk of CRC. Registration This clinical trial was registered with the Chinese Clinical Trial Registry (Trial Registration Number: ChiCTR2100041988). Clinical trial registration website www.chictr.org.cn, identifier ChiCTR2100041988.
Collapse
Affiliation(s)
- Heng Zhang
- Department of Gastroenterology, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Qi Wu
- Endoscopy Center, Peking University Cancer Hospital and Institute, Beijing, China
| | - Jing Sun
- Department of Gastroenterology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jing Wang
- Endoscopy Center, Peking University Cancer Hospital and Institute, Beijing, China
| | - Lei Zhou
- Department of Gastroenterology, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Wei Cai
- Department of Gastrointestinal Surgery, The Central Hospital of Wuhan, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Duowu Zou
- Department of Gastroenterology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
48
|
Kim BS, Cho M, Chung GE, Lee J, Kang HY, Yoon D, Cho WS, Lee JC, Bae JH, Kong HJ, Kim S. Density clustering-based automatic anatomical section recognition in colonoscopy video using deep learning. Sci Rep 2024; 14:872. [PMID: 38195632 PMCID: PMC10776865 DOI: 10.1038/s41598-023-51056-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Accepted: 12/29/2023] [Indexed: 01/11/2024] Open
Abstract
Recognizing anatomical sections during colonoscopy is crucial for diagnosing colonic diseases and generating accurate reports. While recent studies have endeavored to identify anatomical regions of the colon using deep learning, the deformable anatomical characteristics of the colon pose challenges for establishing a reliable localization system. This study presents a system utilizing 100 colonoscopy videos, combining density clustering and deep learning. Cascaded CNN models are employed to estimate the appendix orifice (AO), flexures, and "outside of the body," sequentially. Subsequently, DBSCAN algorithm is applied to identify anatomical sections. Clustering-based analysis integrates clinical knowledge and context based on the anatomical section within the model. We address challenges posed by colonoscopy images through non-informative removal preprocessing. The image data is labeled by clinicians, and the system deduces section correspondence stochastically. The model categorizes the colon into three sections: right (cecum and ascending colon), middle (transverse colon), and left (descending colon, sigmoid colon, rectum). We estimated the appearance time of anatomical boundaries with an average error of 6.31 s for AO, 9.79 s for HF, 27.69 s for SF, and 3.26 s for outside of the body. The proposed method can facilitate future advancements towards AI-based automatic reporting, offering time-saving efficacy and standardization.
Collapse
Grants
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- 1711179421, RS-2021-KD000006 the Korea Medical Device Development Fund grant funded by the Korean government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health and Welfare, and the Ministry of Food and Drug Safety)
- IITP-2023-2018-0-01833 the Ministry of Science and ICT, Korea under the Information Technology Research Center (ITRC) support program
Collapse
Affiliation(s)
- Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Minwoo Cho
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea
| | - Goh Eun Chung
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Jooyoung Lee
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Hae Yeon Kang
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Woo Sang Cho
- Interdisciplinary Program in Bioengineering, Graduate School, Seoul National University, Seoul, 08826, Korea
| | - Jung Chan Lee
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea
- Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, 03080, Korea
| | - Jung Ho Bae
- Department of Internal Medicine and Healthcare Research Institute, Healthcare System Gangnam Center, Seoul National University Hospital, Seoul, 06236, Korea.
| | - Hyoun-Joong Kong
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, 03080, Korea.
- Department of Medicine, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Medical Big Data Research Center, Seoul National University College of Medicine, Seoul, 03087, Korea.
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, 03080, Korea.
- Institute of Bioengineering, Seoul National University, Seoul, 08826, Republic of Korea.
- Artificial Intelligence Institute, Seoul National University, Research Park Building 942, 2 Fl., Seoul, 08826, Korea.
| |
Collapse
|
49
|
Troya J, Sudarevic B, Krenzer A, Banck M, Brand M, Walter BM, Puppe F, Zoller WG, Meining A, Hann A. Direct comparison of multiple computer-aided polyp detection systems. Endoscopy 2024; 56:63-69. [PMID: 37532115 PMCID: PMC10736101 DOI: 10.1055/a-2147-0571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 08/01/2023] [Indexed: 08/04/2023]
Abstract
BACKGROUND AND STUDY AIMS Artificial intelligence (AI)-based systems for computer-aided detection (CADe) of polyps receive regular updates and occasionally offer customizable detection thresholds, both of which impact their performance, but little is known about these effects. This study aimed to compare the performance of different CADe systems on the same benchmark dataset. METHODS 101 colonoscopy videos were used as benchmark. Each video frame with a visible polyp was manually annotated with bounding boxes, resulting in 129 705 polyp images. The videos were then analyzed by three different CADe systems, representing five conditions: two versions of GI Genius, Endo-AID with detection Types A and B, and EndoMind, a freely available system. Evaluation included an analysis of sensitivity and false-positive rate, among other metrics. RESULTS Endo-AID detection Type A, the earlier version of GI Genius, and EndoMind detected all 93 polyps. Both the later version of GI Genius and Endo-AID Type B missed 1 polyp. The mean per-frame sensitivities were 50.63 % and 67.85 %, respectively, for the earlier and later versions of GI Genius, 65.60 % and 52.95 %, respectively, for Endo-AID Types A and B, and 60.22 % for EndoMind. CONCLUSIONS This study compares the performance of different CADe systems, different updates, and different configuration modes. This might help clinicians to select the most appropriate system for their specific needs.
Collapse
Affiliation(s)
- Joel Troya
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Bavarian Cancer Research Center, Würzburg, Germany
| | - Boban Sudarevic
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Department of Internal Medicine and Gastroenterology, Katharinenhospital, Stuttgart, Germany
| | - Adrian Krenzer
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Michael Banck
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Markus Brand
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Benjamin M. Walter
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| | - Frank Puppe
- Artificial Intelligence and Knowledge Systems, Institute for Computer Science, Julius-Maximilians-Universität, Würzburg, Germany
| | - Wolfram G. Zoller
- Department of Internal Medicine and Gastroenterology, Katharinenhospital, Stuttgart, Germany
| | - Alexander Meining
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
- Bavarian Cancer Research Center, Würzburg, Germany
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| |
Collapse
|
50
|
Ahn JC, Shah VH. Artificial intelligence in gastroenterology and hepatology. ARTIFICIAL INTELLIGENCE IN CLINICAL PRACTICE 2024:443-464. [DOI: 10.1016/b978-0-443-15688-5.00016-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|