|
1
|
De Carvalho T, Kader R, Brandao P, Lovat LB, Mountney P, Stoyanov D. NICE polyp feature classification for colonoscopy screening. Int J Comput Assist Radiol Surg 2025; 20:1015-1024. [PMID: 40075052 PMCID: PMC12055651 DOI: 10.1007/s11548-025-03338-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2024] [Accepted: 02/12/2025] [Indexed: 03/14/2025]
Abstract
PURPOSE Colorectal cancer is one of the most prevalent cancers worldwide, highlighting the critical need for early and accurate diagnosis to reduce patient risks. Inaccurate diagnoses not only compromise patient outcomes but also lead to increased costs and additional time burdens for clinicians. Enhancing diagnostic accuracy is essential, and this study focuses on improving the accuracy of polyp classification using the NICE classification, which evaluates three key features: colour, vessels, and surface pattern. METHODS A multiclass classifier was developed and trained to independently classify each of the three features in the NICE classification. The approach prioritizes clinically relevant features rather than relying on handcrafted or obscure deep learning features, ensuring transparency and reliability for clinical use. The classifier was trained on internal datasets and tested on both internal and public datasets. RESULTS The classifier successfully classified the three polyp features, achieving an accuracy of over 92% on internal datasets and exceeding 88% on a public dataset. The high classification accuracy demonstrates the system's effectiveness in identifying the key features from the NICE classification. CONCLUSION This study underscores the potential of using an independent classification approach for NICE features to enhance clinical decision-making in colorectal cancer diagnosis. The method shows promise in improving diagnostic accuracy, which could lead to better patient outcomes and more efficient clinical workflows.
Collapse
Affiliation(s)
- Thomas De Carvalho
- Odin Vision, London, UK.
- Department of Computer Science, UCL Hawkes Institute, University College London, London, UK.
| | - Rawen Kader
- Division of Surgery and Interventional Science, University College London, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| | | | - Laurence B Lovat
- Division of Surgery and Interventional Science, University College London, London, UK
- Gastrointestinal Services, University College London Hospital, London, UK
| | | | - Danail Stoyanov
- Department of Computer Science, UCL Hawkes Institute, University College London, London, UK
| |
Collapse
|
|
2
|
Nagarajan KV, Bhat N. Imaging colonic polyps in 2024. Indian J Gastroenterol 2024; 43:954-965. [PMID: 39347933 DOI: 10.1007/s12664-024-01679-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Accepted: 08/19/2024] [Indexed: 10/01/2024]
Abstract
Screening colonoscopy and polypectomy are the cornerstone in decreasing the incidence and mortality of colorectal cancer. Despite the low incidence of colorectal cancer in India, there has been a rising trend in the incidence of colonic polyps and cancer over the last decade. It is, hence, imperative that we are well equipped in the management of colonic polyps. Adequate training in the detection and characterization of polyps to aid in their management is necessary. Detection of polyps can be increased by adhering to the standards of colonoscopy, including good bowel preparation, cecal intubation rate, adequate withdrawal time and use of distal attachment devices. A detected polyp needs optimal characterization to predict histology in real time and decide on the management strategies. Characterization of the polyps requires high-definition-white light endoscopy and/or image-enhanced endoscopy (dye based or digital). Various factors that help in predicting histology include size, location and morphology of the polyp and the pit pattern, vascular and surface pattern of the polyp. Polyps can be differentiated as neoplastic or non-neoplastic with reasonable accuracy with the above features. Prediction of advanced pathology including high-grade dysplasia and deep sub-mucosal invasion is essential, as it helps in deciding if the lesion is amenable to endotherapy and the technique of endoscopic resection. Adequate training in image-enhanced endoscopy is necessary to assess advanced pathology in polyps. Technology pertaining to image-enhanced endoscopy includes narrow banding imaging and blue laser imaging; newer variations are being introduced every few years making it necessary to be abreast with growing information. The recent advances in gastrointestinal (GI) endoscopy with the advent of endocytoscopy and artificial intelligence seem promising and are predicted to be the future of GI endoscopy.
Collapse
Affiliation(s)
- Kayal Vizhi Nagarajan
- Department of Gastroenterology, Hepatology and Clinical Nutrition, Aster CMI Hospital, Bengaluru, 560 092, India
| | - Naresh Bhat
- Department of Gastroenterology, Hepatology and Clinical Nutrition, Aster CMI Hospital, Bengaluru, 560 092, India.
| |
Collapse
|
|
3
|
Spadaccini M, Troya J, Khalaf K, Facciorusso A, Maselli R, Hann A, Repici A. Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going? Dig Liver Dis 2024; 56:1148-1155. [PMID: 38458884 DOI: 10.1016/j.dld.2024.01.203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 01/22/2024] [Accepted: 01/23/2024] [Indexed: 03/10/2024]
Abstract
Colorectal cancer is a significant global health concern, necessitating effective screening strategies to reduce its incidence and mortality rates. Colonoscopy plays a crucial role in the detection and removal of colorectal neoplastic precursors. However, there are limitations and variations in the performance of endoscopists, leading to missed lesions and suboptimal outcomes. The emergence of artificial intelligence (AI) in endoscopy offers promising opportunities to improve the quality and efficacy of screening colonoscopies. In particular, AI applications, including computer-aided detection (CADe) and computer-aided characterization (CADx), have demonstrated the potential to enhance adenoma detection and optical diagnosis accuracy. Additionally, AI-assisted quality control systems aim to standardize the endoscopic examination process. This narrative review provides an overview of AI principles and discusses the current knowledge on AI-assisted endoscopy in the context of screening colonoscopies. It highlights the significant role of AI in improving lesion detection, characterization, and quality assurance during colonoscopy. However, further well-designed studies are needed to validate the clinical impact and cost-effectiveness of AI-assisted colonoscopy before its widespread implementation.
Collapse
Affiliation(s)
- Marco Spadaccini
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy.
| | - Joel Troya
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Kareem Khalaf
- Division of Gastroenterology, St. Michael's Hospital, University of Toronto, Toronto, Canada
| | - Antonio Facciorusso
- Gastroenterology Unit, Department of Surgical and Medical Sciences, University of Foggia, Foggia, Italy
| | - Roberta Maselli
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Alexander Hann
- Interventional and Experimental Endoscopy (InExEn), Department of Internal Medicine II, University Hospital Würzburg, Würzburg, Germany
| | - Alessandro Repici
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| |
Collapse
|
|
4
|
Sikkandar MY, Sundaram SG, Alassaf A, AlMohimeed I, Alhussaini K, Aleid A, Alolayan SA, Ramkumar P, Almutairi MK, Begum SS. Utilizing adaptive deformable convolution and position embedding for colon polyp segmentation with a visual transformer. Sci Rep 2024; 14:7318. [PMID: 38538774 PMCID: PMC11377543 DOI: 10.1038/s41598-024-57993-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 03/24/2024] [Indexed: 09/07/2024] Open
Abstract
Polyp detection is a challenging task in the diagnosis of Colorectal Cancer (CRC), and it demands clinical expertise due to the diverse nature of polyps. The recent years have witnessed the development of automated polyp detection systems to assist the experts in early diagnosis, considerably reducing the time consumption and diagnostic errors. In automated CRC diagnosis, polyp segmentation is an important step which is carried out with deep learning segmentation models. Recently, Vision Transformers (ViT) are slowly replacing these models due to their ability to capture long range dependencies among image patches. However, the existing ViTs for polyp do not harness the inherent self-attention abilities and incorporate complex attention mechanisms. This paper presents Polyp-Vision Transformer (Polyp-ViT), a novel Transformer model based on the conventional Transformer architecture, which is enhanced with adaptive mechanisms for feature extraction and positional embedding. Polyp-ViT is tested on the Kvasir-seg and CVC-Clinic DB Datasets achieving segmentation accuracies of 0.9891 ± 0.01 and 0.9875 ± 0.71 respectively, outperforming state-of-the-art models. Polyp-ViT is a prospective tool for polyp segmentation which can be adapted to other medical image segmentation tasks as well due to its ability to generalize well.
Collapse
Affiliation(s)
- Mohamed Yacin Sikkandar
- Department of Medical Equipment Technology, College of Applied Medical Sciences, Majmaah University, Al Majmaah, 11952, Saudi Arabia.
| | - Sankar Ganesh Sundaram
- Department of Artificial Intelligence and Data Science, KPR Institute of Engineering and Technology, Coimbatore, 641407, India
| | - Ahmad Alassaf
- Department of Medical Equipment Technology, College of Applied Medical Sciences, Majmaah University, Al Majmaah, 11952, Saudi Arabia
| | - Ibrahim AlMohimeed
- Department of Medical Equipment Technology, College of Applied Medical Sciences, Majmaah University, Al Majmaah, 11952, Saudi Arabia
| | - Khalid Alhussaini
- Department of Biomedical Technology, College of Applied Medical Sciences, King Saud University, Riyadh, 12372, Saudi Arabia
| | - Adham Aleid
- Department of Biomedical Technology, College of Applied Medical Sciences, King Saud University, Riyadh, 12372, Saudi Arabia
| | - Salem Ali Alolayan
- Department of Medical Equipment Technology, College of Applied Medical Sciences, Majmaah University, Al Majmaah, 11952, Saudi Arabia
| | - P Ramkumar
- Department of Computer Science and Engineering, Sri Sairam College of Engineering, Anekal, Bengaluru, 562106, Karnataka, India
| | - Meshal Khalaf Almutairi
- Department of Medical Equipment Technology, College of Applied Medical Sciences, Majmaah University, Al Majmaah, 11952, Saudi Arabia
| | - S Sabarunisha Begum
- Department of Biotechnology, P.S.R. Engineering College, Sivakasi, 626140, India
| |
Collapse
|
|
5
|
Khalaf K, Fujiyoshi MRA, Spadaccini M, Rizkala T, Ramai D, Colombo M, Fugazza A, Facciorusso A, Carrara S, Hassan C, Repici A. From Staining Techniques to Artificial Intelligence: A Review of Colorectal Polyps Characterization. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:89. [PMID: 38256350 PMCID: PMC10818333 DOI: 10.3390/medicina60010089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/24/2023] [Accepted: 12/26/2023] [Indexed: 01/24/2024]
Abstract
This review article provides a comprehensive overview of the evolving techniques in image-enhanced endoscopy (IEE) for the characterization of colorectal polyps, and the potential of artificial intelligence (AI) in revolutionizing the diagnostic accuracy of endoscopy. We discuss the historical use of dye-spray and virtual chromoendoscopy for the characterization of colorectal polyps, which are now being replaced with more advanced technologies. Specifically, we focus on the application of AI to create a "virtual biopsy" for the detection and characterization of colorectal polyps, with potential for replacing histopathological diagnosis. The incorporation of AI has the potential to provide an evolutionary learning system that aids in the diagnosis and management of patients with the best possible outcomes. A detailed analysis of the literature supporting AI-assisted diagnostic techniques for the detection and characterization of colorectal polyps, with a particular emphasis on AI's characterization mechanism, is provided. The benefits of AI over traditional IEE techniques, including the reduction in human error in diagnosis, and its potential to provide an accurate diagnosis with similar accuracy to the gold standard are presented. However, the need for large-scale testing of AI in clinical practice and the importance of integrating patient data into the diagnostic process are acknowledged. In conclusion, the constant evolution of IEE technology and the potential for AI to revolutionize the field of endoscopy in the future are presented.
Collapse
Affiliation(s)
- Kareem Khalaf
- Division of Gastroenterology, St. Michael’s Hospital, University of Toronto, Toronto, ON M5B 1T8, Canada; (K.K.); (M.R.A.F.)
| | - Mary Raina Angeli Fujiyoshi
- Division of Gastroenterology, St. Michael’s Hospital, University of Toronto, Toronto, ON M5B 1T8, Canada; (K.K.); (M.R.A.F.)
- Digestive Diseases Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Marco Spadaccini
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Tommy Rizkala
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Daryl Ramai
- Gastroenterology and Hepatology, University of Utah Health, Salt Lake City, UT 84132, USA;
| | - Matteo Colombo
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Alessandro Fugazza
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Antonio Facciorusso
- Department of Endoscopy, Section of Gastroenterology, Department of Medical and Surgical Sciences, University of Foggia, 71122 Foggia, Italy;
| | - Silvia Carrara
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
| | - Cesare Hassan
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| | - Alessandro Repici
- Department of Endoscopy, Humanitas Research Hospital, IRCCS, 20089 Rozzano, Italy; (T.R.); (M.C.); (A.F.); (S.C.); (C.H.); (A.R.)
- Department of Biomedical Sciences, Humanitas University, 20089 Rozzano, Italy
| |
Collapse
|
|
6
|
Ding M, Yan J, Chao G, Zhang S. Application of artificial intelligence in colorectal cancer screening by colonoscopy: Future prospects (Review). Oncol Rep 2023; 50:199. [PMID: 37772392 DOI: 10.3892/or.2023.8636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 07/07/2023] [Indexed: 09/30/2023] Open
Abstract
Colorectal cancer (CRC) has become a severe global health concern, with the third‑high incidence and second‑high mortality rate of all cancers. The burden of CRC is expected to surge to 60% by 2030. Fortunately, effective early evidence‑based screening could significantly reduce the incidence and mortality of CRC. Colonoscopy is the core screening method for CRC with high popularity and accuracy. Yet, the accuracy of colonoscopy in CRC screening is related to the experience and state of operating physicians. It is challenging to maintain the high CRC diagnostic rate of colonoscopy. Artificial intelligence (AI)‑assisted colonoscopy will compensate for the above shortcomings and improve the accuracy, efficiency, and quality of colonoscopy screening. The unique advantages of AI, such as the continuous advancement of high‑performance computing capabilities and innovative deep‑learning architectures, which hugely impact the control of colorectal cancer morbidity and mortality expectancy, highlight its role in colonoscopy screening.
Collapse
Affiliation(s)
- Menglu Ding
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| | - Junbin Yan
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| | - Guanqun Chao
- Department of General Practice, Sir Run Run Shaw Hospital, Zhejiang University, Hangzhou, Zhejiang 310000, P.R. China
| | - Shuo Zhang
- The Second Affiliated Hospital of Zhejiang Chinese Medical University (The Xin Hua Hospital of Zhejiang Province), Hangzhou, Zhejiang 310000, P.R. China
| |
Collapse
|
|
7
|
Dos Santos CEO, Malaman D, Arciniegas Sanmartin ID, Leão ABS, Leão GS, Pereira-Lima JC. Performance of artificial intelligence in the characterization of colorectal lesions. Saudi J Gastroenterol 2023; 29:219-224. [PMID: 37203122 PMCID: PMC10445495 DOI: 10.4103/sjg.sjg_316_22] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 04/10/2023] [Indexed: 05/20/2023] Open
Abstract
Background Image-enhanced endoscopy (IEE) has been used in the differentiation between neoplastic and non-neoplastic colorectal lesions through microvasculature analysis. This study aimed to evaluate the computer-aided diagnosis (CADx) mode of the CAD EYE system for the optical diagnosis of colorectal lesions and compare it with the performance of an expert, in addition to evaluating the computer-aided detection (CADe) mode in terms of polyp detection rate (PDR) and adenoma detection rate (ADR). Methods A prospective study was conducted to evaluate the performance of CAD EYE using blue light imaging (BLI), dichotomizing lesions into hyperplastic and neoplastic, and of an expert based on the Japan Narrow-Band Imaging Expert Team (JNET) classification for the characterization of lesions. After white light imaging (WLI) diagnosis, magnification was used on all lesions, which were removed and examined histologically. Diagnostic criteria were evaluated, and PDR and ADR were calculated. Results A total of 110 lesions (80 (72.7%) dysplastic lesions and 30 (27.3%) nondysplastic lesions) were evaluated in 52 patients, with a mean lesion size of 4.3 mm. Artificial intelligence (AI) analysis showed 81.8% accuracy, 76.3% sensitivity, 96.7% specificity, 98.5% positive predictive value (PPV), and 60.4% negative predictive value (NPV). The kappa value was 0.61, and the area under the receiver operating characteristic curve (AUC) was 0.87. Expert analysis showed 93.6% accuracy, 92.5% sensitivity, 96.7% specificity, 98.7% PPV, and 82.9% NPV. The kappa value was 0.85, and the AUC was 0.95. Overall, PDR was 67.6% and ADR was 45.9%. Conclusions The CADx mode showed good accuracy in characterizing colorectal lesions, but the expert assessment was superior in almost all diagnostic criteria. PDR and ADR were high.
Collapse
Affiliation(s)
- Carlos E. O. Dos Santos
- Department of Endoscopy, Santa Casa de Caridade Hospital, Bagé, RS, Brazil
- Department of Endoscopy, Pontifícia Universidade Católica do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Daniele Malaman
- Department of Endoscopy, Santa Casa de Caridade Hospital, Bagé, RS, Brazil
| | | | - Ari B. S. Leão
- Department of Endoscopy, Pontifícia Universidade Católica do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Gabriel S. Leão
- Department of Endoscopy, Pontifícia Universidade Católica do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Júlio C. Pereira-Lima
- Department of Gastroenterology and Endoscopy, Santa Casa Hospital, Porto Alegre, RS, Brazil
| |
Collapse
|
|
8
|
Mansour NM. Artificial Intelligence in Colonoscopy. Curr Gastroenterol Rep 2023; 25:122-129. [PMID: 37129831 DOI: 10.1007/s11894-023-00872-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/03/2023] [Indexed: 05/03/2023]
Abstract
PURPOSE OF REVIEW Artificial intelligence (AI) is a rapidly growing field in gastrointestinal endoscopy, and its potential applications are virtually endless, with studies demonstrating use of AI for early gastric cancer, inflammatory bowel disease, Barrett's esophagus, capsule endoscopy, as well as other areas in gastroenterology. Much of the early studies and applications of AI in gastroenterology have revolved around colonoscopy, particularly with regards to real-time polyp detection and characterization. This review will cover much of the existing data on computer-aided detection (CADe), computer-aided diagnosis (CADx), and briefly discuss some other interesting applications of AI for colonoscopy, while also considering some of the challenges and limitations that exist around the use of AI for colonoscopy. RECENT FINDINGS Multiple randomized controlled trials have now been published which show a statistically significant improvement when using AI to improve adenoma detection and reduce adenoma miss rates during colonoscopy. There is also a growing pool of literature showing that AI can be helpful for characterizing/diagnosing colorectal polyps in real time. AI has also shown promise in other areas of colonoscopy, including polyp sizing and automated measurement and monitoring of quality metrics during colonoscopy. AI is a promising tool that has the ability to shape the future of gastrointestinal endoscopy, with much of the early data showing significant benefits to use of AI during colonoscopy. However, there remain several challenges that may delay or hamper the widespread use of AI in the field.
Collapse
Affiliation(s)
- Nabil M Mansour
- Section of Gastroenterology and Hepatology, Baylor College of Medicine, 7200 Cambridge St., Suite 8B, Houston, TX, 77030, USA.
| |
Collapse
|
|
9
|
Gimeno-García AZ, Hernández-Pérez A, Nicolás-Pérez D, Hernández-Guerra M. Artificial Intelligence Applied to Colonoscopy: Is It Time to Take a Step Forward? Cancers (Basel) 2023; 15:cancers15082193. [PMID: 37190122 DOI: 10.3390/cancers15082193] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 04/04/2023] [Accepted: 04/05/2023] [Indexed: 05/17/2023] Open
Abstract
Growing evidence indicates that artificial intelligence (AI) applied to medicine is here to stay. In gastroenterology, AI computer vision applications have been stated as a research priority. The two main AI system categories are computer-aided polyp detection (CADe) and computer-assisted diagnosis (CADx). However, other fields of expansion are those related to colonoscopy quality, such as methods to objectively assess colon cleansing during the colonoscopy, as well as devices to automatically predict and improve bowel cleansing before the examination, predict deep submucosal invasion, obtain a reliable measurement of colorectal polyps and accurately locate colorectal lesions in the colon. Although growing evidence indicates that AI systems could improve some of these quality metrics, there are concerns regarding cost-effectiveness, and large and multicentric randomized studies with strong outcomes, such as post-colonoscopy colorectal cancer incidence and mortality, are lacking. The integration of all these tasks into one quality-improvement device could facilitate the incorporation of AI systems in clinical practice. In this manuscript, the current status of the role of AI in colonoscopy is reviewed, as well as its current applications, drawbacks and areas for improvement.
Collapse
Affiliation(s)
- Antonio Z Gimeno-García
- Gastroenterology Department, Hospital Universitario de Canarias, 38200 San Cristóbal de La Laguna, Tenerife, Spain
- Instituto Universitario de Tecnologías Biomédicas (ITB) & Centro de Investigación Biomédica de Canarias (CIBICAN), Internal Medicine Department, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Tenerife, Spain
| | - Anjara Hernández-Pérez
- Gastroenterology Department, Hospital Universitario de Canarias, 38200 San Cristóbal de La Laguna, Tenerife, Spain
- Instituto Universitario de Tecnologías Biomédicas (ITB) & Centro de Investigación Biomédica de Canarias (CIBICAN), Internal Medicine Department, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Tenerife, Spain
| | - David Nicolás-Pérez
- Gastroenterology Department, Hospital Universitario de Canarias, 38200 San Cristóbal de La Laguna, Tenerife, Spain
- Instituto Universitario de Tecnologías Biomédicas (ITB) & Centro de Investigación Biomédica de Canarias (CIBICAN), Internal Medicine Department, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Tenerife, Spain
| | - Manuel Hernández-Guerra
- Gastroenterology Department, Hospital Universitario de Canarias, 38200 San Cristóbal de La Laguna, Tenerife, Spain
- Instituto Universitario de Tecnologías Biomédicas (ITB) & Centro de Investigación Biomédica de Canarias (CIBICAN), Internal Medicine Department, Universidad de La Laguna, 38200 San Cristóbal de La Laguna, Tenerife, Spain
| |
Collapse
|
|
10
|
Spadaccini M, Massimi D, Mori Y, Alfarone L, Fugazza A, Maselli R, Sharma P, Facciorusso A, Hassan C, Repici A. Artificial Intelligence-Aided Endoscopy and Colorectal Cancer Screening. Diagnostics (Basel) 2023; 13:1102. [PMID: 36980409 PMCID: PMC10047293 DOI: 10.3390/diagnostics13061102] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 02/19/2023] [Accepted: 03/11/2023] [Indexed: 03/17/2023] Open
Abstract
Colorectal cancer (CRC) is the third most common cancer worldwide, with the highest incidence reported in high-income countries. However, because of the slow progression of neoplastic precursors, along with the opportunity for their endoscopic detection and resection, a well-designed endoscopic screening program is expected to strongly decrease colorectal cancer incidence and mortality. In this regard, quality of colonoscopy has been clearly related with the risk of post-colonoscopy colorectal cancer. Recently, the development of artificial intelligence (AI) applications in the medical field has been growing in interest. Through machine learning processes, and, more recently, deep learning, if a very high numbers of learning samples are available, AI systems may automatically extract specific features from endoscopic images/videos without human intervention, helping the endoscopists in different aspects of their daily practice. The aim of this review is to summarize the current knowledge on AI-aided endoscopy, and to outline its potential role in colorectal cancer prevention.
Collapse
Affiliation(s)
- Marco Spadaccini
- Department of Biomedical Sciences, Humanitas University, 20090 Rozzano, Italy
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Davide Massimi
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Yuichi Mori
- Clinical Effectiveness Research Group, Institute of Health and Society, Faculty of Medicine, University of Oslo, 0315 Oslo, Norway
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama 224-0032, Japan
| | - Ludovico Alfarone
- Department of Biomedical Sciences, Humanitas University, 20090 Rozzano, Italy
| | - Alessandro Fugazza
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Roberta Maselli
- Department of Biomedical Sciences, Humanitas University, 20090 Rozzano, Italy
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Prateek Sharma
- Division of Gastroenterology and Hepatology, Veterans Affairs Medical Center, Kansas City, MO 64128, USA
| | - Antonio Facciorusso
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, 20090 Rozzano, Italy
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| | - Alessandro Repici
- Department of Biomedical Sciences, Humanitas University, 20090 Rozzano, Italy
- Endoscopy Unit, Humanitas Clinical and Research Center, IRCCS, 20090 Rozzano, Italy
| |
Collapse
|
|
11
|
Gan P, Li P, Xia H, Zhou X, Tang X. The application of artificial intelligence in improving colonoscopic adenoma detection rate: Where are we and where are we going. GASTROENTEROLOGIA Y HEPATOLOGIA 2023; 46:203-213. [PMID: 35489584 DOI: 10.1016/j.gastrohep.2022.03.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Revised: 03/08/2022] [Accepted: 03/18/2022] [Indexed: 02/08/2023]
Abstract
Colorectal cancer (CRC) is one of the common malignant tumors in the world. Colonoscopy is the crucial examination technique in CRC screening programs for the early detection of precursor lesions, and treatment of early colorectal cancer, which can reduce the morbidity and mortality of CRC significantly. However, pooled polyp miss rates during colonoscopic examination are as high as 22%. Artificial intelligence (AI) provides a promising way to improve the colonoscopic adenoma detection rate (ADR). It might assist endoscopists in avoiding missing polyps and offer an accurate optical diagnosis of suspected lesions. Herein, we described some of the milestone studies in using AI for colonoscopy, and the future application directions of AI in improving colonoscopic ADR.
Collapse
Affiliation(s)
- Peiling Gan
- Department of Gastroenterology, Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Peiling Li
- Department of Gastroenterology, Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Huifang Xia
- Department of Gastroenterology, Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Xian Zhou
- Department of Gastroenterology, Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Xiaowei Tang
- Department of Gastroenterology, Affiliated Hospital of Southwest Medical University, Luzhou, China; Department of Gastroenterology, The First Medical Center of Chinese PLA General Hospital, Beijing, China.
| |
Collapse
|
|
12
|
Artificial Intelligence-The Rising Star in the Field of Gastroenterology and Hepatology. Diagnostics (Basel) 2023; 13:diagnostics13040662. [PMID: 36832150 PMCID: PMC9955763 DOI: 10.3390/diagnostics13040662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 01/31/2023] [Accepted: 02/07/2023] [Indexed: 02/12/2023] Open
Abstract
Artificial intelligence (AI) is a term that covers a multitude of techniques that are used in a manner that tries to reproduce human intelligence. AI is helpful in various medical specialties that use imaging for diagnostic purposes, and gastroenterology is no exception. In this field, AI has several applications, such as detecting and classifying polyps, detecting the malignancy in polyps, diagnosing Helicobacter pylori infection, gastritis, inflammatory bowel disease, gastric cancer, esophageal neoplasia, and pancreatic and hepatic lesions. The aim of this mini-review is to analyze the currently available studies regarding AI in the field of gastroenterology and hepatology and to discuss its main applications as well as its main limitations.
Collapse
|
|
13
|
A Novel Computer-Aided Detection/Diagnosis System for Detection and Classification of Polyps in Colonoscopy. Diagnostics (Basel) 2023; 13:diagnostics13020170. [PMID: 36672980 PMCID: PMC9857872 DOI: 10.3390/diagnostics13020170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 12/16/2022] [Accepted: 12/20/2022] [Indexed: 01/05/2023] Open
Abstract
Using a deep learning algorithm in the development of a computer-aided system for colon polyp detection is effective in reducing the miss rate. This study aimed to develop a system for colon polyp detection and classification. We used a data augmentation technique and conditional GAN to generate polyp images for YOLO training to improve the polyp detection ability. After testing the model five times, a model with 300 GANs (GAN 300) achieved the highest average precision (AP) of 54.60% for SSA and 75.41% for TA. These results were better than those of the data augmentation method, which showed AP of 53.56% for SSA and 72.55% for TA. The AP, mAP, and IoU for the 300 GAN model for the HP were 80.97%, 70.07%, and 57.24%, and the data increased in comparison with the data augmentation technique by 76.98%, 67.70%, and 55.26%, respectively. We also used Gaussian blurring to simulate the blurred images during colonoscopy and then applied DeblurGAN-v2 to deblur the images. Further, we trained the dataset using YOLO to classify polyps. After using DeblurGAN-v2, the mAP increased from 25.64% to 30.74%. This method effectively improved the accuracy of polyp detection and classification.
Collapse
|
|
14
|
Dilmaghani S, Coelho-Prabhu N. Role of Artificial Intelligence in Colonoscopy: A Literature Review of the Past, Present, and Future Directions. TECHNIQUES AND INNOVATIONS IN GASTROINTESTINAL ENDOSCOPY 2023; 25:399-412. [DOI: 10.1016/j.tige.2023.03.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
|
15
|
Li MD, Huang ZR, Shan QY, Chen SL, Zhang N, Hu HT, Wang W. Performance and comparison of artificial intelligence and human experts in the detection and classification of colonic polyps. BMC Gastroenterol 2022; 22:517. [PMID: 36513975 PMCID: PMC9749329 DOI: 10.1186/s12876-022-02605-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Accepted: 12/05/2022] [Indexed: 12/15/2022] Open
Abstract
OBJECTIVE The main aim of this study was to analyze the performance of different artificial intelligence (AI) models in endoscopic colonic polyp detection and classification and compare them with doctors with different experience. METHODS We searched the studies on Colonoscopy, Colonic Polyps, Artificial Intelligence, Machine Learning, and Deep Learning published before May 2020 in PubMed, EMBASE, Cochrane, and the citation index of the conference proceedings. The quality of studies was assessed using the QUADAS-2 table of diagnostic test quality evaluation criteria. The random-effects model was calculated using Meta-DISC 1.4 and RevMan 5.3. RESULTS A total of 16 studies were included for meta-analysis. Only one study (1/16) presented externally validated results. The area under the curve (AUC) of AI group, expert group and non-expert group for detection and classification of colonic polyps were 0.940, 0.918, and 0.871, respectively. AI group had slightly lower pooled specificity than the expert group (79% vs. 86%, P < 0.05), but the pooled sensitivity was higher than the expert group (88% vs. 80%, P < 0.05). While the non-experts had less pooled specificity in polyp recognition than the experts (81% vs. 86%, P < 0.05), and higher pooled sensitivity than the experts (85% vs. 80%, P < 0.05). CONCLUSION The performance of AI in polyp detection and classification is similar to that of human experts, with high sensitivity and moderate specificity. Different tasks may have an impact on the performance of deep learning models and human experts, especially in terms of sensitivity and specificity.
Collapse
Affiliation(s)
- Ming-De Li
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| | - Ze-Rong Huang
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| | - Quan-Yuan Shan
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| | - Shu-Ling Chen
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| | - Ning Zhang
- grid.412615.50000 0004 1803 6239Department of Gastroenterology, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
| | - Hang-Tong Hu
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| | - Wei Wang
- grid.412615.50000 0004 1803 6239Department of Medical Ultrasonics, Ultrasomics Artificial Intelligence X-Lab, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-Sen University, 58 Zhongshan Road 2, Guangzhou, 510080 People’s Republic of China
| |
Collapse
|
|
16
|
Teramoto A, Hamada S, Ogino B, Yasuda I, Sano Y. Updates in narrow-band imaging for colorectal polyps: Narrow-band imaging generations, detection, diagnosis, and artificial intelligence. Dig Endosc 2022; 35:453-470. [PMID: 36480465 DOI: 10.1111/den.14489] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 12/01/2022] [Indexed: 01/20/2023]
Abstract
Narrow-band imaging (NBI) is an optical digital enhancement method that allows the observation of vascular and surface structures of colorectal lesions. Its usefulness in the detection and diagnosis of colorectal polyps has been demonstrated in several clinical trials and the diagnostic algorithms have been simplified after the establishment of endoscopic classifications such as the Japan NBI Expert Team classification. However, there were issues including lack of brightness in the earlier models, poor visibility under insufficient bowel preparation, and the incompatibility of magnifying endoscopes in certain endoscopic platforms, which had impeded NBI from becoming standardized globally. Nonetheless, NBI continued its evolution and the newest endoscopic platform launched in 2020 offers significantly brighter and detailed images. Enhanced visualization is expected to improve the detection of polyps while universal compatibility across all scopes including magnifying endoscopy will promote the global standardization of magnifying diagnosis. Therefore, knowledge related to magnifying colonoscopy will become essential as magnification becomes standardly equipped in future models, although the advent of computer-aided diagnosis and detection may greatly assist endoscopists to ensure quality of practice. Given that most endoscopic departments will be using both old and new models, it is important to understand how each generation of endoscopic platforms differ from each other. We reviewed the advances in the endoscopic platforms, artificial intelligence, and evidence related to NBI essential for the next generation of endoscopic practice.
Collapse
Affiliation(s)
- Akira Teramoto
- Third Department of Internal Medicine, Toyama University Hospital, Toyama, Japan
| | - Seiji Hamada
- Gastrointestinal Center, Urasoe General Hospital, Okinawa, Japan
| | - Banri Ogino
- Third Department of Internal Medicine, Toyama University Hospital, Toyama, Japan
| | - Ichiro Yasuda
- Third Department of Internal Medicine, Toyama University Hospital, Toyama, Japan
| | - Yasushi Sano
- Gastrointestinal Center, Sano Hospital, Hyogo, Japan
| |
Collapse
|
|
17
|
Parkash O, Siddiqui ATS, Jiwani U, Rind F, Padhani ZA, Rizvi A, Hoodbhoy Z, Das JK. Diagnostic accuracy of artificial intelligence for detecting gastrointestinal luminal pathologies: A systematic review and meta-analysis. Front Med (Lausanne) 2022; 9:1018937. [PMID: 36405592 PMCID: PMC9672666 DOI: 10.3389/fmed.2022.1018937] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/03/2022] [Indexed: 11/06/2022] Open
Abstract
Background Artificial Intelligence (AI) holds considerable promise for diagnostics in the field of gastroenterology. This systematic review and meta-analysis aims to assess the diagnostic accuracy of AI models compared with the gold standard of experts and histopathology for the diagnosis of various gastrointestinal (GI) luminal pathologies including polyps, neoplasms, and inflammatory bowel disease. Methods We searched PubMed, CINAHL, Wiley Cochrane Library, and Web of Science electronic databases to identify studies assessing the diagnostic performance of AI models for GI luminal pathologies. We extracted binary diagnostic accuracy data and constructed contingency tables to derive the outcomes of interest: sensitivity and specificity. We performed a meta-analysis and hierarchical summary receiver operating characteristic curves (HSROC). The risk of bias was assessed using Quality Assessment for Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Subgroup analyses were conducted based on the type of GI luminal disease, AI model, reference standard, and type of data used for analysis. This study is registered with PROSPERO (CRD42021288360). Findings We included 73 studies, of which 31 were externally validated and provided sufficient information for inclusion in the meta-analysis. The overall sensitivity of AI for detecting GI luminal pathologies was 91.9% (95% CI: 89.0–94.1) and specificity was 91.7% (95% CI: 87.4–94.7). Deep learning models (sensitivity: 89.8%, specificity: 91.9%) and ensemble methods (sensitivity: 95.4%, specificity: 90.9%) were the most commonly used models in the included studies. Majority of studies (n = 56, 76.7%) had a high risk of selection bias while 74% (n = 54) studies were low risk on reference standard and 67% (n = 49) were low risk for flow and timing bias. Interpretation The review suggests high sensitivity and specificity of AI models for the detection of GI luminal pathologies. There is a need for large, multi-center trials in both high income countries and low- and middle- income countries to assess the performance of these AI models in real clinical settings and its impact on diagnosis and prognosis. Systematic review registration [https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=288360], identifier [CRD42021288360].
Collapse
Affiliation(s)
- Om Parkash
- Department of Medicine, Aga Khan University, Karachi, Pakistan
| | | | - Uswa Jiwani
- Center of Excellence in Women and Child Health, Aga Khan University, Karachi, Pakistan
| | - Fahad Rind
- Head and Neck Oncology, The Ohio State University, Columbus, OH, United States
| | - Zahra Ali Padhani
- Institute for Global Health and Development, Aga Khan University, Karachi, Pakistan
| | - Arjumand Rizvi
- Center of Excellence in Women and Child Health, Aga Khan University, Karachi, Pakistan
| | - Zahra Hoodbhoy
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | - Jai K. Das
- Institute for Global Health and Development, Aga Khan University, Karachi, Pakistan
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
- *Correspondence: Jai K. Das,
| |
Collapse
|
|
18
|
Rao HB, Sastry NB, Venu RP, Pattanayak P. The role of artificial intelligence based systems for cost optimization in colorectal cancer prevention programs. Front Artif Intell 2022; 5:955399. [PMID: 36248620 PMCID: PMC9563712 DOI: 10.3389/frai.2022.955399] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Accepted: 08/16/2022] [Indexed: 11/13/2022] Open
Abstract
Colorectal Cancer (CRC) has seen a dramatic increase in incidence globally. In 2019, colorectal cancer accounted for 1.15 million deaths and 24.28 million disability-adjusted life-years (DALYs) worldwide. In India, the annual incidence rates (AARs) for colon cancer was 4.4 per 100,000. There has been a steady rise in the prevalence of CRC in India which may be attributed to urbanization, mass migration of population, westernization of diet and lifestyle practices and a rise of obesity and metabolic risk factors that place the population at a higher risk of CRC. Moreoever, CRC in India differs from that described in the Western countries, with a higher proportion of young patients and more patients presenting with an advanced stage. This may be due to poor access to specialized healthcare and socio-economic factors. Early identification of adenomatous colonic polyps, which are well-recognized pre-cancerous lesions, at the time of screening colonoscopy has been shown to be the most effective measure used for CRC prevention. However, colonic polyps are frequently missed during colonoscopy and moreover, these screening programs necessitate man-power, time and resources for processing resected polyps, that may hamper penetration and efficacy in mid- to low-income countries. In the last decade, there has been significant progress made in the automatic detection of colonic polyps by multiple AI-based systems. With the advent of better AI methodology, the focus has shifted from mere detection to accurate discrimination and diagnosis of colonic polyps. These systems, once validated, could usher in a new era in Colorectal Cancer (CRC) prevention programs which would center around "Leave in-situ" and "Resect and discard" strategies. These new strategies hinge around the specificity and accuracy of AI based systems in correctly identifying the pathological diagnosis of the polyps, thereby providing the endoscopist with real-time information in order to make a clinical decision of either leaving the lesion in-situ (mucosal polyps) or resecting and discarding the polyp (hyperplastic polyps). The major advantage of employing these strategies would be in cost optimization of CRC prevention programs while ensuring good clinical outcomes. The adoption of these AI-based systems in the national cancer prevention program of India in accordance with the mandate to increase technology integration could prove to be cost-effective and enable implementation of CRC prevention programs at the population level. This level of penetration could potentially reduce the incidence of CRC and improve patient survival by enabling early diagnosis and treatment. In this review, we will highlight key advancements made in the field of AI in the identification of polyps during colonoscopy and explore the role of AI based systems in cost optimization during the universal implementation of CRC prevention programs in the context of mid-income countries like India.
Collapse
Affiliation(s)
- Harshavardhan B. Rao
- Department of Gastroenterology, M.S. Ramaiah Medical College, Ramaiah University of Applied Sciences, Bangalore, Karnataka, India
| | - Nandakumar Bidare Sastry
- Department of Gastroenterology, M.S. Ramaiah Medical College, Ramaiah University of Applied Sciences, Bangalore, Karnataka, India
| | - Rama P. Venu
- Department of Gastroenterology, Amrita Institute of Medical Sciences and Research Centre, Kochi, Kerala, India
| | - Preetiparna Pattanayak
- Department of Gastroenterology, M.S. Ramaiah Medical College, Ramaiah University of Applied Sciences, Bangalore, Karnataka, India
| |
Collapse
|
|
19
|
Kavitha MS, Gangadaran P, Jackson A, Venmathi Maran BA, Kurita T, Ahn BC. Deep Neural Network Models for Colon Cancer Screening. Cancers (Basel) 2022; 14:3707. [PMID: 35954370 PMCID: PMC9367621 DOI: 10.3390/cancers14153707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 07/26/2022] [Accepted: 07/27/2022] [Indexed: 12/24/2022] Open
Abstract
Early detection of colorectal cancer can significantly facilitate clinicians' decision-making and reduce their workload. This can be achieved using automatic systems with endoscopic and histological images. Recently, the success of deep learning has motivated the development of image- and video-based polyp identification and segmentation. Currently, most diagnostic colonoscopy rooms utilize artificial intelligence methods that are considered to perform well in predicting invasive cancer. Convolutional neural network-based architectures, together with image patches and preprocesses are often widely used. Furthermore, learning transfer and end-to-end learning techniques have been adopted for detection and localization tasks, which improve accuracy and reduce user dependence with limited datasets. However, explainable deep networks that provide transparency, interpretability, reliability, and fairness in clinical diagnostics are preferred. In this review, we summarize the latest advances in such models, with or without transparency, for the prediction of colorectal cancer and also address the knowledge gap in the upcoming technology.
Collapse
Affiliation(s)
- Muthu Subash Kavitha
- School of Information and Data Sciences, Nagasaki University, Nagasaki 852-8521, Japan;
| | - Prakash Gangadaran
- BK21 FOUR KNU Convergence Educational Program of Biomedical Sciences for Creative Future Talents, School of Medicine, Kyungpook National University, Daegu 41944, Korea;
- Department of Nuclear Medicine, School of Medicine, Kyungpook National University, Kyungpook National University Hospital, Daegu 41944, Korea
| | - Aurelia Jackson
- Borneo Marine Research Institute, Universiti Malaysia Sabah, Kota Kinabalu 88400, Malaysia; (A.J.); (B.A.V.M.)
| | - Balu Alagar Venmathi Maran
- Borneo Marine Research Institute, Universiti Malaysia Sabah, Kota Kinabalu 88400, Malaysia; (A.J.); (B.A.V.M.)
| | - Takio Kurita
- Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi-Hiroshima 739-8521, Japan;
| | - Byeong-Cheol Ahn
- BK21 FOUR KNU Convergence Educational Program of Biomedical Sciences for Creative Future Talents, School of Medicine, Kyungpook National University, Daegu 41944, Korea;
- Department of Nuclear Medicine, School of Medicine, Kyungpook National University, Kyungpook National University Hospital, Daegu 41944, Korea
| |
Collapse
|
|
20
|
Rao BH, Trieu JA, Nair P, Gressel G, Venu M, Venu RP. Artificial intelligence in endoscopy: More than what meets the eye in screening colonoscopy and endosonographic evaluation of pancreatic lesions. Artif Intell Gastrointest Endosc 2022; 3:16-30. [DOI: 10.37126/aige.v3.i3.16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 03/07/2022] [Accepted: 05/07/2022] [Indexed: 02/06/2023] Open
|
|
21
|
Lu Y, Wu J, Zhuo X, Hu M, Chen Y, Luo Y, Feng Y, Zhi M, Li C, Sun J. Real-Time Artificial Intelligence-Based Histologic Classifications of Colorectal Polyps Using Narrow-Band Imaging. Front Oncol 2022; 12:879239. [PMID: 35619917 PMCID: PMC9128404 DOI: 10.3389/fonc.2022.879239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Accepted: 03/28/2022] [Indexed: 11/28/2022] Open
Abstract
Background and Aims With the development of artificial intelligence (AI), we have become capable of applying real-time computer-aided detection (CAD) in clinical practice. Our aim is to develop an AI-based CAD-N and optimize its diagnostic performance with narrow-band imaging (NBI) images. Methods We developed the CAD-N model with ResNeSt using NBI images for real-time assessment of the histopathology of colorectal polyps (type 1, hyperplastic or inflammatory polyps; type 2, adenomatous polyps, intramucosal cancer, or superficial submucosal invasive cancer; type 3, deep submucosal invasive cancer; and type 4, normal mucosa). We also collected 116 consecutive polyp videos to validate the accuracy of the CAD-N. Results A total of 10,573 images (7,032 images from 650 polyps and 3,541 normal mucous membrane images) from 478 patients were finally chosen for analysis. The sensitivity, specificity, PPV, NPV, and accuracy for each type of the CAD-N in the test set were 89.86%, 97.88%, 93.13%, 96.79%, and 95.93% for type 1; 93.91%, 95.49%, 91.80%, 96.69%, and 94.94% for type 2; 90.21%, 99.29%, 90.21%, 99.29%, and 98.68% for type 3; and 94.86%, 97.28%, 94.73%, 97.35%, and 96.45% for type 4, respectively. The overall accuracy was 93%. We also built models for polyps ≤5 mm, and the sensitivity, specificity, PPV, NPV, and accuracy for them were 96.81%, 94.08%, 95%, 95.97%, and 95.59%, respectively. Video validation results showed that the sensitivity, specificity, and accuracy of the CAD-N were 84.62%, 86.27%, and 85.34%, respectively. Conclusions We have developed real-time AI-based histologic classifications of colorectal polyps using NBI images with good accuracy, which may help in clinical management and documentation of optical histology results.
Collapse
Affiliation(s)
- Yi Lu
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jiachuan Wu
- Digestive Endoscopy Center, Guangdong Second Provincial General Hospital, Guangzhou, China
| | - Xianhua Zhuo
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Department of Otorhinolaryngology, the Second Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Minhui Hu
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yongpeng Chen
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yuxuan Luo
- Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
| | - Yue Feng
- Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
| | - Min Zhi
- Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Department of Gastroenterology, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Chujun Li
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Jiachen Sun
- Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
|
22
|
Current Status and Future Perspectives of Artificial Intelligence in Colonoscopy. J Clin Med 2022; 11:jcm11102923. [PMID: 35629049 PMCID: PMC9143862 DOI: 10.3390/jcm11102923] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 05/18/2022] [Accepted: 05/20/2022] [Indexed: 12/19/2022] Open
Abstract
The early endoscopic identification, resection, and treatment of precancerous adenoma and early-stage cancer has been shown to reduce not only the prevalence of colorectal cancer but also its mortality rate. Recent advances in endoscopic devices and imaging technology have dramatically improved our ability to detect colorectal lesions and predict their pathological diagnosis. In addition to this, rapid advances in artificial intelligence (AI) technology mean that AI-related research and development is now progressing in the diagnostic imaging field, particularly colonoscopy, and AIs (i.e., devices that mimic cognitive abilities, such as learning and problem-solving) already approved as medical devices are now being introduced into everyday clinical practice. Today, there is an increasing expectation that sophisticated AIs will be able to provide high-level diagnostic performance irrespective of the level of skill of the endoscopist. In this paper, we review colonoscopy-related AI research and the AIs that have already been approved and discuss the future prospects of this technology.
Collapse
|
|
23
|
Abstract
Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.
Collapse
Affiliation(s)
- Yutaka Okagawa
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.,Department of Gastroenterology, Tonan Hospital, Sapporo, Japan
| | - Seiichiro Abe
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
| | - Masayoshi Yamada
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Ichiro Oda
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| |
Collapse
|
|
24
|
Larsen SLV, Mori Y. Artificial intelligence in colonoscopy: A review on the current status. DEN OPEN 2022; 2:e109. [PMID: 35873511 PMCID: PMC9302306 DOI: 10.1002/deo2.109] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 02/14/2022] [Accepted: 02/17/2022] [Indexed: 12/30/2022]
Abstract
Artificial intelligence has become an increasingly hot topic in the last several years, and it has also gained its way into the medical field. In recent years, the application of artificial intelligence in the gastroenterology field has been of increasing interest, particularly in the colonoscopy setting. Novel technologies such as deep neural networks have enabled real‐time computer‐aided polyp detection and diagnosis during colonoscopy. This might lead to increased performance of endoscopists as well as potentially reducing the costs of unnecessary polypectomies of hyperplastic polyps. Newly published prospective trials studying computer‐aided detection showed that the assistance of artificial intelligence significantly increased the detection of polyps and non‐advanced adenomas approximately by 10%, while three tandem randomized control trials proved that the adenoma miss rate was significantly reduced (e.g., 13.8% vs. 36.7% in one Japanese multicenter trial). Promising results have also been shown in prospective single‐arm trials on computer‐aided polyp diagnosis, but the evidence is insufficient to reach a conclusion.
Collapse
Affiliation(s)
- Solveig Linnea Veen Larsen
- Clinical Effectiveness Research Group, Institute of Health and Society, University of Oslo Oslo Norway.,Department of Transplantation Medicine, Oslo University Hospital University of Oslo Oslo Norway
| | - Yuichi Mori
- Clinical Effectiveness Research Group, Institute of Health and Society, University of Oslo Oslo Norway.,Department of Transplantation Medicine, Oslo University Hospital University of Oslo Oslo Norway.,Digestive Disease Center, Showa University Northern Yokohama Hospital Kanagawa Japan
| |
Collapse
|
|
25
|
Li JW, Wang LM, Ang TL. Artificial intelligence-assisted colonoscopy: a narrative review of current data and clinical applications. Singapore Med J 2022; 63:118-124. [PMID: 35509251 PMCID: PMC9251247 DOI: 10.11622/smedj.2022044] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/22/2023]
Abstract
Colonoscopy is the reference standard procedure for the prevention and diagnosis of colorectal cancer, which is a leading cause of cancer-related deaths in Singapore. Artificial intelligence systems are automated, objective and reproducible. Artificial intelligence-assisted colonoscopy has recently been introduced into clinical practice as a clinical decision support tool. This review article provides a summary of the current published data and discusses ongoing research and current clinical applications of artificial intelligence-assisted colonoscopy.
Collapse
Affiliation(s)
- James Weiquan Li
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- SingHealth Duke-NUS Medicine Academic Clinical Programme, Singapore
| | - Lai Mun Wang
- Pathology Section, Department of Laboratory Medicine, Changi General Hospital, Singapore
- SingHealth Duke-NUS Pathology Academic Clinical Programme, Singapore
| | - Tiing Leong Ang
- Department of Gastroenterology and Hepatology, Changi General Hospital, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
- SingHealth Duke-NUS Medicine Academic Clinical Programme, Singapore
| |
Collapse
|
|
26
|
Proposing Novel Data Analytics Method for Anatomical Landmark Identification from Endoscopic Video Frames. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:8151177. [PMID: 35251578 PMCID: PMC8890842 DOI: 10.1155/2022/8151177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 12/20/2021] [Accepted: 01/07/2022] [Indexed: 11/18/2022]
Abstract
Background The anatomical landmarks contain the characteristics that are used to guide the gastroenterologists during the endoscopy. The expert can also ensure the completion of examination with the help of the anatomical landmarks. Automatic detection of anatomical landmarks in endoscopic video frames can be helpful for guiding the physicians during screening the gastrointestinal tract (GI). Method This study presents an automatic novel method for anatomical landmark detection of GI tract from endoscopic video frames based on semisupervised deep convolutional neural network (CNN) and compares the results with supervised CNN model. We consider the anatomical landmarks from Kvasir dataset that includes 500 images for each class of Z-line, pylorus, and cecum. The resolution of these images varies from 750 × 576 up to 1920 × 1072 pixels. Result Experimental results show that the supervised CNN has highly desirable performance with accuracy of 100%. Also, our proposed semisupervised CNN can compete with a slight difference similar to the CNN model. Our proposed semisupervised model trained using 1, 5, 10, and 20 percent of training data records as labeled training dataset has the average accuracy of 83%, 98%, 99%, and 99%, respectively. Conclusion The main advantage of our proposed method is achieving the high accuracy with small amount of labeled data without spending time for labeling more data. The strength of our proposed method saves the required labor, cost, and time for data labeling.
Collapse
|
|
27
|
A deep representation to fully characterize hyperplastic, adenoma, and serrated polyps on narrow band imaging sequences. HEALTH AND TECHNOLOGY 2022. [DOI: 10.1007/s12553-021-00633-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
|
28
|
Racz I, Horvath A, Kranitz N, Kiss G, Regoczi H, Horvath Z. Artificial Intelligence-Based Colorectal Polyp Histology Prediction by Using Narrow-Band Image-Magnifying Colonoscopy. Clin Endosc 2022; 55:113-121. [PMID: 34551512 PMCID: PMC8831420 DOI: 10.5946/ce.2021.149] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 06/10/2021] [Accepted: 06/19/2021] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND/AIMS We have been developing artificial intelligence based polyp histology prediction (AIPHP) method to classify Narrow Band Imaging (NBI) magnifying colonoscopy images to predict the hyperplastic or neoplastic histology of polyps. Our aim was to analyze the accuracy of AIPHP and narrow-band imaging international colorectal endoscopic (NICE) classification based histology predictions and also to compare the results of the two methods. METHODS We studied 373 colorectal polyp samples taken by polypectomy from 279 patients. The documented NBI still images were analyzed by the AIPHP method and by the NICE classification parallel. The AIPHP software was created by machine learning method. The software measures five geometrical and color features on the endoscopic image. RESULTS The accuracy of AIPHP was 86.6% (323/373) in total of polyps. We compared the AIPHP accuracy results for diminutive and non-diminutive polyps (82.1% vs. 92.2%; p=0.0032). The accuracy of the hyperplastic histology prediction was significantly better by NICE compared to AIPHP method both in the diminutive polyps (n=207) (95.2% vs. 82.1%) (p<0.001) and also in all evaluated polyps (n=373) (97.1% vs. 86.6%) (p<0.001). CONCLUSION Our artificial intelligence based polyp histology prediction software could predict histology with high accuracy only in the large size polyp subgroup.
Collapse
Affiliation(s)
- Istvan Racz
- Department of Internal Medicine and Gastroenterology, Petz Aladar University Teaching Hospital, Gyor, Hungary
| | - Andras Horvath
- Department of Physics and Chemistry, Szechenyi Istvan University, Gyor, Hungary
| | - Noemi Kranitz
- Department of Pathology, Petz Aladar University Teaching Hospital, Gyor, Hungary
| | - Gyongyi Kiss
- Department of Internal Medicine and Gastroenterology, Petz Aladar University Teaching Hospital, Gyor, Hungary
| | - Henriett Regoczi
- Department of Internal Medicine and Gastroenterology, Petz Aladar University Teaching Hospital, Gyor, Hungary
| | - Zoltan Horvath
- Department of Mathematics and Informatics, Szechenyi Istvan University, Gyor, Hungary
| |
Collapse
|
|
29
|
Okamoto Y, Yoshida S, Izakura S, Katayama D, Michida R, Koide T, Tamaki T, Kamigaichi Y, Tamari H, Shimohara Y, Nishimura T, Inagaki K, Tanaka H, Yamashita K, Sumimoto K, Oka S, Tanaka S. Development of multi-class computer-aided diagnostic systems using the NICE/JNET classifications for colorectal lesions. J Gastroenterol Hepatol 2022; 37:104-110. [PMID: 34478167 DOI: 10.1111/jgh.15682] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 07/22/2021] [Accepted: 08/30/2021] [Indexed: 12/15/2022]
Abstract
BACKGROUND AND AIM Diagnostic support using artificial intelligence may contribute to the equalization of endoscopic diagnosis of colorectal lesions. We developed computer-aided diagnosis (CADx) support system for diagnosing colorectal lesions using the NBI International Colorectal Endoscopic (NICE) classification and the Japan NBI Expert Team (JNET) classification. METHODS Using Residual Network as the classifier and NBI images as training images, we developed a CADx based on the NICE classification (CADx-N) and a CADx based on the JNET classification (CADx-J). For validation, 480 non-magnifying and magnifying NBI images were used for the CADx-N and 320 magnifying NBI images were used for the CADx-J. The diagnostic performance of the CADx-N was evaluated using the magnification rate. RESULTS The accuracy of the CADx-N for Types 1, 2, and 3 was 97.5%, 91.2%, and 93.8%, respectively. The diagnostic performance for each magnification level was good (no statistically significant difference). The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of the CADx-J were 100%, 96.3%, 82.8%, 100%, and 96.9% for Type 1; 80.3%, 93.7%, 94.1%, 79.2%, and 86.3% for Type 2A; 80.4%, 84.7%, 46.8%, 96.3%, and 84.1% for Type 2B; and 62.5%, 99.6%, 96.8%, 93.8%, and 94.1% for Type 3, respectively. CONCLUSIONS The multi-class CADx systems had good diagnostic performance with both the NICE and JNET classifications and may aid in educating non-expert endoscopists and assist in diagnosing colorectal lesions.
Collapse
Affiliation(s)
- Yuki Okamoto
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Shigeto Yoshida
- Department of Gastroenterology, JR Hiroshima Hospital, Hiroshima, Japan
| | - Seiji Izakura
- Research Institute for Nanodevice and Bio Systems, Hiroshima University, Hiroshima, Japan
| | - Daisuke Katayama
- Research Institute for Nanodevice and Bio Systems, Hiroshima University, Hiroshima, Japan
| | - Ryuichi Michida
- Research Institute for Nanodevice and Bio Systems, Hiroshima University, Hiroshima, Japan
| | - Tetsushi Koide
- Research Institute for Nanodevice and Bio Systems, Hiroshima University, Hiroshima, Japan
| | - Toru Tamaki
- Department of Computer Science, Nagoya Institute of Technology, Nagoya, Japan
| | - Yuki Kamigaichi
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Hirosato Tamari
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Yasutsugu Shimohara
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Tomoyuki Nishimura
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Katsuaki Inagaki
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Hidenori Tanaka
- Department of Endoscopy, Hiroshima University Hospital, Hiroshima, Japan
| | - Ken Yamashita
- Department of Endoscopy, Hiroshima University Hospital, Hiroshima, Japan
| | - Kyoku Sumimoto
- Department of Endoscopy, Hiroshima University Hospital, Hiroshima, Japan
| | - Shiro Oka
- Department of Gastroenterology and Metabolism, Hiroshima University Hospital, Hiroshima, Japan
| | - Shinji Tanaka
- Department of Endoscopy, Hiroshima University Hospital, Hiroshima, Japan
| |
Collapse
|
|
30
|
Taghiakbari M, Mori Y, von Renteln D. Artificial intelligence-assisted colonoscopy: A review of current state of practice and research. World J Gastroenterol 2021; 27:8103-8122. [PMID: 35068857 PMCID: PMC8704267 DOI: 10.3748/wjg.v27.i47.8103] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Revised: 08/22/2021] [Accepted: 12/03/2021] [Indexed: 02/06/2023] Open
Abstract
Colonoscopy is an effective screening procedure in colorectal cancer prevention programs; however, colonoscopy practice can vary in terms of lesion detection, classification, and removal. Artificial intelligence (AI)-assisted decision support systems for endoscopy is an area of rapid research and development. The systems promise improved detection, classification, screening, and surveillance for colorectal polyps and cancer. Several recently developed applications for AI-assisted colonoscopy have shown promising results for the detection and classification of colorectal polyps and adenomas. However, their value for real-time application in clinical practice has yet to be determined owing to limitations in the design, validation, and testing of AI models under real-life clinical conditions. Despite these current limitations, ambitious attempts to expand the technology further by developing more complex systems capable of assisting and supporting the endoscopist throughout the entire colonoscopy examination, including polypectomy procedures, are at the concept stage. However, further work is required to address the barriers and challenges of AI integration into broader colonoscopy practice, to navigate the approval process from regulatory organizations and societies, and to support physicians and patients on their journey to accepting the technology by providing strong evidence of its accuracy and safety. This article takes a closer look at the current state of AI integration into the field of colonoscopy and offers suggestions for future research.
Collapse
Affiliation(s)
- Mahsa Taghiakbari
- Department of Gastroenterology, CRCHUM, Montreal H2X 0A9, Quebec, Canada
| | - Yuichi Mori
- Clinical Effectiveness Research Group, University of Oslo, Oslo 0450, Norway
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama 224-8503, Japan
| | - Daniel von Renteln
- Department of Gastroenterology, CRCHUM, Montreal H2X 0A9, Quebec, Canada
| |
Collapse
|
|
31
|
Hardy NP, Mac Aonghusa P, Neary PM, Cahill RA. Intraprocedural Artificial Intelligence for Colorectal Cancer Detection and Characterisation in Endoscopy and Laparoscopy. Surg Innov 2021; 28:768-775. [PMID: 33634722 PMCID: PMC8647474 DOI: 10.1177/1553350621997761] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
In this article, we provide an evidence-based primer of current tools and evolving concepts in the area of intraprocedural artificial intelligence (AI) methods in colonoscopy and laparoscopy as a 'procedure companion', with specific focus on colorectal cancer recognition and characterisation. These interventions are both likely beneficiaries from an impending rapid phase in technical and technological evolution. The domains where AI is most likely to impact are explored as well as the methodological pitfalls pertaining to AI methods. Such issues include the need for large volumes of data to train AI systems, questions surrounding false positive rates, explainability and interpretability as well as recent concerns surrounding instabilities in current deep learning (DL) models. The area of biophysics-inspired models, a potential remedy to some of these pitfalls, is explored as it could allow our understanding of the fundamental physiological differences between tissue types to be exploited in real time with the help of computer-assisted interpretation. Right now, such models can include data collected from dynamic fluorescence imaging in surgery to characterise lesions by their biology reducing the number of cases needed to build a reliable and interpretable classification system. Furthermore, instead of focussing on image-by-image analysis, such systems could analyse in a continuous fashion, more akin to how we view procedures in real life and make decisions in a manner more comparable to human decision-making. Synergistical approaches can ensure AI methods usefully embed within practice thus safeguarding against collapse of this exciting field of investigation as another 'boom and bust' cycle of AI endeavour.
Collapse
Affiliation(s)
- Niall P Hardy
- UCD Centre for Precision Surgery, School of
Medicine, University College Dublin, Dublin, Ireland
| | | | - Peter M Neary
- Department of Surgery, University College
Cork, University Hospital Waterford, Waterford, Ireland
| | - Ronan A Cahill
- UCD Centre for Precision Surgery, School of
Medicine, University College Dublin, Dublin, Ireland
- Department of Surgery, Mater Misericordiae University
Hospital, Dublin, Ireland
| |
Collapse
|
|
32
|
Kudo SE, Mori Y, Abdel-Aal UM, Misawa M, Itoh H, Oda M, Mori K. Artificial intelligence and computer-aided diagnosis for colonoscopy: where do we stand now? Transl Gastroenterol Hepatol 2021; 6:64. [PMID: 34805586 DOI: 10.21037/tgh.2019.12.14] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 11/12/2019] [Indexed: 12/22/2022] Open
Abstract
Computer-aided diagnosis (CAD) for colonoscopy with use of artificial intelligence (AI) is catching increased attention of endoscopists. CAD allows automated detection and pathological prediction, namely optical biopsy, of colorectal polyps during real-time endoscopy, which help endoscopists avoid missing and/or misdiagnosing colorectal lesions. With the increased number of publications in this field and emergence of the AI medical device that have already secured regulatory approval, CAD in colonoscopy is now being implemented into clinical practice. On the other side, drawbacks and weak points of CAD in colonoscopy have not been thoroughly discussed. In this review, we provide an overview of CAD for optical biopsy of colorectal lesions with a particular focus on its clinical applications and limitations.
Collapse
Affiliation(s)
- Shin-Ei Kudo
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Yuichi Mori
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Usama M Abdel-Aal
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan.,Internal Medicine, Faculty of Medicine, Sohag University, Sohag, Egypt
| | - Masashi Misawa
- Digestive Disease Center, Showa University Northern Yokohama Hospital, Yokohama, Japan
| | - Hayato Itoh
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | - Masahiro Oda
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| | - Kensaku Mori
- Graduate School of Informatics, Nagoya University, Nagoya, Japan
| |
Collapse
|
|
33
|
Goyal H, Sherazi SAA, Mann R, Gandhi Z, Perisetti A, Aziz M, Chandan S, Kopel J, Tharian B, Sharma N, Thosani N. Scope of Artificial Intelligence in Gastrointestinal Oncology. Cancers (Basel) 2021; 13:5494. [PMID: 34771658 PMCID: PMC8582733 DOI: 10.3390/cancers13215494] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 10/27/2021] [Indexed: 12/12/2022] Open
Abstract
Gastrointestinal cancers are among the leading causes of death worldwide, with over 2.8 million deaths annually. Over the last few decades, advancements in artificial intelligence technologies have led to their application in medicine. The use of artificial intelligence in endoscopic procedures is a significant breakthrough in modern medicine. Currently, the diagnosis of various gastrointestinal cancer relies on the manual interpretation of radiographic images by radiologists and various endoscopic images by endoscopists. This can lead to diagnostic variabilities as it requires concentration and clinical experience in the field. Artificial intelligence using machine or deep learning algorithms can provide automatic and accurate image analysis and thus assist in diagnosis. In the field of gastroenterology, the application of artificial intelligence can be vast from diagnosis, predicting tumor histology, polyp characterization, metastatic potential, prognosis, and treatment response. It can also provide accurate prediction models to determine the need for intervention with computer-aided diagnosis. The number of research studies on artificial intelligence in gastrointestinal cancer has been increasing rapidly over the last decade due to immense interest in the field. This review aims to review the impact, limitations, and future potentials of artificial intelligence in screening, diagnosis, tumor staging, treatment modalities, and prediction models for the prognosis of various gastrointestinal cancers.
Collapse
Affiliation(s)
- Hemant Goyal
- Department of Internal Medicine, The Wright Center for Graduate Medical Education, 501 S. Washington Avenue, Scranton, PA 18505, USA
| | - Syed A. A. Sherazi
- Department of Medicine, John H Stroger Jr Hospital of Cook County, 1950 W Polk St, Chicago, IL 60612, USA;
| | - Rupinder Mann
- Department of Medicine, Saint Agnes Medical Center, 1303 E. Herndon Ave, Fresno, CA 93720, USA;
| | - Zainab Gandhi
- Department of Medicine, Geisinger Wyoming Valley Medical Center, 1000 E Mountain Dr, Wilkes-Barre, PA 18711, USA;
| | - Abhilash Perisetti
- Division of Interventional Oncology & Surgical Endoscopy (IOSE), Parkview Cancer Institute, 11050 Parkview Circle, Fort Wayne, IN 46845, USA; (A.P.); (N.S.)
| | - Muhammad Aziz
- Department of Gastroenterology and Hepatology, University of Toledo Medical Center, 3000 Arlington Avenue, Toledo, OH 43614, USA;
| | - Saurabh Chandan
- Division of Gastroenterology and Hepatology, CHI Health Creighton University Medical Center, 7500 Mercy Rd, Omaha, NE 68124, USA;
| | - Jonathan Kopel
- Department of Medicine, Texas Tech University Health Sciences Center, 3601 4th St, Lubbock, TX 79430, USA;
| | - Benjamin Tharian
- Department of Gastroenterology and Hepatology, The University of Arkansas for Medical Sciences, 4301 W Markham St, Little Rock, AR 72205, USA;
| | - Neil Sharma
- Division of Interventional Oncology & Surgical Endoscopy (IOSE), Parkview Cancer Institute, 11050 Parkview Circle, Fort Wayne, IN 46845, USA; (A.P.); (N.S.)
| | - Nirav Thosani
- Division of Gastroenterology, Hepatology & Nutrition, McGovern Medical School, UTHealth, 6410 Fannin, St #1014, Houston, TX 77030, USA;
| |
Collapse
|
|
34
|
Kröner PT, Engels MML, Glicksberg BS, Johnson KW, Mzaik O, van Hooft JE, Wallace MB, El-Serag HB, Krittanawong C. Artificial intelligence in gastroenterology: A state-of-the-art review. World J Gastroenterol 2021; 27:6794-6824. [PMID: 34790008 PMCID: PMC8567482 DOI: 10.3748/wjg.v27.i40.6794] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 06/15/2021] [Accepted: 09/16/2021] [Indexed: 02/06/2023] Open
Abstract
The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.
Collapse
Affiliation(s)
- Paul T Kröner
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Megan ML Engels
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Cancer Center Amsterdam, Department of Gastroenterology and Hepatology, Amsterdam UMC, Location AMC, Amsterdam 1105, The Netherlands
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kipp W Johnson
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Obaie Mzaik
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Amsterdam 2300, The Netherlands
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Division of Gastroenterology and Hepatology, Sheikh Shakhbout Medical City, Abu Dhabi 11001, United Arab Emirates
| | - Hashem B El-Serag
- Section of Gastroenterology and Hepatology, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
| | - Chayakrit Krittanawong
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Cardiology, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
| |
Collapse
|
|
35
|
Christou CD, Tsoulfas G. Challenges and opportunities in the application of artificial intelligence in gastroenterology and hepatology. World J Gastroenterol 2021; 27:6191-6223. [PMID: 34712027 PMCID: PMC8515803 DOI: 10.3748/wjg.v27.i37.6191] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Revised: 05/06/2021] [Accepted: 08/31/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is an umbrella term used to describe a cluster of interrelated fields. Machine learning (ML) refers to a model that learns from past data to predict future data. Medicine and particularly gastroenterology and hepatology, are data-rich fields with extensive data repositories, and therefore fruitful ground for AI/ML-based software applications. In this study, we comprehensively review the current applications of AI/ML-based models in these fields and the opportunities that arise from their application. Specifically, we refer to the applications of AI/ML-based models in prevention, diagnosis, management, and prognosis of gastrointestinal bleeding, inflammatory bowel diseases, gastrointestinal premalignant and malignant lesions, other nonmalignant gastrointestinal lesions and diseases, hepatitis B and C infection, chronic liver diseases, hepatocellular carcinoma, cholangiocarcinoma, and primary sclerosing cholangitis. At the same time, we identify the major challenges that restrain the widespread use of these models in healthcare in an effort to explore ways to overcome them. Notably, we elaborate on the concerns regarding intrinsic biases, data protection, cybersecurity, intellectual property, liability, ethical challenges, and transparency. Even at a slower pace than anticipated, AI is infiltrating the healthcare industry. AI in healthcare will become a reality, and every physician will have to engage with it by necessity.
Collapse
Affiliation(s)
- Chrysanthos D Christou
- Organ Transplant Unit, Hippokration General Hospital, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| | - Georgios Tsoulfas
- Organ Transplant Unit, Hippokration General Hospital, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| |
Collapse
|
|
36
|
Schreuder RM, van der Zander QE, Fonollà R, Gilissen LP, Stronkhorst A, Klerkx B, de With PH, Masclee AM, van der Sommen F, Schoon EJ. Algorithm combining virtual chromoendoscopy features for colorectal polyp classification. Endosc Int Open 2021; 9:E1497-E1503. [PMID: 34540541 PMCID: PMC8445691 DOI: 10.1055/a-1512-5175] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/26/2020] [Accepted: 05/11/2021] [Indexed: 11/06/2022] Open
Abstract
Background and study aims Colonoscopy is considered the gold standard for decreasing colorectal cancer incidence and mortality. Optical diagnosis of colorectal polyps (CRPs) is an ongoing challenge in clinical colonoscopy and its accuracy among endoscopists varies widely. Computer-aided diagnosis (CAD) for CRP characterization may help to improve this accuracy. In this study, we investigated the diagnostic accuracy of a novel algorithm for polyp malignancy classification by exploiting the complementary information revealed by three specific modalities. Methods We developed a CAD algorithm for CRP characterization based on high-definition, non-magnified white light (HDWL), Blue light imaging (BLI) and linked color imaging (LCI) still images from routine exams. All CRPs were collected prospectively and classified into benign or premalignant using histopathology as gold standard. Images and data were used to train the CAD algorithm using triplet network architecture. Our training dataset was validated using a threefold cross validation. Results In total 609 colonoscopy images of 203 CRPs of 154 consecutive patients were collected. A total of 174 CRPs were found to be premalignant and 29 were benign. Combining the triplet network features with all three image enhancement modalities resulted in an accuracy of 90.6 %, 89.7 % sensitivity, 96.6 % specificity, a positive predictive value of 99.4 %, and a negative predictive value of 60.9 % for CRP malignancy classification. The classification time for our CAD algorithm was approximately 90 ms per image. Conclusions Our novel approach and algorithm for CRP classification differentiates accurately between benign and premalignant polyps in non-magnified endoscopic images. This is the first algorithm combining three optical modalities (HDWL/BLI/LCI) exploiting the triplet network approach.
Collapse
Affiliation(s)
- Ramon-Michel Schreuder
- Department of Gastroenterology and Hepatology, Catharina Cancer Institute, Catharina Hospital Eindhoven, The Netherlands
| | - Qurine E.W. van der Zander
- Department of Gastroenterology and Hepatology, Maastricht University Medical Center, Maastricht, The Netherlands,GROW School for Oncology and Developmental Biology, Maastricht University, Maastricht, The Netherlands
| | - Roger Fonollà
- Department of Electrical Engineering, Eindhoven University of Technology, The Netherlands
| | - Lennard P.L. Gilissen
- Department of Gastroenterology and Hepatology, Catharina Cancer Institute, Catharina Hospital Eindhoven, The Netherlands
| | - Arnold Stronkhorst
- Department of Gastroenterology and Hepatology, Catharina Cancer Institute, Catharina Hospital Eindhoven, The Netherlands
| | - Birgitt Klerkx
- Department of Gastroenterology and Hepatology, Catharina Cancer Institute, Catharina Hospital Eindhoven, The Netherlands
| | - Peter H.N. de With
- Department of Electrical Engineering, Eindhoven University of Technology, The Netherlands
| | - Ad M. Masclee
- Department of Gastroenterology and Hepatology, Maastricht University Medical Center, Maastricht, The Netherlands
| | - Fons van der Sommen
- Department of Electrical Engineering, Eindhoven University of Technology, The Netherlands
| | - Erik J. Schoon
- Department of Gastroenterology and Hepatology, Catharina Cancer Institute, Catharina Hospital Eindhoven, The Netherlands
| |
Collapse
|
|
37
|
Pecere S, Milluzzo SM, Esposito G, Dilaghi E, Telese A, Eusebi LH. Applications of Artificial Intelligence for the Diagnosis of Gastrointestinal Diseases. Diagnostics (Basel) 2021; 11:diagnostics11091575. [PMID: 34573917 PMCID: PMC8469485 DOI: 10.3390/diagnostics11091575] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 08/20/2021] [Accepted: 08/23/2021] [Indexed: 12/16/2022] Open
Abstract
The development of convolutional neural networks has achieved impressive advances of machine learning in recent years, leading to an increasing use of artificial intelligence (AI) in the field of gastrointestinal (GI) diseases. AI networks have been trained to differentiate benign from malignant lesions, analyze endoscopic and radiological GI images, and assess histological diagnoses, obtaining excellent results and high overall diagnostic accuracy. Nevertheless, there data are lacking on side effects of AI in the gastroenterology field, and high-quality studies comparing the performance of AI networks to health care professionals are still limited. Thus, large, controlled trials in real-time clinical settings are warranted to assess the role of AI in daily clinical practice. This narrative review gives an overview of some of the most relevant potential applications of AI for gastrointestinal diseases, highlighting advantages and main limitations and providing considerations for future development.
Collapse
Affiliation(s)
- Silvia Pecere
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00135 Rome, Italy;
- Center for Endoscopic Research Therapeutics and Training (CERTT), Catholic University, 00168 Rome, Italy
- Correspondence: (S.P.); (L.H.E.)
| | - Sebastian Manuel Milluzzo
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00135 Rome, Italy;
- Fondazione Poliambulanza Istituto Ospedaliero, 25121 Brescia, Italy
| | - Gianluca Esposito
- Department of Medical-Surgical Sciences and Translational Medicine, Sant’Andrea Hospital, Sapienza University of Rome, 00168 Rome, Italy; (G.E.); (E.D.)
| | - Emanuele Dilaghi
- Department of Medical-Surgical Sciences and Translational Medicine, Sant’Andrea Hospital, Sapienza University of Rome, 00168 Rome, Italy; (G.E.); (E.D.)
| | - Andrea Telese
- Department of Gastroenterology, University College London Hospital (UCLH), London NW1 2AF, UK;
| | - Leonardo Henry Eusebi
- Division of Gastroenterology and Endoscopy, IRCCS Azienda Ospedaliero-Universitaria di Bologna, 40121 Bologna, Italy
- Department of Medical and Surgical Sciences, University of Bologna, 40121 Bologna, Italy
- Correspondence: (S.P.); (L.H.E.)
| |
Collapse
|
|
38
|
Joseph J, LePage EM, Cheney CP, Pawa R. Artificial intelligence in colonoscopy. World J Gastroenterol 2021; 27:4802-4817. [PMID: 34447227 PMCID: PMC8371500 DOI: 10.3748/wjg.v27.i29.4802] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Revised: 05/12/2021] [Accepted: 07/16/2021] [Indexed: 02/06/2023] Open
Abstract
Colorectal cancer remains a leading cause of morbidity and mortality in the United States. Advances in artificial intelligence (AI), specifically computer aided detection and computer-aided diagnosis offer promising methods of increasing adenoma detection rates with the goal of removing more pre-cancerous polyps. Conversely, these methods also may allow for smaller non-cancerous lesions to be diagnosed in vivo and left in place, decreasing the risks that come with unnecessary polypectomies. This review will provide an overview of current advances in the use of AI in colonoscopy to aid in polyp detection and characterization as well as areas of developing research.
Collapse
Affiliation(s)
- Joel Joseph
- Department of Internal Medicine, Wake Forest Baptist Medical Center, Winston Salem, NC 27157, United States
| | - Ella Marie LePage
- Department of Internal Medicine, Wake Forest Baptist Medical Center, Winston Salem, NC 27157, United States
| | - Catherine Phillips Cheney
- Department of Internal Medicine, Wake Forest School of Medicine, Winston Salem, NC 27157, United States
| | - Rishi Pawa
- Department of Internal Medicine, Section of Gastroenterology and Hepatology, Wake Forest Baptist Medical Center, Winston-Salem, NC 27157, United States
| |
Collapse
|
|
39
|
Nazarian S, Glover B, Ashrafian H, Darzi A, Teare J. Diagnostic Accuracy of Artificial Intelligence and Computer-Aided Diagnosis for the Detection and Characterization of Colorectal Polyps: Systematic Review and Meta-analysis. J Med Internet Res 2021; 23:e27370. [PMID: 34259645 PMCID: PMC8319784 DOI: 10.2196/27370] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 03/09/2021] [Accepted: 05/06/2021] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND Colonoscopy reduces the incidence of colorectal cancer (CRC) by allowing detection and resection of neoplastic polyps. Evidence shows that many small polyps are missed on a single colonoscopy. There has been a successful adoption of artificial intelligence (AI) technologies to tackle the issues around missed polyps and as tools to increase the adenoma detection rate (ADR). OBJECTIVE The aim of this review was to examine the diagnostic accuracy of AI-based technologies in assessing colorectal polyps. METHODS A comprehensive literature search was undertaken using the databases of Embase, MEDLINE, and the Cochrane Library. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. Studies reporting the use of computer-aided diagnosis for polyp detection or characterization during colonoscopy were included. Independent proportions and their differences were calculated and pooled through DerSimonian and Laird random-effects modeling. RESULTS A total of 48 studies were included. The meta-analysis showed a significant increase in pooled polyp detection rate in patients with the use of AI for polyp detection during colonoscopy compared with patients who had standard colonoscopy (odds ratio [OR] 1.75, 95% CI 1.56-1.96; P<.001). When comparing patients undergoing colonoscopy with the use of AI to those without, there was also a significant increase in ADR (OR 1.53, 95% CI 1.32-1.77; P<.001). CONCLUSIONS With the aid of machine learning, there is potential to improve ADR and, consequently, reduce the incidence of CRC. The current generation of AI-based systems demonstrate impressive accuracy for the detection and characterization of colorectal polyps. However, this is an evolving field and before its adoption into a clinical setting, AI systems must prove worthy to patients and clinicians. TRIAL REGISTRATION PROSPERO International Prospective Register of Systematic Reviews CRD42020169786; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020169786.
Collapse
Affiliation(s)
- Scarlet Nazarian
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Ben Glover
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Hutan Ashrafian
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Ara Darzi
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| | - Julian Teare
- Department of Surgery and Cancer, Imperial College London, London, United Kingdom
| |
Collapse
|
|
40
|
Parsa N, Byrne MF. Artificial intelligence for identification and characterization of colonic polyps. Ther Adv Gastrointest Endosc 2021; 14:26317745211014698. [PMID: 34263163 PMCID: PMC8252334 DOI: 10.1177/26317745211014698] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 04/07/2021] [Indexed: 12/27/2022] Open
Abstract
Colonoscopy remains the gold standard exam for colorectal cancer screening due to its ability to detect and resect pre-cancerous lesions in the colon. However, its performance is greatly operator dependent. Studies have shown that up to one-quarter of colorectal polyps can be missed on a single colonoscopy, leading to high rates of interval colorectal cancer. In addition, the American Society for Gastrointestinal Endoscopy has proposed the “resect-and-discard” and “diagnose-and-leave” strategies for diminutive colorectal polyps to reduce the costs of unnecessary polyp resection and pathology evaluation. However, the performance of optical biopsy has been suboptimal in community practice. With recent improvements in machine-learning techniques, artificial intelligence–assisted computer-aided detection and diagnosis have been increasingly utilized by endoscopists. The application of computer-aided design on real-time colonoscopy has been shown to increase the adenoma detection rate while decreasing the withdrawal time and improve endoscopists’ optical biopsy accuracy, while reducing the time to make the diagnosis. These are promising steps toward standardization and improvement of colonoscopy quality, and implementation of “resect-and-discard” and “diagnose-and-leave” strategies. Yet, issues such as real-world applications and regulatory approval need to be addressed before artificial intelligence models can be successfully implemented in clinical practice. In this review, we summarize the recent literature on the application of artificial intelligence for detection and characterization of colorectal polyps and review the limitation of existing artificial intelligence technologies and future directions for this field.
Collapse
Affiliation(s)
- Nasim Parsa
- Division of Gastroenterology and Hepatology, Department of Medicine, University of Missouri, Columbia, MO 65211, USA
| | - Michael F Byrne
- Division of Gastroenterology, Department of Medicine, The University of British Columbia, Vancouver, BC, Canada; Satisfai Health, Vancouver, BC, Canada
| |
Collapse
|
|
41
|
Mankoo R, Ali AH, Hammoud GM. Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies. Artif Intell Gastrointest Endosc 2021; 2:89-94. [DOI: 10.37126/aige.v2.i3.89] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 06/20/2021] [Accepted: 06/28/2021] [Indexed: 02/06/2023] Open
|
|
42
|
Mankoo R, Ali AH, Hammoud GM. Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies. Artif Intell Gastrointest Endosc 2021; 2:88-93. [DOI: 10.37126/aige.v2.i3.88] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
|
|
43
|
Kim KO, Kim EY. Application of Artificial Intelligence in the Detection and Characterization of Colorectal Neoplasm. Gut Liver 2021; 15:346-353. [PMID: 32773386 PMCID: PMC8129657 DOI: 10.5009/gnl20186] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Accepted: 06/28/2020] [Indexed: 12/19/2022] Open
Abstract
Endoscpists always have tried to pursue a perfect colonoscopy, and application of artificial intelligence (AI) using deep-learning algorithms is one of the promising supportive options for detection and characterization of colorectal polyps during colonoscopy. Many retrospective studies conducted with real-time application of AI using convolutional neural networks have shown improved colorectal polyp detection. Moreover, a recent randomized clinical trial reported additional polyp detection with shorter analysis time. Studies conducted regarding polyp characterization provided additional promising results. Application of AI with narrow band imaging in real-time prediction of the pathology of diminutive polyps resulted in high diagnostic accuracy. In addition, application of AI with endocytoscopy or confocal laser endomicroscopy was investigated for real-time cellular diagnosis, and the diagnostic accuracy of some studies was comparable to that of pathologists. With AI technology, we can expect a higher polyp detection rate with reduced time and cost by avoiding unnecessary procedures, resulting in enhanced colonoscopy efficiency. However, for AI application in actual daily clinical practice, more prospective studies with minimized selection bias, consensus on standardized utilization, and regulatory approval are needed. (Gut Liver 2021;15:-353)
Collapse
Affiliation(s)
- Kyeong Ok Kim
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Yeungnam University College of Medicine, Daegu, Korea
| | - Eun Young Kim
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Daegu Catholic University School of Medicine, Daegu, Korea
| |
Collapse
|
|
44
|
Mitsala A, Tsalikidis C, Pitiakoudis M, Simopoulos C, Tsaroucha AK. Artificial Intelligence in Colorectal Cancer Screening, Diagnosis and Treatment. A New Era. ACTA ACUST UNITED AC 2021; 28:1581-1607. [PMID: 33922402 PMCID: PMC8161764 DOI: 10.3390/curroncol28030149] [Citation(s) in RCA: 122] [Impact Index Per Article: 30.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 04/09/2021] [Accepted: 04/20/2021] [Indexed: 12/24/2022]
Abstract
The development of artificial intelligence (AI) algorithms has permeated the medical field with great success. The widespread use of AI technology in diagnosing and treating several types of cancer, especially colorectal cancer (CRC), is now attracting substantial attention. CRC, which represents the third most commonly diagnosed malignancy in both men and women, is considered a leading cause of cancer-related deaths globally. Our review herein aims to provide in-depth knowledge and analysis of the AI applications in CRC screening, diagnosis, and treatment based on current literature. We also explore the role of recent advances in AI systems regarding medical diagnosis and therapy, with several promising results. CRC is a highly preventable disease, and AI-assisted techniques in routine screening represent a pivotal step in declining incidence rates of this malignancy. So far, computer-aided detection and characterization systems have been developed to increase the detection rate of adenomas. Furthermore, CRC treatment enters a new era with robotic surgery and novel computer-assisted drug delivery techniques. At the same time, healthcare is rapidly moving toward precision or personalized medicine. Machine learning models have the potential to contribute to individual-based cancer care and transform the future of medicine.
Collapse
Affiliation(s)
- Athanasia Mitsala
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
- Correspondence: ; Tel.: +30-6986423707
| | - Christos Tsalikidis
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Michail Pitiakoudis
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Constantinos Simopoulos
- Second Department of Surgery, University General Hospital of Alexandroupolis, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece; (C.T.); (M.P.); (C.S.)
| | - Alexandra K. Tsaroucha
- Laboratory of Experimental Surgery & Surgical Research, Democritus University of Thrace Medical School, Dragana, 68100 Alexandroupolis, Greece;
| |
Collapse
|
|
45
|
Prediction of the histology of colorectal neoplasm in white light colonoscopic images using deep learning algorithms. Sci Rep 2021; 11:5311. [PMID: 33674628 PMCID: PMC7935886 DOI: 10.1038/s41598-021-84299-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 02/15/2021] [Indexed: 01/01/2023] Open
Abstract
The treatment plan of colorectal neoplasm differs based on histology. Although new endoscopic imaging systems have been developed, there are clear diagnostic thresholds and requirements in using them. To overcome these limitations, we trained convolutional neural networks (CNNs) with endoscopic images and developed a computer-aided diagnostic (CAD) system which predicts the pathologic histology of colorectal adenoma. We retrospectively collected colonoscopic images from two tertiary hospitals and labeled 3400 images into one of 4 classes according to the final histology: normal, low-grade dysplasia, high-grade dysplasia, and adenocarcinoma. We implemented a CAD system based on ensemble learning with three CNN models which transfer the knowledge learned from common digital photography images to the colonoscopic image domain. The deep learning models were trained to classify the colorectal adenoma into these 4 classes. We compared the outcomes of the CNN models to those of two endoscopist groups having different years of experience, and visualized the model predictions using Class Activation Mapping. In our multi-center study, our CNN-CAD system identified the histology of colorectal adenoma with as sensitivity 77.25%, specificity of 92.42%, positive predictive value of 77.16%, negative predictive value of 92.58% averaged over the 4 classes, and mean diagnostic time of 0.12 s per image. Our experiments demonstrate that the CNN-CAD showed a similar performance to that of endoscopic experts and outperformed that of trainees. The model visualization results also showed reasonable regions of interest to explain the classification decisions of CAD systems. We suggest that CNN-CAD system can predict the histology of colorectal adenoma.
Collapse
|
|
46
|
Rodriguez-Diaz E, Baffy G, Lo WK, Mashimo H, Vidyarthi G, Mohapatra SS, Singh SK. Real-time artificial intelligence-based histologic classification of colorectal polyps with augmented visualization. Gastrointest Endosc 2021; 93:662-670. [PMID: 32949567 DOI: 10.1016/j.gie.2020.09.018] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Accepted: 09/10/2020] [Indexed: 02/08/2023]
Abstract
BACKGROUND AND AIMS Artificial intelligence (AI)-based computer-aided diagnostic (CADx) algorithms are a promising approach for real-time histology (RTH) of colonic polyps. Our aim is to present a novel in situ CADx approach that seeks to increase transparency and interpretability of results by generating an intuitive augmented visualization of the model's predicted histology over the polyp surface. METHODS We developed a deep learning model using semantic segmentation to delineate polyp boundaries and a deep learning model to classify subregions within the segmented polyp. These subregions were classified independently and were subsequently aggregated to generate a histology map of the polyp's surface. We used 740 high-magnification narrow-band images from 607 polyps in 286 patients and over 65,000 subregions to train and validate the model. RESULTS The model achieved a sensitivity of .96, specificity of .84, negative predictive value (NPV) of .91, and high-confidence rate (HCR) of .88, distinguishing 171 neoplastic polyps from 83 non-neoplastic polyps of all sizes. Among 93 neoplastic and 75 non-neoplastic polyps ≤5 mm, the model achieved a sensitivity of .95, specificity of .84, NPV of .91, and HCR of .86. CONCLUSIONS The CADx model is capable of accurately distinguishing neoplastic from non-neoplastic polyps and provides a histology map of the spatial distribution of localized histologic predictions along the delineated polyp surface. This capability may improve interpretability and transparency of AI-based RTH and offer intuitive, accurate, and user-friendly guidance in real time for the clinical management and documentation of optical histology results.
Collapse
Affiliation(s)
- Eladio Rodriguez-Diaz
- Research Service, VA Boston Healthcare System, Boston, MA; Department of Biomedical Engineering, Boston University College of Engineering, Boston, MA
| | - György Baffy
- Department of Medicine, Section of Gastroenterology, VA Boston Healthcare System, Boston, MA; Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Wai-Kit Lo
- Department of Medicine, Section of Gastroenterology, VA Boston Healthcare System, Boston, MA; Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Hiroshi Mashimo
- Department of Medicine, Section of Gastroenterology, VA Boston Healthcare System, Boston, MA; Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| | - Gitanjali Vidyarthi
- Section of Gastroenterology, James A. Haley Veterans Hospital, Tampa, FL; Department of Medicine, Morsani College of Medicine, University of South Florida, Tampa, FL
| | - Shyam S Mohapatra
- Research Service, James A. Haley Veterans Hospital, Tampa, FL; Department of Medicine, Morsani College of Medicine, University of South Florida, Tampa, FL
| | - Satish K Singh
- Research Service, VA Boston Healthcare System, Boston, MA; Department of Biomedical Engineering, Boston University College of Engineering, Boston, MA; Department of Medicine, Section of Gastroenterology, VA Boston Healthcare System, Boston, MA; Department of Medicine, Boston University School of Medicine, Boston, MA; Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
|
47
|
Tokunaga M, Matsumura T, Nankinzan R, Suzuki T, Oura H, Kaneko T, Fujie M, Hirai S, Saiki R, Akizue N, Okimoto K, Arai M, Kato J, Kato N. Computer-aided diagnosis system using only white-light endoscopy for the prediction of invasion depth in colorectal cancer. Gastrointest Endosc 2021; 93:647-653. [PMID: 32735946 DOI: 10.1016/j.gie.2020.07.053] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 07/24/2020] [Indexed: 02/06/2023]
Abstract
BACKGROUND AND AIMS Endoscopic treatment is recommended for low-grade dysplasia (LGD), high-grade dysplasia (HGD), and colorectal cancer (CRC) with submucosal (SM) invasion <1000 μm. However, diagnosis of invasion depth requires experience and is often difficult. This study developed and evaluated a novel computer-aided diagnosis (CAD) system to determine whether endoscopic treatment is appropriate for colorectal lesions using only white-light endoscopy (WLE). METHODS We extracted 3442 images from 1035 consecutive colorectal lesions (105 LGDs, 377 HGDs, 107 CRCs with SM <1000 μm, 146 CRCs with SM ≥1000 μm, and 300 advanced CRCs). All images were WLE, nonmagnified, and nonstained. We developed a novel CAD system using 2751 images; the remaining 691 images were evaluated by the CAD system as a test set. The capability of the CAD system to distinguish endoscopically treatable lesions and untreatable lesions was assessed and compared with the results from 2 trainees and 2 experts. RESULTS The CAD system distinguished endoscopically treatable from untreatable lesions with 96.7% sensitivity, 75.0% specificity, and 90.3% accuracy. These values were significantly higher than those from trainees (92.1%, 67.6%, and 84.9%; P < .01, <.01, and <.01, respectively) and were comparable with those from experts (96.5%, 72.5%, and 89.4%, respectively). Trainees assisted by the CAD system demonstrated a diagnostic capability comparable with that of experts. CONCLUSIONS The CAD system had good diagnostic capability for making treatment decisions for colorectal lesions. This system may enable a more convenient and accurate diagnosis using only WLE.
Collapse
Affiliation(s)
- Mamoru Tokunaga
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Tomoaki Matsumura
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | | | - Takuto Suzuki
- Endoscopy Division, Chiba Cancer Center, Chiba, Japan
| | - Hirotaka Oura
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Tatsuya Kaneko
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Mai Fujie
- Department of Clinical Engineering Center, Chiba University Hospital, Chiba, Japan
| | | | | | - Naoki Akizue
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Kenichiro Okimoto
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Makoto Arai
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Jun Kato
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| | - Naoya Kato
- Department of Gastroenterology, Graduate School of Medicine, Chiba University, Chiba, Japan
| |
Collapse
|
|
48
|
Wang X, Huang J, Ji X, Zhu Z. [Application of artificial intelligence for detection and classification of colon polyps]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2021; 41:310-313. [PMID: 33624608 DOI: 10.12122/j.issn.1673-4254.2021.02.22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 12/09/2022]
Abstract
Colorectal cancer is one of the most common cancers worldwide, and colonoscopy has proven to be a preferable modality for screening and surveillance of colorectal cancer. This review discusses the clinical application of artificial intelligence (AI) and computer-aided diagnosis for automated colonoscopic detection and diagnosis of colorectal polyps for better understanding of the application of AI-based computer-aided diagnosis systems especially in terms of machine learning, deep learning and convolutional neural network for screening and surveillance of colorectal cancer.
Collapse
Affiliation(s)
- X Wang
- Information Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - J Huang
- Department of Oncology, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - X Ji
- Day Surgery Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| | - Z Zhu
- Day Surgery Center, First Affiliated Hospital of Kunming Medical University, Kunming 65003, China
| |
Collapse
|
|
49
|
Parsa N, Rex DK, Byrne MF. Colorectal polyp characterization with standard endoscopy: Will Artificial Intelligence succeed where human eyes failed? Best Pract Res Clin Gastroenterol 2021; 52-53:101736. [PMID: 34172255 DOI: 10.1016/j.bpg.2021.101736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 02/16/2021] [Accepted: 02/18/2021] [Indexed: 01/31/2023]
Abstract
The American Society for Gastrointestinal Endoscopy (ASGE) has proposed the "resect-and-discard" and "diagnose-and-leave" strategies for diminutive colorectal polyps to reduce the costs of unnecessary polyp resection and pathology evaluation. However, the diagnostic thresholds set by these guidelines are not always met in community practice. To overcome this sub-optimal performance, artificial intelligence (AI) has been applied to the field of endoscopy. The incorporation of deep learning algorithms with AI models resulted in highly accurate systems that match the expert endoscopists' optical biopsy and exceed the ASGE recommended thresholds. Recent studies have demonstrated that the integration of AI in clinical practice results in significant improvement in endoscopists' diagnostic accuracy while reducing the time to make a diagnosis. Yet, several points need to be addressed before AI models can be successfully implemented in clinical practice. In this review, we summarize the recent literature on the application of AI for characterization of colorectal polyps, and review the current limitation and future directions for this field.
Collapse
Affiliation(s)
- Nasim Parsa
- University of Missouri, Department of Medicine, Division of Gastroenterology and Hepatology, Columbia, MO, United States
| | - Douglas K Rex
- Indiana University School of Medicine, Department of Medicine, Division of Gastroenterology and Hepatology, Indianapolis, IN, United States
| | - Michael F Byrne
- University of British Columbia, Department of Medicine, Division of Gastroenterology and Hepatology Vancouver, British Columbia, Canada; Satisfai Health and AI4GI Joint Venture, Vancouver, British Columbia, Canada.
| |
Collapse
|
|
50
|
Milluzzo SM, Cesaro P, Grazioli LM, Olivari N, Spada C. Artificial Intelligence in Lower Gastrointestinal Endoscopy: The Current Status and Future Perspective. Clin Endosc 2021; 54:329-339. [PMID: 33434961 PMCID: PMC8182250 DOI: 10.5946/ce.2020.082] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2020] [Accepted: 07/30/2020] [Indexed: 12/24/2022] Open
Abstract
The present manuscript aims to review the history, recent advances, evidence, and challenges of artificial intelligence (AI) in colonoscopy. Although it is mainly focused on polyp detection and characterization, it also considers other potential applications (i.e., inflammatory bowel disease) and future perspectives. Some of the most recent algorithms show promising results that are similar to human expert performance. The integration of AI in routine clinical practice will be challenging, with significant issues to overcome (i.e., regulatory, reimbursement). Medico-legal issues will also need to be addressed. With the exception of an AI system that is already available in selected countries (GI Genius; Medtronic, Minneapolis, MN, USA), the majority of the technology is still in its infancy and has not yet been proven to reach a sufficient diagnostic performance to be adopted in the clinical practice. However, larger players will enter the arena of AI in the next few months.
Collapse
Affiliation(s)
- Sebastian Manuel Milluzzo
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy.,Department of Gastroenterology, Fondazione Policlinico Universitario A. Gemelli IRCCS -Università Cattolica del Sacro Cuore, Roma, Italy
| | - Paola Cesaro
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy
| | | | - Nicola Olivari
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy
| | - Cristiano Spada
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy.,Department of Gastroenterology, Fondazione Policlinico Universitario A. Gemelli IRCCS -Università Cattolica del Sacro Cuore, Roma, Italy
| |
Collapse
|