1
|
Hartmann Tolić I, Habijan M, Galić I, Nyarko EK. Advancements in Computer-Aided Diagnosis of Celiac Disease: A Systematic Review. Biomimetics (Basel) 2024; 9:493. [PMID: 39194472 DOI: 10.3390/biomimetics9080493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 08/06/2024] [Accepted: 08/12/2024] [Indexed: 08/29/2024] Open
Abstract
Celiac disease, a chronic autoimmune condition, manifests in those genetically prone to it through damage to the small intestine upon gluten consumption. This condition is estimated to affect approximately one in every hundred individuals worldwide, though it often goes undiagnosed. The early and accurate diagnosis of celiac disease (CD) is critical to preventing severe health complications, with computer-aided diagnostic approaches showing significant promise. However, there is a shortage of review literature that encapsulates the field's current state and offers a perspective on future advancements. Therefore, this review critically assesses the literature on the role of imaging techniques, biomarker analysis, and computer models in improving CD diagnosis. We highlight the diagnostic strengths of advanced imaging and the non-invasive appeal of biomarker analyses, while also addressing ongoing challenges in standardization and integration into clinical practice. Our analysis stresses the importance of computer-aided diagnostics in fast-tracking the diagnosis of CD, highlighting the necessity for ongoing research to refine these approaches for effective implementation in clinical settings. Future research in the field will focus on standardizing CAD protocols for broader clinical use and exploring the integration of genetic and protein data to enhance early detection and personalize treatment strategies. These advancements promise significant improvements in patient outcomes and broader implications for managing autoimmune diseases.
Collapse
Affiliation(s)
- Ivana Hartmann Tolić
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
| | - Marija Habijan
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
| | - Irena Galić
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
| | - Emmanuel Karlo Nyarko
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
| |
Collapse
|
2
|
Denholm J, Schreiber BA, Jaeckle F, Wicks MN, Benbow EW, Bracey TS, Chan JYH, Farkas L, Fryer E, Gopalakrishnan K, Hughes CA, Kirkwood KJ, Langman G, Mahler-Araujo B, McMahon RFT, Myint KLW, Natu S, Robinson A, Sanduka A, Sheppard KA, Tsang YW, Arends MJ, Soilleux EJ. CD, or not CD, that is the question: a digital interobserver agreement study in coeliac disease. BMJ Open Gastroenterol 2024; 11:e001252. [PMID: 38302475 PMCID: PMC10870791 DOI: 10.1136/bmjgast-2023-001252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 12/11/2023] [Indexed: 02/03/2024] Open
Abstract
OBJECTIVE Coeliac disease (CD) diagnosis generally depends on histological examination of duodenal biopsies. We present the first study analysing the concordance in examination of duodenal biopsies using digitised whole-slide images (WSIs). We further investigate whether the inclusion of immunoglobulin A tissue transglutaminase (IgA tTG) and haemoglobin (Hb) data improves the interobserver agreement of diagnosis. DESIGN We undertook a large study of the concordance in histological examination of duodenal biopsies using digitised WSIs in an entirely virtual reporting setting. Our study was organised in two phases: in phase 1, 13 pathologists independently classified 100 duodenal biopsies (40 normal; 40 CD; 20 indeterminate enteropathy) in the absence of any clinical or laboratory data. In phase 2, the same pathologists examined the (re-anonymised) WSIs with the inclusion of IgA tTG and Hb data. RESULTS We found the mean probability of two observers agreeing in the absence of additional data to be 0.73 (±0.08) with a corresponding Cohen's kappa of 0.59 (±0.11). We further showed that the inclusion of additional data increased the concordance to 0.80 (±0.06) with a Cohen's kappa coefficient of 0.67 (±0.09). CONCLUSION We showed that the addition of serological data significantly improves the quality of CD diagnosis. However, the limited interobserver agreement in CD diagnosis using digitised WSIs, even after the inclusion of IgA tTG and Hb data, indicates the importance of interpreting duodenal biopsy in the appropriate clinical context. It further highlights the unmet need for an objective means of reproducible duodenal biopsy diagnosis, such as the automated analysis of WSIs using artificial intelligence.
Collapse
Affiliation(s)
- James Denholm
- Department of Pathology, University of Cambridge, Cambridge, UK
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| | - Benjamin A Schreiber
- Department of Pathology, University of Cambridge, Cambridge, UK
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Florian Jaeckle
- Department of Pathology, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| | - Mike N Wicks
- Department of Pathology, The University of Edinburgh College of Medicine and Veterinary Medicine, Edinburgh, UK
| | - Emyr W Benbow
- Division of Medical Education, The University of Manchester, Manchester, UK
- Department of Histopathology, Manchester University NHS Foundation Trust, Manchester, UK
| | - Tim S Bracey
- Department of Diagnostic and Molecular Pathology, Royal Cornwall Hospitals NHS Trust, Truro, UK
- University Hospitals Plymouth NHS Trust, Plymouth, UK
| | - James Y H Chan
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Lorant Farkas
- Department of Pathology, Akershus University Hospital, Nordbyhagen, Norway
- Institute of Clinical Medicine, University of Oslo, Nordbyhagen, Norway
| | - Eve Fryer
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | - Kishore Gopalakrishnan
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Caroline A Hughes
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | | | - Gerald Langman
- Department of Cellular Pathology, Heartlands Hospital, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Betania Mahler-Araujo
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
- MRC Institute of Metabolic Science, Wellcome Trust, Cambridge, UK
| | - Raymond F T McMahon
- Division of Medical Education, The University of Manchester, Manchester, UK
- Department of Histopathology, Manchester University NHS Foundation Trust, Manchester, UK
| | - Khun La Win Myint
- Department of Pathology, Queen Elizabeth University Hospital, Glasgow, UK
| | - Sonali Natu
- University Hospital of North Tees, North Tees and Hartlepool NHS Foundation Trust, Stockton on Tees, UK
| | - Andrew Robinson
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Ashraf Sanduka
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Katharine A Sheppard
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | - Yee Wah Tsang
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Mark J Arends
- Division of Pathology, University of Edinburgh, Edinburgh, UK
| | - Elizabeth J Soilleux
- Department of Pathology, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| |
Collapse
|
3
|
Gruver AM, Lu H, Zhao X, Fulford AD, Soper MD, Ballard D, Hanson JC, Schade AE, Hsi ED, Gottlieb K, Credille KM. Pathologist-trained machine learning classifiers developed to quantitate celiac disease features differentiate endoscopic biopsies according to modified marsh score and dietary intervention response. Diagn Pathol 2023; 18:122. [PMID: 37951937 PMCID: PMC10638821 DOI: 10.1186/s13000-023-01412-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 11/02/2023] [Indexed: 11/14/2023] Open
Abstract
BACKGROUND Histologic evaluation of the mucosal changes associated with celiac disease is important for establishing an accurate diagnosis and monitoring the impact of investigational therapies. While the Marsh-Oberhuber classification has been used to categorize the histologic findings into discrete stages (i.e., Type 0-3c), significant variability has been documented between observers using this ordinal scoring system. Therefore, we evaluated whether pathologist-trained machine learning classifiers can be developed to objectively quantitate the pathological changes of villus blunting, intraepithelial lymphocytosis, and crypt hyperplasia in small intestine endoscopic biopsies. METHODS A convolutional neural network (CNN) was trained and combined with a secondary algorithm to quantitate intraepithelial lymphocytes (IEL) with 5 classes on CD3 immunohistochemistry whole slide images (WSI) and used to correlate feature outputs with ground truth modified Marsh scores in a total of 116 small intestine biopsies. RESULTS Across all samples, median %CD3 counts (positive cells/enterocytes) from villous epithelium (VE) increased with higher Marsh scores (Type 0%CD3 VE = 13.4; Type 1-3%CD3 VE = 41.9, p < 0.0001). Indicators of villus blunting and crypt hyperplasia were also observed (Type 0-2 villous epithelium/lamina propria area ratio = 0.81; Type 3a-3c villous epithelium/lamina propria area ratio = 0.29, p < 0.0001), and Type 0-1 crypt/villous epithelial area ratio = 0.59; Type 2-3 crypt/villous epithelial area ratio = 1.64, p < 0.0001). Using these individual features, a combined feature machine learning score (MLS) was created to evaluate a set of 28 matched pre- and post-intervention biopsies captured before and after dietary gluten restriction. The disposition of the continuous MLS paired biopsy result aligned with the Marsh score in 96.4% (27/28) of the cohort. CONCLUSIONS Machine learning classifiers can be developed to objectively quantify histologic features and capture additional data not achievable with manual scoring. Such approaches should be further investigated to improve biopsy evaluation, especially for clinical trials.
Collapse
Affiliation(s)
- Aaron M Gruver
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Haiyan Lu
- Wake Forest University School of Medicine, Winston-Salem, NC, 27157, USA
| | - Xiaoxian Zhao
- Wake Forest University School of Medicine, Winston-Salem, NC, 27157, USA
| | - Angie D Fulford
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Michael D Soper
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Darryl Ballard
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Jeffrey C Hanson
- Research Informatics, Eli Lilly and Company, Indianapolis, IN, 46285, USA
| | - Andrew E Schade
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA
| | - Eric D Hsi
- Wake Forest University School of Medicine, Winston-Salem, NC, 27157, USA
| | - Klaus Gottlieb
- Immunology, Eli Lilly and Company, Indianapolis, IN, 46285, USA
| | - Kelly M Credille
- Clinical Diagnostics Laboratory, Eli Lilly and Company, Lilly Corporate Center, Indianapolis, IN, 46285, USA.
| |
Collapse
|
4
|
Schreiber B, Denholm J, Gilbey J, Schönlieb CB, Soilleux E. Stain normalization gives greater generalizability than stain jittering in neural network training for the classification of coeliac disease in duodenal biopsy whole slide images. J Pathol Inform 2023; 14:100324. [PMID: 37577172 PMCID: PMC10416012 DOI: 10.1016/j.jpi.2023.100324] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2023] [Revised: 06/09/2023] [Accepted: 06/14/2023] [Indexed: 08/15/2023] Open
Abstract
Around 1% of the population of the UK and North America have a diagnosis of coeliac disease (CD), due to a damaging immune response to the small intestine. Assessing whether a patient has CD relies primarily on the examination of a duodenal biopsy, an unavoidably subjective process with poor inter-observer concordance. Wei et al. [11] developed a neural network-based method for diagnosing CD using a dataset of duodenal biopsy whole slide images (WSIs). As all training and validation data came from one source, there was no guarantee that their results would generalize to WSIs obtained from different scanners and laboratories. In this study, the effects of applying stain normalization and jittering to the training data were compared. We trained a deep neural network on 331 WSIs obtained with a Ventana scanner (WSIs; CD: n = 190 ; normal: n = 141 ) to classify presence of CD. In order to test the effects of stain processing when validating on WSIs scanned on varying scanners and from varying laboratories, the neural network was validated on 4 datasets: WSIs of slides scanned on a Ventana scanner (WSIs; CD: n = 48 ; normal: n = 35 ), WSIs of the same slides rescanned on a Hamamatsu scanner (WSIs; CD: n = 48 ; normal: n = 35 ), WSIs of the same slides rescanned on an Aperio scanner (WSIs; CD: n = 48 ; normal: n = 35 ), and WSIs of different slides scanned on an Aperio scanner (WSIs; CD: n = 38 ; normal: n = 37 ). Without stain processing, the F1 scores of the neural network were 0.947 , 0.619 , 0.746 , and 0.727 when validating on the Ventana validation WSIs, Hamamatsu and Aperio rescans of the Ventana validation WSIs, and Aperio WSIs from a different source respectively. With stain normalization, the performance of the neural network improved significantly with respective F1 scores 0.982 , 0.943 , 0.903 , and 0.847 . Stain jittering resulted in a better performance than stain normalization when validating on data from the same source F1 score 1.000 , but resulted in poorer performance than stain normalization when validating on WSIs from different scanners (F1 scores 0.939 , 0.814 , and 0.747 ). This study shows the importance of stain processing, in particular stain normalization, when training machine learning models on duodenal biopsy WSIs to ensure generalizability between different scanners and laboratories.
Collapse
Affiliation(s)
- B.A. Schreiber
- Department of Pathology, University of Cambridge, Cambridge, UK
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - J. Denholm
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- Lyzeum Ltd., Cambridge, UK
| | - J.D. Gilbey
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - C.-B. Schönlieb
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- Lyzeum Ltd., Cambridge, UK
| | - E.J. Soilleux
- Department of Pathology, University of Cambridge, Cambridge, UK
- Lyzeum Ltd., Cambridge, UK
| |
Collapse
|
5
|
Denholm J, Schreiber B, Evans S, Crook O, Sharma A, Watson J, Bancroft H, Langman G, Gilbey J, Schönlieb CB, Arends M, Soilleux E. Multiple-instance-learning-based detection of coeliac disease in histological whole-slide images. J Pathol Inform 2022; 13:100151. [PMID: 36605111 PMCID: PMC9808019 DOI: 10.1016/j.jpi.2022.100151] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 10/21/2022] [Accepted: 10/21/2022] [Indexed: 11/06/2022] Open
Abstract
We present a multiple-instance-learning-based scheme for detecting coeliac disease, an autoimmune disorder affecting the intestine, in histological whole-slide images (WSIs) of duodenal biopsies. We train our model to detect 2 distinct classes, normal tissue and coeliac disease, on the patch-level, and in turn leverage slide-level classifications. Using 5-fold cross-validation in a training set of 1841 (1163 normal; 680 coeliac disease) WSIs, our model classifies slides as normal with accuracy (96.7±0.6)%, precision (98.0±1.7)%, and recall (96.8±2.5)%, and as coeliac disease with accuracy (96.7±0.5)%, precision (94.9±3.7)%, and recall (96.5±2.9)% where the error bars are the cross-validation standard deviation. We apply our model to 2 test sets: one containing 191 WSIs (126 normal; 65 coeliac) from the same sources as the training data, and another from a completely independent source, containing 34 WSIs (17 normal; 17 coeliac), obtained with a scanner model not represented in the training data. Using the same-source test data, our model classifies slides as normal with accuracy 96.5%, precision 98.4% and recall 96.1%, and positive for coeliac disease with accuracy 96.5%, precision 93.5%, and recall 97.3%. Using the different-source test data the model classifies slides as normal with accuracy 94.1% (32/34), precision 89.5%, and recall 100%, and as positive for coeliac disease with accuracy 94.1%, precision 100%, and recall 88.2%. We discuss generalising our approach to screen for a range of pathologies.
Collapse
Affiliation(s)
- J. Denholm
- Lyzeum Ltd, Salisbury House, Station Road, Cambridge CB1 2LA, Cambridgeshire, UK,Department of Applied Maths and Theoretical Physics, University of Cambridge, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, Cambridgeshire, UK,Department of Pathology, University of Cambridge, Tennis Court Road, Cambridge CB2 1QP, Cambridgeshire, UK,Corresponding author.
| | - B.A. Schreiber
- Department of Applied Maths and Theoretical Physics, University of Cambridge, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, Cambridgeshire, UK,Department of Pathology, University of Cambridge, Tennis Court Road, Cambridge CB2 1QP, Cambridgeshire, UK
| | - S.C. Evans
- Department of Pathology, University of Cambridge, Tennis Court Road, Cambridge CB2 1QP, Cambridgeshire, UK
| | - O.M. Crook
- The Alan Turing Institute, 96 Euston Rd, London NW1 2DB, UK
| | - A. Sharma
- Department of Pathology, University of Cambridge, Tennis Court Road, Cambridge CB2 1QP, Cambridgeshire, UK
| | - J.L. Watson
- Oxford Medical School, University of Oxford, S Parks Road, Oxford OX1 3PL, Oxfordshire, UK
| | - H. Bancroft
- Department of Cellular Pathology, Birmingham Heartlands Hospital, University Hospitals Birmingham, 45 Bordesley Green East, Birmingham B9 5SS, West Midlands, UK
| | - G. Langman
- Department of Cellular Pathology, Birmingham Heartlands Hospital, University Hospitals Birmingham, 45 Bordesley Green East, Birmingham B9 5SS, West Midlands, UK
| | - J.D. Gilbey
- Department of Applied Maths and Theoretical Physics, University of Cambridge, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, Cambridgeshire, UK
| | - C.-B. Schönlieb
- Department of Applied Maths and Theoretical Physics, University of Cambridge, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, Cambridgeshire, UK
| | - M.J. Arends
- Division of Pathology, University of Edinburgh, Cancer Research UK Edinburgh Centre, Western General Hospital, Crewe Road South, Edinburgh, EH4 2XR, Lothian, Scotland
| | - E.J. Soilleux
- Lyzeum Ltd, Salisbury House, Station Road, Cambridge CB1 2LA, Cambridgeshire, UK,Department of Pathology, University of Cambridge, Tennis Court Road, Cambridge CB2 1QP, Cambridgeshire, UK
| |
Collapse
|
6
|
Brown DE, Sharma S, Jablonski JA, Weltman A. Neural network methods for diagnosing patient conditions from cardiopulmonary exercise testing data. BioData Min 2022; 15:16. [PMID: 35964102 PMCID: PMC9375280 DOI: 10.1186/s13040-022-00299-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 06/27/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Cardiopulmonary exercise testing (CPET) provides a reliable and reproducible approach to measuring fitness in patients and diagnosing their health problems. However, the data from CPET consist of multiple time series that require training to interpret. Part of this training teaches the use of flow charts or nested decision trees to interpret the CPET results. This paper investigates the use of two machine learning techniques using neural networks to predict patient health conditions with CPET data in contrast to flow charts. The data for this investigation comes from a small sample of patients with known health problems and who had CPET results. The small size of the sample data also allows us to investigate the use and performance of deep learning neural networks on health care problems with limited amounts of labeled training and testing data. METHODS This paper compares the current standard for interpreting and classifying CPET data, flowcharts, to neural network techniques, autoencoders and convolutional neural networks (CNN). The study also investigated the performance of principal component analysis (PCA) with logistic regression to provide an additional baseline of comparison to the neural network techniques. RESULTS The patients in the sample had two primary diagnoses: heart failure and metabolic syndrome. All model-based testing was done with 5-fold cross-validation and metrics of precision, recall, F1 score, and accuracy. As a baseline for comparison to our models, the highest performing flow chart method achieved an accuracy of 77%. Both PCA regression and CNN achieved an average accuracy of 90% and outperformed the flow chart methods on all metrics. The autoencoder with logistic regression performed the best on each of the metrics and had an average accuracy of 94%. CONCLUSIONS This study suggests that machine learning and neural network techniques, in particular, can provide higher levels of accuracy with CPET data than traditional flowchart methods. Further, the CNN performed well with a small data set showing that these techniques can be designed to perform well on small data problems that are often found in health care and the life sciences. Further testing with larger data sets is needed to continue evaluating the use of machine learning to interpret CPET data.
Collapse
Affiliation(s)
- Donald E. Brown
- School of Data Science, University of Virginia, Charlottesville, VA USA
- Department of Engineering Systems and Environment, University of Virginia, Charlottesville, VA USA
| | - Suchetha Sharma
- School of Data Science, University of Virginia, Charlottesville, VA USA
| | - James A. Jablonski
- Department of Engineering Systems and Environment, University of Virginia, Charlottesville, VA USA
| | - Arthur Weltman
- Department of Kinesiology, University of Virginia, Charlottesville, VA USA
- Division of Endocrinology and Metabolism, Department of Medicine, University of Virginia, Charlottesville, VA USA
| |
Collapse
|
7
|
Stoleru CA, Dulf EH, Ciobanu L. Automated detection of celiac disease using Machine Learning Algorithms. Sci Rep 2022; 12:4071. [PMID: 35260574 PMCID: PMC8904634 DOI: 10.1038/s41598-022-07199-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Accepted: 02/14/2022] [Indexed: 12/20/2022] Open
Abstract
Celiac disease is a disorder of the immune system that mainly affects the small intestine but can also affect the skeletal system. The diagnosis relies on histological assessment of duodenal biopsies acquired by upper digestive endoscopy. Immunological tests involve collecting a blood sample to detect if the antibodies have been produced in the body. Endoscopy is invasive and histology is time-consuming. In recent years there have been various algorithms that use artificial intelligence (AI) and neural convolutions (CNN, Convolutional Neural Network) to process images from capsule endoscopy, a non-invasive endoscopy approach, that provides magnified, high qualitative images of the small bowel mucosa, to quickly establish a diagnosis. The proposed innovative approach do not use complex learning algorithms, instead it find some artefacts in the endoscopies using kernels and use classified machine learning algorithms. Each used artefacts have a psychical meaning: atrophies of the mucosa with a visible submucosal vascular pattern; the presence of cracks (depressions) that have an appearance similar to that of dry land; reduction or complete loss of folds in the duodenum; the presence of a submerged appearance at the Kerckring folds and a low number of villi. The results obtained for video capsule endoscopy images processing reveal an accuracy of 94.1% and F1 score of 94%, which is competitive with other complex algorithms. The main goal of the present research was to demonstrate that computer-aided diagnosis of celiac disease is possible even without the use of very complex algorithms, which require expensive hardware and a lot of processing time. The use of the proposed automated images processing acquired noninvasively by capsule endoscopy would be assistive in detecting the subtle presence of villous atrophy not evident by visual inspection. It may also be useful to assess the degree of improvement of celiac. Patients on a gluten-free diet, the main treatment method for stopping the autoimmune process and improving the state of the small intestinal villi. The novelty of the work is that the algorithm uses two modified filters to properly analyse the intestine wall texture. It is proved that using the right filters, the proper diagnostic can be obtained by image processing, without the use of a complicated machine learning algorithm.
Collapse
Affiliation(s)
- Cristian-Andrei Stoleru
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, Memorandumului 28, 400014, Cluj-Napoca, Romania
| | - Eva H Dulf
- Automation Department, Faculty of Automation and Computer Science, Technical University of Cluj-Napoca, Memorandumului 28, 400014, Cluj-Napoca, Romania.
| | - Lidia Ciobanu
- Faculty of Medicine, Regional Institute of Gastroenterology and Hepatology, Iuliu Hatieganu University of Medicine and Pharmacy, Croitorilor Street 19-21, 400162, Cluj-Napoca, Romania
| |
Collapse
|
8
|
Kobayashi S, Saltz JH, Yang VW. State of machine and deep learning in histopathological applications in digestive diseases. World J Gastroenterol 2021; 27:2545-2575. [PMID: 34092975 PMCID: PMC8160628 DOI: 10.3748/wjg.v27.i20.2545] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2021] [Revised: 03/27/2021] [Accepted: 04/29/2021] [Indexed: 02/06/2023] Open
Abstract
Machine learning (ML)- and deep learning (DL)-based imaging modalities have exhibited the capacity to handle extremely high dimensional data for a number of computer vision tasks. While these approaches have been applied to numerous data types, this capacity can be especially leveraged by application on histopathological images, which capture cellular and structural features with their high-resolution, microscopic perspectives. Already, these methodologies have demonstrated promising performance in a variety of applications like disease classification, cancer grading, structure and cellular localizations, and prognostic predictions. A wide range of pathologies requiring histopathological evaluation exist in gastroenterology and hepatology, indicating these as disciplines highly targetable for integration of these technologies. Gastroenterologists have also already been primed to consider the impact of these algorithms, as development of real-time endoscopic video analysis software has been an active and popular field of research. This heightened clinical awareness will likely be important for future integration of these methods and to drive interdisciplinary collaborations on emerging studies. To provide an overview on the application of these methodologies for gastrointestinal and hepatological histopathological slides, this review will discuss general ML and DL concepts, introduce recent and emerging literature using these methods, and cover challenges moving forward to further advance the field.
Collapse
Affiliation(s)
- Soma Kobayashi
- Department of Biomedical Informatics, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
| | - Joel H Saltz
- Department of Biomedical Informatics, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
| | - Vincent W Yang
- Department of Medicine, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY 11794, United States
- Department of Physiology and Biophysics, Renaissance School of Medicine, Stony Brook University, Stony Brook , NY 11794, United States
| |
Collapse
|
9
|
Guleria S, Shah TU, Pulido JV, Fasullo M, Ehsan L, Lippman R, Sali R, Mutha P, Cheng L, Brown DE, Syed S. Deep learning systems detect dysplasia with human-like accuracy using histopathology and probe-based confocal laser endomicroscopy. Sci Rep 2021; 11:5086. [PMID: 33658592 PMCID: PMC7930108 DOI: 10.1038/s41598-021-84510-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Accepted: 02/15/2021] [Indexed: 12/20/2022] Open
Abstract
Probe-based confocal laser endomicroscopy (pCLE) allows for real-time diagnosis of dysplasia and cancer in Barrett's esophagus (BE) but is limited by low sensitivity. Even the gold standard of histopathology is hindered by poor agreement between pathologists. We deployed deep-learning-based image and video analysis in order to improve diagnostic accuracy of pCLE videos and biopsy images. Blinded experts categorized biopsies and pCLE videos as squamous, non-dysplastic BE, or dysplasia/cancer, and deep learning models were trained to classify the data into these three categories. Biopsy classification was conducted using two distinct approaches-a patch-level model and a whole-slide-image-level model. Gradient-weighted class activation maps (Grad-CAMs) were extracted from pCLE and biopsy models in order to determine tissue structures deemed relevant by the models. 1970 pCLE videos, 897,931 biopsy patches, and 387 whole-slide images were used to train, test, and validate the models. In pCLE analysis, models achieved a high sensitivity for dysplasia (71%) and an overall accuracy of 90% for all classes. For biopsies at the patch level, the model achieved a sensitivity of 72% for dysplasia and an overall accuracy of 90%. The whole-slide-image-level model achieved a sensitivity of 90% for dysplasia and 94% overall accuracy. Grad-CAMs for all models showed activation in medically relevant tissue regions. Our deep learning models achieved high diagnostic accuracy for both pCLE-based and histopathologic diagnosis of esophageal dysplasia and its precursors, similar to human accuracy in prior studies. These machine learning approaches may improve accuracy and efficiency of current screening protocols.
Collapse
Affiliation(s)
- Shan Guleria
- Rush University Medical Center, Chicago, IL, USA
| | - Tilak U Shah
- Hunter Holmes McGuire Veterans Affairs Medical Center, Richmond, VA, USA
- Division of Gastroenterology, Hepatology and Nutrition, Virginia Commonwealth University, Richmond, VA, USA
| | - J Vincent Pulido
- Johns Hopkins University Applied Physics Laboratory, Laurel, MD, USA
- Department of Systems & Information Engineering, University of Virginia, Charlottesville, VA, USA
| | - Matthew Fasullo
- Hunter Holmes McGuire Veterans Affairs Medical Center, Richmond, VA, USA
- Division of Gastroenterology, Hepatology and Nutrition, Virginia Commonwealth University, Richmond, VA, USA
| | - Lubaina Ehsan
- Division of Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, University of Virginia School of Medicine, Charlottesville, VA, USA
| | - Robert Lippman
- Hunter Holmes McGuire Veterans Affairs Medical Center, Richmond, VA, USA
| | - Rasoul Sali
- Department of Systems & Information Engineering, University of Virginia, Charlottesville, VA, USA
| | - Pritesh Mutha
- Hunter Holmes McGuire Veterans Affairs Medical Center, Richmond, VA, USA
- Division of Gastroenterology, Hepatology and Nutrition, Virginia Commonwealth University, Richmond, VA, USA
| | - Lin Cheng
- Rush University Medical Center, Chicago, IL, USA
| | - Donald E Brown
- Department of Systems & Information Engineering, University of Virginia, Charlottesville, VA, USA
| | - Sana Syed
- Division of Gastroenterology, Hepatology, and Nutrition, Department of Pediatrics, University of Virginia School of Medicine, Charlottesville, VA, USA.
| |
Collapse
|