This study aims to create a reliable framework for grading esophageal cancer. The framework combines feature extraction, deep learning with attention mechanisms, and radiomics to ensure accuracy, interpretability, and practical use in tumor analysis.

This retrospective study used data from 2,560 esophageal cancer patients across multiple clinical centers, collected from 2018 to 2023. The dataset included CT scan images and clinical information, representing a variety of cancer grades and types. Standardized CT imaging protocols were followed, and experienced radiologists manually segmented the tumor regions. Only high-quality data were used in the study. A total of 215 radiomic features were extracted using the SERA platform. The study used two deep learning models-DenseNet121 and EfficientNet-B0-enhanced with attention mechanisms to improve accuracy. A combined classification approach used both radiomic and deep learning features, and machine learning models like Random Forest, XGBoost, and CatBoost were applied. These models were validated with strict training and testing procedures to ensure effective cancer grading.

This study analyzed the reliability and performance of radiomic and deep learning features for grading esophageal cancer. Radiomic features were classified into four reliability levels based on their ICC (Intraclass Correlation) values. Most of the features had excellent (ICC > 0.90) or good (0.75 < ICC ≤ 0.90) reliability. Deep learning features extracted from DenseNet121 and EfficientNet-B0 were also categorized, and some of them showed poor reliability. The machine learning models, including XGBoost and CatBoost, were tested for their ability to grade cancer. XGBoost with Recursive Feature Elimination (RFE) gave the best results for radiomic features, with an AUC (Area Under the Curve) of 91.36%. For deep learning features, XGBoost with Principal Component Analysis (PCA) gave the best results using DenseNet121, while CatBoost with RFE performed best with EfficientNet-B0, achieving an AUC of 94.20%. Combining radiomic and deep features led to significant improvements, with XGBoost achieving the highest AUC of 96.70%, accuracy of 96.71%, and sensitivity of 95.44%. The combination of both DenseNet121 and EfficientNet-B0 models in ensemble models achieved the best overall performance, with an AUC of 95.14% and accuracy of 94.88%.

This study improves esophageal cancer grading by combining radiomics and deep learning. It enhances diagnostic accuracy, reproducibility, and interpretability, while also helping in personalized treatment planning through better tumor characterization.

Not applicable.

The diagnostic performance of artificial intelligence (AI)-assisted endoscopy for digestive tumors remains controversial. The objective of this umbrella review was to summarize the comprehensive evidence for the AI-assisted endoscopic diagnosis of digestive system tumors. We grouped the evidence according to the location of each digestive system tumor and performed separate subgroup analyses on the basis of the method of data collection and form of the data. We also compared the diagnostic performance of AI with that of experts and nonexperts. For early digestive system cancer and precancerous lesions, AI showed a high diagnostic performance in capsule endoscopy and esophageal squamous cell carcinoma. Additionally, AI-assisted endoscopic ultrasonography (EUS) had good diagnostic accuracy for pancreatic cancer. In the subgroup analysis, AI had a better diagnostic performance than experts for most digestive system tumors. However, the diagnostic performance of AI using video data requires improvement.

Artificial intelligence (AI) has the potential to transform cancer diagnosis, ultimately leading to better patient outcomes.

We performed an umbrella review to summarize and critically evaluate the evidence for the AI-based imaging diagnosis of cancers.

PubMed, Embase, Web of Science, Cochrane, and IEEE databases were searched for relevant systematic reviews from inception to June 19, 2024. Two independent investigators abstracted data and assessed the quality of evidence, using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses. We further assessed the quality of evidence in each meta-analysis by applying the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) criteria. Diagnostic performance data were synthesized narratively.

In a comprehensive analysis of 158 included studies evaluating the performance of AI algorithms in noninvasive imaging diagnosis across 8 major human system cancers, the accuracy of the classifiers for central nervous system cancers varied widely (ranging from 48% to 100%). Similarities were observed in the diagnostic performance for cancers of the head and neck, respiratory system, digestive system, urinary system, female-related systems, skin, and other sites. Most meta-analyses demonstrated positive summary performance. For instance, 9 reviews meta-analyzed sensitivity and specificity for esophageal cancer, showing ranges of 90%-95% and 80%-93.8%, respectively. In the case of breast cancer detection, 8 reviews calculated the pooled sensitivity and specificity within the ranges of 75.4%-92% and 83%-90.6%, respectively. Four meta-analyses reported the ranges of sensitivity and specificity in ovarian cancer, and both were 75%-94%. Notably, in lung cancer, the pooled specificity was relatively low, primarily distributed between 65% and 80%. Furthermore, 80.4% (127/158) of the included studies were of high quality according to the JBI Critical Appraisal Checklist, with the remaining studies classified as medium quality. The GRADE assessment indicated that the overall quality of the evidence was moderate to low.

Although AI shows great potential for achieving accelerated, accurate, and more objective diagnoses of multiple cancers, there are still hurdles to overcome before its implementation in clinical settings. The present findings highlight that a concerted effort from the research community, clinicians, and policymakers is required to overcome existing hurdles and translate this potential into improved patient outcomes and health care delivery.

PROSPERO CRD42022364278; https://www.crd.york.ac.uk/PROSPERO/view/CRD42022364278.

Neoadjuvant chemotherapy is standard for advanced esophageal squamous cell carcinoma, though often ineffective. Therefore, predicting the response to chemotherapy before treatment is desirable. However, there is currently no established method for predicting response to neoadjuvant chemotherapy. This study aims to build a deep-learning model to predict the response of esophageal squamous cell carcinoma to preoperative chemotherapy by utilizing multimodal data integrating esophageal endoscopic images and clinical information.

170 patients with locally advanced esophageal squamous cell carcinoma were retrospectively studied, and endoscopic images and clinical information before neoadjuvant chemotherapy were collected. Endoscopic images alone and endoscopic images plus clinical information were each analyzed with a deep-learning model based on ResNet50. The clinical information alone was analyzed using logistic regression machine learning models, and the area under a receiver operating characteristic curve was calculated to compare the accuracy of each model. Gradient-weighted Class Activation Mapping was used on the endoscopic images to analyze the trend of the regions of interest in this model.

The area under the curve by clinical information alone, endoscopy alone, and both combined were 0.64, 0.55, and 0.77, respectively. The endoscopic image plus clinical information group was statistically more significant than the other models. This model focused more on the tumor when trained with clinical information.

The deep-learning model developed suggests that gastrointestinal endoscopic imaging, in combination with other clinical information, has the potential to predict the efficacy of neoadjuvant chemotherapy in locally advanced esophageal squamous cell carcinoma before treatment.

This study aims to assess a hybrid framework that combines radiomic features with deep learning and attention mechanisms to improve the accuracy of classifying lung cancer subtypes using CT images.

A dataset of 2725 lung cancer images was used, covering various subtypes: adenocarcinoma (552 images), SCC (380 images), small cell lung cancer (SCLC) (307 images), large cell carcinoma (215 images), and pulmonary carcinoid tumors (180 images). The images were extracted as 2D slices from 3D CT scans, with tumor-containing slices selected from scans obtained across five healthcare centers. The number of slices per patient varied between 7 and 30, depending on tumor visibility. CT images were preprocessed using standardization, cropping, and Gaussian smoothing to ensure consistency across scans from different imaging instruments used at the centers. Radiomic features, including first-order statistics (FOS), shape-based, and texture-based features, were extracted using the PyRadiomics library. A DeepCNN architecture, integrated with attention mechanisms in the second convolutional block, was used for deep feature extraction, focusing on diagnostically important regions. The dataset was split into training (60%), validation (20%), and testing (20%) sets. Various feature selection techniques, such as Non-negative Matrix Factorization (NMF) and Recursive Feature Elimination (RFE), were used, and multiple machines learning models, including XGBoost and Stacking, were evaluated using accuracy, sensitivity, and AUC metrics. The model's reproducibility was validated using ICC analysis across different imaging conditions.

The hybrid model, which integrates DeepCNN with attention mechanisms, outperformed traditional methods. It achieved a testing accuracy of 92.47%, an AUC of 93.99%, and a sensitivity of 92.11%. XGBoost with NMF showed the best performance across all models, and the combination of radiomic and deep features improved classification further. Attention mechanisms played a key role in enhancing model performance by focusing on relevant tumor areas, reducing misclassification from irrelevant features. This also improved the performance of the 3D Autoencoder, boosting the AUC to 93.89% and accuracy to 93.24%.

This study shows that combining radiomic features with deep learning-especially when enhanced by attention mechanisms-creates a powerful and accurate framework for classifying lung cancer subtypes. Clinical trial number Not applicable.

Laryngoscopy is routinely used for suspicious vocal cord lesions with limited performance. Accumulated studies have demonstrated the bright prospect of deep learning in processing medical imaging. In this study, we perform a systematic review and meta-analysis to investigate diagnostic utility of deep learning in laryngoscopy.

The study was performed according to the Primary Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines. We comprehensively retrieved articles from the PubMed, Scopus, Embase, and Web of Science up to July 14, 2024. Eligible studies with application of deep learning algorithm in laryngoscopy were assessed and enrolled by two independent investigators. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio and diagnostic odds ratio with 95% confidence intervals (CIs) were calculated using a random effects model.

We retained 9 eligible studies adding up to 106,175 endoscopic images for the meta-analysis. The pooled sensitivity and specificity to diagnose laryngeal cancer were 0.95(95% CI: 0.85-0.98) and 0.96 (95% CI: 0.91-0.98). The area under the curve of deep learning was 0.99 (95%CI: 0.97-0.99).

Deep learning demonstrated excellent diagnostic efficacy in assessing laryngeal cancer with laryngoscope images in current studies, which manifests its potential of aiding endoscopist for laryngeal cancer diagnosis and clinical decision making.

One of the foremost causes of global healthcare burden is cancer of the gastrointestinal tract. The medical records, lab results, radiographs, endoscopic images, tissue samples, and medical histories of patients with gastrointestinal malignancies provide an enormous amount of medical data. There are encouraging signs that the advent of artificial intelligence could enhance the treatment of gastrointestinal issues with this data. Deep learning algorithms can swiftly and effectively analyze unstructured, high-dimensional data, including texts, images, and waveforms, while advanced machine learning approaches could reveal new insights into disease risk factors and phenotypes. In summary, artificial intelligence has the potential to revolutionize various features of gastrointestinal cancer care, such as early detection, diagnosis, therapy, and prognosis. This paper highlights some of the many potential applications of artificial intelligence in this domain. Additionally, we discuss the present state of the discipline and its potential future developments.

Understanding the intricate relationships between gene expression levels and epigenetic modifications in a genome is crucial to comprehending the pathogenic mechanisms of many diseases. With the advancement of DNA Methylome Profiling techniques, the emphasis on identifying Differentially Methylated Regions (DMRs/DMGs) has become crucial for biomarker discovery, offering new insights into the etiology of illnesses. This review surveys the current state of computational tools/algorithms for the analysis of microarray-based DNA methylation profiling datasets, focusing on key concepts underlying the diagnostic/prognostic CpG site extraction. It addresses methodological frameworks, algorithms, and pipelines employed by various authors, serving as a roadmap to address challenges and understand changing trends in the methodologies for analyzing array-based DNA methylation profiling datasets derived from diseased genomes. Additionally, it highlights the importance of integrating gene expression and methylation datasets for accurate biomarker identification, explores prognostic prediction models, and discusses molecular subtyping for disease classification. The review also emphasizes the contributions of machine learning, neural networks, and data mining to enhance diagnostic workflow development, thereby improving accuracy, precision, and robustness.

Capsule endoscopy (CE) is a minimally invasive exam suitable of panendoscopic evaluation of the gastrointestinal (GI) tract. Nevertheless, CE is time-consuming with suboptimal diagnostic yield in the upper GI tract. Convolutional neural networks (CNN) are human brain architecture-based models suitable for image analysis. However, there is no study about their role in capsule panendoscopy.

Our group developed an artificial intelligence (AI) model for panendoscopic automatic detection of pleomorphic lesions (namely vascular lesions, protuberant lesions, hematic residues, ulcers, and erosions). 355,110 images (6,977 esophageal, 12,918 gastric, 258,443 small bowel, 76,772 colonic) from eight different CE and colon CE (CCE) devices were divided into a training and validation dataset in a patient split design. The model classification was compared to three CE experts' classification. The model's performance was evaluated by its sensitivity, specificity, accuracy, positive predictive value, negative predictive value, and area under the precision-recall curve.

The binary esophagus CNN had a diagnostic accuracy for pleomorphic lesions of 83.6%. The binary gastric CNN identified pleomorphic lesions with a 96.6% accuracy. The undenary small bowel CNN distinguished pleomorphic lesions with different hemorrhagic potentials with 97.6% accuracy. The trinary colonic CNN (detection and differentiation of normal mucosa, pleomorphic lesions, and hematic residues) had 94.9% global accuracy.

We developed the first AI model for panendoscopic automatic detection of pleomorphic lesions in both CE and CCE from multiple brands, solving a critical interoperability technological challenge. Deep learning-based tools may change the landscape of minimally invasive capsule panendoscopy.

Esophageal cancer has a dismal prognosis and necessitates a multimodal and multidisciplinary approach from diagnosis to treatment. High-definition white-light endoscopy and histopathological confirmation remain the gold standard for the definitive diagnosis of premalignant and malignant lesions. Artificial intelligence using deep learning (DL) methods for image analysis constitutes a promising adjunct for the clinical endoscopist that could effectively decrease BE overdiagnosis and unnecessary surveillance, while also assisting in the timely detection of dysplastic BE and esophageal cancer. A plethora of studies published during the last five years have consistently reported highly accurate DL algorithms with comparable or superior performance compared to endoscopists. Recent efforts aim to expand DL utilization into further aspects of esophageal neoplasia management including histologic diagnosis, segmentation of gross tumor volume, pretreatment prediction and post-treatment evaluation of patient response to systemic therapy and operative guidance during minimally invasive esophagectomy. Our manuscript serves as an introduction to the growing literature of DL applications for image analysis in the management of esophageal neoplasia, concisely presenting all currently published studies. We also aim to guide the clinician across basic functional principles, evaluation metrics and limitations of DL for image recognition to facilitate the comprehension and critical evaluation of the presented studies.

Accurate imaging is key for the diagnosis and treatment of esophageal and gastroesophageal junction cancers . Current imaging modalities, such as computed tomography (CT) and 18F-FDG (2-deoxy-2-[18F]fluoro-D-glucose) positron emission tomography (PET)/CT, have limitations in accurately staging these cancers. MRI shows promise for T staging and residual disease assessment. Novel PET tracers, like FAPI, FLT, and hypoxia markers, offer potential improvements in diagnostic accuracy. 18F-FDG PET/MRI combines metabolic and anatomic information, enhancing disease evaluation. Radiomics and artificial intelligence hold promise for early detection, treatment planning, and response assessment. Theranostic nanoparticles and personalized medicine approaches offer new avenues for cancer therapy.

Background/Objectives: Proficient colposcopy is crucial for the adequate management of cervical cancer precursor lesions; nonetheless its limitations may impact its cost-effectiveness. The development of artificial intelligence models is experiencing an exponential growth, particularly in image-based specialties. The aim of this study is to develop and validate a Convolutional Neural Network (CNN) for the automatic differentiation of high-grade (HSIL) from low-grade dysplasia (LSIL) in colposcopy. Methods: A unicentric retrospective study was conducted based on 70 colposcopy exams, comprising a total of 22,693 frames. Among these, 8729 were categorized as HSIL based on histopathology. The total dataset was divided into a training (90%, n = 20,423) and a testing set (10%, n = 2270), the latter being used to evaluate the model's performance. The main outcome measures included sensitivity, specificity, accuracy, positive predictive value (PPV), negative predictive value (NPV), and the area under the receiving operating curve (AUC-ROC). Results: The sensitivity was 99.7% and the specificity was 98.6%. The PPV and NPV were 97.8% and 99.8%, respectively. The overall accuracy was 99.0%. The AUC-ROC was 0.98. The CNN processed 112 frames per second. Conclusions: We developed a CNN capable of differentiating cervical cancer precursors in colposcopy frames. The high levels of accuracy for the differentiation of HSIL from LSIL may improve the diagnostic yield of this exam.

The Japan Gastroenterological Endoscopy Society (JGES) held four serial symposia between 2021 and 2022 on state-of-the-art issues related to advanced diagnostic endoscopy of the upper gastrointestinal tract. This review summarizes the four core sessions and presents them as a conference report. Eleven studies were discussed in the 101st JGES Core Session, which addressed the challenges and prospects of upper gastroenterological endoscopy. Ten studies were also explored in the 102nd JGES Core Session on advanced upper gastrointestinal endoscopic diagnosis for decision-making regarding therapeutic strategies. Moreover, eight studies were presented during the 103rd JGES Core Session on the development and evaluation of endoscopic artificial intelligence in the field of upper gastrointestinal endoscopy. Twelve studies were also discussed in the 104th JGES Core Session, which focused on the evidence and new developments related to the upper gastrointestinal tract. The endoscopic diagnosis of upper gastrointestinal diseases using image-enhanced endoscopy and AI is one of the most recent topics and has received considerable attention. These four core sessions enabled us to grasp the current state-of-the-art in upper gastrointestinal endoscopic diagnostics and identify future challenges. Based on these studies, we hope that an endoscopic diagnostic system useful in clinical practice is established for each field of upper gastrointestinal endoscopy.

Deep learning methods have demonstrated great potential for processing high-resolution images. The U-Net model, in particular, has shown proficiency in the segmentation of biomedical images. However, limited research has examined the application of deep learning to esophageal squamous cell carcinoma (ESCC) segmentation. Therefore, this study aimed to develop deep learning segmentation systems specifically for ESCC.

A Visual Geometry Group (VGG)-based U-Net neural network architecture was utilized to develop the segmentation models. A pathological image cohort of surgical specimens was used for model training and internal validation, with two additional endoscopic biopsy section cohort for external validation. Model efficacy was evaluated across several metrics including Intersection over Union (IOU), accuracy, positive predict value (PPV), true positive rate (TPR), specificity, dice similarity coefficient (DSC), area under the receiver operating characteristic curve (AUC), and F1-Score.

Surgical samples from ten patients were analyzed retrospectively, with each biopsy section cohort encompassing five patients. Transfer learning models based on U-Net weights yielded optimal results. For mucosa segmentation, the in internal validation achieved 93.81% IOU, with other parameters exceeding 96% (96.96% accuracy, 96.45% PPV, 96.65% TPR, 98.41% specificity, 96.81% DSC, 96.11% AUC, and 96.55% F1-Score). The tumor segmentation model attained an IOU of 91.95%, along with other parameters surpassing 95% (95.90% accuracy, 95.62% PPV, 95.71% TPR, 97.88% specificity, 95.81% DSC, 94.92% AUC, and 95.67% F1-Score). In the external validation for tumor segmentation model, IOU was 59.86% for validation database 1 (72.74% for accuracy, 76.03% for PPV, 77.17% for TPR, 83.80% for specificity, 74.89% for DSC, 71.83% for AUC, and 76.60% for F1-Score), and 50.88% for validation cohort 2 (68.03% for accuracy, 59.02% for PPV, 66.87% for TPR, 78.48% for specificity, 67.44% for DSC, 64.68% for AUC, and 62.70% for F1-Score).

The models exhibited satisfactory results, paving the way for their potential deployment on standard computers and integration with other artificial intelligence models in clinical practice in the future. However, limited to the size of study, the generalizability of models is impaired in the external validation, larger pathological section cohort would be needed in future development to ensure robustness and generalization.

Esophageal cancer (EC) is the deadliest cancer worldwide, with a 92% annual mortality rate per incidence. Esophageal squamous cell carcinoma (ESCC) and esophageal adenocarcinoma (EAC) are the two major types of ECs, with EAC having one of the worst prognoses in oncology. Limited screening techniques and a lack of molecular analysis of diseased tissues have led to late-stage presentation and very low survival durations. The five-year survival rate of EC is less than 20%. Thus, early diagnosis of EC may prolong survival and improve clinical outcomes. Cellular and molecular biomarkers are used for diagnosis. At present, esophageal biopsy during upper endoscopy and histopathological analysis is the standard screening modality for both ESCC and EAC. However, this is an invasive method that fails to yield a molecular profile of the diseased compartment. To decrease the invasiveness of the procedures for diagnosis, researchers are proposing non-invasive biomarkers for early diagnosis and point-of-care screening options. Liquid biopsy involves the collection of body fluids (blood, urine, and saliva) non-invasively or with minimal invasiveness. In this review, we have critically discussed various biomarkers and specimen retrieval techniques for ESCC and EAC.