|
1
|
Jong BK, Yu ZH, Hsu YJ, Chiang SF, You JF, Chern YJ. Deep learning algorithms for predicting pathological complete response in MRI of rectal cancer patients undergoing neoadjuvant chemoradiotherapy: a systematic review. Int J Colorectal Dis 2025; 40:19. [PMID: 39833443 PMCID: PMC11753312 DOI: 10.1007/s00384-025-04809-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/08/2025] [Indexed: 01/22/2025]
Abstract
PURPOSE This systematic review examines the utility of deep learning algorithms in predicting pathological complete response (pCR) in rectal cancer patients undergoing neoadjuvant chemoradiotherapy (nCRT). The primary goal is to evaluate the performance of MRI-based artificial intelligence (AI) models and explore factors affecting their diagnostic accuracy. METHODS The review followed PRISMA guidelines and is registered with PROSPERO (CRD42024628017). Literature searches were conducted in PubMed, Embase, and Cochrane Library using keywords such as "artificial intelligence," "rectal cancer," "MRI," and "pathological complete response." Articles involving deep learning models applied to MRI for predicting pCR were included, excluding non-MRI data and studies without AI applications. Data on study characteristics, MRI sequences, AI model details, and performance metrics were extracted. Quality assessment was performed using the PROBAST tool. RESULTS Out of 512 initial records, 26 studies met the inclusion criteria. Most studies demonstrated promising diagnostic performance, with AUC values for external validation typically exceeding 0.8. The use of T2W and diffusion-weighted imaging (DWI) MRI phases enhanced model accuracy compared to T2W alone. Larger datasets generally correlated with improved model performance. However, heterogeneity in model designs, MRI protocols, and the limited integration of clinical data were noted as challenges. CONCLUSION AI-enhanced MRI demonstrates significant potential in predicting pCR in rectal cancer, particularly with T2W + DWI sequences and larger datasets. While integrating clinical data remains controversial, standardizing methodologies and expanding datasets will further enhance model robustness and clinical utility.
Collapse
Affiliation(s)
- Bor-Kang Jong
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
- School of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Zhen-Hao Yu
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
- School of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Yu-Jen Hsu
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
- School of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Sum-Fu Chiang
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
- School of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Jeng-Fu You
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan
- School of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Yih-Jong Chern
- Colorectal Section, Department of Surgery, Chang Gung Memorial Hospital, Taoyuan, Taiwan.
- School of Medicine, Chang Gung University, Taoyuan, Taiwan.
| |
Collapse
|
|
2
|
Ramireddy JK, Sathya A, Sasidharan BK, Varghese AJ, Sathyamurthy A, John NO, Chandramohan A, Singh A, Joel A, Mittal R, Masih D, Varghese K, Rebekah G, Ram TS, Thomas HMT. Can Pretreatment MRI and Planning CT Radiomics Improve Prediction of Complete Pathological Response in Locally Advanced Rectal Cancer Following Neoadjuvant Treatment? J Gastrointest Cancer 2024; 55:1199-1211. [PMID: 38856797 DOI: 10.1007/s12029-024-01073-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/19/2024] [Indexed: 06/11/2024]
Abstract
OBJECTIVE(S) The treatment response to neoadjuvant chemoradiation (nCRT) differs largely in individuals treated for rectal cancer. In this study, we investigated the role of radiomics to predict the pathological response in locally advanced rectal cancers at different treatment time points: (1) before the start of any treatment using baseline T2-weighted MRI (T2W-MR) and (2) at the start of radiation treatment using planning CT. METHODS Patients on nCRT followed by surgery between June 2017 to December 2019 were included in the study. Histopathological tumour response grading (TRG) was used for classification, and gross tumour volume was defined by the radiation oncologists. Following resampling, 100 and 103 pyradiomic features were extracted from T2W-MR and planning CT images, respectively. Synthetic minority oversampling technique (SMOTE) was used to address class imbalance. Four machine learning classifiers built clinical, radiomic, and merged models. Model performances were evaluated on a held-out test dataset following 3-fold cross-validation using area under the receiver operator characteristic curves (AUC) with bootstrap 95% confidence intervals. RESULTS One hundred and fifty patients were included; 58/150 with TRG 1 were classified as complete responders, and rest were incomplete responders (IR). Clinical models performed better (AUC = 0.68) compared to radiomics models (AUC = 0.62). Overall, the clinical + T2W-MR model showed best performance (AUC = 0.72) in predicting the pathological response prior to therapy. Clinical + Planning CT-merged models could only achieve the highest AUC of 0.66. CONCLUSION Merging clinical and baseline T2W-MR radiomics enhances predicting pathological response in rectal cancer. Validation in larger cohorts is warranted, especially for watch and wait strategies.
Collapse
Affiliation(s)
- Jeba Karunya Ramireddy
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - A Sathya
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Balu Krishna Sasidharan
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Amal Joseph Varghese
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Arvind Sathyamurthy
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Neenu Oliver John
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | | | - Ashish Singh
- Department of Medical Oncology, Christian Medical College, Vellore, India
| | - Anjana Joel
- Department of Medical Oncology, Christian Medical College, Vellore, India
| | - Rohin Mittal
- Department of General Surgery, Christian Medical College, Vellore, India
| | - Dipti Masih
- Department of Pathology, Christian Medical College, Vellore, India
| | - Kripa Varghese
- Department of Pathology, Christian Medical College, Vellore, India
| | - Grace Rebekah
- Department of Biostatistics, Christian Medical College, Vellore, India
| | - Thomas Samuel Ram
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India
| | - Hannah Mary T Thomas
- Quantitative Imaging Research and Artificial Intelligence Lab, Department of Radiation Oncology, Unit 2, Dr Ida B Scudder Cancer Centre, Christian Medical College, Vellore, Tamil Nadu, 632004, India.
| |
Collapse
|
|
3
|
Fu J, Yang Z, Melemenidis S, Viswanathan V, Dutt S, Manjappa R, Lau B, Soto LA, Ashraf MR, Skinner L, Yu SJ, Surucu M, Casey KM, Rankin EB, Graves E, Lu W, Loo BW, Gu X. Exploring Deep Learning for Estimating the Isoeffective Dose of FLASH Irradiation From Mouse Intestinal Histological Images. Int J Radiat Oncol Biol Phys 2024; 119:1001-1010. [PMID: 38171387 DOI: 10.1016/j.ijrobp.2023.12.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Revised: 12/09/2023] [Accepted: 12/23/2023] [Indexed: 01/05/2024]
Abstract
PURPOSE Ultrahigh-dose-rate (FLASH) irradiation has been reported to reduce normal tissue damage compared with conventional dose rate (CONV) irradiation without compromising tumor control. This proof-of-concept study aims to develop a deep learning (DL) approach to quantify the FLASH isoeffective dose (dose of CONV that would be required to produce the same effect as the given physical FLASH dose) with postirradiation mouse intestinal histology images. METHODS AND MATERIALS Eighty-four healthy C57BL/6J female mice underwent 16 MeV electron CONV (0.12 Gy/s; n = 41) or FLASH (200 Gy/s; n = 43) single fraction whole abdominal irradiation. Physical dose ranged from 12 to 16 Gy for FLASH and 11 to 15 Gy for CONV in 1 Gy increments. Four days after irradiation, 9 jejunum cross-sections from each mouse were hematoxylin and eosin stained and digitized for histological analysis. CONV data set was randomly split into training (n = 33) and testing (n = 8) data sets. ResNet101-based DL models were retrained using the CONV training data set to estimate the dose based on histological features. The classical manual crypt counting (CC) approach was implemented for model comparison. Cross-section-wise mean squared error was computed to evaluate the dose estimation accuracy of both approaches. The validated DL model was applied to the FLASH data set to map the physical FLASH dose into the isoeffective dose. RESULTS The DL model achieved a cross-section-wise mean squared error of 0.20 Gy2 on the CONV testing data set compared with 0.40 Gy2 of the CC approach. Isoeffective doses estimated by the DL model for FLASH doses of 12, 13, 14, 15, and 16 Gy were 12.19 ± 0.46, 12.54 ± 0.37, 12.69 ± 0.26, 12.84 ± 0.26, and 13.03 ± 0.28 Gy, respectively. CONCLUSIONS Our proposed DL model achieved accurate CONV dose estimation. The DL model results indicate that in the physical dose range of 13 to 16 Gy, the biologic dose response of small intestinal tissue to FLASH irradiation is represented by a lower isoeffective dose compared with the physical dose. Our DL approach can be a tool for studying isoeffective doses of other radiation dose modifying interventions.
Collapse
Affiliation(s)
- Jie Fu
- Department of Radiation Oncology, University of Washington, Seattle, Washington; Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Zi Yang
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California; Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Stavros Melemenidis
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Vignesh Viswanathan
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Suparna Dutt
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Rakesh Manjappa
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Brianna Lau
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Luis A Soto
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - M Ramish Ashraf
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Lawrie Skinner
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Shu-Jung Yu
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Murat Surucu
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Kerriann M Casey
- Department of Comparative Medicine, Stanford University School of Medicine, Stanford, California
| | - Erinn B Rankin
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Edward Graves
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California
| | - Weiguo Lu
- Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Billy W Loo
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California.
| | - Xuejun Gu
- Department of Radiation Oncology, Stanford University School of Medicine, Stanford, California.
| |
Collapse
|
|
4
|
Duwe G, Mercier D, Wiesmann C, Kauth V, Moench K, Junker M, Neumann CCM, Haferkamp A, Dengel A, Höfner T. Challenges and perspectives in use of artificial intelligence to support treatment recommendations in clinical oncology. Cancer Med 2024; 13:e7398. [PMID: 38923826 PMCID: PMC11196383 DOI: 10.1002/cam4.7398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 05/31/2024] [Accepted: 06/06/2024] [Indexed: 06/28/2024] Open
Abstract
Artificial intelligence (AI) promises to be the next revolutionary step in modern society. Yet, its role in all fields of industry and science need to be determined. One very promising field is represented by AI-based decision-making tools in clinical oncology leading to more comprehensive, personalized therapy approaches. In this review, the authors provide an overview on all relevant technical applications of AI in oncology, which are required to understand the future challenges and realistic perspectives for decision-making tools. In recent years, various applications of AI in medicine have been developed focusing on the analysis of radiological and pathological images. AI applications encompass large amounts of complex data supporting clinical decision-making and reducing errors by objectively quantifying all aspects of the data collected. In clinical oncology, almost all patients receive a treatment recommendation in a multidisciplinary cancer conference at the beginning and during their treatment periods. These highly complex decisions are based on a large amount of information (of the patients and of the various treatment options), which need to be analyzed and correctly classified in a short time. In this review, the authors describe the technical and medical requirements of AI to address these scientific challenges in a multidisciplinary manner. Major challenges in the use of AI in oncology and decision-making tools are data security, data representation, and explainability of AI-based outcome predictions, in particular for decision-making processes in multidisciplinary cancer conferences. Finally, limitations and potential solutions are described and compared for current and future research attempts.
Collapse
Affiliation(s)
- Gregor Duwe
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
| | - Dominique Mercier
- Research Unit Smart Data and Knowledge ServicesGerman Research Center for Artificial IntelligenceKaiserslauternGermany
| | - Crispin Wiesmann
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
| | - Verena Kauth
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
| | - Kerstin Moench
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
| | - Markus Junker
- Research Unit Smart Data and Knowledge ServicesGerman Research Center for Artificial IntelligenceKaiserslauternGermany
| | - Christopher C. M. Neumann
- Department of Hematology, Oncology and Tumor ImmunologyCharité‐Universitätsmedizin Berlin, Freie Universität Berlin, Humboldt‐Universität zu BerlinBerlinGermany
| | - Axel Haferkamp
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
| | - Andreas Dengel
- Research Unit Smart Data and Knowledge ServicesGerman Research Center for Artificial IntelligenceKaiserslauternGermany
| | - Thomas Höfner
- Department of Urology and Pediatric UrologyUniversity Medical Center, Johannes Gutenberg UniversityMainzGermany
- Department of Urology, Ordensklinikum Linz ElisabethinenLinzAustria
| |
Collapse
|
|
5
|
Cao YH, Bourbonne V, Lucia F, Schick U, Bert J, Jaouen V, Visvikis D. CT respiratory motion synthesis using joint supervised and adversarial learning. Phys Med Biol 2024; 69:095001. [PMID: 38537289 DOI: 10.1088/1361-6560/ad388a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 03/27/2024] [Indexed: 04/16/2024]
Abstract
Objective.Four-dimensional computed tomography (4DCT) imaging consists in reconstructing a CT acquisition into multiple phases to track internal organ and tumor motion. It is commonly used in radiotherapy treatment planning to establish planning target volumes. However, 4DCT increases protocol complexity, may not align with patient breathing during treatment, and lead to higher radiation delivery.Approach.In this study, we propose a deep synthesis method to generate pseudo respiratory CT phases from static images for motion-aware treatment planning. The model produces patient-specific deformation vector fields (DVFs) by conditioning synthesis on external patient surface-based estimation, mimicking respiratory monitoring devices. A key methodological contribution is to encourage DVF realism through supervised DVF training while using an adversarial term jointly not only on the warped image but also on the magnitude of the DVF itself. This way, we avoid excessive smoothness typically obtained through deep unsupervised learning, and encourage correlations with the respiratory amplitude.Main results.Performance is evaluated using real 4DCT acquisitions with smaller tumor volumes than previously reported. Results demonstrate for the first time that the generated pseudo-respiratory CT phases can capture organ and tumor motion with similar accuracy to repeated 4DCT scans of the same patient. Mean inter-scans tumor center-of-mass distances and Dice similarity coefficients were 1.97 mm and 0.63, respectively, for real 4DCT phases and 2.35 mm and 0.71 for synthetic phases, and compares favorably to a state-of-the-art technique (RMSim).Significance.This study presents a deep image synthesis method that addresses the limitations of conventional 4DCT by generating pseudo-respiratory CT phases from static images. Although further studies are needed to assess the dosimetric impact of the proposed method, this approach has the potential to reduce radiation exposure in radiotherapy treatment planning while maintaining accurate motion representation. Our training and testing code can be found athttps://github.com/cyiheng/Dynagan.
Collapse
Affiliation(s)
- Y-H Cao
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
| | - V Bourbonne
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
- CHRU Brest University Hospital, Brest, France
| | - F Lucia
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
- CHRU Brest University Hospital, Brest, France
| | - U Schick
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
- CHRU Brest University Hospital, Brest, France
| | - J Bert
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
- CHRU Brest University Hospital, Brest, France
| | - V Jaouen
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
- IMT Atlantique, Brest, France
| | - D Visvikis
- LaTIM, UMR Inserm 1101, Université de Bretagne Occidentale, IMT Atlantique, Brest, France
| |
Collapse
|
|
6
|
Vogin G, Lepage M, Salleron J, Cuenin M, Blum A, Gondim Teixeira PA. Evaluation of the Prognostic Value of Pretherapeutic Magnetic Resonance Imaging in Predicting Soft Tissue Sarcoma Radiation Response: A Retrospective Study from a Large Institutional Sarcoma Imaging Database. Cancers (Basel) 2024; 16:878. [PMID: 38473238 DOI: 10.3390/cancers16050878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/10/2024] [Accepted: 02/13/2024] [Indexed: 03/14/2024] Open
Abstract
Background: RT-induced hyalinization/fibrosis was recently evidenced as a significant independent predictor for complete response to neoadjuvant radiotherapy (RT) and survival in patients with soft tissue sarcoma (STS). Purpose: Non-invasive predictive markers of histologic response after neoadjuvant RT of STS are expected. Materials and Methods: From May 2010 to April 2017, patients with a diagnosis of STS who underwent neoadjuvant RT for limb STS were retrieved from a single center prospective clinical imaging database. Tumor Apparent Diffusion Coefficients (ADC) and areas under the time-intensity perfusion curve (AUC) were compared with the histologic necrosis ratio, fibrosis, and cellularity in post-surgical specimens. Results: We retrieved 29 patients. The median ADC value was 134.3 × 10-3 mm2/s. ADC values positively correlated with the post-treatment tumor necrosis ratio (p = 0.013). Median ADC values were lower in patients with less than 50% necrosis and higher in those with more than 50% (120.3 × 10-3 mm2/s and 202.0 × 10-3 mm2/s, respectively (p = 0.020). ADC values higher than 161 × 10-3 mm2/s presented a 95% sensitivity and a 55% specificity for the identification of tumors with more than 50% tumor necrosis ratio. Tumor-to-muscle AUC ratios were associated with histologic fibrosis (p = 0.036). Conclusions: ADC and perfusion AUC correlated, respectively, with radiation-induced tumor necrosis and fibrosis.
Collapse
Affiliation(s)
- Guillaume Vogin
- Department of Radiation Therapy, Institut de Cancérologie de Lorraine, 6 Avenue de Bourgogne, 54519 Vandœuvre-lès-Nancy, France
- Centre François Baclesse, Centre National de Radiothérapie du Luxembourg, BP436, L-4005 Esch-sur-Alzette, Luxembourg
- UMR 7365 CNRS-UL IMoPA, Biopôle de l'Université de Lorraine, Campus Brabois Santé, 9 Avenue de la Forêt de Haye, BP 20199, 54505 Vandœuvre-lès-Nancy, France
| | - Matthias Lepage
- Guilloz Imaging Department, University Hospital Center of Nancy, 29 Avenue du Maréchal de Lattre de Tassigny, 54035 Nancy, France
| | - Julia Salleron
- Biostatistics Unit, Institut de Cancérologie de Lorraine, 6 Avenue de Bourgogne, 54519 Vandœuvre-lès-Nancy, France
| | - Mathilde Cuenin
- Department of Radiation Therapy, Institut de Cancérologie de Lorraine, 6 Avenue de Bourgogne, 54519 Vandœuvre-lès-Nancy, France
| | - Alain Blum
- Guilloz Imaging Department, University Hospital Center of Nancy, 29 Avenue du Maréchal de Lattre de Tassigny, 54035 Nancy, France
| | - Pedro Augusto Gondim Teixeira
- Guilloz Imaging Department, University Hospital Center of Nancy, 29 Avenue du Maréchal de Lattre de Tassigny, 54035 Nancy, France
- Université de Lorraine, IADI, Inserm U1254, Bâtiment Recherche CHRU de Nancy Brabois, 5 Rue du Morvan, 54500 Vandœuvre-lès-Nancy, France
| |
Collapse
|
|
7
|
Yang J, Huang J, Han D, Ma X. Artificial Intelligence Applications in the Treatment of Colorectal Cancer: A Narrative Review. Clin Med Insights Oncol 2024; 18:11795549231220320. [PMID: 38187459 PMCID: PMC10771756 DOI: 10.1177/11795549231220320] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 11/26/2023] [Indexed: 01/09/2024] Open
Abstract
Colorectal cancer is the third most prevalent cancer worldwide, and its treatment has been a demanding clinical problem. Beyond traditional surgical therapy and chemotherapy, newly revealed molecular mechanisms diversify therapeutic approaches for colorectal cancer. However, the selection of personalized treatment among multiple treatment options has become another challenge in the era of precision medicine. Artificial intelligence has recently been increasingly investigated in the treatment of colorectal cancer. This narrative review mainly discusses the applications of artificial intelligence in the treatment of colorectal cancer patients. A comprehensive literature search was conducted in MEDLINE, EMBASE, and Web of Science to identify relevant papers, resulting in 49 articles being included. The results showed that, based on different categories of data, artificial intelligence can predict treatment outcomes and essential guidance information of traditional and novel therapies, thus enabling individualized treatment strategy selection for colorectal cancer patients. Some frequently implemented machine learning algorithms and deep learning frameworks have also been employed for long-term prognosis prediction in patients with colorectal cancer. Overall, artificial intelligence shows encouraging results in treatment strategy selection and prognosis evaluation for colorectal cancer patients.
Collapse
Affiliation(s)
- Jiaqing Yang
- Department of Biotherapy, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, Chengdu, China
- West China School of Medicine, West China Hospital, Sichuan University, Chengdu, China
| | - Jing Huang
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu, China
| | - Deqian Han
- Department of Oncology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China
| | - Xuelei Ma
- Department of Biotherapy, West China Hospital and State Key Laboratory of Biotherapy, Sichuan University, Chengdu, China
| |
Collapse
|
|
8
|
Chen H, Li X, Pan X, Qiang Y, Qi XS. Feature selection based on unsupervised clustering evaluation for predicting neoadjuvant chemoradiation response for patients with locally advanced rectal cancer. Phys Med Biol 2023; 68:235012. [PMID: 37972413 DOI: 10.1088/1361-6560/ad0d46] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 11/16/2023] [Indexed: 11/19/2023]
Abstract
Accurate response prediction allows for personalized cancer treatment of locally advanced rectal cancer (LARC) with neoadjuvant chemoradiation. In this work, we designed a convolutional neural network (CNN) feature extractor with switchable 3D and 2D convolutional kernels to extract deep learning features for response prediction. Compared with radiomics features, convolutional kernels may adaptively extract local or global image features from multi-modal MR sequences without the need of feature predefinition. We then developed an unsupervised clustering based evaluation method to improve the feature selection operation in the feature space formed by the combination of CNN features and radiomics features. While normal process of feature selection generally includes the operations of classifier training and classification execution, the process needs to be repeated many times after new feature combinations were found to evaluate the model performance, which incurs a significant time cost. To address this issue, we proposed a cost effective process to use a constructed unsupervised clustering analysis indicator to replace the classifier training process by indirectly evaluating the quality of new found feature combinations in feature selection process. We evaluated the proposed method using 43 LARC patients underwent neoadjuvant chemoradiation. Our prediction model achieved accuracy, area-under-curve (AUC), sensitivity and specificity of 0.852, 0.871, 0.868, and 0.735 respectively. Compared with traditional radiomics methods, the prediction models (AUC = 0.846) based on deep learning-based feature sets are significantly better than traditional radiomics methods (AUC = 0.714). The experiments also showed following findings: (1) the features with higher predictive power are mainly from high-order abstract features extracted by CNN on ADC images and T2 images; (2) both ADC_Radiomics and ADC_CNN features are more advantageous for predicting treatment responses than the radiomics and CNN features extracted from T2 images; (3) 3D CNN features are more effective than 2D CNN features in the treatment response prediction. The proposed unsupervised clustering indicator is feasible with low computational cost, which facilitates the discovery of valuable solutions by highlighting the correlation and complementarity between different types of features.
Collapse
Affiliation(s)
- Hao Chen
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, xi'an 710121, People's Republic of China
- Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an University of Posts and Telecommunications, Xi'an, 710121, People's Republic of China
| | - Xing Li
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, xi'an 710121, People's Republic of China
| | - Xiaoying Pan
- School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, xi'an 710121, People's Republic of China
- Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an University of Posts and Telecommunications, Xi'an, 710121, People's Republic of China
| | - Yongqian Qiang
- First Affiliated Hospital of Xi'an Jiaotong University, Xi'an 710061, People's Republic of China
| | - X Sharon Qi
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, United States of America
| |
Collapse
|
|
9
|
Li Z, Raldow AC, Weidhaas JB, Zhou Q, Qi XS. Prediction of Radiation Treatment Response for Locally Advanced Rectal Cancer via a Longitudinal Trend Analysis Framework on Cone-Beam CT. Cancers (Basel) 2023; 15:5142. [PMID: 37958316 PMCID: PMC10647315 DOI: 10.3390/cancers15215142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 10/07/2023] [Accepted: 10/13/2023] [Indexed: 11/15/2023] Open
Abstract
Locally advanced rectal cancer (LARC) presents a significant challenge in terms of treatment management, particularly with regards to identifying patients who are likely to respond to radiation therapy (RT) at an individualized level. Patients respond to the same radiation treatment course differently due to inter- and intra-patient variability in radiosensitivity. In-room volumetric cone-beam computed tomography (CBCT) is widely used to ensure proper alignment, but also allows us to assess tumor response during the treatment course. In this work, we proposed a longitudinal radiomic trend (LRT) framework for accurate and robust treatment response assessment using daily CBCT scans for early detection of patient response. The LRT framework consists of four modules: (1) Automated registration and evaluation of CBCT scans to planning CT; (2) Feature extraction and normalization; (3) Longitudinal trending analyses; and (4) Feature reduction and model creation. The effectiveness of the framework was validated via leave-one-out cross-validation (LOOCV), using a total of 840 CBCT scans for a retrospective cohort of LARC patients. The trending model demonstrates significant differences between the responder vs. non-responder groups with an Area Under the Curve (AUC) of 0.98, which allows for systematic monitoring and early prediction of patient response during the RT treatment course for potential adaptive management.
Collapse
Affiliation(s)
- Zirong Li
- Manteia Medical Technologies Co., Milwaukee, WI 53226, USA;
| | - Ann C. Raldow
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA; (A.C.R.); (J.B.W.)
| | - Joanne B. Weidhaas
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA; (A.C.R.); (J.B.W.)
| | - Qichao Zhou
- Manteia Medical Technologies Co., Milwaukee, WI 53226, USA;
| | - X. Sharon Qi
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA; (A.C.R.); (J.B.W.)
| |
Collapse
|
|
10
|
Demircioğlu A. Deep Features from Pretrained Networks Do Not Outperform Hand-Crafted Features in Radiomics. Diagnostics (Basel) 2023; 13:3266. [PMID: 37892087 PMCID: PMC10606594 DOI: 10.3390/diagnostics13203266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 10/16/2023] [Accepted: 10/19/2023] [Indexed: 10/29/2023] Open
Abstract
In radiomics, utilizing features extracted from pretrained deep networks could result in models with a higher predictive performance than those relying on hand-crafted features. This study compared the predictive performance of models trained with either deep features, hand-crafted features, or a combination of these features in terms of the area under the receiver-operating characteristic curve (AUC) and other metrics. We trained models on ten radiological datasets using five feature selection methods and three classifiers. Our results indicate that models based on deep features did not show an improved AUC compared to those utilizing hand-crafted features (deep: AUC 0.775, hand-crafted: AUC 0.789; p = 0.28). Including morphological features alongside deep features led to overall improvements in prediction performance for all models (+0.02 gain in AUC; p < 0.001); however, the best model did not benefit from this (+0.003 gain in AUC; p = 0.57). Using all hand-crafted features in addition to the deep features resulted in a further overall improvement (+0.034 in AUC; p < 0.001), but only a minor improvement could be observed for the best model (deep: AUC 0.798, hand-crafted: AUC 0.789; p = 0.92). Furthermore, our results show that models based on deep features extracted from networks pretrained on medical data have no advantage in predictive performance over models relying on features extracted from networks pretrained on ImageNet data. Our study contributes a benchmarking analysis of models trained on hand-crafted and deep features from pretrained networks across multiple datasets. It also provides a comprehensive understanding of their applicability and limitations in radiomics. Our study shows, in conclusion, that models based on features extracted from pretrained deep networks do not outperform models trained on hand-crafted ones.
Collapse
Affiliation(s)
- Aydin Demircioğlu
- Institute of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Hufelandstraße 55, 45147 Essen, Germany
| |
Collapse
|
|
11
|
Geng H, Xiao D, Yang S, Fan J, Fu T, Lin Y, Bai Y, Ai D, Song H, Wang Y, Duan F, Yang J. CT2X-IRA: CT to x-ray image registration agent using domain-cross multi-scale-stride deep reinforcement learning. Phys Med Biol 2023; 68:175024. [PMID: 37549676 DOI: 10.1088/1361-6560/acede5] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 08/07/2023] [Indexed: 08/09/2023]
Abstract
Objective.In computer-assisted minimally invasive surgery, the intraoperative x-ray image is enhanced by overlapping it with a preoperative CT volume to improve visualization of vital anatomical structures. Therefore, accurate and robust 3D/2D registration of CT volume and x-ray image is highly desired in clinical practices. However, previous registration methods were prone to initial misalignments and struggled with local minima, leading to issues of low accuracy and vulnerability.Approach.To improve registration performance, we propose a novel CT/x-ray image registration agent (CT2X-IRA) within a task-driven deep reinforcement learning framework, which contains three key strategies: (1) a multi-scale-stride learning mechanism provides multi-scale feature representation and flexible action step size, establishing fast and globally optimal convergence of the registration task. (2) A domain adaptation module reduces the domain gap between the x-ray image and digitally reconstructed radiograph projected from the CT volume, decreasing the sensitivity and uncertainty of the similarity measurement. (3) A weighted reward function facilitates CT2X-IRA in searching for the optimal transformation parameters, improving the estimation accuracy of out-of-plane transformation parameters under large initial misalignments.Main results.We evaluate the proposed CT2X-IRA on both the public and private clinical datasets, achieving target registration errors of 2.13 mm and 2.33 mm with the computation time of 1.5 s and 1.1 s, respectively, showing an accurate and fast workflow for CT/x-ray image rigid registration.Significance.The proposed CT2X-IRA obtains the accurate and robust 3D/2D registration of CT and x-ray images, suggesting its potential significance in clinical applications.
Collapse
Affiliation(s)
- Haixiao Geng
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Deqiang Xiao
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Shuo Yang
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Jingfan Fan
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Tianyu Fu
- School of Medical Engineering, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Yucong Lin
- School of Medical Engineering, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Yanhua Bai
- Department of Interventional Radiology, The First Medical Center of Chinese PLA General Hospital, Beijing 100853, People's Republic of China
| | - Danni Ai
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Hong Song
- School of Computer Science, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Yongtian Wang
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| | - Feng Duan
- Department of Interventional Radiology, The First Medical Center of Chinese PLA General Hospital, Beijing 100853, People's Republic of China
| | - Jian Yang
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, People's Republic of China
| |
Collapse
|
|
12
|
Prabhakaran S, Choong KWK, Prabhakaran S, Choy KT, Kong JC. Accuracy of deep neural learning models in the imaging prediction of pathological complete response after neoadjuvant chemoradiotherapy for locally advanced rectal cancer: a systematic review. Langenbecks Arch Surg 2023; 408:321. [PMID: 37594552 DOI: 10.1007/s00423-023-03039-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Accepted: 08/01/2023] [Indexed: 08/19/2023]
Abstract
PURPOSE Up to 15-27% of patients achieve pathologic complete response (pCR) following neoadjuvant chemoradiotherapy (CRT) for locally advanced rectal cancer (LARC). Deep neural learning (DL) algorithms have been suggested to be a useful adjunct to allow accurate prediction of pCR and to identify patients who could potentially avoid surgery. This systematic review aims to interrogate the accuracy of DL algorithms at predicting pCR. METHODS Embase (PubMed, MEDLINE) databases and Google Scholar were searched to identify eligible English-language studies, with the search concluding in July 2022. Studies reporting on the accuracy of DL models in predicting pCR were selected for review and information pertaining to study characteristics and diagnostic measures was extracted from relevant studies. Risk of bias was evaluated using the Newcastle-Ottawa scale (NOS). RESULTS Our search yielded 85 potential publications. Nineteen full texts were reviewed, and a total of 12 articles were included in this systematic review. There were six retrospective and six prospective cohort studies. The most common DL algorithm used was the Convolutional Neural Network (CNN). Performance comparison was carried out via single modality comparison. The median performance for each best-performing algorithm was an AUC of 0.845 (range 0.71-0.99) and Accuracy of 0.85 (0.83-0.98). CONCLUSIONS There is a promising role for DL models in the prediction of pCR following neoadjuvant-CRT for LARC. Further studies are needed to provide a standardised comparison in order to allow for large-scale clinical application. PROPERO REGISTRATION PROSPERO 2021 CRD42021269904 Available from: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021269904 .
Collapse
Affiliation(s)
- Sowmya Prabhakaran
- Department of General Surgical Specialties, The Royal Melbourne Hospital, Melbourne, Victoria, Australia.
| | | | - Swetha Prabhakaran
- Department of Colorectal Surgery, Alfred Hospital, Melbourne, Victoria, Australia
| | - Kay Tai Choy
- Department of Surgery, Austin Health, Melbourne, Victoria, Australia
| | - Joseph Ch Kong
- Department of Colorectal Surgery, Alfred Hospital, Melbourne, Victoria, Australia
- Central Clinical School, Monash University, Melbourne, Victoria, Australia
- Department of Surgical Oncology, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia
| |
Collapse
|
|
13
|
Wang Z, Li VR, Chu FI, Yu V, Lee A, Low D, Moghanaki D, Lee P, Qi XS. Predicting Overall Survival for Patients with Malignant Mesothelioma Following Radiotherapy via Interpretable Machine Learning. Cancers (Basel) 2023; 15:3916. [PMID: 37568732 PMCID: PMC10416916 DOI: 10.3390/cancers15153916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 07/20/2023] [Accepted: 07/27/2023] [Indexed: 08/13/2023] Open
Abstract
PURPOSE/OBJECTIVES Malignant pleural mesothelioma (MPM) is a rare but aggressive cancer arising from the cells of the thoracic pleura with a poor prognosis. We aimed to develop a model, via interpretable machine learning (ML) methods, predicting overall survival for MPM following radiotherapy based on dosimetric metrics as well as patient characteristics. MATERIALS/METHODS Sixty MPM (37 right, 23 left) patients treated on a Tomotherapy unit between 2013 and 2018 were retrospectively analyzed. All patients received 45 Gy (25 fractions). The multivariable Cox regression (Cox PH) model and Survival Support Vector Machine (sSVM) were applied to build predictive models of overall survival (OS) based on clinical, dosimetric, and combined variables. RESULTS Significant differences in dosimetric endpoints for critical structures, i.e., the lung, heart, liver, kidney, and stomach, were observed according to target laterality. The OS was found to be insignificantly different (p = 0.18) between MPM patients who tested left- and right-sided, with 1-year OS of 77.3% and 75.0%, respectively. With Cox PH regression, considering dosimetric variables for right-sided patients alone, an increase in PTV_Min, Total_Lung_PTV_Mean, Contra_Lung_Volume, Contra_Lung_V20, Esophagus_Mean, and Heart_Volume had a greater hazard to all-cause death, while an increase in Total_Lung_PTV_V20, Contra_Lung_V5, and Esophagus_Max had a lower hazard to all-cause death. Considering clinical variables alone, males and increases in N stage had greater hazard to all-cause death; considering both clinical and dosimetric variables, increases in N stage, PTV_Mean, PTV_Min, and esophagus_Mean had greater hazard to all-cause death, while increases in T stage and Heart_V30 had lower hazard to all-cause-death. In terms of C-index, the Cox PH model and sSVM performed similarly and fairly well when considering clinical and dosimetric variables independently or jointly. CONCLUSIONS Clinical and dosimetric variables may predict the overall survival of mesothelioma patients, which could guide personalized treatment planning towards a better treatment response. The identified predictors and their impact on survival offered additional value for translational application in clinical practice.
Collapse
Affiliation(s)
- Zitian Wang
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| | - Vincent R. Li
- Department of Biology, University of Southern California Dornsife School of Arts and Sciences, Los Angeles, CA 90089, USA
| | - Fang-I Chu
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| | - Victoria Yu
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Alan Lee
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| | - Daniel Low
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| | - Drew Moghanaki
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| | - Percy Lee
- Department of Radiation Oncology, City of Hope Orange County Lennar Foundation Cancer Center, Irvine, CA 92618, USA
| | - X. Sharon Qi
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095, USA
| |
Collapse
|
|
14
|
Peng J, Wang W, Jin H, Qin X, Hou J, Yang Z, Shu Z. Develop and validate a radiomics space-time model to predict the pathological complete response in patients undergoing neoadjuvant treatment of rectal cancer: an artificial intelligence model study based on machine learning. BMC Cancer 2023; 23:365. [PMID: 37085830 PMCID: PMC10120125 DOI: 10.1186/s12885-023-10855-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Accepted: 04/17/2023] [Indexed: 04/23/2023] Open
Abstract
OBJECTIVE In this study, we aimed to investigate the predictive efficacy of magnetic resonance imaging (MRI) radiomics features at different time points of neoadjuvant therapy for rectal cancer in patients with pathological complete response (pCR). Furthermore, we aimed to develop and validate a radiomics space-time model (RSTM) using machine learning for artificial intelligence interventions in predicting pCR in patients. METHODS Clinical and imaging data of 83 rectal cancer patients were retrospectively analyzed, and the patients were classified as pCR and non-pCR patients according to their postoperative pathological results. All patients received one MRI examination before and after neoadjuvant therapy to extract radiomics features, including pre-treatment, post-treatment, and delta features. Delta features were defined by the ratio of the difference between the pre- and the post-treatment features to the pre-treatment feature. After feature dimensionality reduction based on the above three feature types, the RSTM was constructed using machine learning methods, and its performance was evaluated using the area under the curve (AUC). RESULTS The AUC values of the individual basic models constructed by pre-treatment, post-treatment, and delta features were 0.771, 0.681, and 0.871, respectively. Their sensitivity values were 0.727, 0.864, and 0.909, respectively, and their specificity values were 0.803, 0.492, and 0.656, respectively. The AUC, sensitivity, and specificity values of the combined basic model constructed by combining pre-treatment, post-treatment, and delta features were 0.901, 0.909, and 0.803, respectively. The AUC, sensitivity, and specificity values of the RSTM constructed using the K-Nearest Neighbor (KNN) classifier on the basis of the combined basic model were 0.944, 0.871, and 0.983, respectively. The Delong test showed that the performance of RSTM was significantly different from that of pre-treatment, post-treatment, and delta models (P < 0.05) but not significantly different from the combined basic model of the three (P > 0.05). CONCLUSIONS The RSTM constructed using the KNN classifier based on the combined features of before and after neoadjuvant therapy and delta features had the best predictive efficacy for pCR of neoadjuvant therapy. It may emerge as a new clinical tool to assist with individualized management of rectal cancer patients.
Collapse
Affiliation(s)
- Jiaxuan Peng
- Jinzhou medical university, Jinzhou, Liaoning Province, China
| | - Wei Wang
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical and Pharmaceutical College, Chongqing, China
| | - Hui Jin
- Bengbu medical college, Bengbu, China
| | - Xue Qin
- Bengbu medical college, Bengbu, China
| | - Jie Hou
- Jinzhou medical university, Jinzhou, Liaoning Province, China
| | - Zhang Yang
- Center for General Practice Medicine, Department of Radiology, Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College, Hangzhou, Zhejiang, China
| | - Zhenyu Shu
- Center for General Practice Medicine, Department of Radiology, Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College, Hangzhou, Zhejiang, China.
| |
Collapse
|
|
15
|
Huang Y, Zhu Y, Yang Q, Luo Y, Zhang P, Yang X, Ren J, Ren Y, Lang J, Xu G. Automatic tumor segmentation and metachronous single-organ metastasis prediction of nasopharyngeal carcinoma patients based on multi-sequence magnetic resonance imaging. Front Oncol 2023; 13:953893. [PMID: 37064158 PMCID: PMC10099248 DOI: 10.3389/fonc.2023.953893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 03/07/2023] [Indexed: 03/30/2023] Open
Abstract
BackgroundDistant metastases is the main failure mode of nasopharyngeal carcinoma. However, early prediction of distant metastases in NPC is extremely challenging. Deep learning has made great progress in recent years. Relying on the rich data features of radiomics and the advantages of deep learning in image representation and intelligent learning, this study intends to explore and construct the metachronous single-organ metastases (MSOM) based on multimodal magnetic resonance imaging.Patients and methodsThe magnetic resonance imaging data of 186 patients with nasopharyngeal carcinoma before treatment were collected, and the gross tumor volume (GTV) and metastatic lymph nodes (GTVln) prior to treatment were defined on T1WI, T2WI, and CE-T1WI. After image normalization, the deep learning platform Python (version 3.9.12) was used in Ubuntu 20.04.1 LTS to construct automatic tumor detection and the MSOM prediction model.ResultsThere were 85 of 186 patients who had MSOM (including 32 liver metastases, 25 lung metastases, and 28 bone metastases). The median time to MSOM was 13 months after treatment (7–36 months). The patients were randomly assigned to the training set (N = 140) and validation set (N = 46). By comparison, we found that the overall performance of the automatic tumor detection model based on CE-T1WI was the best (6). The performance of automatic detection for primary tumor (GTV) and lymph node gross tumor volume (GTVln) based on the CE-T1WI model was better than that of models based on T1WI and T2WI (AP@0.5 is 59.6 and 55.6). The prediction model based on CE-T1WI for MSOM prediction achieved the best overall performance, and it obtained the largest AUC value (AUC = 0.733) in the validation set. The precision, recall, precision, and AUC of the prediction model based on CE-T1WI are 0.727, 0.533, 0.730, and 0.733 (95% CI 0.557–0.909), respectively. When clinical data were added to the deep learning prediction model, a better performance of the model could be obtained; the AUC of the integrated model based on T2WI, T1WI, and CE-T1WI were 0.719, 0.738, and 0.775, respectively. By comparing the 3-year survival of high-risk and low-risk patients based on the fusion model, we found that the 3-year DMFS of low and high MSOM risk patients were 95% and 11.4%, respectively (p < 0.001).ConclusionThe intelligent prediction model based on magnetic resonance imaging alone or combined with clinical data achieves excellent performance in automatic tumor detection and MSOM prediction for NPC patients and is worthy of clinical application.
Collapse
Affiliation(s)
- Yecai Huang
- School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
- Department of Radiation Oncology, Radiation Oncology Key Laboratory of Sichuan Province, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
- Applied Nuclear Technology in Geosciences Key Laboratory of Sichuan Province, Chengdu University of Technology, Chengdu, China
| | - Yuxin Zhu
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Qiang Yang
- School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
- Applied Nuclear Technology in Geosciences Key Laboratory of Sichuan Province, Chengdu University of Technology, Chengdu, China
| | - Yangkun Luo
- Department of Radiation Oncology, Radiation Oncology Key Laboratory of Sichuan Province, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
| | - Peng Zhang
- Department of Radiation Oncology, Radiation Oncology Key Laboratory of Sichuan Province, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
| | - Xuegang Yang
- Department of Interventional Radiology, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
| | - Jing Ren
- Department of Radiology, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
| | - Yazhou Ren
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
- *Correspondence: Yazhou Ren, ; Jinyi Lang, ; Guohui Xu,
| | - Jinyi Lang
- School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
- Department of Radiation Oncology, Radiation Oncology Key Laboratory of Sichuan Province, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
- *Correspondence: Yazhou Ren, ; Jinyi Lang, ; Guohui Xu,
| | - Guohui Xu
- School of Medicine, University of Electronic Science and Technology of China, Chengdu, China
- Department of Interventional Radiology, Sichuan Clinical Research Center for Cancer, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, Chengdu, China
- *Correspondence: Yazhou Ren, ; Jinyi Lang, ; Guohui Xu,
| |
Collapse
|
|
16
|
Automatic treatment outcome prediction with DeepInteg based on multimodal radiological images in rectal cancer. Heliyon 2023; 9:e13094. [PMID: 36785834 PMCID: PMC9918765 DOI: 10.1016/j.heliyon.2023.e13094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Revised: 01/04/2023] [Accepted: 01/16/2023] [Indexed: 01/26/2023] Open
Abstract
Neoadjuvant systemic treatment before surgery is a prevalent regimen in the patients with advanced-stage or high-risk tumor, which has shaped the treatment strategies and cancer survival in the past decades. However, some patients present with poor response to the neoadjuvant treatment. Therefore, it is of great significance to develop tools to help distinguish the patients that could achieve pathological complete response before surgery to avoid inappropriate treatment. Here, this study demonstrated a multi-task deep learning tool called DeepInteg. In the DeepInteg framework, the segmentation module was constructed based on the CE-Net with a context extractor to achieve end-to-end delineation of region of interest (ROI) from radiological images, then the features of segmented Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) images of each case were fused and input to the classification module based on a convolution neural network for treatment outcome prediction. The dataset with 1700 MRI and CT slices collected from the prospectively randomized clinical trial (NCT01211210) on systemic treatment for rectal cancer was used to develop and systematically optimize DeepInteg. As a result, DeepInteg achieved automatic segmentation of tumoral ROI with Dices of 0.766 and 0.719 and mIoUs of 0.788 and 0.756 in CT and MRI images, respectively. In addition, DeepInteg achieved AUC of 0.833, accuracy of 0.826 and specificity of 0.856 in the prediction for pathological complete response after treatment, which showed better performance compared with the model based on CT or MRI alone. This study provide a robust framework to develop disease-specific tools for automatic delineation of ROI and clinical outcome prediction. The well-trained DeepInteg could be readily applied in clinic to predict pathological complete response after neoadjuvant therapy in rectal cancer patients.
Collapse
|
|
17
|
Radiomics Approaches for the Prediction of Pathological Complete Response after Neoadjuvant Treatment in Locally Advanced Rectal Cancer: Ready for Prime Time? Cancers (Basel) 2023; 15:cancers15020432. [PMID: 36672381 PMCID: PMC9857080 DOI: 10.3390/cancers15020432] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/03/2023] [Accepted: 01/05/2023] [Indexed: 01/12/2023] Open
Abstract
In recent years, neoadjuvant therapy of locally advanced rectal cancer has seen tremendous modifications. Adding neoadjuvant chemotherapy before or after chemoradiotherapy significantly increases loco-regional disease-free survival, negative surgical margin rates, and complete response rates. The higher complete rate is particularly clinically meaningful given the possibility of organ preservation in this specific sub-population, without compromising overall survival. However, all locally advanced rectal cancer most likely does not benefit from total neoadjuvant therapy (TNT), but experiences higher toxicity rates. Diagnosis of complete response after neoadjuvant therapy is a real challenge, with a risk of false negatives and possible under-treatment. These new therapeutic approaches thus raise the need for better selection tools, enabling a personalized therapeutic approach for each patient. These tools mostly focus on the prediction of the pathological complete response given the clinical impact. In this article, we review the place of different biomarkers (clinical, biological, genomics, transcriptomics, proteomics, and radiomics) as well as their clinical implementation and discuss the most recent trends for future steps in prediction modeling in patients with locally advanced rectal cancer.
Collapse
|
|
18
|
Ouyang G, Chen Z, Dou M, Luo X, Wen H, Deng X, Meng W, Yu Y, Wu B, Jiang D, Wang Z, Yao Y, Wang X. Predicting Rectal Cancer Response to Total Neoadjuvant Treatment Using an Artificial Intelligence Model Based on Magnetic Resonance Imaging and Clinical Data. Technol Cancer Res Treat 2023; 22:15330338231186467. [PMID: 37431270 PMCID: PMC10338728 DOI: 10.1177/15330338231186467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 05/15/2023] [Accepted: 05/24/2023] [Indexed: 07/12/2023] Open
Abstract
PURPOSE To develop a model for predicting response to total neoadjuvant treatment (TNT) for patients with locally advanced rectal cancer (LARC) based on baseline magnetic resonance imaging (MRI) and clinical data using artificial intelligence methods. METHODS Baseline MRI and clinical data were curated from patients with LARC and analyzed using logistic regression (LR) and deep learning (DL) methods to predict TNT response retrospectively. We defined two groups of response to TNT as pathological complete response (pCR) versus non-pCR (Group 1), and high sensitivity [tumor regression grade (TRG) 0 and TRG 1] versus moderate sensitivity (TRG 2 or patients with TRG 3 and a reduction in tumor volume of at least 20% compared to baseline) versus low sensitivity (TRG 3 and a reduction in tumor volume <20% compared to baseline) (Group 2). We extracted and selected clinical and radiomic features on baseline T2WI. Then we built LR models and DL models. Receiver operating characteristic (ROC) curves analysis was performed to assess predictive performance of models. RESULTS Eighty-nine patients were assigned to the training cohort, and 29 patients were assigned to the testing cohort. The area under receiver operating characteristics curve (AUC) of LR models, which were predictive of high sensitivity and pCR, were 0.853 and 0.866, respectively. Whereas the AUCs of DL models were 0.829 and 0.838, respectively. After 10 rounds of cross validation, the accuracy of the models in Group 1 is higher than in Group 2. CONCLUSION There was no significant difference between LR model and DL model. Artificial Intelligence-based radiomics biomarkers may have potential clinical implications for adaptive and personalized therapy.
Collapse
Affiliation(s)
- Ganlu Ouyang
- Department of Radiation Oncology, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
- Department of Medical Oncology, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
- Lung Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| | - Zhebin Chen
- Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, Sichuan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Meng Dou
- Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, Sichuan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xu Luo
- Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, Sichuan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Han Wen
- Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, Sichuan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xiangbing Deng
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Wenjian Meng
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Yongyang Yu
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Bing Wu
- Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Dan Jiang
- Department of Pathology, West China Hospital, Sichuan University, Chengdu, China
| | - Ziqiang Wang
- Department of Gastrointestinal Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Yu Yao
- Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu, Sichuan, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Xin Wang
- Department of Radiation Oncology, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
- Department of Abdominal Oncology, Cancer Center, West China Hospital, Sichuan University, Chengdu, China
| |
Collapse
|
|
19
|
Wang L, Wu X, Tian R, Ma H, Jiang Z, Zhao W, Cui G, Li M, Hu Q, Yu X, Xu W. MRI-based pre-Radiomics and delta-Radiomics models accurately predict the post-treatment response of rectal adenocarcinoma to neoadjuvant chemoradiotherapy. Front Oncol 2023; 13:1133008. [PMID: 36925913 PMCID: PMC10013156 DOI: 10.3389/fonc.2023.1133008] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 02/06/2023] [Indexed: 02/24/2023] Open
Abstract
Objectives To develop and validate magnetic resonance imaging (MRI)-based pre-Radiomics and delta-Radiomics models for predicting the treatment response of local advanced rectal cancer (LARC) to neoadjuvant chemoradiotherapy (NCRT). Methods Between October 2017 and August 2022, 105 LARC NCRT-naïve patients were enrolled in this study. After careful evaluation, data for 84 patients that met the inclusion criteria were used to develop and validate the NCRT response models. All patients received NCRT, and the post-treatment response was evaluated by pathological assessment. We manual segmented the volume of tumors and 105 radiomics features were extracted from three-dimensional MRIs. Then, the eXtreme Gradient Boosting algorithm was implemented for evaluating and incorporating important tumor features. The predictive performance of MRI sequences and Synthetic Minority Oversampling Technique (SMOTE) for NCRT response were compared. Finally, the optimal pre-Radiomics and delta-Radiomics models were established respectively. The predictive performance of the radionics model was confirmed using 5-fold cross-validation, 10-fold cross-validation, leave-one-out validation, and independent validation. The predictive accuracy of the model was based on the area under the receiver operator characteristic (ROC) curve (AUC). Results There was no significant difference in clinical factors between patients with good and poor reactions. Integrating different MRI modes and the SMOTE method improved the performance of the radiomics model. The pre-Radiomics model (train AUC: 0.93 ± 0.06; test AUC: 0.79) and delta-Radiomcis model (train AUC: 0.96 ± 0.03; test AUC: 0.83) all have high NCRT response prediction performance by LARC. Overall, the delta-Radiomics model was superior to the pre-Radiomics model. Conclusion MRI-based pre-Radiomics model and delta-Radiomics model all have good potential to predict the post-treatment response of LARC to NCRT. Delta-Radiomics analysis has a huge potential for clinical application in facilitating the provision of personalized therapy.
Collapse
Affiliation(s)
- Likun Wang
- Tianjin's Clinical Research Center for Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China.,Department of Molecular Imaging and Nuclear Medicine, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin, China.,Department of Ultrasound Medicine, The First Affiliated Hospital of Hebei North University, Zhangjiakou, China
| | - Xueliang Wu
- Graduate School, Tianjin Medical University, Tianjin, China.,Department of Gastrointestinal Surgery, Tianjin Medical University Nankai Hospital, Tianjin, China
| | - Ruoxi Tian
- Department of Colorectal Surgery, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital, Chinese Academy of Medical Sciences, Beijing, China
| | - Hongqing Ma
- Department of General Surgery, The Fourth Hospital of Hebei Medical University, Shijiazhuang, China
| | - Zekun Jiang
- College of Computer Science, Sichuan University, Chengdu, China
| | - Weixin Zhao
- College of Computer Science, Sichuan University, Chengdu, China
| | - Guoqing Cui
- Medical Image Center, The First Affiliated Hospital of Hebei North University, Zhangjiakou, China
| | - Meng Li
- Graduate School, Hebei North University, Zhangjiakou, China
| | - Qinsheng Hu
- Department of Orthopedics, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Xiangyang Yu
- Department of Gastrointestinal Surgery, Tianjin Medical University Nankai Hospital, Tianjin, China
| | - Wengui Xu
- Tianjin's Clinical Research Center for Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| |
Collapse
|
|
20
|
Wong PK, Chan IN, Yan HM, Gao S, Wong CH, Yan T, Yao L, Hu Y, Wang ZR, Yu HH. Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview. World J Gastroenterol 2022; 28:6363-6379. [PMID: 36533112 PMCID: PMC9753055 DOI: 10.3748/wjg.v28.i45.6363] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 10/25/2022] [Accepted: 11/16/2022] [Indexed: 12/02/2022] Open
Abstract
Gastrointestinal (GI) cancers are the major cause of cancer-related mortality globally. Medical imaging is an important auxiliary means for the diagnosis, assessment and prognostic prediction of GI cancers. Radiomics is an emerging and effective technology to decipher the encoded information within medical images, and traditional machine learning is the most commonly used tool. Recent advances in deep learning technology have further promoted the development of radiomics. In the field of GI cancer, although there are several surveys on radiomics, there is no specific review on the application of deep-learning-based radiomics (DLR). In this review, a search was conducted on Web of Science, PubMed, and Google Scholar with an emphasis on the application of DLR for GI cancers, including esophageal, gastric, liver, pancreatic, and colorectal cancers. Besides, the challenges and recommendations based on the findings of the review are comprehensively analyzed to advance DLR.
Collapse
Affiliation(s)
- Pak Kin Wong
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
| | - In Neng Chan
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
| | - Hao-Ming Yan
- School of Clinical Medicine, China Medical University, Shenyang 110013, Liaoning Province, China
| | - Shan Gao
- Department of Gastroenterology, Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441021, Hubei Province, China
| | - Chi Hong Wong
- Faculty of Medicine, Macau University of Science and Technology, Taipa 999078, Macau, China
| | - Tao Yan
- School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, Hubei Province, China
| | - Liang Yao
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau, China
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, Guangdong Province, China
| | - Ying Hu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, Guangdong Province, China
| | - Zhong-Ren Wang
- School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, Hubei Province, China
| | - Hon Ho Yu
- Department of Gastroenterology, Kiang Wu Hospital, Macau 999078, China
| |
Collapse
|
|
21
|
Chen R, Fu Y, Yi X, Pei Q, Zai H, Chen BT. Application of Radiomics in Predicting Treatment Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer: Strategies and Challenges. JOURNAL OF ONCOLOGY 2022; 2022:1590620. [PMID: 36471884 PMCID: PMC9719428 DOI: 10.1155/2022/1590620] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Revised: 10/30/2022] [Accepted: 11/09/2022] [Indexed: 08/01/2023]
Abstract
Neoadjuvant chemoradiotherapy (nCRT) followed by total mesorectal excision is the standard treatment for locally advanced rectal cancer (LARC). A noninvasive preoperative prediction method should greatly assist in the evaluation of response to nCRT and for the development of a personalized strategy for patients with LARC. Assessment of nCRT relies on imaging and radiomics can extract valuable quantitative data from medical images. In this review, we examined the status of radiomic application for assessing response to nCRT in patients with LARC and indicated a potential direction for future research.
Collapse
Affiliation(s)
- Rui Chen
- Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, Hunan, China
| | - Yan Fu
- Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, Hunan, China
| | - Xiaoping Yi
- Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, Hunan, China
| | - Qian Pei
- Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, Hunan, China
| | - Hongyan Zai
- Department of Radiology, Xiangya Hospital, Central South University, Changsha 410008, Hunan, China
| | - Bihong T. Chen
- Department of Diagnostic Radiology, City of Hope National Medical Center, Duarte, CA, USA
| |
Collapse
|
|
22
|
Li C, Li W, Liu C, Zheng H, Cai J, Wang S. Artificial intelligence in multi-parametric magnetic resonance imaging: A review. Med Phys 2022; 49:e1024-e1054. [PMID: 35980348 DOI: 10.1002/mp.15936] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/01/2022] [Accepted: 08/04/2022] [Indexed: 11/06/2022] Open
Abstract
Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Cheng Li
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Wen Li
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Chenyang Liu
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Hairong Zheng
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China
| | - Shanshan Wang
- Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.,Peng Cheng Laboratory, Shenzhen, 518066, China.,Guangdong Provincial Key Laboratory of Artificial Intelligence in Medical Image Analysis and Application, Guangzhou, 510080, China
| |
Collapse
|
|
23
|
Qin Y, Zhu LH, Zhao W, Wang JJ, Wang H. Review of Radiomics- and Dosiomics-based Predicting Models for Rectal Cancer. Front Oncol 2022; 12:913683. [PMID: 36016617 PMCID: PMC9395725 DOI: 10.3389/fonc.2022.913683] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 06/23/2022] [Indexed: 12/20/2022] Open
Abstract
By breaking the traditional medical image analysis framework, precision medicine-radiomics has attracted much attention in the past decade. The use of various mathematical algorithms offers radiomics the ability to extract vast amounts of detailed features from medical images for quantitative analysis and analyzes the confidential information related to the tumor in the image, which can establish valuable disease diagnosis and prognosis models to support personalized clinical decisions. This article summarizes the application of radiomics and dosiomics in radiation oncology. We focus on the application of radiomics in locally advanced rectal cancer and also summarize the latest research progress of dosiomics in radiation tumors to provide ideas for the treatment of future related diseases, especially 125I CT-guided radioactive seed implant brachytherapy.
Collapse
Affiliation(s)
- Yun Qin
- School of Physics, Beihang University, Beijing, China
| | - Li-Hua Zhu
- School of Physics, Beihang University, Beijing, China
| | - Wei Zhao
- School of Physics, Beihang University, Beijing, China
| | - Jun-Jie Wang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| | - Hao Wang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
- Cancer Center, Peking University Third Hospital, Beijing, China
| |
Collapse
|
|
24
|
Vicini S, Bortolotto C, Rengo M, Ballerini D, Bellini D, Carbone I, Preda L, Laghi A, Coppola F, Faggioni L. A narrative review on current imaging applications of artificial intelligence and radiomics in oncology: focus on the three most common cancers. Radiol Med 2022; 127:819-836. [DOI: 10.1007/s11547-022-01512-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 06/01/2022] [Indexed: 12/24/2022]
|
|
25
|
Lou X, Zhou N, Feng L, Li Z, Fang Y, Fan X, Ling Y, Liu H, Zou X, Wang J, Huang J, Yun J, Yao J, Huang Y. Deep Learning Model for Predicting the Pathological Complete Response to Neoadjuvant Chemoradiotherapy of Locally Advanced Rectal Cancer. Front Oncol 2022; 12:807264. [PMID: 35756653 PMCID: PMC9214314 DOI: 10.3389/fonc.2022.807264] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 05/02/2022] [Indexed: 12/24/2022] Open
Abstract
Objective This study aimed to develop an artificial intelligence model for predicting the pathological complete response (pCR) to neoadjuvant chemoradiotherapy (nCRT) of locally advanced rectal cancer (LARC) using digital pathological images. Background nCRT followed by total mesorectal excision (TME) is a standard treatment strategy for patients with LARC. Predicting the PCR to nCRT of LARC remine difficulty. Methods 842 LARC patients treated with standard nCRT from three medical centers were retrospectively recruited and subgrouped into the training, testing and external validation sets. Treatment response was classified as pCR and non-pCR based on the pathological diagnosis after surgery as the ground truth. The hematoxylin & eosin (H&E)-stained biopsy slides were manually annotated and used to develop a deep pathological complete response (DeepPCR) prediction model by deep learning. Results The proposed DeepPCR model achieved an AUC-ROC of 0.710 (95% CI: 0.595, 0.808) in the testing cohort. Similarly, in the external validation cohort, the DeepPCR model achieved an AUC-ROC of 0.723 (95% CI: 0.591, 0.844). The sensitivity and specificity of the DeepPCR model were 72.6% and 46.9% in the testing set and 72.5% and 62.7% in the external validation cohort, respectively. Multivariate logistic regression analysis showed that the DeepPCR model was an independent predictive factor of nCRT (P=0.008 and P=0.004 for the testing set and external validation set, respectively). Conclusions The DeepPCR model showed high accuracy in predicting pCR and served as an independent predictive factor for pCR. The model can be used to assist in clinical treatment decision making before surgery.
Collapse
Affiliation(s)
- Xiaoying Lou
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | | | - Lili Feng
- Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Department of Radiation Oncology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Zhenhui Li
- Department of Pathology, Yunnan Cancer Hospital, Kunming, China
| | - Yuqi Fang
- Tencent AI Lab, Shenzhen, China.,Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong SAR, China
| | - Xinjuan Fan
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Yihong Ling
- Department of Pathology, Cancer Center of Sun Yat-sen University, Guangzhou, China
| | - Hailing Liu
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Xuan Zou
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | - Jing Wang
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| | | | - Jingping Yun
- Department of Pathology, Cancer Center of Sun Yat-sen University, Guangzhou, China
| | | | - Yan Huang
- Department of Pathology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China.,Guangdong Institute of Gastroenterology, The Sixth Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
|
26
|
Miranda J, Tan GXV, Fernandes MC, Yildirim O, Sims JA, de Arimateia Batista Araujo-Filho J, Machado FADM, Assuncao AN, Nomura CH, Horvat N. Rectal MRI radiomics for predicting pathological complete response: Where we are. Clin Imaging 2022; 82:141-149. [PMID: 34826772 PMCID: PMC9119743 DOI: 10.1016/j.clinimag.2021.10.005] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 09/21/2021] [Accepted: 10/11/2021] [Indexed: 02/03/2023]
Abstract
Radiomics using rectal MRI radiomics has emerged as a promising approach in predicting pathological complete response. In this study, we present a typical pipeline of a radiomics analysis and review recent studies, exploring applications, development of radiomics methodologies and model construction in pCR prediction. Finally, we will offer our opinion about the future and discuss the next steps of rectal MRI radiomics for predicting pCR.
Collapse
Affiliation(s)
- Joao Miranda
- Department of Radiology, University of Sao Paulo, Sao Paulo, SP, Brazil,Department of Radiology, Diagnosticos da America SA (DASA), Sao Paulo, SP, Brazil
| | - Gary Xia Vern Tan
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | - Onur Yildirim
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - John A. Sims
- Department of Biomedical Engineering, Universidade Federal do ABC, Santo Andre, SP, Brazil
| | | | | | | | - Cesar Higa Nomura
- Department of Radiology, University of Sao Paulo, Sao Paulo, SP, Brazil,Department of Radiology, Hospital Sirio-Libanes, Sao Paulo, Brazil
| | - Natally Horvat
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| |
Collapse
|
|
27
|
Bektaş M, Tuynman JB, Costa Pereira J, Burchell GL, van der Peet DL. Machine Learning Algorithms for Predicting Surgical Outcomes after Colorectal Surgery: A Systematic Review. World J Surg 2022; 46:3100-3110. [PMID: 36109367 PMCID: PMC9636121 DOI: 10.1007/s00268-022-06728-1] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/22/2022] [Indexed: 01/14/2023]
Abstract
BACKGROUND Machine learning (ML) has been introduced in various fields of healthcare. In colorectal surgery, the role of ML has yet to be reported. In this systematic review, an overview of machine learning models predicting surgical outcomes after colorectal surgery is provided. METHODS Databases PubMed, EMBASE, Cochrane, and Web of Science were searched for studies using machine learning models for patients undergoing colorectal surgery. To be eligible for inclusion, studies needed to apply machine learning models for patients undergoing colorectal surgery. Absence of machine learning or colorectal surgery or studies reporting on reviews, children, study abstracts were excluded. The Probast risk of bias tool was used to evaluate the methodological quality of machine learning models. RESULTS A total of 1821 studies were analysed, resulting in the inclusion of 31 articles. A vast proportion of ML algorithms have been used to predict the course of disease and response to neoadjuvant chemoradiotherapy. Radiomics have been applied most frequently, along with predictive accuracies up to 91%. However, most studies included a retrospective study design without external validation or calibration. CONCLUSIONS Machine learning models have shown promising potential in predicting surgical outcomes after colorectal surgery. However, large-scale data is warranted to bridge the gap between calibration and external validation. Clinical implementation is needed to demonstrate the contribution of ML within daily practice.
Collapse
Affiliation(s)
- Mustafa Bektaş
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV Amsterdam, The Netherlands
| | - Jurriaan B. Tuynman
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV Amsterdam, The Netherlands
| | - Jaime Costa Pereira
- Department of Computer Science, Vrije Universiteit Amsterdam, De Boelelaan 1105, 1081 HV Amsterdam, The Netherlands
| | - George L. Burchell
- Medical Library, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV Amsterdam, The Netherlands
| | - Donald L. van der Peet
- Department of Surgery, Amsterdam UMC Location Vrije Universiteit Amsterdam, De Boelelaan 1117, 1081 HV Amsterdam, The Netherlands
| |
Collapse
|
|
28
|
Wu KC, Chen SW, Hsieh TC, Yen KY, Law KM, Kuo YC, Chang RF, Kao CH. Prediction of Neoadjuvant Chemoradiotherapy Response in Rectal Cancer with Metric Learning Using Pretreatment 18F-Fluorodeoxyglucose Positron Emission Tomography. Cancers (Basel) 2021; 13:cancers13246350. [PMID: 34944970 PMCID: PMC8699508 DOI: 10.3390/cancers13246350] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 12/12/2021] [Accepted: 12/14/2021] [Indexed: 12/23/2022] Open
Abstract
OBJECTIVES Neoadjuvant chemoradiotherapy (NCRT) followed by surgery is the mainstay of treatment for patients with locally advanced rectal cancer. Based on baseline 18F-fluorodeoxyglucose ([18F]-FDG)-positron emission tomography (PET)/computed tomography (CT), a new artificial intelligence model using metric learning (ML) was introduced to predict responses to NCRT. PATIENTS AND METHODS This study used the data of 236 patients with newly diagnosed rectal cancer; the data of 202 and 34 patients were for training and validation, respectively. All patients received pretreatment [18F]FDG-PET/CT, NCRT, and surgery. The treatment response was scored by Dworak tumor regression grade (TRG); TRG3 and TRG4 indicated favorable responses. The model employed ML combined with the Uniform Manifold Approximation and Projection for dimensionality reduction. A receiver operating characteristic (ROC) curve analysis was performed to assess the model's predictive performance. RESULTS In the training cohort, 115 patients (57%) achieved TRG3 or TRG4 responses. The area under the ROC curve was 0.96 for the prediction of a favorable response. The sensitivity, specificity, and accuracy were 98.3%, 96.5%, and 97.5%, respectively. The sensitivity, specificity, and accuracy for the validation cohort were 95.0%, 100%, and 98.8%, respectively. CONCLUSIONS The new ML model presented herein was used to determined that baseline 18F[FDG]-PET/CT images could predict a favorable response to NCRT in patients with rectal cancer. External validation is required to verify the model's predictive value.
Collapse
Affiliation(s)
- Kuo-Chen Wu
- Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei 106, Taiwan;
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
| | - Shang-Wen Chen
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
- School of Medicine, College of Medicine, China Medical University, Taichung 404, Taiwan
- School of Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan
- Department of Radiation Oncology, China Medical University Hospital, Taichung 404, Taiwan
| | - Te-Chun Hsieh
- Department of Nuclear Medicine and PET Center, China Medical University Hospital, Taichung 404, Taiwan; (T.-C.H.); (K.-Y.Y.)
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan
| | - Kuo-Yang Yen
- Department of Nuclear Medicine and PET Center, China Medical University Hospital, Taichung 404, Taiwan; (T.-C.H.); (K.-Y.Y.)
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 404, Taiwan
| | - Kin-Man Law
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
- Department of Computer Science and Engineering, National Chung Hsing University, Taichung 402, Taiwan
| | - Yu-Chieh Kuo
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
| | - Ruey-Feng Chang
- Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei 106, Taiwan;
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
- Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan
- Correspondence: (R.-F.C.); or (C.-H.K.); Tel.: +886-2-33664888 (ext. 331) (R.-F.C.); +886-4-22052121 (C.-H.K.)
| | - Chia-Hung Kao
- Center of Augmented Intelligence in Healthcare, China Medical University Hospital, Taichung 404, Taiwan; (S.-W.C.); (K.-M.L.); (Y.-C.K.)
- Department of Nuclear Medicine and PET Center, China Medical University Hospital, Taichung 404, Taiwan; (T.-C.H.); (K.-Y.Y.)
- Graduate Institute of Biomedical Sciences, School of Medicine, College of Medicine, China Medical University, Taichung 404, Taiwan
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung 413, Taiwan
- Correspondence: (R.-F.C.); or (C.-H.K.); Tel.: +886-2-33664888 (ext. 331) (R.-F.C.); +886-4-22052121 (C.-H.K.)
| |
Collapse
|
|
29
|
Peng Y, Bi L, Kumar A, Fulham M, Feng D, Kim J. Predicting distant metastases in soft-tissue sarcomas from PET-CT scans using constrained hierarchical multi-modality feature learning. Phys Med Biol 2021; 66. [PMID: 34818637 DOI: 10.1088/1361-6560/ac3d17] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 11/24/2021] [Indexed: 11/11/2022]
Abstract
Objective.Positron emission tomography-computed tomography (PET-CT) is regarded as the imaging modality of choice for the management of soft-tissue sarcomas (STSs). Distant metastases (DM) are the leading cause of death in STS patients and early detection is important to effectively manage tumors with surgery, radiotherapy and chemotherapy. In this study, we aim to early detect DM in patients with STS using their PET-CT data.Approach.We derive a new convolutional neural network method for early DM detection. The novelty of our method is the introduction of a constrained hierarchical multi-modality feature learning approach to integrate functional imaging (PET) features with anatomical imaging (CT) features. In addition, we removed the reliance on manual input, e.g. tumor delineation, for extracting imaging features.Main results.Our experimental results on a well-established benchmark PET-CT dataset show that our method achieved the highest accuracy (0.896) and AUC (0.903) scores when compared to the state-of-the-art methods (unpaired student's t-testp-value < 0.05).Significance.Our method could be an effective and supportive tool to aid physicians in tumor quantification and in identifying image biomarkers for cancer treatment.
Collapse
Affiliation(s)
- Yige Peng
- The School of Computer Science, The University of Sydney, Australia.,The ARC Training Centre for Innovative BioEngineering, Australia
| | - Lei Bi
- The School of Computer Science, The University of Sydney, Australia.,The ARC Training Centre for Innovative BioEngineering, Australia
| | - Ashnil Kumar
- The ARC Training Centre for Innovative BioEngineering, Australia.,The School of Biomedical Engineering, The University of Sydney, Australia
| | - Michael Fulham
- The School of Computer Science, The University of Sydney, Australia.,The ARC Training Centre for Innovative BioEngineering, Australia.,The Department of Molecular Imaging, Royal Prince Alfred Hospital, Australia
| | - Dagan Feng
- The School of Computer Science, The University of Sydney, Australia.,The ARC Training Centre for Innovative BioEngineering, Australia.,The Med-X Research Institute, Shanghai Jiao Tong University, People's Republic of China
| | - Jinman Kim
- The School of Computer Science, The University of Sydney, Australia.,The ARC Training Centre for Innovative BioEngineering, Australia
| |
Collapse
|
|
30
|
Recent Advances in Functional MRI to Predict Treatment Response for Locally Advanced Rectal Cancer. CURRENT COLORECTAL CANCER REPORTS 2021. [DOI: 10.1007/s11888-021-00470-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
|
31
|
Pathologic Complete Response Prediction after Neoadjuvant Chemoradiation Therapy for Rectal Cancer Using Radiomics and Deep Embedding Network of MRI. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11209494] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Assessment of magnetic resonance imaging (MRI) after neoadjuvant chemoradiation therapy (nCRT) is essential in rectal cancer staging and treatment planning. However, when predicting the pathologic complete response (pCR) after nCRT for rectal cancer, existing works either rely on simple quantitative evaluation based on radiomics features or partially analyze multi-parametric MRI. We propose an effective pCR prediction method based on novel multi-parametric MRI embedding. We first seek to extract volumetric features of tumors that can be found only by analyzing multiple MRI sequences jointly. Specifically, we encapsulate multiple MRI sequences into multi-sequence fusion images (MSFI) and generate MSFI embedding. We merge radiomics features, which capture important characteristics of tumors, with MSFI embedding to generate multi-parametric MRI embedding and then use it to predict pCR using a random forest classifier. Our extensive experiments demonstrate that using all given MRI sequences is the most effective regardless of the dimension reduction method. The proposed method outperformed any variants with different combinations of feature vectors and dimension reduction methods or different classification models. Comparative experiments demonstrate that it outperformed four competing baselines in terms of the AUC and F1-score. We use MRI sequences from 912 patients with rectal cancer, a much larger sample than in any existing work.
Collapse
|
|
32
|
|
|
33
|
Orel VE, Ashykhmin A, Golovko T, Rykhalskyi O, Orel VB. Texture Analysis of Tumor and Peritumoral Tissues Based on 18F-Fluorodeoxyglucose Positron Emission Tomography/Computed Tomography Hybrid Imaging in Patients With Rectal Cancer. J Comput Assist Tomogr 2021; 45:820-828. [PMID: 34469907 DOI: 10.1097/rct.0000000000001218] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
OBJECTIVE This study aimed to determine whether texture parameters could be used in differentiation between the tumor and the peritumoral tissues based on hybrid 18F-Fluorodeoxyglucose positron emission tomography/computed tomography imaging for patients with rectal cancer. METHODS Seven parameters, including heterogeneity, entropy, energy, skewness, kurtosis, standard deviation, and average brightness, were extracted from positron emission tomography/computed tomography scans of 22 patients (12 male and 10 female; mean age, 61 ± 2 years). RESULTS The peritumoral tissue had a significantly lower value of the heterogeneity parameter (23%) than the tumor. Tumor size (r = -0.48, P < 0.05) and extramural venous invasion scores (r = 0.64, P < 0.05) correlated with heterogeneity in the peritumoral tissue. There were significant differences (P < 0.05) in the correlation coefficients between men and women. CONCLUSIONS Therefore, we provided additional quantitative information to differentiate the tumor from the peritumoral tissue and indicated possible application for extramural venous invasion evaluation in rectal cancer.
Collapse
|
|
34
|
Fu J, Singhrao K, Zhong X, Gao Y, Qi SX, Yang Y, Ruan D, Lewis JH. An Automatic Deep Learning-Based Workflow for Glioblastoma Survival Prediction Using Preoperative Multimodal MR Images: A Feasibility Study. Adv Radiat Oncol 2021; 6:100746. [PMID: 34458648 PMCID: PMC8377554 DOI: 10.1016/j.adro.2021.100746] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 06/14/2021] [Accepted: 06/23/2021] [Indexed: 12/23/2022] Open
Abstract
PURPOSE Most radiomic studies use the features extracted from the manually drawn tumor contours for classification or survival prediction. However, large interobserver segmentation variations lead to inconsistent features and hence introduce more challenges in constructing robust prediction models. Here, we proposed an automatic workflow for glioblastoma (GBM) survival prediction based on multimodal magnetic resonance (MR) images. METHODS AND MATERIALS Two hundred eighty-five patients with glioma (210 GBM, 75 low-grade glioma) were included. One hundred sixty-three of the patients with GBM had overall survival data. Every patient had 4 preoperative MR images and manually drawn tumor contours. A 3-dimensional convolutional neural network, VGG-Seg, was trained and validated using 122 patients with glioma for automatic GBM segmentation. The trained VGG-Seg was applied to the remaining 163 patients with GBM to generate their autosegmented tumor contours. The handcrafted and deep learning (DL)-based radiomic features were extracted from the autosegmented contours using explicitly designed algorithms and a pretrained convolutional neural network, respectively. One hundred sixty-three patients with GBM were randomly split into training (n = 122) and testing (n = 41) sets for survival analysis. Cox regression models were trained to construct the handcrafted and DL-based signatures. The prognostic powers of the 2 signatures were evaluated and compared. RESULTS The VGG-Seg achieved a mean Dice coefficient of 0.86 across 163 patients with GBM for GBM segmentation. The handcrafted signature achieved a C-index of 0.64 (95% confidence interval, 0.55-0.73), whereas the DL-based signature achieved a C-index of 0.67 (95% confidence interval, 0.57-0.77). Unlike the handcrafted signature, the DL-based signature successfully stratified testing patients into 2 prognostically distinct groups. CONCLUSIONS The VGG-Seg generated accurate GBM contours from 4 MR images. The DL-based signature achieved a numerically higher C-index than the handcrafted signature and significant patient stratification. The proposed automatic workflow demonstrated the potential of improving patient stratification and survival prediction in patients with GBM.
Collapse
Affiliation(s)
- Jie Fu
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California
- Department of Radiation Oncology, Stanford University, Stanford, California
| | - Kamal Singhrao
- Department of Radiation Oncology, University of California, San Francisco, San Francisco, California
| | - Xinran Zhong
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, Texas
| | - Yu Gao
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California
| | - Sharon X. Qi
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California
| | - Yingli Yang
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California
| | - Dan Ruan
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, California
| | - John H. Lewis
- Department of Radiation Oncology, Cedars-Sinai Medical Center, Los Angeles, California
| |
Collapse
|
|
35
|
Nardone V, Boldrini L, Grassi R, Franceschini D, Morelli I, Becherini C, Loi M, Greto D, Desideri I. Radiomics in the Setting of Neoadjuvant Radiotherapy: A New Approach for Tailored Treatment. Cancers (Basel) 2021; 13:3590. [PMID: 34298803 PMCID: PMC8303203 DOI: 10.3390/cancers13143590] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 07/12/2021] [Accepted: 07/14/2021] [Indexed: 12/11/2022] Open
Abstract
INTRODUCTION Neoadjuvant radiotherapy is currently used mainly in locally advanced rectal cancer and sarcoma and in a subset of non-small cell lung cancer and esophageal cancer, whereas in other diseases it is under investigation. The evaluation of the efficacy of the induction strategy is made possible by performing imaging investigations before and after the neoadjuvant therapy and is usually challenging. In the last decade, texture analysis (TA) has been developed to help the radiologist to quantify and identify the parameters related to tumor heterogeneity, which cannot be appreciated by the naked eye. The aim of this narrative is to review the impact of TA on the prediction of response to neoadjuvant radiotherapy and or chemoradiotherapy. MATERIALS AND METHODS Key references were derived from a PubMed query. Hand searching and ClinicalTrials.gov were also used. RESULTS This paper contains a narrative report and a critical discussion of radiomics approaches in different fields of neoadjuvant radiotherapy, including esophageal cancer, lung cancer, sarcoma, and rectal cancer. CONCLUSIONS Radiomics can shed a light on the setting of neoadjuvant therapies that can be used to tailor subsequent approaches or even to avoid surgery in the future. At the same, these results need to be validated in prospective and multicenter trials.
Collapse
Affiliation(s)
- Valerio Nardone
- Department of Precision Medicine, University of Campania “L. Vanvitelli”, 80138 Naples, Italy; (V.N.); (R.G.)
- Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, 20122 Milan, Italy
| | - Luca Boldrini
- Radiation Oncology Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, 00168 Rome, Italy;
| | - Roberta Grassi
- Department of Precision Medicine, University of Campania “L. Vanvitelli”, 80138 Naples, Italy; (V.N.); (R.G.)
- Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, 20122 Milan, Italy
| | - Davide Franceschini
- Radiotherapy and Radiosurgery Department, IRCCS Humanitas Research Hospital, via Manzoni 56, 20089 Milan, Italy;
| | - Ilaria Morelli
- Department of Biomedical, Experimental and Clinical Sciences “Mario Serio”, University of Florence, 50134 Florence, Italy;
| | - Carlotta Becherini
- Department of Biomedical, Experimental and Clinical Sciences “Mario Serio”, University of Florence, 50134 Florence, Italy;
| | - Mauro Loi
- Radiation Oncology Unit, Azienda Ospedaliero Universitaria Careggi, 50139 Florence, Italy; (M.L.); (D.G.); (I.D.)
| | - Daniela Greto
- Radiation Oncology Unit, Azienda Ospedaliero Universitaria Careggi, 50139 Florence, Italy; (M.L.); (D.G.); (I.D.)
| | - Isacco Desideri
- Radiation Oncology Unit, Azienda Ospedaliero Universitaria Careggi, 50139 Florence, Italy; (M.L.); (D.G.); (I.D.)
- Department of Experimental and Clinical Biomedical Sciences “Mario Serio”, University of Florence, 50134 Florence, Italy
| |
Collapse
|
|
36
|
Cao B, Zhang KC, Wei B, Chen L. Status quo and future prospects of artificial neural network from the perspective of gastroenterologists. World J Gastroenterol 2021; 27:2681-2709. [PMID: 34135549 PMCID: PMC8173384 DOI: 10.3748/wjg.v27.i21.2681] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 03/29/2021] [Accepted: 04/21/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial neural networks (ANNs) are one of the primary types of artificial intelligence and have been rapidly developed and used in many fields. In recent years, there has been a sharp increase in research concerning ANNs in gastrointestinal (GI) diseases. This state-of-the-art technique exhibits excellent performance in diagnosis, prognostic prediction, and treatment. Competitions between ANNs and GI experts suggest that efficiency and accuracy might be compatible in virtue of technique advancements. However, the shortcomings of ANNs are not negligible and may induce alterations in many aspects of medical practice. In this review, we introduce basic knowledge about ANNs and summarize the current achievements of ANNs in GI diseases from the perspective of gastroenterologists. Existing limitations and future directions are also proposed to optimize ANN's clinical potential. In consideration of barriers to interdisciplinary knowledge, sophisticated concepts are discussed using plain words and metaphors to make this review more easily understood by medical practitioners and the general public.
Collapse
Affiliation(s)
- Bo Cao
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Ke-Cheng Zhang
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Bo Wei
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Lin Chen
- Department of General Surgery & Institute of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| |
Collapse
|
|
37
|
Wang PP, Deng CL, Wu B. Magnetic resonance imaging-based artificial intelligence model in rectal cancer. World J Gastroenterol 2021; 27:2122-2130. [PMID: 34025068 PMCID: PMC8117733 DOI: 10.3748/wjg.v27.i18.2122] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Revised: 02/23/2021] [Accepted: 03/16/2021] [Indexed: 02/06/2023] Open
Abstract
Rectal magnetic resonance imaging (MRI) is the preferred method for the diagnosis of rectal cancer as recommended by the guidelines. Rectal MRI can accurately evaluate the tumor location, tumor stage, invasion depth, extramural vascular invasion, and circumferential resection margin. We summarize the progress of research on the use of artificial intelligence (AI) in rectal cancer in recent years. AI, represented by machine learning, is being increasingly used in the medical field. The application of AI models based on high-resolution MRI in rectal cancer has been increasingly reported. In addition to staging the diagnosis and localizing radiotherapy, an increasing number of studies have reported that AI models based on high-resolution MRI can be used to predict the response to chemotherapy and prognosis of patients.
Collapse
Affiliation(s)
- Pei-Pei Wang
- Department of General Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100730, China
| | - Chao-Lin Deng
- Department of General Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100730, China
| | - Bin Wu
- Department of General Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100730, China
| |
Collapse
|
|
38
|
Yakar M, Etiz D. Artificial intelligence in rectal cancer. Artif Intell Gastroenterol 2021; 2:10-26. [DOI: 10.35712/aig.v2.i2.10] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 03/03/2021] [Accepted: 03/16/2021] [Indexed: 02/06/2023] Open
|
|
39
|
Studying local tumour heterogeneity on MRI and FDG-PET/CT to predict response to neoadjuvant chemoradiotherapy in rectal cancer. Eur Radiol 2021; 31:7031-7038. [PMID: 33569624 DOI: 10.1007/s00330-021-07724-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 12/24/2020] [Accepted: 01/27/2021] [Indexed: 12/23/2022]
Abstract
OBJECTIVE To investigate whether quantifying local tumour heterogeneity has added benefit compared to global tumour features to predict response to chemoradiotherapy using pre-treatment multiparametric PET and MRI data. METHODS Sixty-one locally advanced rectal cancer patients treated with chemoradiotherapy and staged at baseline with MRI and FDG-PET/CT were retrospectively analyzed. Whole-tumour volumes were segmented on the MRI and PET/CT scans from which global tumour features (T2Wvolume/T2Wentropy/ADCmean/SUVmean/TLG/CTmean-HU) and local texture features (histogram features derived from local entropy/mean/standard deviation maps) were calculated. These respective feature sets were combined with clinical baseline parameters (e.g. age/gender/TN-stage) to build multivariable prediction models to predict a good (Mandard TRG1-2) versus poor (Mandard TRG3-5) response to chemoradiotherapy. Leave-one-out cross-validation (LOOCV) with bootstrapping was performed to estimate performance in an 'independent' dataset. RESULTS When using only imaging features, local texture features showed an AUC = 0.81 versus AUC = 0.74 for global tumour features. After internal cross-validation (LOOCV), AUC to predict a good response was the highest for the combination of clinical baseline variables + global tumour features (AUC = 0.83), compared to AUC = 0.79 for baseline + local texture and AUC = 0.76 for all combined (baseline + global + local texture). CONCLUSION In imaging-based prediction models, local texture analysis has potential added value compared to global tumour features to predict response. However, when combined with clinical baseline parameters such as cTN-stage, the added value of local texture analysis appears to be limited. The overall performance to predict response when combining baseline variables with quantitative imaging parameters is promising and warrants further research. KEY POINTS • Quantification of local tumour texture on pre-therapy FDG-PET/CT and MRI has potential added value compared to global tumour features to predict response to chemoradiotherapy in rectal cancer. • However, when combined with clinical baseline parameters such as cTN-stage, the added value of local texture over global tumour features is limited. • Predictive performance of our optimal model-combining clinical baseline variables with global quantitative tumour features-was encouraging (AUC 0.83), warranting further research in this direction on a larger scale.
Collapse
|
|
40
|
Staal FCR, van der Reijd DJ, Taghavi M, Lambregts DMJ, Beets-Tan RGH, Maas M. Radiomics for the Prediction of Treatment Outcome and Survival in Patients With Colorectal Cancer: A Systematic Review. Clin Colorectal Cancer 2020; 20:52-71. [PMID: 33349519 DOI: 10.1016/j.clcc.2020.11.001] [Citation(s) in RCA: 74] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Revised: 09/03/2020] [Accepted: 11/02/2020] [Indexed: 02/07/2023]
Abstract
Prediction of outcome in patients with colorectal cancer (CRC) is challenging as a result of lack of a robust biomarker and heterogeneity between and within tumors. The aim of this review was to assess the current possibilities and limitations of radiomics (on computed tomography [CT], magnetic resonance imaging [MRI], and positron emission tomography [PET]) for the prediction of treatment outcome and long-term outcome in CRC. Medline/PubMed was searched up to August 2020 for studies that used radiomics for the prediction of response to treatment and survival in patients with CRC (based on pretreatment imaging). The Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool and Radiomics Quality Score (RQS) were used for quality assessment. A total of 76 studies met the inclusion criteria and were included for further analysis. Radiomics analyses were performed on MRI in 41 studies, on CT in 30 studies, and on 18F-FDG-PET/CT in 10 studies. Heterogeneous results were reported regarding radiomics methods and included features. High-quality studies (n = 13), consisting mainly of MRI-based radiomics to predict response in rectal cancer, were able to predict response with good performance. Radiomics literature in CRC is highly heterogeneous, but it nonetheless holds promise for the prediction of outcome. The most evidence is available for MRI-based radiomics in rectal cancer. Future radiomics research in CRC should focus on independent validation of existing models rather than on developing new models.
Collapse
Affiliation(s)
- Femke C R Staal
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands; GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Denise J van der Reijd
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands; GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Marjaneh Taghavi
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands; GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Doenja M J Lambregts
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Regina G H Beets-Tan
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands; GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, The Netherlands; Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Monique Maas
- Department of Radiology, Antoni van Leeuwenhoek, The Netherlands Cancer Institute, Amsterdam, The Netherlands.
| |
Collapse
|
|
41
|
Zhu HT, Zhang XY, Shi YJ, Li XT, Sun YS. A Deep Learning Model to Predict the Response to Neoadjuvant Chemoradiotherapy by the Pretreatment Apparent Diffusion Coefficient Images of Locally Advanced Rectal Cancer. Front Oncol 2020; 10:574337. [PMID: 33194680 PMCID: PMC7658629 DOI: 10.3389/fonc.2020.574337] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2020] [Accepted: 10/12/2020] [Indexed: 12/11/2022] Open
Abstract
Background and Purpose Pretreatment prediction of the response to neoadjuvant chemoradiotherapy (NCRT) helps to determine the subsequent plans for the patients with locally advanced rectal cancer (LARC). If the good responders (GR) and non-good responders (non-GR) can be accurately predicted, they can choose to intensify the neoadjuvant chemoradiotherapy to decrease the risk of tumor progression during NCRT and increase the chance of organ preservation. Compared with radiomics methods, deep learning (DL) may adaptively extract features from the images without the need of feature definition. However, DL suffers from limited training samples and signal discrepancy among different scanners. This study aims to construct a DL model to predict GRs by training apparent diffusion coefficient (ADC) images from different scanners. Methods The study retrospectively recruited 700 participants, chronologically divided into a training group (n = 500) and a test group (n = 200). Deep convolutional neural networks were constructed to classify GRs and non-GRs. The networks were designed with a max-pooling layer parallelized by a center-cropping layer to extract features from both the macro and micro scale. ADC images and T2-weighted images were collected at 1.5 Tesla and 3.0 Tesla. The networks were trained by the image patches delineated by radiologists in ADC images and T2-weighted images, respectively. Pathological results were used as the ground truth. The deep learning models were evaluated on the test group and compared with the prediction by mean ADC value. Results Area under curve (AUC) of receiver operating characteristic (ROC) is 0.851 (95% CI: 0.789–0.914) for DL model with ADC images (DL_ADC), significantly larger (P = 0.018, Z = 2.367) than that of mean ADC with AUC = 0.723 (95% CI: 0.637–0.809). The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of DL_ADC model are 94.3%, 68.3%, 87.4% and 83.7%, respectively. The DL model with T2-weighted images (DL_T2) produces an AUC of 0.721 (95% CI: 0.640–0.802), significantly (P = 0.000, Z = 3.554) lower than that of DL_ADC model. Conclusion Deep learning model reveals the potential of pretreatment apparent diffusion coefficient images for the prediction of good responders to neoadjuvant chemoradiotherapy.
Collapse
Affiliation(s)
- Hai-Tao Zhu
- Department of Radiology, Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Peking University Cancer Hospital & Institute, Beijing, China
| | - Xiao-Yan Zhang
- Department of Radiology, Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Peking University Cancer Hospital & Institute, Beijing, China
| | - Yan-Jie Shi
- Department of Radiology, Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Peking University Cancer Hospital & Institute, Beijing, China
| | - Xiao-Ting Li
- Department of Radiology, Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Peking University Cancer Hospital & Institute, Beijing, China
| | - Ying-Shi Sun
- Department of Radiology, Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Peking University Cancer Hospital & Institute, Beijing, China
| |
Collapse
|