1
|
Yilmaz EC, Harmon SA, Lis RT, Esengur OT, Gelikman DG, Garmendia-Cedillos M, Merino MJ, Wood BJ, Patel K, Citrin DE, Gurram S, Choyke PL, Pinto PA, Turkbey B. Evaluating deep learning and radiologist performance in volumetric prostate cancer analysis with biparametric MRI and histopathologically mapped slides. Abdom Radiol (NY) 2025; 50:2732-2744. [PMID: 39658736 PMCID: PMC12069428 DOI: 10.1007/s00261-024-04734-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2024] [Revised: 11/26/2024] [Accepted: 11/30/2024] [Indexed: 12/12/2024]
Affiliation(s)
- Enis C Yilmaz
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Stephanie A Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Rosina T Lis
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Omer Tarik Esengur
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - David G Gelikman
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Marcial Garmendia-Cedillos
- Instrument Development and Engineering Application Solutions, National Institute of Biomedical Imaging and Bioengineering, National Institutes of Health, Bethesda, Maryland, USA
| | - Maria J Merino
- Laboratory of Pathology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Bradford J Wood
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
- Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, Maryland, USA
| | - Krishnan Patel
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Deborah E Citrin
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Sandeep Gurram
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Peter A Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA.
| |
Collapse
|
2
|
Lee J, Lin T, He Y, Wu Y, Qin J. Toward diffusion MRI in the diagnosis and treatment of pancreatic cancer. Med Oncol 2025; 42:222. [PMID: 40434720 DOI: 10.1007/s12032-025-02759-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2025] [Accepted: 04/28/2025] [Indexed: 05/29/2025]
Abstract
Pancreatic cancer is a highly aggressive malignancy with rising incidence and mortality rates, often diagnosed at advanced stages. Conventional imaging methods, such as computed tomography (CT) and magnetic resonance imaging (MRI), struggle to assess tumor characteristics and vascular involvement, which are crucial for treatment planning. This paper explores the potential of diffusion magnetic resonance imaging (dMRI) in enhancing pancreatic cancer diagnosis and treatment. Diffusion-based techniques, such as diffusion-weighted imaging (DWI), diffusion tensor imaging (DTI), intravoxel incoherent motion (IVIM), and diffusion kurtosis imaging (DKI), combined with emerging AI‑powered analysis, provide insights into tissue microstructure, allowing for earlier detection and improved evaluation of tumor cellularity. These methods may help assess prognosis and monitor therapy response by tracking diffusion and perfusion metrics. However, challenges remain, such as standardized protocols and robust data analysis pipelines. Ongoing research, including deep learning applications, aims to improve reliability, and dMRI shows promise in providing functional insights and improving patient outcomes. Further clinical validation is necessary to maximize its benefits.
Collapse
Affiliation(s)
- Junhao Lee
- School of Mathematics and Statistics, Nanjing University of Science and Technology, Nanjing, China
| | - Tingting Lin
- Department of Medical and Radiation Oncology, Affiliated Sanming First Hospital of Fujian Medical University, Sanming, China.
| | - Yifei He
- School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing, China
| | - Ye Wu
- School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing, China
| | - Jiaolong Qin
- School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing, China.
| |
Collapse
|
3
|
Harmon SA, Tetreault J, Esengur OT, Qin M, Yilmaz EC, Chang V, Yang D, Xu Z, Cohen G, Plum J, Sherif T, Levin R, Schmidt-Richberg A, Thompson S, Coons S, Chen T, Choyke PL, Xu D, Gurram S, Wood BJ, Pinto PA, Turkbey B. Research-based clinical deployment of artificial intelligence algorithm for prostate MRI. Abdom Radiol (NY) 2025:10.1007/s00261-025-05014-7. [PMID: 40418374 DOI: 10.1007/s00261-025-05014-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2025] [Revised: 05/13/2025] [Accepted: 05/15/2025] [Indexed: 05/27/2025]
Abstract
PURPOSE A critical limitation to deployment and utilization of Artificial Intelligence (AI) algorithms in radiology practice is the actual integration of algorithms directly into the clinical Picture Archiving and Communications Systems (PACS). Here, we sought to integrate an AI-based pipeline for prostate organ and intraprostatic lesion segmentation within a clinical PACS environment to enable point-of-care utilization under a prospective clinical trial scenario. METHODS A previously trained, publicly available AI model for segmentation of intra-prostatic findings on multiparametric Magnetic Resonance Imaging (mpMRI) was converted into a containerized environment compatible with MONAI Deploy Express. An inference server and dedicated clinical PACS workflow were established within our institution for evaluation of real-time use of the AI algorithm. PACS-based deployment was prospectively evaluated in two phases: first, a consecutive cohort of patients undergoing diagnostic imaging at our institution and second, a consecutive cohort of patients undergoing biopsy based on mpMRI findings. The AI pipeline was executed from within the PACS environment by the radiologist. AI findings were imported into clinical biopsy planning software for target definition. Metrics analyzing deployment success, timing, and detection performance were recorded and summarized. RESULTS In phase one, clinical PACS deployment was successfully executed in 57/58 cases and were obtained within one minute of activation (median 33 s [range 21-50 s]). Comparison with expert radiologist annotation demonstrated stable model performance compared to independent validation studies. In phase 2, 40/40 cases were successfully executed via PACS deployment and results were imported for biopsy targeting. Cancer detection rates for prostate cancer were 82.1% for ROI targets detected by both AI and radiologist, 47.8% in targets proposed by AI and accepted by radiologist, and 33.3% in targets identified by the radiologist alone. CONCLUSIONS Integration of novel AI algorithms requiring multi-parametric input into clinical PACS environment is feasible and model outputs can be used for downstream clinical tasks.
Collapse
Affiliation(s)
| | | | | | - Ming Qin
- Nvidia (United States), Santa Clara, USA
| | | | | | - Dong Yang
- Nvidia (United States), Santa Clara, USA
| | - Ziyue Xu
- Nvidia (United States), Santa Clara, USA
| | - Gregg Cohen
- National Institutes of Health, Bethesda, USA
| | - Jeff Plum
- National Institutes of Health, Bethesda, USA
| | | | - Ron Levin
- National Institutes of Health, Bethesda, USA
| | | | | | | | - Te Chen
- National Institutes of Health, Bethesda, USA
| | | | - Daguang Xu
- Nvidia (United States), Santa Clara, USA
| | | | | | | | | |
Collapse
|
4
|
Segeroth M, Breit HC, Wasserthal J, Bach M, Rentsch C, Matthias M, Wetterauer C, Merkle EM, Boll DT. AI-Based Evaluation of Prostate MR Imaging at a Modern Low-field 0.55 T Scanner Compared to 3 T in a Screening Cohort. Acad Radiol 2025; 32:2700-2706. [PMID: 39627058 DOI: 10.1016/j.acra.2024.11.024] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2024] [Revised: 11/08/2024] [Accepted: 11/11/2024] [Indexed: 04/23/2025]
Abstract
PURPOSE To evaluate the effect of lower field strength on quantitative apparent-diffusion-coefficient (ADC) values, contrast of the T2-weighted MR images and the performance of an AI-based segmentation. MATERIALS AND METHODS 25 screening clients (61.6 ± 7.5 years) from a study on a 3 T scanner were included and underwent a second examination on a 0.55 T scanner. Axial T2 weighted and diffusion-weighted images (DWI) sequences were acquired. An AI-based segmentation was performed. Based on this, the segmentation, volumetry, ADC values and the ratio of central gland (CG) and peripheral zone (PZ) in T2 weighting were compared by using correlations coefficient (Pearson), Bland-Altman plots and a non-inferior test with a paired t-test and a margin of ± 20% (lower and upper boundary). RESULTS Volumetric assessment (peripheral zone//central gland) showed no significant (p = 0.13//0.38) difference between 3 T (mean volume: 14.81 (12.53-17.09)//23.07 (15.06-31.08)mL) and 0.55 T (mean volume of 14.29 (12.03-16.54; p = 0.13)//22.77 (14.41-31.12)mL). The deviation of the 0.55 T ADC values from the 3 T values was -10.14% (-16.09% to -4.18%) for the PZ and -4.68% (-10.12-0.76%) for the CG. Therefore, all confidence intervals remained within a margin of + /- 20% and thus demonstrated significant non-inferiority. CONCLUSION Biparametric prostate imaging is feasible at 0.55 T: ADC values vary within a common inter-scanner range compared to a 3 T and no difference can be observed regarding contrast ratio between peripheral zone and central gland in T2 weighted images, volumetry and AI-based segmentation compared to 3 T.
Collapse
Affiliation(s)
- Martin Segeroth
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Hanns-Christian Breit
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland.
| | - Jakob Wasserthal
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Michael Bach
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Cyrill Rentsch
- Department of Urology, University Hospital of Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Marc Matthias
- Department of Urology, University Hospital of Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Christian Wetterauer
- Department of Urology, University Hospital of Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Elmar Max Merkle
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland
| | - Daniel Tobias Boll
- Department of Radiology, University Hospital Basel, 4051 Basel, Basel-Stadt, Switzerland
| |
Collapse
|
5
|
Belue MJ, Mukhtar V, Ram R, Gokden N, Jose J, Massey JL, Biben E, Buddha S, Langford T, Shah S, Harmon SA, Turkbey B, Aydin AM. External Validation of an Artificial Intelligence Algorithm Using Biparametric MRI and Its Simulated Integration with Conventional PI-RADS for Prostate Cancer Detection. Acad Radiol 2025:S1076-6332(25)00280-6. [PMID: 40221284 DOI: 10.1016/j.acra.2025.03.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2025] [Revised: 03/18/2025] [Accepted: 03/21/2025] [Indexed: 04/14/2025]
Abstract
PURPOSE Prostate imaging reporting and data systems (PI-RADS) experiences considerable variability in inter-reader performance. Artificial Intelligence (AI) algorithms were suggested to provide comparable performance to PI-RADS for assessing prostate cancer (PCa) risk, albeit tested in highly selected cohorts. This study aimed to assess an AI algorithm for PCa detection in a clinical practice setting and simulate integration of the AI model with PI-RADS for assessment of indeterminate PI-RADS 3 lesions. PATIENTS AND METHODS This retrospective cohort study externally validated a biparametric MRI-based AI model for PCa detection in a consecutive cohort of patients who underwent prostate MRI and subsequently targeted and systematic prostate biopsy at a urology clinic between January 2022 and March 2024. Radiologist interpretations followed PI-RADS v2.1, and biopsies were conducted per PI-RADS scores. The previously developed AI model provided lesion segmentations and cancer probability maps which were compared to biopsy results. Additionally, we conducted a simulation to adjust biopsy thresholds for index PI-RADS category 3 studies, where AI predictions within these studies upgraded them to PI-RADS category 4. RESULTS Among 144 patients with a median age of 70 years and PSA density of 0.17ng/mL/cc, AI's sensitivity for detection of PCa (86.6%) and clinically significant PCa (csPCa, 88.4%) was comparable to radiologists (85.7%, p=0.84, and 89.5%, p=0.80, respectively). The simulation combining radiologist and AI evaluations improved clinically significant PCa sensitivity by 5.8% (p=0.025). The combination of AI, PI-RADS and PSA density provided the best diagnostic performance for csPCa (area under the curve [AUC]=0.76). CONCLUSION The AI algorithm demonstrated comparable PCa detection rates to PI-RADS. The combination of AI with radiologist interpretation improved sensitivity and could be instrumental in assessment of low-risk and indeterminate PI-RADS lesions. The role of AI in PCa screening remains to be further elucidated.
Collapse
Affiliation(s)
- Mason J Belue
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.)
| | - Vaneeza Mukhtar
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.)
| | - Roopa Ram
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (R.R., J.J., S.B., S.S.)
| | - Neriman Gokden
- Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (N.G.)
| | - Joe Jose
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (R.R., J.J., S.B., S.S.)
| | - Jackson L Massey
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.)
| | - Emily Biben
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.)
| | - Suryakala Buddha
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (R.R., J.J., S.B., S.S.)
| | - Timothy Langford
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.)
| | - Sumit Shah
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (R.R., J.J., S.B., S.S.)
| | - Stephanie A Harmon
- Artificial Intelligence Resource, National Cancer Institute, National Institutes of Health, Bethesda, Maryland (S.A.H.,)
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland (B.T.)
| | - Ahmet Murat Aydin
- Department of Urology, University of Arkansas for Medical Sciences, Little Rock, Arkansas (M.J.B., V.M., J.L.M., E.B., T.L., A.M.A.).
| |
Collapse
|
6
|
Stevenson E, Esengur OT, Zhang H, Simon BD, Harmon SA, Turkbey B. An overview of utilizing artificial intelligence in localized prostate cancer imaging. Expert Rev Med Devices 2025; 22:293-310. [PMID: 40056148 PMCID: PMC12038709 DOI: 10.1080/17434440.2025.2477601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Revised: 02/14/2025] [Accepted: 02/27/2025] [Indexed: 03/10/2025]
Abstract
INTRODUCTION Prostate cancer (PCa) is a leading cause of cancer-related deaths among men, and accurate diagnosis is critical for effective management. Multiparametric MRI (mpMRI) has become an essential tool in PCa diagnosis due to its superior spatial resolution which enables detailed anatomical, functional information and its resultant ability to detect clinically significant PCa. However, challenges such as subjective interpretation methods and high inter-reader variability remain. In recent years, artificial intelligence (AI) has emerged as a promising solution to enhance the diagnostic performance of mpMRI by automating key tasks such as prostate segmentation, lesion detection, classification. AREAS COVERED This review provides a comprehensive overview of the current AI applications in prostate mpMRI, discussing advancements in automated image analysis and how AI-driven models are developed to improve detection and risk stratification. A literature search was conducted to examine both machine learning and deep learning techniques applied in this field, highlighting key studies and future directions. EXPERT OPINION While AI models have shown significant promise, their clinical integration remains limited due to the need for larger, multi-institutional validation studies. As AI continues to evolve, multimodal approaches combining imaging with clinical data are likely to play pivotal role in personalized PCa diagnosis, treatment planning.
Collapse
Affiliation(s)
- Emma Stevenson
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Omer Tarik Esengur
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Haoyue Zhang
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Benjamin D. Simon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, UK
| | - Stephanie A. Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
7
|
Xu Y, Wang R, Fang Z, Tang J. Feasibility study of AI-assisted multi-parameter MRI diagnosis of prostate cancer. Sci Rep 2025; 15:10530. [PMID: 40148363 PMCID: PMC11950164 DOI: 10.1038/s41598-024-84516-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2024] [Accepted: 12/24/2024] [Indexed: 03/29/2025] Open
Abstract
Distinguishing between benign and malignant prostate lesions in magnetic resonance imaging (MRI) poses challenges that affect prostate cancer screening accuracy. We propose a novel computer-aided diagnosis (CAD) system to extract cancerous lesions from the prostate in multi-parametric MRI (mp-MRI), assessing the feasibility of using artificial intelligence for detecting clinically significant prostate cancer (PCa). A retrospective study was conducted on 106 patients who underwent mp-MRI from 2021 to 2024 at a single center. We analyzed three sequences (T2W, DCE, and DWI) and collected 137 mp-MRI images corresponding to pathological sections. From these, we obtained 274 sets of ROI data, using 206 for training and validation, and 68 for testing. A feature extractor was developed using a pre-trained ResNet50 model combined with a multi-head attention mechanism to fuse modality-specific features and perform classification. The experimental results indicate that our model demonstrates high classification performance, achieving an AUC of 0.89. The PR curve shows high precision across most recall values, with an AUC of 0.91. We developed a novel CAD system based on deep learning ResNet50 models to assess the risk of prostate malignancy in mpMRI images. High classification ability is achieved, and combining the attention mechanism or optimization strategy can improve the performance of the model in medical imaging.
Collapse
Affiliation(s)
- Yibo Xu
- The Department of Urology, The First Affiliated Hospital of Huzhou Normal College, Huzhou, 31300, Zhejiang Province, China
- Huzhou Key Laboratory of Precise Diagnosis and Treatment of Urinary Tumors, Huzhou, 313000, Zhejiang Province, China
| | - Rongjiang Wang
- The Department of Urology, The First Affiliated Hospital of Huzhou Normal College, Huzhou, 31300, Zhejiang Province, China
- Huzhou Key Laboratory of Precise Diagnosis and Treatment of Urinary Tumors, Huzhou, 313000, Zhejiang Province, China
| | - Zhihai Fang
- The Department of Urology, The First Affiliated Hospital of Huzhou Normal College, Huzhou, 31300, Zhejiang Province, China
- Huzhou Key Laboratory of Precise Diagnosis and Treatment of Urinary Tumors, Huzhou, 313000, Zhejiang Province, China
| | - Jianer Tang
- The Department of Urology, The First Affiliated Hospital of Huzhou Normal College, Huzhou, 31300, Zhejiang Province, China.
- Huzhou Key Laboratory of Precise Diagnosis and Treatment of Urinary Tumors, Huzhou, 313000, Zhejiang Province, China.
| |
Collapse
|
8
|
Esengur OT, Yilmaz EC, Ozyoruk KB, Chen A, Lay NS, Gelikman DG, Merino MJ, Gurram S, Wood BJ, Choyke PL, Harmon SA, Pinto PA, Turkbey B. Multimodal approach to optimize biopsy decision-making for PI-RADS 3 lesions on multiparametric MRI. Clin Imaging 2025; 117:110363. [PMID: 39579754 PMCID: PMC11624978 DOI: 10.1016/j.clinimag.2024.110363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2024] [Revised: 11/15/2024] [Accepted: 11/17/2024] [Indexed: 11/25/2024]
Abstract
PURPOSE To develop and evaluate a multimodal approach including clinical parameters and biparametric MRI-based artificial intelligence (AI) model for determining the necessity of prostate biopsy in patients with PI-RADS 3 lesions. METHODS This retrospective study included a prospectively recruited patient cohort with PI-RADS 3 lesions who underwent prostate MRI and MRI/US fusion-guided biopsy between April 2019 and February 2024 in a single institution. The study examined demographic data, PSA and PSA density (PSAD) levels, prostate volumes, prospective PI-RADS v2.1-compliant interpretations of a genitourinary radiologist, lesion characteristics, history of prior biopsies, and AI evaluations, focusing mainly on the detection of clinically significant prostate cancer (csPCa) (International Society of Urological Pathology grade group ≥2) on MRI/US fusion-guided biopsy. The AI model lesion segmentations were compared to manual segmentations and biopsy results. The statistical methods employed included Fisher's exact test and logistic regression. RESULTS The cohort was comprised of 248 patients with 312 PI-RADS 3 lesions in total (n = 268 non-csPCa, n = 44 csPCa). The AI model's negative predictive value (NPV) was 89.2 % for csPCa in all lesions. In patient-level analysis, the NPV was 91.2 % for patients with a highest PI-RADS score of 3. PSAD was a significant predictor of csPCa (odds ratio = 5.8, p = 0.038). Combining AI and PSAD, where AI correctly mapped a lesion or PSAD ≥0.15 ng/mL2, achieved higher sensitivity (77.8 %) while maintaining a high NPV (93.1 %). CONCLUSION Combining AI and PSAD has the potential to enhance biopsy decision-making for PI-RADS 3 lesions by minimizing missed csPCa occurrences and reducing unnecessary biopsies.
Collapse
Affiliation(s)
- Omer Tarik Esengur
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Enis C Yilmaz
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Kutsev B Ozyoruk
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Alex Chen
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Nathan S Lay
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - David G Gelikman
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Maria J Merino
- Laboratory of Pathology, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Sandeep Gurram
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Bradford J Wood
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA; Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, MD, USA
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Stephanie A Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Peter A Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA.
| |
Collapse
|
9
|
Wang L, Sun R, Wei X, Chen J, Jia S, Wu G, Nie S. Enhancing prostate cancer segmentation on multiparametric magnetic resonance imaging with background information and gland masks. Med Phys 2024; 51:8179-8191. [PMID: 39134025 DOI: 10.1002/mp.17346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Revised: 06/24/2024] [Accepted: 07/15/2024] [Indexed: 11/03/2024] Open
Abstract
BACKGROUND The landscape of prostate cancer (PCa) segmentation within multiparametric magnetic resonance imaging (MP-MRI) was fragmented, with a noticeable lack of consensus on incorporating background details, culminating in inconsistent segmentation outputs. Given the complex and heterogeneous nature of PCa, conventional imaging segmentation algorithms frequently fell short, prompting the need for specialized research and refinement. PURPOSE This study sought to dissect and compare various segmentation methods, emphasizing the role of background information and gland masks in achieving superior PCa segmentation. The goal was to systematically refine segmentation networks to ascertain the most efficacious approach. METHODS A cohort of 232 patients (ages 61-73 years old, prostate-specific antigen: 3.4-45.6 ng/mL), who had undergone MP-MRI followed by prostate biopsies, was analyzed. An advanced segmentation model, namely Attention-Unet, which combines U-Net with attention gates, was employed for training and validation. The model was further enhanced through a multiscale module and a composite loss function, culminating in the development of Matt-Unet. Performance metrics included Dice Similarity Coefficient (DSC) and accuracy (ACC). RESULTS The Matt-Unet model, which integrated background information and gland masks, outperformed the baseline U-Net model using raw images, yielding significant gains (DSC: 0.7215 vs. 0.6592; ACC: 0.8899 vs. 0.8601, p < 0.001). CONCLUSION A targeted and practical PCa segmentation method was designed, which could significantly improve PCa segmentation on MP-MRI by combining background information and gland masks. The Matt-Unet model showcased promising capabilities for effectively delineating PCa, enhancing the precision of MP-MRI analysis.
Collapse
Affiliation(s)
- Lei Wang
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Rong Sun
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| | - Xiaobin Wei
- Department of Urology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Jie Chen
- Department of Radiology, Huangpu Branch, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shouqiang Jia
- Jinan People's Hospital Affiliated to Shandong First Medical University, Shandong, China
| | - Guangyu Wu
- Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China
| | - Shengdong Nie
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China
| |
Collapse
|
10
|
Yilmaz EC, Harmon SA, Law YM, Huang EP, Belue MJ, Lin Y, Gelikman DG, Ozyoruk KB, Yang D, Xu Z, Tetreault J, Xu D, Hazen LA, Garcia C, Lay NS, Eclarinal P, Toubaji A, Merino MJ, Wood BJ, Gurram S, Choyke PL, Pinto PA, Turkbey B. External Validation of a Previously Developed Deep Learning-based Prostate Lesion Detection Algorithm on Paired External and In-House Biparametric MRI Scans. Radiol Imaging Cancer 2024; 6:e240050. [PMID: 39400232 PMCID: PMC11615635 DOI: 10.1148/rycan.240050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Revised: 07/01/2024] [Accepted: 09/09/2024] [Indexed: 10/15/2024]
Abstract
Purpose To evaluate the performance of an artificial intelligence (AI) model in detecting overall and clinically significant prostate cancer (csPCa)-positive lesions on paired external and in-house biparametric MRI (bpMRI) scans and assess performance differences between each dataset. Materials and Methods This single-center retrospective study included patients who underwent prostate MRI at an external institution and were rescanned at the authors' institution between May 2015 and May 2022. A genitourinary radiologist performed prospective readouts on in-house MRI scans following the Prostate Imaging Reporting and Data System (PI-RADS) version 2.0 or 2.1 and retrospective image quality assessments for all scans. A subgroup of patients underwent an MRI/US fusion-guided biopsy. A bpMRI-based lesion detection AI model previously developed using a completely separate dataset was tested on both MRI datasets. Detection rates were compared between external and in-house datasets with use of the paired comparison permutation tests. Factors associated with AI detection performance were assessed using multivariable generalized mixed-effects models, incorporating features selected through forward stepwise regression based on the Akaike information criterion. Results The study included 201 male patients (median age, 66 years [IQR, 62-70 years]; prostate-specific antigen density, 0.14 ng/mL2 [IQR, 0.10-0.22 ng/mL2]) with a median interval between external and in-house MRI scans of 182 days (IQR, 97-383 days). For intraprostatic lesions, AI detected 39.7% (149 of 375) on external and 56.0% (210 of 375) on in-house MRI scans (P < .001). For csPCa-positive lesions, AI detected 61% (54 of 89) on external and 79% (70 of 89) on in-house MRI scans (P < .001). On external MRI scans, better overall lesion detection was associated with a higher PI-RADS score (odds ratio [OR] = 1.57; P = .005), larger lesion diameter (OR = 3.96; P < .001), better diffusion-weighted MRI quality (OR = 1.53; P = .02), and fewer lesions at MRI (OR = 0.78; P = .045). Better csPCa detection was associated with a shorter MRI interval between external and in-house scans (OR = 0.58; P = .03) and larger lesion size (OR = 10.19; P < .001). Conclusion The AI model exhibited modest performance in identifying both overall and csPCa-positive lesions on external bpMRI scans. Keywords: MR Imaging, Urinary, Prostate Supplemental material is available for this article. © RSNA, 2024.
Collapse
Affiliation(s)
- Enis C. Yilmaz
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Stephanie A. Harmon
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Yan Mee Law
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Erich P. Huang
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Mason J. Belue
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Yue Lin
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - David G. Gelikman
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Kutsev B. Ozyoruk
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Dong Yang
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Ziyue Xu
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Jesse Tetreault
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Daguang Xu
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Lindsey A. Hazen
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Charisse Garcia
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Nathan S. Lay
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Philip Eclarinal
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Antoun Toubaji
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Maria J. Merino
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Bradford J. Wood
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Sandeep Gurram
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Peter L. Choyke
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Peter A. Pinto
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| | - Baris Turkbey
- From the Molecular Imaging Branch (E.C.Y., S.A.H., M.J.B., Y.L.,
D.G.G., K.B.O., N.S.L., P.E., P.L.C., B.T.), Biometric Research Program,
Division of Cancer Treatment and Diagnosis (E.P.H.), Center for Interventional
Oncology (L.A.H., C.G., B.J.W.), Department of Radiology, Clinical Center
(L.A.H., C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic
Oncology Branch (S.G., P.A.P.), National Cancer Institute, National Institutes
of Health, 10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892;
Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.); and
NVIDIA Corporation, Santa Clara, Calif (D.Y., Z.X., J.T., D.X.)
| |
Collapse
|
11
|
Patel KR, van der Heide UA, Kerkmeijer LGW, Schoots IG, Turkbey B, Citrin DE, Hall WA. Target Volume Optimization for Localized Prostate Cancer. Pract Radiat Oncol 2024; 14:522-540. [PMID: 39019208 PMCID: PMC11531394 DOI: 10.1016/j.prro.2024.06.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 06/17/2024] [Accepted: 06/26/2024] [Indexed: 07/19/2024]
Abstract
PURPOSE To provide a comprehensive review of the means by which to optimize target volume definition for the purposes of treatment planning for patients with intact prostate cancer with a specific emphasis on focal boost volume definition. METHODS Here we conduct a narrative review of the available literature summarizing the current state of knowledge on optimizing target volume definition for the treatment of localized prostate cancer. RESULTS Historically, the treatment of prostate cancer included a uniform prescription dose administered to the entire prostate with or without coverage of all or part of the seminal vesicles. The development of prostate magnetic resonance imaging (MRI) and positron emission tomography (PET) using prostate-specific radiotracers has ushered in an era in which radiation oncologists are able to localize and focally dose-escalate high-risk volumes in the prostate gland. Recent phase 3 data has demonstrated that incorporating focal dose escalation to high-risk subvolumes of the prostate improves biochemical control without significantly increasing toxicity. Still, several fundamental questions remain regarding the optimal target volume definition and prescription strategy to implement this technique. Given the remaining uncertainty, a knowledge of the pathological correlates of radiographic findings and the anatomic patterns of tumor spread may help inform clinical judgement for the definition of clinical target volumes. CONCLUSION Advanced imaging has the ability to improve outcomes for patients with prostate cancer in multiple ways, including by enabling focal dose escalation to high-risk subvolumes. However, many questions remain regarding the optimal target volume definition and prescription strategy to implement this practice, and key knowledge gaps remain. A detailed understanding of the pathological correlates of radiographic findings and the patterns of local tumor spread may help inform clinical judgement for target volume definition given the current state of uncertainty.
Collapse
Affiliation(s)
- Krishnan R Patel
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland.
| | - Uulke A van der Heide
- Department of Radiation Oncology, The Netherlands Cancer Institute (NKI-AVL), Amsterdam, The Netherlands
| | - Linda G W Kerkmeijer
- Department of Radiation Oncology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Ivo G Schoots
- Department of Radiation Oncology, The Netherlands Cancer Institute (NKI-AVL), Amsterdam, The Netherlands
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Deborah E Citrin
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - William A Hall
- Froedtert and the Medical College of Wisconsin, Milwaukee, Wisconsin
| |
Collapse
|
12
|
Ozyoruk KB, Harmon SA, Lay NS, Yilmaz EC, Bagci U, Citrin DE, Wood BJ, Pinto PA, Choyke PL, Turkbey B. AI-ADC: Channel and Spatial Attention-Based Contrastive Learning to Generate ADC Maps from T2W MRI for Prostate Cancer Detection. J Pers Med 2024; 14:1047. [PMID: 39452554 PMCID: PMC11508265 DOI: 10.3390/jpm14101047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 09/28/2024] [Accepted: 10/06/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND/OBJECTIVES Apparent Diffusion Coefficient (ADC) maps in prostate MRI can reveal tumor characteristics, but their accuracy can be compromised by artifacts related with patient motion or rectal gas associated distortions. To address these challenges, we propose a novel approach that utilizes a Generative Adversarial Network to synthesize ADC maps from T2-weighted magnetic resonance images (T2W MRI). METHODS By leveraging contrastive learning, our model accurately maps axial T2W MRI to ADC maps within the cropped region of the prostate organ boundary, capturing subtle variations and intricate structural details by learning similar and dissimilar pairs from two imaging modalities. We trained our model on a comprehensive dataset of unpaired T2-weighted images and ADC maps from 506 patients. In evaluating our model, named AI-ADC, we compared it against three state-of-the-art methods: CycleGAN, CUT, and StyTr2. RESULTS Our model demonstrated a higher mean Structural Similarity Index (SSIM) of 0.863 on a test dataset of 3240 2D MRI slices from 195 patients, compared to values of 0.855, 0.797, and 0.824 for CycleGAN, CUT, and StyTr2, respectively. Similarly, our model achieved a significantly lower Fréchet Inception Distance (FID) value of 31.992, compared to values of 43.458, 179.983, and 58.784 for the other three models, indicating its superior performance in generating ADC maps. Furthermore, we evaluated our model on 147 patients from the publicly available ProstateX dataset, where it demonstrated a higher SSIM of 0.647 and a lower FID of 113.876 compared to the other three models. CONCLUSIONS These results highlight the efficacy of our proposed model in generating ADC maps from T2W MRI, showcasing its potential for enhancing clinical diagnostics and radiological workflows.
Collapse
Affiliation(s)
- Kutsev Bengisu Ozyoruk
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| | - Stephanie A. Harmon
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| | - Nathan S. Lay
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| | - Enis C. Yilmaz
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| | - Ulas Bagci
- Radiology and Biomedical Engineering Department, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA;
| | - Deborah E. Citrin
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20814, USA;
| | - Bradford J. Wood
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, MD 20814, USA;
- Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, MD 20814, USA
| | - Peter A. Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20814, USA;
| | - Peter L. Choyke
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| | - Baris Turkbey
- Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA; (K.B.O.); (S.A.H.); (N.S.L.); (E.C.Y.); (P.L.C.)
| |
Collapse
|
13
|
Simon BD, Merriman KM, Harmon SA, Tetreault J, Yilmaz EC, Blake Z, Merino MJ, An JY, Marko J, Law YM, Gurram S, Wood BJ, Choyke PL, Pinto PA, Turkbey B. Automated Detection and Grading of Extraprostatic Extension of Prostate Cancer at MRI via Cascaded Deep Learning and Random Forest Classification. Acad Radiol 2024; 31:4096-4106. [PMID: 38670874 PMCID: PMC11490411 DOI: 10.1016/j.acra.2024.04.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 04/03/2024] [Accepted: 04/10/2024] [Indexed: 04/28/2024]
Abstract
RATIONALE AND OBJECTIVES Extraprostatic extension (EPE) is well established as a significant predictor of prostate cancer aggression and recurrence. Accurate EPE assessment prior to radical prostatectomy can impact surgical approach. We aimed to utilize a deep learning-based AI workflow for automated EPE grading from prostate T2W MRI, ADC map, and High B DWI. MATERIAL AND METHODS An expert genitourinary radiologist conducted prospective clinical assessments of MRI scans for 634 patients and assigned risk for EPE using a grading technique. The training set and held-out independent test set consisted of 507 patients and 127 patients, respectively. Existing deep-learning AI models for prostate organ and lesion segmentation were leveraged to extract area and distance features for random forest classification models. Model performance was evaluated using balanced accuracy, ROC AUCs for each EPE grade, as well as sensitivity, specificity, and accuracy compared to EPE on histopathology. RESULTS A balanced accuracy score of .390 ± 0.078 was achieved using a lesion detection probability threshold of 0.45 and distance features. Using the test set, ROC AUCs for AI-assigned EPE grades 0-3 were 0.70, 0.65, 0.68, and 0.55 respectively. When using EPE≥ 1 as the threshold for positive EPE, the model achieved a sensitivity of 0.67, specificity of 0.73, and accuracy of 0.72 compared to radiologist sensitivity of 0.81, specificity of 0.62, and accuracy of 0.66 using histopathology as the ground truth. CONCLUSION Our AI workflow for assigning imaging-based EPE grades achieves an accuracy for predicting histologic EPE approaching that of physicians. This automated workflow has the potential to enhance physician decision-making for assessing the risk of EPE in patients undergoing treatment for prostate cancer due to its consistency and automation.
Collapse
Affiliation(s)
- Benjamin D Simon
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.); Institute of Biomedical Engineering, Department Engineering Science, University of Oxford, UK (B.D.S.)
| | - Katie M Merriman
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.)
| | - Stephanie A Harmon
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.)
| | | | - Enis C Yilmaz
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.)
| | - Zoë Blake
- Urology Oncology Branch, NCI, NIH, Bethesda, Maryland, USA (Z.B., S.G., P.A.P.)
| | - Maria J Merino
- Laboratory of Pathology, NCI, NIH, Bethesda, Maryland, USA (M.J.M.)
| | - Julie Y An
- Department of Radiology, University of California, San Diego, California, USA (J.Y.A.)
| | - Jamie Marko
- Department of Radiology, Johns Hopkins University, Baltimore, Maryland, USA (J.M.)
| | - Yan Mee Law
- Department of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Sandeep Gurram
- Urology Oncology Branch, NCI, NIH, Bethesda, Maryland, USA (Z.B., S.G., P.A.P.)
| | - Bradford J Wood
- Center for Interventional Oncology, NCI, NIH, Bethesda, Maryland, USA (B.J.W.); Department of Radiology, Clinical Center, NIH, Bethesda, Maryland, USA (B.J.W.)
| | - Peter L Choyke
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.)
| | - Peter A Pinto
- Urology Oncology Branch, NCI, NIH, Bethesda, Maryland, USA (Z.B., S.G., P.A.P.)
| | - Baris Turkbey
- Molecular Imaging Branch, NCI, NIH, Bethesda, Maryland, USA (B.D.S., K.M.M., S.A.H., E.C.Y., P.L.C., B.T.).
| |
Collapse
|
14
|
Tsuboyama T, Yanagawa M, Fujioka T, Fujita S, Ueda D, Ito R, Yamada A, Fushimi Y, Tatsugami F, Nakaura T, Nozaki T, Kamagata K, Matsui Y, Hirata K, Fujima N, Kawamura M, Naganawa S. Recent trends in AI applications for pelvic MRI: a comprehensive review. LA RADIOLOGIA MEDICA 2024; 129:1275-1287. [PMID: 39096356 DOI: 10.1007/s11547-024-01861-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 07/25/2024] [Indexed: 08/05/2024]
Abstract
Magnetic resonance imaging (MRI) is an essential tool for evaluating pelvic disorders affecting the prostate, bladder, uterus, ovaries, and/or rectum. Since the diagnostic pathway of pelvic MRI can involve various complex procedures depending on the affected organ, the Reporting and Data System (RADS) is used to standardize image acquisition and interpretation. Artificial intelligence (AI), which encompasses machine learning and deep learning algorithms, has been integrated into both pelvic MRI and the RADS, particularly for prostate MRI. This review outlines recent developments in the use of AI in various stages of the pelvic MRI diagnostic pathway, including image acquisition, image reconstruction, organ and lesion segmentation, lesion detection and classification, and risk stratification, with special emphasis on recent trends in multi-center studies, which can help to improve the generalizability of AI.
Collapse
Affiliation(s)
- Takahiro Tsuboyama
- Department of Radiology, Kobe University Graduate School of Medicine, 7-5-2 Kusunoki-cho, Chuo-ku, Kobe-City, Hyogo, 650-0017, Japan.
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, Suita-City, Osaka, 565-0871, Japan
| | - Tomoyuki Fujioka
- Department of Diagnostic Radiology, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8519, Japan
| | - Shohei Fujita
- Department of Radiology, Graduate School of Medicine and Faculty of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Daiju Ueda
- Department of Artificial Intelligence, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahi-machi, Abeno-ku, Osaka, 545-8585, Japan
| | - Rintaro Ito
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Akira Yamada
- Medical Data Science Course, Shinshu University School of Medicine, 3-1-1 Asahi, Matsumoto, Nagano, 390-8621, Japan
| | - Yasutaka Fushimi
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, 54 Shogoin Kawaharacho, Sakyoku, Kyoto, 606-8507, Japan
| | - Fuminari Tatsugami
- Department of Diagnostic Radiology, Hiroshima University, 1-2-3 Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Takeshi Nakaura
- Department of Diagnostic Radiology, Kumamoto University Graduate School of Medicine, 1-1-1 Honjo Chuo-ku, Kumamoto, 860-8556, Japan
| | - Taiki Nozaki
- Department of Radiology, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-0016, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-ku, Tokyo, 113-8421, Japan
| | - Yusuke Matsui
- Department of Radiology, Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, 2-5-1 Shikata-cho, Kita-ku, Okayama, 700-8558, Japan
| | - Kenji Hirata
- Department of Diagnostic Imaging, Graduate School of Medicine, Hokkaido University, Kita 15 Nishi 7, Kita-ku, Sapporo, Hokkaido, 060-8648, Japan
| | - Noriyuki Fujima
- Department of Diagnostic and Interventional Radiology, Hokkaido University Hospital, N15, W5, Kita-ku, Sapporo, 060-8638, Japan
| | - Mariko Kawamura
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, 65 Tsurumai-cho, Showa-ku, Nagoya, Aichi, 466-8550, Japan
| |
Collapse
|
15
|
Kou W, Rey C, Marshall H, Chiu B. Interactive Cascaded Network for Prostate Cancer Segmentation from Multimodality MRI with Automated Quality Assessment. Bioengineering (Basel) 2024; 11:796. [PMID: 39199754 PMCID: PMC11351867 DOI: 10.3390/bioengineering11080796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Revised: 07/17/2024] [Accepted: 07/30/2024] [Indexed: 09/01/2024] Open
Abstract
The accurate segmentation of prostate cancer (PCa) from multiparametric MRI is crucial in clinical practice for guiding biopsy and treatment planning. Existing automated methods often lack the necessary accuracy and robustness in localizing PCa, whereas interactive segmentation methods, although more accurate, require user intervention on each input image, thereby limiting the cost-effectiveness of the segmentation workflow. Our innovative framework addresses the limitations of current methods by combining a coarse segmentation network, a rejection network, and an interactive deep network known as Segment Anything Model (SAM). The coarse segmentation network automatically generates initial segmentation results, which are evaluated by the rejection network to estimate their quality. Low-quality results are flagged for user interaction, with the user providing a region of interest (ROI) enclosing the lesions, whereas for high-quality results, ROIs were cropped from the automatic segmentation. Both manually and automatically defined ROIs are fed into SAM to produce the final fine segmentation. This approach significantly reduces the annotation burden and achieves substantial improvements by flagging approximately 20% of the images with the lowest quality scores for manual annotation. With only half of the images manually annotated, the final segmentation accuracy is statistically indistinguishable from that achieved using full manual annotation. Although this paper focuses on prostate lesion segmentation from multimodality MRI, the framework can be adapted to other medical image segmentation applications to improve segmentation efficiency while maintaining high accuracy standards.
Collapse
Affiliation(s)
- Weixuan Kou
- Department of Electrical Engineering, City University of Hong Kong, Hong Kong;
| | - Cristian Rey
- Schulich School of Medicine & Dentistry, Western University, London, ON N6A 5C1, Canada;
| | - Harry Marshall
- Department of Radiology, Vanderbilt University Medical Center, Nashville, TN 37232, USA;
| | - Bernard Chiu
- Department of Physics & Computer Science, Wilfrid Laurier University, Waterloo, ON N2L 3C5, Canada
| |
Collapse
|
16
|
Gelikman DG, Harmon SA, Kenigsberg AP, Law YM, Yilmaz EC, Merino MJ, Wood BJ, Choyke PL, Pinto PA, Turkbey B. Evaluating a deep learning AI algorithm for detecting residual prostate cancer on MRI after focal therapy. BJUI COMPASS 2024; 5:665-667. [PMID: 39022660 PMCID: PMC11250150 DOI: 10.1002/bco2.373] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 04/22/2024] [Indexed: 07/20/2024] Open
Affiliation(s)
- David G. Gelikman
- Molecular Imaging Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Stephanie A. Harmon
- Molecular Imaging Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Alexander P. Kenigsberg
- Urologic Oncology Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Yan Mee Law
- Department of RadiologySingapore General HospitalSingapore
| | - Enis C. Yilmaz
- Molecular Imaging Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Maria J. Merino
- Laboratory of Pathology, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Bradford J. Wood
- Center for Interventional Oncology, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
- Department of Radiology, Clinical CenterNational Institutes of HealthBethesdaMarylandUSA
| | - Peter L. Choyke
- Molecular Imaging Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Peter A. Pinto
- Urologic Oncology Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer InstituteNational Institutes of HealthBethesdaMarylandUSA
| |
Collapse
|
17
|
Rajagopal A, Westphalen AC, Velarde N, Simko JP, Nguyen H, Hope TA, Larson PEZ, Magudia K. Mixed Supervision of Histopathology Improves Prostate Cancer Classification From MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2610-2622. [PMID: 38547000 PMCID: PMC11361281 DOI: 10.1109/tmi.2024.3382909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/02/2024]
Abstract
Non-invasive prostate cancer classification from MRI has the potential to revolutionize patient care by providing early detection of clinically significant disease, but has thus far shown limited positive predictive value. To address this, we present a image-based deep learning method to predict clinically significant prostate cancer from screening MRI in patients that subsequently underwent biopsy with results ranging from benign pathology to the highest grade tumors. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classification performance despite the cost of reduced concordance with image-based segmentation. Where prior approaches have utilized pathology results as ground truth derived from targeted biopsies and whole-mount prostatectomy to strongly supervise the localization of clinically significant cancer, our approach also utilizes weak supervision signals extracted from nontargeted systematic biopsies with regional localization to improve overall performance. Our key innovation is performing regression by distribution rather than simply by value, enabling use of additional pathology findings traditionally ignored by deep learning strategies. We evaluated our model on a dataset of 973 (testing n=198 ) multi-parametric prostate MRI exams collected at UCSF from 2016-2019 followed by MRI/ultrasound fusion (targeted) biopsy and systematic (nontargeted) biopsy of the prostate gland, demonstrating that deep networks trained with mixed supervision of histopathology can feasibly exceed the performance of the Prostate Imaging-Reporting and Data System (PI-RADS) clinical standard for prostate MRI interpretation (71.6% vs 66.7% balanced accuracy and 0.724 vs 0.716 AUC).
Collapse
|
18
|
Riaz IB, Harmon S, Chen Z, Naqvi SAA, Cheng L. Applications of Artificial Intelligence in Prostate Cancer Care: A Path to Enhanced Efficiency and Outcomes. Am Soc Clin Oncol Educ Book 2024; 44:e438516. [PMID: 38935882 DOI: 10.1200/edbk_438516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Abstract
The landscape of prostate cancer care has rapidly evolved. We have transitioned from the use of conventional imaging, radical surgeries, and single-agent androgen deprivation therapy to an era of advanced imaging, precision diagnostics, genomics, and targeted treatment options. Concurrently, the emergence of large language models (LLMs) has dramatically transformed the paradigm for artificial intelligence (AI). This convergence of advancements in prostate cancer management and AI provides a compelling rationale to comprehensively review the current state of AI applications in prostate cancer care. Here, we review the advancements in AI-driven applications across the continuum of the journey of a patient with prostate cancer from early interception to survivorship care. We subsequently discuss the role of AI in prostate cancer drug discovery, clinical trials, and clinical practice guidelines. In the localized disease setting, deep learning models demonstrated impressive performance in detecting and grading prostate cancer using imaging and pathology data. For biochemically recurrent diseases, machine learning approaches are being tested for improved risk stratification and treatment decisions. In advanced prostate cancer, deep learning can potentially improve prognostication and assist in clinical decision making. Furthermore, LLMs are poised to revolutionize information summarization and extraction, clinical trial design and operations, drug development, evidence synthesis, and clinical practice guidelines. Synergistic integration of multimodal data integration and human-AI integration are emerging as a key strategy to unlock the full potential of AI in prostate cancer care.
Collapse
Affiliation(s)
- Irbaz Bin Riaz
- Division of Hematology and Oncology, Department of Internal Medicine, Mayo Clinic, Phoenix, AZ
- Department of AI and Informatics, Mayo Clinic, Rochester, MN
| | - Stephanie Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD
| | - Zhijun Chen
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD
| | | | - Liang Cheng
- Department of Pathology and Laboratory Medicine, Department of Surgery (Urology), Brown University Warren Alpert Medical School, Lifespan Health, and the Legorreta Cancer Center at Brown University, Providence, RI
| |
Collapse
|
19
|
Lin Y, Yilmaz EC, Belue MJ, Harmon SA, Tetreault J, Phelps TE, Merriman KM, Hazen L, Garcia C, Yang D, Xu Z, Lay NS, Toubaji A, Merino MJ, Xu D, Law YM, Gurram S, Wood BJ, Choyke PL, Pinto PA, Turkbey B, Atzen S. Evaluation of a Cascaded Deep Learning-based Algorithm for Prostate Lesion Detection at Biparametric MRI. Radiology 2024; 311:e230750. [PMID: 38713024 PMCID: PMC11140533 DOI: 10.1148/radiol.230750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 01/24/2024] [Accepted: 03/18/2024] [Indexed: 05/08/2024]
Abstract
Background Multiparametric MRI (mpMRI) improves prostate cancer (PCa) detection compared with systematic biopsy, but its interpretation is prone to interreader variation, which results in performance inconsistency. Artificial intelligence (AI) models can assist in mpMRI interpretation, but large training data sets and extensive model testing are required. Purpose To evaluate a biparametric MRI AI algorithm for intraprostatic lesion detection and segmentation and to compare its performance with radiologist readings and biopsy results. Materials and Methods This secondary analysis of a prospective registry included consecutive patients with suspected or known PCa who underwent mpMRI, US-guided systematic biopsy, or combined systematic and MRI/US fusion-guided biopsy between April 2019 and September 2022. All lesions were prospectively evaluated using Prostate Imaging Reporting and Data System version 2.1. The lesion- and participant-level performance of a previously developed cascaded deep learning algorithm was compared with histopathologic outcomes and radiologist readings using sensitivity, positive predictive value (PPV), and Dice similarity coefficient (DSC). Results A total of 658 male participants (median age, 67 years [IQR, 61-71 years]) with 1029 MRI-visible lesions were included. At histopathologic analysis, 45% (294 of 658) of participants had lesions of International Society of Urological Pathology (ISUP) grade group (GG) 2 or higher. The algorithm identified 96% (282 of 294; 95% CI: 94%, 98%) of all participants with clinically significant PCa, whereas the radiologist identified 98% (287 of 294; 95% CI: 96%, 99%; P = .23). The algorithm identified 84% (103 of 122), 96% (152 of 159), 96% (47 of 49), 95% (38 of 40), and 98% (45 of 46) of participants with ISUP GG 1, 2, 3, 4, and 5 lesions, respectively. In the lesion-level analysis using radiologist ground truth, the detection sensitivity was 55% (569 of 1029; 95% CI: 52%, 58%), and the PPV was 57% (535 of 934; 95% CI: 54%, 61%). The mean number of false-positive lesions per participant was 0.61 (range, 0-3). The lesion segmentation DSC was 0.29. Conclusion The AI algorithm detected cancer-suspicious lesions on biparametric MRI scans with a performance comparable to that of an experienced radiologist. Moreover, the algorithm reliably predicted clinically significant lesions at histopathologic examination. ClinicalTrials.gov Identifier: NCT03354416 © RSNA, 2024 Supplemental material is available for this article.
Collapse
Affiliation(s)
- Yue Lin
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Enis C. Yilmaz
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Mason J. Belue
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Stephanie A. Harmon
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Jesse Tetreault
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Tim E. Phelps
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Katie M. Merriman
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Lindsey Hazen
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Charisse Garcia
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Dong Yang
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Ziyue Xu
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Nathan S. Lay
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Antoun Toubaji
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Maria J. Merino
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Daguang Xu
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Yan Mee Law
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Sandeep Gurram
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Bradford J. Wood
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Peter L. Choyke
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Peter A. Pinto
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Baris Turkbey
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| | - Sarah Atzen
- From the Molecular Imaging Branch (Y.L., E.C.Y., M.J.B., S.A.H.,
T.E.P., K.M.M., N.S.L., P.L.C., B.T.), Center for Interventional Oncology (L.H.,
C.G., B.J.W.), Laboratory of Pathology (A.T., M.J.M.), and Urologic Oncology
Branch (S.G., P.A.P.), National Cancer Institute, National Institutes of Health,
10 Center Dr, MSC 1182, Bldg 10, Rm B3B85, Bethesda, MD 20892; NVIDIA, Santa
Clara, Calif (J.T., D.Y., Z.X., D.X.); Department of Radiology, Clinical Center,
National Institutes of Health, Bethesda, Md (L.H., C.G., B.J.W.); and Department
of Radiology, Singapore General Hospital, Singapore (Y.M.L.)
| |
Collapse
|
20
|
Yan W, Chiu B, Shen Z, Yang Q, Syer T, Min Z, Punwani S, Emberton M, Atkinson D, Barratt DC, Hu Y. Combiner and HyperCombiner networks: Rules to combine multimodality MR images for prostate cancer localisation. Med Image Anal 2024; 91:103030. [PMID: 37995627 DOI: 10.1016/j.media.2023.103030] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 09/22/2023] [Accepted: 11/13/2023] [Indexed: 11/25/2023]
Abstract
One of the distinct characteristics of radiologists reading multiparametric prostate MR scans, using reporting systems like PI-RADS v2.1, is to score individual types of MR modalities, including T2-weighted, diffusion-weighted, and dynamic contrast-enhanced, and then combine these image-modality-specific scores using standardised decision rules to predict the likelihood of clinically significant cancer. This work aims to demonstrate that it is feasible for low-dimensional parametric models to model such decision rules in the proposed Combiner networks, without compromising the accuracy of predicting radiologic labels. First, we demonstrate that either a linear mixture model or a nonlinear stacking model is sufficient to model PI-RADS decision rules for localising prostate cancer. Second, parameters of these combining models are proposed as hyperparameters, weighing independent representations of individual image modalities in the Combiner network training, as opposed to end-to-end modality ensemble. A HyperCombiner network is developed to train a single image segmentation network that can be conditioned on these hyperparameters during inference for much-improved efficiency. Experimental results based on 751 cases from 651 patients compare the proposed rule-modelling approaches with other commonly-adopted end-to-end networks, in this downstream application of automating radiologist labelling on multiparametric MR. By acquiring and interpreting the modality combining rules, specifically the linear-weights or odds ratios associated with individual image modalities, three clinical applications are quantitatively presented and contextualised in the prostate cancer segmentation application, including modality availability assessment, importance quantification and rule discovery.
Collapse
Affiliation(s)
- Wen Yan
- Department of Electrical Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Hong Kong China; Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| | - Bernard Chiu
- Department of Electrical Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Hong Kong China; Department of Physics & Computer Science, Wilfrid Laurier University, 75 University Avenue West Waterloo, Ontario N2L 3C5, Canada.
| | - Ziyi Shen
- Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| | - Qianye Yang
- Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| | - Tom Syer
- Centre for Medical Imaging, Division of Medicine, University College London, London W1 W 7TS, UK.
| | - Zhe Min
- Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| | - Shonit Punwani
- Centre for Medical Imaging, Division of Medicine, University College London, London W1 W 7TS, UK.
| | - Mark Emberton
- Division of Surgery & Interventional Science, University College London, Gower St, WC1E 6BT, London, UK.
| | - David Atkinson
- Centre for Medical Imaging, Division of Medicine, University College London, London W1 W 7TS, UK.
| | - Dean C Barratt
- Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| | - Yipeng Hu
- Centre for Medical Image Computing; Department of Medical Physics & Biomedical Engineering; Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, Gower St, WC1E 6BT, London, UK.
| |
Collapse
|
21
|
Bugeja JM, Mehawed G, Roberts MJ, Rukin N, Dowling J, Murray R. Prostate volume analysis in image registration for prostate cancer care: a verification study. Phys Eng Sci Med 2023; 46:1791-1802. [PMID: 37819450 DOI: 10.1007/s13246-023-01342-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 09/26/2023] [Indexed: 10/13/2023]
Abstract
Combined magnetic resonance imaging (MRI) and positron emission tomography/computed tomography (PET/CT) may enhance diagnosis, aid surgical planning and intra-operative orientation for prostate biopsy and radical prostatectomy. Although PET-MRI may provide these benefits, PET-MRI machines are not widely available. Image fusion of Prostate specific membrane antigen PET/CT and MRI acquired separately may be a suitable clinical alternative. This study compares CT-MR registration algorithms for urological prostate cancer care. Paired whole-pelvis MR and CT scan data were used (n = 20). A manual prostate CTV contour was performed independently on each patients MR and CT image. A semi-automated rigid-, automated rigid- and automated non-rigid registration technique was applied to align the MR and CT data. Dice Similarity Index (DSI), 95% Hausdorff distance (95%HD) and average surface distance (ASD) measures were used to assess the closeness of the manual and registered contours. The automated non-rigid approach had a significantly improved performance compared to the automated rigid- and semi-automated rigid-registration, having better average scores and decreased spread for the DSI, 95%HD and ASD (all p < 0.001). Additionally, the automated rigid approach had similar significantly improved performance compared to the semi-automated rigid registration across all accuracy metrics observed (all p < 0.001). Overall, all registration techniques studied here demonstrated sufficient accuracy for exploring their clinical use. While the fully automated non-rigid registration algorithm in the present study provided the most accurate registration, the semi-automated rigid registration is a quick, feasible, and accessible method to perform image registration for prostate cancer care by urologists and radiation oncologists now.
Collapse
Affiliation(s)
- Jessica M Bugeja
- Australian e-Health Research Centre, Commonwealth Scientific and Industrial Research Organisation, Health and Biosecurity, Herston, Australia.
| | - Georges Mehawed
- Herston Biofabrication Institute, Urology Program, Herston, Australia
- Urology Department, Redcliffe Hospital, Redcliffe, Australia
- School of Medicine, The University of Queensland, Brisbane, Australia
- Australian Institute of Bioengineering and Nanotechnology, The University of Queensland, Brisbane, Australia
| | - Matthew J Roberts
- Herston Biofabrication Institute, Urology Program, Herston, Australia
- Urology Department, Redcliffe Hospital, Redcliffe, Australia
- School of Medicine, The University of Queensland, Brisbane, Australia
- Urology Department, Royal Brisbane and Women's Hospital, Herston, Australia
- University of Queensland, University of Queensland Centre for Clinical Research, Herston, Australia
| | - Nicholas Rukin
- Herston Biofabrication Institute, Urology Program, Herston, Australia
- Urology Department, Redcliffe Hospital, Redcliffe, Australia
- School of Medicine, The University of Queensland, Brisbane, Australia
| | - Jason Dowling
- Australian e-Health Research Centre, Commonwealth Scientific and Industrial Research Organisation, Health and Biosecurity, Herston, Australia
- School of Information Technology and Electrical Engineering, The University of Queensland, Brisbane, Australia
| | - Rebecca Murray
- Herston Biofabrication Institute, Urology Program, Herston, Australia
- Urology Department, Redcliffe Hospital, Redcliffe, Australia
- Australian Institute of Bioengineering and Nanotechnology, The University of Queensland, Brisbane, Australia
| |
Collapse
|
22
|
Yilmaz EC, Harmon SA, Belue MJ, Merriman KM, Phelps TE, Lin Y, Garcia C, Hazen L, Patel KR, Merino MJ, Wood BJ, Choyke PL, Pinto PA, Citrin DE, Turkbey B. Evaluation of a Deep Learning-based Algorithm for Post-Radiotherapy Prostate Cancer Local Recurrence Detection Using Biparametric MRI. Eur J Radiol 2023; 168:111095. [PMID: 37717420 PMCID: PMC10615746 DOI: 10.1016/j.ejrad.2023.111095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 09/04/2023] [Accepted: 09/12/2023] [Indexed: 09/19/2023]
Abstract
OBJECTIVE To evaluate a biparametric MRI (bpMRI)-based artificial intelligence (AI) model for the detection of local prostate cancer (PCa) recurrence in patients with radiotherapy history. MATERIALS AND METHODS This study included post-radiotherapy patients undergoing multiparametric MRI and subsequent MRI/US fusion-guided and/or systematic biopsy. Histopathology results were used as ground truth. The recurrent cancer detection sensitivity of a bpMRI-based AI model, which was developed on a large dataset to primarily identify lesions in treatment-naïve patients, was compared to a prospective radiologist assessment using the Wald test. Subanalysis was conducted on patients stratified by the treatment modality (external beam radiation treatment [EBRT] and brachytherapy) and the prostate volume quartiles. RESULTS Of the 62 patients included (median age = 70 years; median PSA = 3.51 ng/ml; median prostate volume = 27.55 ml), 56 recurrent PCa foci were identified within 46 patients. The AI model detected 40 lesions in 35 patients. The AI model performance was lower than the prospective radiology interpretation (Rad) on a patient-(AI: 76.1% vs. Rad: 91.3%, p = 0.02) and lesion-level (AI: 71.4% vs. Rad: 87.5%, p = 0.01). The mean number of false positives per patient was 0.35 (range: 0-2). The AI model performance was higher in EBRT group both on patient-level (EBRT: 81.5% [22/27] vs. brachytherapy: 68.4% [13/19]) and lesion-level (EBRT: 79.4% [27/34] vs. brachytherapy: 59.1% [13/22]). In patients with gland volumes >34 ml (n = 25), detection sensitivities were 100% (11/11) and 94.1% (16/17) on patient- and lesion-level, respectively. CONCLUSION The reported bpMRI-based AI model detected the majority of locally recurrent prostate cancer after radiotherapy. Further testing including external validation of this model is warranted prior to clinical implementation.
Collapse
Affiliation(s)
- Enis C Yilmaz
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Stephanie A Harmon
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Mason J Belue
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Katie M Merriman
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Tim E Phelps
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Yue Lin
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Charisse Garcia
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States; Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, MD, United States
| | - Lindsey Hazen
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States; Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, MD, United States
| | - Krishnan R Patel
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Maria J Merino
- Laboratory of Pathology, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Bradford J Wood
- Center for Interventional Oncology, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States; Department of Radiology, Clinical Center, National Institutes of Health, Bethesda, MD, United States
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Peter A Pinto
- Urologic Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Deborah E Citrin
- Radiation Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, MD, United States; Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, 10 Center Dr., MSC 1182, Building 10, Room B3B85, Bethesda, MD, United States.
| |
Collapse
|
23
|
Weikert T, Litt HI, Moore WH, Abed M, Azour L, Noor AM, Friebe L, Linna N, Yerebakan HZ, Shinagawa Y, Hermosillo G, Allen-Raffl S, Ranganath M, Sauter AW. Reduction in Radiologist Interpretation Time of Serial CT and MR Imaging Findings with Deep Learning Identification of Relevant Priors, Series and Finding Locations. Acad Radiol 2023; 30:2269-2279. [PMID: 37210268 DOI: 10.1016/j.acra.2023.03.041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 03/28/2023] [Accepted: 03/29/2023] [Indexed: 05/22/2023]
Abstract
RATIONALE AND OBJECTIVES Finding comparison to relevant prior studies is a requisite component of the radiology workflow. The purpose of this study was to evaluate the impact of a deep learning tool simplifying this time-consuming task by automatically identifying and displaying the finding in relevant prior studies. MATERIALS AND METHODS The algorithm pipeline used in this retrospective study, TimeLens (TL), is based on natural language processing and descriptor-based image-matching algorithms. The dataset used for testing comprised 3872 series of 246 radiology examinations from 75 patients (189 CTs, 95 MRIs). To ensure a comprehensive testing, five finding types frequently encountered in radiology practice were included: aortic aneurysm, intracranial aneurysm, kidney lesion, meningioma, and pulmonary nodule. After a standardized training session, nine radiologists from three university hospitals performed two reading sessions on a cloud-based evaluation platform resembling a standard RIS/PACS. The task was to measure the diameter of the finding-of-interest on two or more exams (a most recent and at least one prior exam): first without use of TL, and a second session at an interval of at least 21 days with the use of TL. All user actions were logged for each round, including time needed to measure the finding at all timepoints, number of mouse clicks, and mouse distance traveled. The effect of TL was evaluated in total, per finding type, per reader, per experience (resident vs. board-certified radiologist), and per modality. Mouse movement patterns were analyzed with heatmaps. To assess the effect of habituation to the cases, a third round of readings was performed without TL. RESULTS Across scenarios, TL reduced the average time needed to assess a finding at all timepoints by 40.1% (107 vs. 65 seconds; p < 0.001). Largest accelerations were demonstrated for assessment of pulmonary nodules (-47.0%; p < 0.001). Less mouse clicks (-17.2%) were needed for finding evaluation with TL, and mouse distance traveled was reduced by 38.0%. Time needed to assess the findings increased from round 2 to round 3 (+27.6%; p < 0.001). Readers were able to measure a given finding in 94.4% of cases on the series initially proposed by TL as most relevant series for comparison. The heatmaps showed consistently simplified mouse movement patterns with TL. CONCLUSION A deep learning tool significantly reduced both the amount of user interactions with the radiology image viewer and the time needed to assess findings of interest on cross-sectional imaging with relevant prior exams.
Collapse
Affiliation(s)
- Thomas Weikert
- University Hospital Basel, Department of Radiology, University of Basel, Petersgraben 4, 4031 Basel, Switzerland (T.W., L.F., A.W.S.).
| | - Harold I Litt
- Department of Radiology, Perelman School of Medicine of the University of Pennsylvania, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA, 19104, USA (H.I.L., M.A., A.M.N., N.L.)
| | - William H Moore
- Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health, 660 First Ave, NY 10016 (W.H.M., L.A.)
| | - Mohammed Abed
- Department of Radiology, Perelman School of Medicine of the University of Pennsylvania, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA, 19104, USA (H.I.L., M.A., A.M.N., N.L.)
| | - Lea Azour
- Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health, 660 First Ave, NY 10016 (W.H.M., L.A.)
| | - Abass M Noor
- Department of Radiology, Perelman School of Medicine of the University of Pennsylvania, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA, 19104, USA (H.I.L., M.A., A.M.N., N.L.)
| | - Liene Friebe
- University Hospital Basel, Department of Radiology, University of Basel, Petersgraben 4, 4031 Basel, Switzerland (T.W., L.F., A.W.S.)
| | - Nathaniel Linna
- Department of Radiology, Perelman School of Medicine of the University of Pennsylvania, Hospital of the University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA, 19104, USA (H.I.L., M.A., A.M.N., N.L.)
| | - Halid Ziya Yerebakan
- Siemens Medical Solutions USA, 40 Liberty Blvd, Malvern, PA 19355 (H.Z.Y., Y.S., G.H., S.A.-R., M.R.)
| | - Yoshihisa Shinagawa
- Siemens Medical Solutions USA, 40 Liberty Blvd, Malvern, PA 19355 (H.Z.Y., Y.S., G.H., S.A.-R., M.R.)
| | - Gerardo Hermosillo
- Siemens Medical Solutions USA, 40 Liberty Blvd, Malvern, PA 19355 (H.Z.Y., Y.S., G.H., S.A.-R., M.R.)
| | - Simon Allen-Raffl
- Siemens Medical Solutions USA, 40 Liberty Blvd, Malvern, PA 19355 (H.Z.Y., Y.S., G.H., S.A.-R., M.R.)
| | - Mahesh Ranganath
- Siemens Medical Solutions USA, 40 Liberty Blvd, Malvern, PA 19355 (H.Z.Y., Y.S., G.H., S.A.-R., M.R.)
| | - Alexander W Sauter
- University Hospital Basel, Department of Radiology, University of Basel, Petersgraben 4, 4031 Basel, Switzerland (T.W., L.F., A.W.S.); University Hospital Tuebingen, Department of Radiology, University of Tuebingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany (A.W.S.)
| |
Collapse
|
24
|
Chatterjee A, Szasz T, Munakami M, Karademir I, Yusufishaq MS, Martens S, Wheeler C, Antic T, Thomas S, Karczmar GS, Oto A. An Interactive App with Multi-parametric MRI - Whole-Mount Histology Correlation for Enhanced Prostate MRI Training of Radiology Residents. Acad Radiol 2023; 30 Suppl 1:S21-S29. [PMID: 37137744 DOI: 10.1016/j.acra.2023.04.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 03/30/2023] [Accepted: 04/02/2023] [Indexed: 05/05/2023]
Abstract
RATIONALE AND OBJECTIVES To validate the educational value of a newly created learning application in enhancing prostate MRI training of radiologists for detecting prostate cancer using an observer study. MATERIALS AND METHODS An interactive learning app, LearnRadiology, was developed using a web-based framework to display multi-parametric prostate MRI images with whole-mount histology for 20 cases curated for unique pathology and teaching points. Twenty new prostate MRI cases, different from the ones used in the web app, were uploaded on 3D Slicer. Three radiologists (R1: radiologist; R2, R3: residents) blinded to pathology results were asked to mark areas suspected of cancer and provide a confidence score (1-5, with 5 being high confidence level). Then after a minimum memory washout period of 1 month, the same radiologists used the learning app and then repeated the same observer study. The diagnostic performance for detecting cancers before and after accessing the learning app was measured by correlating MRI with whole-mount pathology by an independent reviewer. RESULTS The 20 subjects included in the observer study had 39 cancer lesions (13 Gleason 3 + 3, 17 Gleason 3 + 4, 7 Gleason 4 + 3, and 2 Gleason 4 + 5 lesions). The sensitivity (R1: 54% → 64%, P = 0.08; R2: 44% → 59%, P = 0.03; R3: 62% → 72%, P = 0.04) and positive predictive value (R1: 68% → 76%, P = 0.23; R2: 52% → 79%, P = 0.01; R3: 48% → 65%, P = 0.04) for all 3 radiologists improved after using the teaching app. The confidence score for true positive cancer lesion also improved significantly (R1: 4.0 ± 1.0 → 4.3 ± 0.8; R2: 3.1 ± 0.8 → 4.0 ± 1.1; R3: 2.8 ± 1.2 → 4.1 ± 1.1; P < 0.05). CONCLUSION The web-based and interactive LearnRadiology app learning resource can support medical student and postgraduate education by improving diagnostic performance of trainees for detecting prostate cancer.
Collapse
Affiliation(s)
- Aritrick Chatterjee
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.); Sanford J. Grossman Center of Excellence in Prostate Imaging and Image Guided Therapy, University of Chicago, Chicago, IL (A.C., G.S.K., A.O.).
| | - Teodora Szasz
- Research Computing Center, University of Chicago, Chicago, IL (T.S., M.M.)
| | - Milson Munakami
- Research Computing Center, University of Chicago, Chicago, IL (T.S., M.M.)
| | - Ibrahim Karademir
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.)
| | - Mohamed Shaif Yusufishaq
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.)
| | - Spencer Martens
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.)
| | | | - Tatjana Antic
- Department of Pathology, University of Chicago, Chicago, IL (T.A.)
| | - Stephen Thomas
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.)
| | - Gregory S Karczmar
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.); Sanford J. Grossman Center of Excellence in Prostate Imaging and Image Guided Therapy, University of Chicago, Chicago, IL (A.C., G.S.K., A.O.)
| | - Aytekin Oto
- Department of Radiology, University of Chicago, Chicago, IL (A.C., I.K., M.S.Y., S.M., S.T., G.S.K., A.O.); Sanford J. Grossman Center of Excellence in Prostate Imaging and Image Guided Therapy, University of Chicago, Chicago, IL (A.C., G.S.K., A.O.)
| |
Collapse
|
25
|
Yilmaz EC, Belue MJ, Turkbey B, Reinhold C, Choyke PL. A Brief Review of Artificial Intelligence in Genitourinary Oncological Imaging. Can Assoc Radiol J 2023; 74:534-547. [PMID: 36515576 DOI: 10.1177/08465371221135782] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Genitourinary (GU) system is among the most commonly involved malignancy sites in the human body. Imaging plays a crucial role not only in diagnosis of cancer but also in disease management and its prognosis. However, interpretation of conventional imaging methods such as CT or MR imaging (MRI) usually demonstrates variability across different readers and institutions. Artificial intelligence (AI) has emerged as a promising technology that could improve the patient care by providing helpful input to human readers through lesion detection algorithms and lesion classification systems. Moreover, the robustness of these models may be valuable in automating time-consuming tasks such as organ and lesion segmentations. Herein, we review the current state of imaging and existing challenges in GU malignancies, particularly for cancers of prostate, kidney and bladder; and briefly summarize the recent AI-based solutions to these challenges.
Collapse
Affiliation(s)
- Enis C Yilmaz
- Molecular Imaging Branch, National Cancer Institute, NIH, Bethesda, MD, USA
| | - Mason J Belue
- Molecular Imaging Branch, National Cancer Institute, NIH, Bethesda, MD, USA
| | - Baris Turkbey
- Molecular Imaging Branch, National Cancer Institute, NIH, Bethesda, MD, USA
| | - Caroline Reinhold
- McGill University Health Center, McGill University, Montreal, Canada
| | - Peter L Choyke
- Molecular Imaging Branch, National Cancer Institute, NIH, Bethesda, MD, USA
| |
Collapse
|
26
|
Karagoz A, Alis D, Seker ME, Zeybel G, Yergin M, Oksuz I, Karaarslan E. Anatomically guided self-adapting deep neural network for clinically significant prostate cancer detection on bi-parametric MRI: a multi-center study. Insights Imaging 2023; 14:110. [PMID: 37337101 DOI: 10.1186/s13244-023-01439-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 04/17/2023] [Indexed: 06/21/2023] Open
Abstract
OBJECTIVE To evaluate the effectiveness of a self-adapting deep network, trained on large-scale bi-parametric MRI data, in detecting clinically significant prostate cancer (csPCa) in external multi-center data from men of diverse demographics; to investigate the advantages of transfer learning. METHODS We used two samples: (i) Publicly available multi-center and multi-vendor Prostate Imaging: Cancer AI (PI-CAI) training data, consisting of 1500 bi-parametric MRI scans, along with its unseen validation and testing samples; (ii) In-house multi-center testing and transfer learning data, comprising 1036 and 200 bi-parametric MRI scans. We trained a self-adapting 3D nnU-Net model using probabilistic prostate masks on the PI-CAI data and evaluated its performance on the hidden validation and testing samples and the in-house data with and without transfer learning. We used the area under the receiver operating characteristic (AUROC) curve to evaluate patient-level performance in detecting csPCa. RESULTS The PI-CAI training data had 425 scans with csPCa, while the in-house testing and fine-tuning data had 288 and 50 scans with csPCa, respectively. The nnU-Net model achieved an AUROC of 0.888 and 0.889 on the hidden validation and testing data. The model performed with an AUROC of 0.886 on the in-house testing data, with a slight decrease in performance to 0.870 using transfer learning. CONCLUSIONS The state-of-the-art deep learning method using prostate masks trained on large-scale bi-parametric MRI data provides high performance in detecting csPCa in internal and external testing data with different characteristics, demonstrating the robustness and generalizability of deep learning within and across datasets. CLINICAL RELEVANCE STATEMENT A self-adapting deep network, utilizing prostate masks and trained on large-scale bi-parametric MRI data, is effective in accurately detecting clinically significant prostate cancer across diverse datasets, highlighting the potential of deep learning methods for improving prostate cancer detection in clinical practice.
Collapse
Affiliation(s)
- Ahmet Karagoz
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
- Artificial Intelligence and Information Technologies, Hevi AI Health, Istanbul, Turkey
| | - Deniz Alis
- Artificial Intelligence and Information Technologies, Hevi AI Health, Istanbul, Turkey.
- Department of Radiology, School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey.
| | - Mustafa Ege Seker
- School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey
| | - Gokberk Zeybel
- School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey
| | - Mert Yergin
- Artificial Intelligence and Information Technologies, Hevi AI Health, Istanbul, Turkey
| | - Ilkay Oksuz
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| | - Ercan Karaarslan
- Department of Radiology, School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey
| |
Collapse
|
27
|
Alis D, Kartal MS, Seker ME, Guroz B, Basar Y, Arslan A, Sirolu S, Kurtcan S, Denizoglu N, Tuzun U, Yildirim D, Oksuz I, Karaarslan E. Deep learning for assessing image quality in bi-parametric prostate MRI: A feasibility study. Eur J Radiol 2023; 165:110924. [PMID: 37354768 DOI: 10.1016/j.ejrad.2023.110924] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 05/15/2023] [Accepted: 06/09/2023] [Indexed: 06/26/2023]
Abstract
BACKGROUND Although systems such as Prostate Imaging Quality (PI-QUAL) have been proposed for quality assessment, visual evaluations by human readers remain somewhat inconsistent, particularly among less-experienced readers. OBJECTIVES To assess the feasibility of deep learning (DL) for the automated assessment of image quality in bi-parametric MRI scans and compare its performance to that of less-experienced readers. METHODS We used bi-parametric prostate MRI scans from the PI-CAI dataset in this study. A 3-point Likert scale, consisting of poor, moderate, and excellent, was utilized for assessing image quality. Three expert readers established the ground-truth labels for the development (500) and testing sets (100). We trained a 3D DL model on the development set using probabilistic prostate masks and an ordinal loss function. Four less-experienced readers scored the testing set for performance comparison. RESULTS The kappa scores between the DL model and the expert consensus for T2W images and ADC maps were 0.42 and 0.61, representing moderate and good levels of agreement. The kappa scores between the less-experienced readers and the expert consensus for T2W images and ADC maps ranged from 0.39 to 0.56 (fair to moderate) and from 0.39 to 0.62 (fair to good). CONCLUSIONS Deep learning (DL) can offer performance comparable to that of less-experienced readers when assessing image quality in bi-parametric prostate MRI, making it a viable option for an automated quality assessment tool. We suggest that DL models trained on more representative datasets, annotated by a larger group of experts, could yield reliable image quality assessment and potentially substitute or assist visual evaluations by human readers.
Collapse
Affiliation(s)
- Deniz Alis
- Acibadem Mehmet Ali Aydinlar University, School of Medicine, Department of Radiology, Istanbul, 34457, Turkey.
| | | | - Mustafa Ege Seker
- Acibadem Mehmet Ali Aydinlar University, School of Medicine, Istanbul, 34752, Turkey
| | - Batuhan Guroz
- Acibadem Mehmet Ali Aydinlar University, School of Medicine, Department of Radiology, Istanbul, 34457, Turkey
| | - Yeliz Basar
- Acibadem Healthcare Group, Department of Radiology, Istanbul, 34457, Turkey
| | - Aydan Arslan
- Umraniye Training and Research Hospital, Department of Radiology, Istanbul, 34764, Turkey
| | - Sabri Sirolu
- Istanbul Sisli Hamidiye Etfal Training and Research Hospital, Department of Radiology, Istanbul, 34396, Turkey
| | - Serpil Kurtcan
- Acibadem Healthcare Group, Department of Radiology, Istanbul, 34457, Turkey.
| | - Nurper Denizoglu
- Acibadem Healthcare Group, Department of Radiology, Istanbul, 34457, Turkey.
| | - Umit Tuzun
- Neolife, Radiology Center, Istanbul, 34340, Turkey.
| | - Duzgun Yildirim
- Acibadem Mehmet Ali Aydinlar University, School of Vocational Sciences, Department of Radiology, Istanbul, 34457, Turkey.
| | - Ilkay Oksuz
- Istanbul Technical University, Department of Computer Engineering, Istanbul, 34467, Turkey
| | - Ercan Karaarslan
- Cumhuriyet University, School of Medicine, Sivas, 581407, Turkey.
| |
Collapse
|
28
|
Chervenkov L, Sirakov N, Kostov G, Velikova T, Hadjidekov G. Future of prostate imaging: Artificial intelligence in assessing prostatic magnetic resonance imaging. World J Radiol 2023; 15:136-145. [PMID: 37275303 PMCID: PMC10236970 DOI: 10.4329/wjr.v15.i5.136] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 03/21/2023] [Accepted: 04/10/2023] [Indexed: 05/23/2023] Open
Abstract
Prostate cancer (Pca; adenocarcinoma) is one of the most common cancers in adult males and one of the leading causes of death in both men and women. The diagnosis of Pca requires substantial experience, and even then the lesions can be difficult to detect. Moreover, although the diagnostic approach for this disease has improved significantly with the advent of multiparametric magnetic resonance, that technology has certain unresolved limitations. In recent years artificial intelligence (AI) has been introduced to the field of radiology, providing new software solutions for prostate diagnostics. Precise mapping of the prostate has become possible through AI and this has greatly improved the accuracy of biopsy. AI has also allowed for certain suspicious lesions to be attributed to a given group according to the Prostate Imaging-Reporting & Data System classification. Finally, AI has facilitated the combination of data obtained from clinical, laboratory (prostate-specific antigen), imaging (magnetic resonance), and biopsy examinations, and in this way new regularities can be found which at the moment remain hidden. Further evolution of AI in this field is inevitable and it is almost certain to significantly expand the efficacy, accuracy and efficiency of diagnosis and treatment of Pca.
Collapse
Affiliation(s)
- Lyubomir Chervenkov
- Department of Diagnostic Imaging, Medical University Plovdiv, Plovdiv 4000, Bulgaria
- Research Complex for Translational Neuroscience, Medical University of Plovdiv, Bul. Vasil Aprilov 15A, Plovdiv 4002, Bulgaria
| | - Nikolay Sirakov
- Research Complex for Translational Neuroscience, Medical University of Plovdiv, Bul. Vasil Aprilov 15A, Plovdiv 4002, Bulgaria
- Department of Diagnostic Imaging, Dental Allergology and Physiotherapy, Faculty of Dental Medicine, Medical University Plovdiv, Plovdiv 4000, Bulgaria
| | - Gancho Kostov
- Department of Special Surgery, Medical University Plovdiv, Plovdiv 4000, Bulgaria
| | - Tsvetelina Velikova
- Department of Clinical Immunology, University Hospital Lozenetz, Sofia 1407, Bulgaria
- Department of Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| | - George Hadjidekov
- Department of Radiology, University Hospital Lozenetz, Sofia 1407, Bulgaria
- Department of Physics, Biophysics and Radiology, Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| |
Collapse
|
29
|
Govindan B, Sabri MA, Hai A, Banat F, Haija MA. A Review of Advanced Multifunctional Magnetic Nanostructures for Cancer Diagnosis and Therapy Integrated into an Artificial Intelligence Approach. Pharmaceutics 2023; 15:868. [PMID: 36986729 PMCID: PMC10058002 DOI: 10.3390/pharmaceutics15030868] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 03/06/2023] [Accepted: 03/07/2023] [Indexed: 03/10/2023] Open
Abstract
The new era of nanomedicine offers significant opportunities for cancer diagnostics and treatment. Magnetic nanoplatforms could be highly effective tools for cancer diagnosis and treatment in the future. Due to their tunable morphologies and superior properties, multifunctional magnetic nanomaterials and their hybrid nanostructures can be designed as specific carriers of drugs, imaging agents, and magnetic theranostics. Multifunctional magnetic nanostructures are promising theranostic agents due to their ability to diagnose and combine therapies. This review provides a comprehensive overview of the development of advanced multifunctional magnetic nanostructures combining magnetic and optical properties, providing photoresponsive magnetic platforms for promising medical applications. Moreover, this review discusses various innovative developments using multifunctional magnetic nanostructures, including drug delivery, cancer treatment, tumor-specific ligands that deliver chemotherapeutics or hormonal agents, magnetic resonance imaging, and tissue engineering. Additionally, artificial intelligence (AI) can be used to optimize material properties in cancer diagnosis and treatment, based on predicted interactions with drugs, cell membranes, vasculature, biological fluid, and the immune system to enhance the effectiveness of therapeutic agents. Furthermore, this review provides an overview of AI approaches used to assess the practical utility of multifunctional magnetic nanostructures for cancer diagnosis and treatment. Finally, the review presents the current knowledge and perspectives on hybrid magnetic systems as cancer treatment tools with AI models.
Collapse
Affiliation(s)
- Bharath Govindan
- Department of Chemical Engineering, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
- Department of Chemistry, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
| | - Muhammad Ashraf Sabri
- Department of Chemical Engineering, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
| | - Abdul Hai
- Department of Chemical Engineering, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
| | - Fawzi Banat
- Department of Chemical Engineering, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
| | - Mohammad Abu Haija
- Department of Chemical Engineering, Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
- Advanced Materials Chemistry Center (AMCC), Khalifa University of Science and Technology, Abu Dhabi P.O. Box 127788, United Arab Emirates
| |
Collapse
|
30
|
Jiang W, Lin Y, Vardhanabhuti V, Ming Y, Cao P. Joint Cancer Segmentation and PI-RADS Classification on Multiparametric MRI Using MiniSegCaps Network. Diagnostics (Basel) 2023; 13:615. [PMID: 36832103 PMCID: PMC9955952 DOI: 10.3390/diagnostics13040615] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 01/27/2023] [Accepted: 01/28/2023] [Indexed: 02/11/2023] Open
Abstract
MRI is the primary imaging approach for diagnosing prostate cancer. Prostate Imaging Reporting and Data System (PI-RADS) on multiparametric MRI (mpMRI) provides fundamental MRI interpretation guidelines but suffers from inter-reader variability. Deep learning networks show great promise in automatic lesion segmentation and classification, which help to ease the burden on radiologists and reduce inter-reader variability. In this study, we proposed a novel multi-branch network, MiniSegCaps, for prostate cancer segmentation and PI-RADS classification on mpMRI. MiniSeg branch outputted the segmentation in conjunction with PI-RADS prediction, guided by the attention map from the CapsuleNet. CapsuleNet branch exploited the relative spatial information of prostate cancer to anatomical structures, such as the zonal location of the lesion, which also reduced the sample size requirement in training due to its equivariance properties. In addition, a gated recurrent unit (GRU) is adopted to exploit spatial knowledge across slices, improving through-plane consistency. Based on the clinical reports, we established a prostate mpMRI database from 462 patients paired with radiologically estimated annotations. MiniSegCaps was trained and evaluated with fivefold cross-validation. On 93 testing cases, our model achieved a 0.712 dice coefficient on lesion segmentation, 89.18% accuracy, and 92.52% sensitivity on PI-RADS classification (PI-RADS ≥ 4) in patient-level evaluation, significantly outperforming existing methods. In addition, a graphical user interface (GUI) integrated into the clinical workflow can automatically produce diagnosis reports based on the results from MiniSegCaps.
Collapse
Affiliation(s)
| | | | | | | | - Peng Cao
- Department of Diagnostic Radiology, University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
31
|
Miyahira AK, Hawley JE, Adelaiye-Ogala R, Calais J, Nappi L, Parikh R, Seibert TM, Wasmuth EV, Wei XX, Pienta KJ, Soule HR. Exploring new frontiers in prostate cancer research: Report from the 2022 Coffey-Holden prostate cancer academy meeting. Prostate 2023; 83:207-226. [PMID: 36443902 DOI: 10.1002/pros.24461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 11/02/2022] [Indexed: 12/03/2022]
Abstract
INTRODUCTION The 2022 Coffey-Holden Prostate Cancer Academy (CHPCA) Meeting, "Exploring New Frontiers in Prostate Cancer Research," was held from June 23 to 26, 2022, at the University of California, Los Angeles, Luskin Conference Center, in Los Angeles, CA. METHODS The CHPCA Meeting is an annual discussion-oriented scientific conference organized by the Prostate Cancer Foundation, that focuses on emerging and next-step topics deemed critical for making the next major advances in prostate cancer research and clinical care. The 2022 CHPCA Meeting included 35 talks over 10 sessions and was attended by 73 academic investigators. RESULTS Major topic areas discussed at the meeting included: prostate cancer diversity and disparities, the impact of social determinants on research and patient outcomes, leveraging real-world and retrospective data, development of artificial intelligence biomarkers, androgen receptor (AR) signaling biology and new strategies for targeting AR, features of homologous recombination deficient prostate cancer, and future directions in immunotherapy and nuclear theranostics. DISCUSSION This article summarizes the scientific presentations from the 2022 CHPCA Meeting, with the goal that dissemination of this knowledge will contribute to furthering global prostate cancer research efforts.
Collapse
Affiliation(s)
| | - Jessica E Hawley
- Department of Medicine, Division of Medical Oncology, University of Washington, Seattle, Washington, USA
- Clinical Research Division, Fred Hutchinson Cancer Center, Seattle, Washington, USA
| | - Remi Adelaiye-Ogala
- Department of Medicine, Division of Hematology and Oncology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, New York, USA
- Department of Pharmacology and Toxicology, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, New York, USA
| | - Jeremie Calais
- Department of Molecular and Medical Pharmacology, Ahmanson Translational Imaging Division, University of California, Los Angeles, Los Angeles, California, USA
| | - Lucia Nappi
- Department of Urologic Sciences, Vancouver Prostate Centre, University of British Columbia, British Columbia, Canada
- Department of Medical Oncology, BC Cancer, British Columbia, Canada
| | - Ravi Parikh
- Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Department of Medical Ethics and Health Policy, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
- Corporal Michael J. Crescenz VA Medical Center, Philadelphia, Pennsylvania, USA
| | - Tyler M Seibert
- Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, California, USA
- Department of Radiology, University of California San Diego, La Jolla, California, USA
- Department of Bioengineering, University of California San Diego, La Jolla, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - Elizabeth V Wasmuth
- Department of Biochemistry and Structural Biology, University of Texas Health at San Antonio, San Antonio, Texas, USA
| | - Xiao X Wei
- Department of Medical Oncology, Dana-Farber Cancer Institute, Boston, Massachusetts, USA
| | - Kenneth J Pienta
- The James Buchanan Brady Urological Institute, The Johns Hopkins School of Medicine, Baltimore, Maryland, USA
| | - Howard R Soule
- Prostate Cancer Foundation, Santa Monica, California, USA
| |
Collapse
|
32
|
Belue MJ, Harmon SA, Lay NS, Daryanani A, Phelps TE, Choyke PL, Turkbey B. The Low Rate of Adherence to Checklist for Artificial Intelligence in Medical Imaging Criteria Among Published Prostate MRI Artificial Intelligence Algorithms. J Am Coll Radiol 2023; 20:134-145. [PMID: 35922018 PMCID: PMC9887098 DOI: 10.1016/j.jacr.2022.05.022] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 05/13/2022] [Accepted: 05/18/2022] [Indexed: 02/02/2023]
Abstract
OBJECTIVE To determine the rigor, generalizability, and reproducibility of published classification and detection artificial intelligence (AI) models for prostate cancer (PCa) on MRI using the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) guidelines, a 42-item checklist that is considered a measure of best practice for presenting and reviewing medical imaging AI research. MATERIALS AND METHODS This review searched English literature for studies proposing PCa AI detection and classification models on MRI. Each study was evaluated with the CLAIM checklist. The additional outcomes for which data were sought included measures of AI model performance (eg, area under the curve [AUC], sensitivity, specificity, free-response operating characteristic curves), training and validation and testing group sample size, AI approach, detection versus classification AI, public data set utilization, MRI sequences used, and definition of gold standard for ground truth. The percentage of CLAIM checklist fulfillment was used to stratify studies into quartiles. Wilcoxon's rank-sum test was used for pair-wise comparisons. RESULTS In all, 75 studies were identified, and 53 studies qualified for analysis. The original CLAIM items that most studies did not fulfill includes item 12 (77% no): de-identification methods; item 13 (68% no): handling missing data; item 15 (47% no): rationale for choosing ground truth reference standard; item 18 (55% no): measurements of inter- and intrareader variability; item 31 (60% no): inclusion of validated interpretability maps; item 37 (92% no): inclusion of failure analysis to elucidate AI model weaknesses. An AUC score versus percentage CLAIM fulfillment quartile revealed a significant difference of the mean AUC scores between quartile 1 versus quartile 2 (0.78 versus 0.86, P = .034) and quartile 1 versus quartile 4 (0.78 versus 0.89, P = .003) scores. Based on additional information and outcome metrics gathered in this study, additional measures of best practice are defined. These new items include disclosure of public dataset usage, ground truth definition in comparison to other referenced works in the defined task, and sample size power calculation. CONCLUSION A large proportion of AI studies do not fulfill key items in CLAIM guidelines within their methods and results sections. The percentage of CLAIM checklist fulfillment is weakly associated with improved AI model performance. Additions or supplementations to CLAIM are recommended to improve publishing standards and aid reviewers in determining study rigor.
Collapse
Affiliation(s)
- Mason J Belue
- Medical Research Scholars Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Stephanie A Harmon
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Nathan S Lay
- Staff Scientist, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Asha Daryanani
- Intramural Research Training Program Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Tim E Phelps
- Postdoctoral Fellow, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Peter L Choyke
- Artificial Intelligence Resource, Chief of Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland
| | - Baris Turkbey
- Senior Clinician/Director, Artificial Intelligence Resource, Molecular Imaging Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland.
| |
Collapse
|
33
|
Artificial Intelligence for Clinical Diagnosis and Treatment of Prostate Cancer. Cancers (Basel) 2022; 14:cancers14225595. [PMID: 36428686 PMCID: PMC9688370 DOI: 10.3390/cancers14225595] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 10/29/2022] [Accepted: 11/01/2022] [Indexed: 11/16/2022] Open
Abstract
As medical science and technology progress towards the era of "big data", a multi-dimensional dataset pertaining to medical diagnosis and treatment is becoming accessible for mathematical modelling. However, these datasets are frequently inconsistent, noisy, and often characterized by a significant degree of redundancy. Thus, extensive data processing is widely advised to clean the dataset before feeding it into the mathematical model. In this context, Artificial intelligence (AI) techniques, including machine learning (ML) and deep learning (DL) algorithms based on artificial neural networks (ANNs) and their types, are being used to produce a precise and cross-sectional illustration of clinical data. For prostate cancer patients, datasets derived from the prostate-specific antigen (PSA), MRI-guided biopsies, genetic biomarkers, and the Gleason grading are primarily used for diagnosis, risk stratification, and patient monitoring. However, recording diagnoses and further stratifying risks based on such diagnostic data frequently involves much subjectivity. Thus, implementing an AI algorithm on a PC's diagnostic data can reduce the subjectivity of the process and assist in decision making. In addition, AI is used to cut down the processing time and help with early detection, which provides a superior outcome in critical cases of prostate cancer. Furthermore, this also facilitates offering the service at a lower cost by reducing the amount of human labor. Herein, the prime objective of this review is to provide a deep analysis encompassing the existing AI algorithms that are being deployed in the field of prostate cancer (PC) for diagnosis and treatment. Based on the available literature, AI-powered technology has the potential for extensive growth and penetration in PC diagnosis and treatment to ease and expedite the existing medical process.
Collapse
|
34
|
Sunoqrot MRS, Saha A, Hosseinzadeh M, Elschot M, Huisman H. Artificial intelligence for prostate MRI: open datasets, available applications, and grand challenges. Eur Radiol Exp 2022; 6:35. [PMID: 35909214 PMCID: PMC9339427 DOI: 10.1186/s41747-022-00288-8] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 05/09/2022] [Indexed: 11/29/2022] Open
Abstract
Artificial intelligence (AI) for prostate magnetic resonance imaging (MRI) is starting to play a clinical role for prostate cancer (PCa) patients. AI-assisted reading is feasible, allowing workflow reduction. A total of 3,369 multi-vendor prostate MRI cases are available in open datasets, acquired from 2003 to 2021 in Europe or USA at 3 T (n = 3,018; 89.6%) or 1.5 T (n = 296; 8.8%), 346 cases scanned with endorectal coil (10.3%), 3,023 (89.7%) with phased-array surface coils; 412 collected for anatomical segmentation tasks, 3,096 for PCa detection/classification; for 2,240 cases lesions delineation is available and 56 cases have matching histopathologic images; for 2,620 cases the PSA level is provided; the total size of all open datasets amounts to approximately 253 GB. Of note, quality of annotations provided per dataset highly differ and attention must be paid when using these datasets (e.g., data overlap). Seven grand challenges and commercial applications from eleven vendors are here considered. Few small studies provided prospective validation. More work is needed, in particular validation on large-scale multi-institutional, well-curated public datasets to test general applicability. Moreover, AI needs to be explored for clinical stages other than detection/characterization (e.g., follow-up, prognosis, interventions, and focal treatment).
Collapse
Affiliation(s)
- Mohammed R S Sunoqrot
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway.
- Department of Radiology and Nuclear Medicine, St. Olavs Hospital, Trondheim University Hospital, 7030, Trondheim, Norway.
| | - Anindo Saha
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| | - Matin Hosseinzadeh
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| | - Mattijs Elschot
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway
- Department of Radiology and Nuclear Medicine, St. Olavs Hospital, Trondheim University Hospital, 7030, Trondheim, Norway
| | - Henkjan Huisman
- Department of Circulation and Medical Imaging, NTNU-Norwegian University of Science and Technology, 7030, Trondheim, Norway
- Diagnostic Image Analysis Group, Department of Medical Imaging, Radboud University Medical Center, Nijmegen, 6525 GA, The Netherlands
| |
Collapse
|
35
|
Gunashekar DD, Bielak L, Hägele L, Oerther B, Benndorf M, Grosu AL, Brox T, Zamboglou C, Bock M. Explainable AI for CNN-based prostate tumor segmentation in multi-parametric MRI correlated to whole mount histopathology. Radiat Oncol 2022; 17:65. [PMID: 35366918 PMCID: PMC8976981 DOI: 10.1186/s13014-022-02035-0] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Accepted: 03/15/2022] [Indexed: 12/15/2022] Open
Abstract
Automatic prostate tumor segmentation is often unable to identify the lesion even if multi-parametric MRI data is used as input, and the segmentation output is difficult to verify due to the lack of clinically established ground truth images. In this work we use an explainable deep learning model to interpret the predictions of a convolutional neural network (CNN) for prostate tumor segmentation. The CNN uses a U-Net architecture which was trained on multi-parametric MRI data from 122 patients to automatically segment the prostate gland and prostate tumor lesions. In addition, co-registered ground truth data from whole mount histopathology images were available in 15 patients that were used as a test set during CNN testing. To be able to interpret the segmentation results of the CNN, heat maps were generated using the Gradient Weighted Class Activation Map (Grad-CAM) method. The CNN achieved a mean Dice Sorensen Coefficient 0.62 and 0.31 for the prostate gland and the tumor lesions -with the radiologist drawn ground truth and 0.32 with whole-mount histology ground truth for tumor lesions. Dice Sorensen Coefficient between CNN predictions and manual segmentations from MRI and histology data were not significantly different. In the prostate the Grad-CAM heat maps could differentiate between tumor and healthy prostate tissue, which indicates that the image information in the tumor was essential for the CNN segmentation.
Collapse
Affiliation(s)
- Deepa Darshini Gunashekar
- Department of Radiology, Medical Physics, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany.
| | - Lars Bielak
- Department of Radiology, Medical Physics, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
- German Cancer Consortium (DKTK), Partner Site Freiburg, Freiburg, Germany
| | - Leonard Hägele
- Department of Radiology, Medical Physics, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Benedict Oerther
- Department of Radiology, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Matthias Benndorf
- Department of Radiology, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Anca-L Grosu
- German Cancer Consortium (DKTK), Partner Site Freiburg, Freiburg, Germany
- Department of Radiology, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Thomas Brox
- Department of Computer Science, University of Freiburg, Freiburg, Germany
| | - Constantinos Zamboglou
- German Cancer Consortium (DKTK), Partner Site Freiburg, Freiburg, Germany
- Department of Radiology, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Michael Bock
- Department of Radiology, Medical Physics, Medical Center University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
- German Cancer Consortium (DKTK), Partner Site Freiburg, Freiburg, Germany
| |
Collapse
|
36
|
Li H, Lee CH, Chia D, Lin Z, Huang W, Tan CH. Machine Learning in Prostate MRI for Prostate Cancer: Current Status and Future Opportunities. Diagnostics (Basel) 2022; 12:diagnostics12020289. [PMID: 35204380 PMCID: PMC8870978 DOI: 10.3390/diagnostics12020289] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 12/31/2021] [Accepted: 01/14/2022] [Indexed: 02/04/2023] Open
Abstract
Advances in our understanding of the role of magnetic resonance imaging (MRI) for the detection of prostate cancer have enabled its integration into clinical routines in the past two decades. The Prostate Imaging Reporting and Data System (PI-RADS) is an established imaging-based scoring system that scores the probability of clinically significant prostate cancer on MRI to guide management. Image fusion technology allows one to combine the superior soft tissue contrast resolution of MRI, with real-time anatomical depiction using ultrasound or computed tomography. This allows the accurate mapping of prostate cancer for targeted biopsy and treatment. Machine learning provides vast opportunities for automated organ and lesion depiction that could increase the reproducibility of PI-RADS categorisation, and improve co-registration across imaging modalities to enhance diagnostic and treatment methods that can then be individualised based on clinical risk of malignancy. In this article, we provide a comprehensive and contemporary review of advancements, and share insights into new opportunities in this field.
Collapse
Affiliation(s)
- Huanye Li
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (H.L.); (Z.L.)
| | - Chau Hung Lee
- Department of Diagnostic Radiology, Tan Tock Seng Hospital, Singapore 308433, Singapore;
| | - David Chia
- Department of Radiation Oncology, National University Cancer Institute (NUH), Singapore 119074, Singapore;
| | - Zhiping Lin
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore; (H.L.); (Z.L.)
| | - Weimin Huang
- Institute for Infocomm Research, A*Star, Singapore 138632, Singapore;
| | - Cher Heng Tan
- Department of Diagnostic Radiology, Tan Tock Seng Hospital, Singapore 308433, Singapore;
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 639798, Singapore
- Correspondence:
| |
Collapse
|
37
|
Urraro F, Nardone V, Reginelli A, Varelli C, Angrisani A, Patanè V, D’Ambrosio L, Roccatagliata P, Russo GM, Gallo L, De Chiara M, Altucci L, Cappabianca S. MRI Radiomics in Prostate Cancer: A Reliability Study. Front Oncol 2021; 11:805137. [PMID: 34993153 PMCID: PMC8725993 DOI: 10.3389/fonc.2021.805137] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 11/29/2021] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Radiomics can provide quantitative features from medical imaging that can be correlated to clinical endpoints. The challenges relevant to robustness of radiomics features have been analyzed by many researchers, as it seems to be influenced by acquisition and reconstruction protocols, as well as by the segmentation of the region of interest (ROI). Prostate cancer (PCa) represents a difficult playground for this technique, due to discrepancies in the identification of the cancer lesion and the heterogeneity of the acquisition protocols. The aim of this study was to investigate the reliability of radiomics in PCa magnetic resonance imaging (MRI). METHODS A homogeneous cohort of patients with a PSA rise that underwent multiparametric MRI imaging of the prostate before biopsy was tested in this study. All the patients were acquired with the same MRI scanner, with a standardized protocol. The identification and the contouring of the region of interest (ROI) of an MRI suspicious cancer lesion were done by two radiologists with great experience in prostate cancer (>10 years). After the segmentation, the texture features were extracted with LIFEx. Texture features were then tested with intraclass coefficient correlation (ICC) analysis to analyze the reliability of the segmentation. RESULTS Forty-four consecutive patients were included in the present analysis. In 26 patients (59.1%), the prostate biopsy confirmed the presence of prostate cancer, which was scored as Gleason 6 in 6 patients (13.6%), Gleason 3 + 4 in 8 patients (18.2%), and Gleason 4 + 3 in 12 patients (27.3%). The reliability analysis conversely showed poor reliability in the majority of the MRI acquisition (61% in T2, 89% in DWI50, 44% in DWI400, and 83% in DWI1,500), with ADC acquisition only showing better reliability (poor reliability in only 33% of the texture features). CONCLUSIONS The low ratio of reliability in a monoinstitutional homogeneous cohort represents a significant alarm bell for the application of MRI radiomics in the field of prostate cancer. More work is needed in a clinical setting to further study the potential of MRI radiomics in prostate cancer.
Collapse
Affiliation(s)
- Fabrizio Urraro
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Valerio Nardone
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Alfonso Reginelli
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | | | - Antonio Angrisani
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Vittorio Patanè
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Luca D’Ambrosio
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Pietro Roccatagliata
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Gaetano Maria Russo
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Luigi Gallo
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Marco De Chiara
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Lucia Altucci
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| | - Salvatore Cappabianca
- Department of Precision Medicine, University of Campania Luigi Vanvitelli, Naples, Italy
| |
Collapse
|