Retrospective Study Open Access
Copyright ©The Author(s) 2021. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Hepatol. Jan 27, 2022; 14(1): 244-259
Published online Jan 27, 2022. doi: 10.4254/wjh.v14.i1.244
Can the computed tomography texture analysis of colorectal liver metastases predict the response to first-line cytotoxic chemotherapy?
Etienne Rabe, Dania Cioni, Michela Gabelloni, Emanuele Neri, Academic Radiology, Master in Oncologic Imaging, Department of Translational Research, University of Pisa, Pisa 56126, Italy
Etienne Rabe, Bay Radiology-Cancercare Oncology Centre, Bay Radiology, Port Elizabeth 6001, Eastern Cape, South Africa
Laura Baglietto, Marco Fornili, Department of Clinical and Experimental Medicine, University of Pisa, Pisa 56126, Italy
ORCID number: Etienne Rabe (0000-0002-9972-5508); Dania Cioni (0000-0002-5120-886X); Laura Baglietto (0000-0002-8193-7529); Marco Fornili (0000-0002-5713-3926); Michela Gabelloni (0000-0002-6668-499X); Emanuele Neri (0000-0001-7950-4559).
Author contributions: Rabe E conceptualized and designed the study; Neri E assisted with the study methodology and supervised the study as Master tutor; Rabe E collected the data, performed the formal image analysis and wrote the original draft; Baglietto L and Fornili M performed the statistical analysis of the data and contributed to the interpretation of the results; Cioni D, Baglietto L, Fornili M, Gabelloni M and Neri E reviewed and revised the manuscript.
Institutional review board statement: The Protocol of this clinical trial was submitted for approval to the BLINDED Committee (BLINDED), a research ethics committee registered with the BLINDED Council. Written approval has been granted by BLINDED for the conduct of the trial. The study has been structured in accordance with the Guidelines on Clinical Trials and Ethics in Health Research, published by the Department of Health and the Declaration of Helsinki (last updated October 2013), adopted by the World Medical Association (WMA), which deals with the recommendations guiding doctors in biomedical research involving human participants. Copies of these documents may be obtained upon reasonable request.
Informed consent statement: Informed consent was waived.
Conflict-of-interest statement: The authors have no relevant financial or non-financial interests to disclose.
Data sharing statement: No additional data are available.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Etienne Rabe, Academic Radiology, Master in Oncologic Imaging, Department of Translational Research, University of Pisa, Lungarno Antonio Pacinotti Street 43, Pisa 56126, Italy. etienne.rabe@gmail.com
Received: April 25, 2021
Peer-review started: April 25, 2021
First decision: June 13, 2021
Revised: June 15, 2021
Accepted: December 2, 2021
Article in press: December 2, 2021
Published online: January 27, 2022
Processing time: 270 Days and 22.4 Hours

Abstract
BACKGROUND

Artificial intelligence in radiology has the potential to assist with the diagnosis, prognostication and therapeutic response prediction of various cancers. A few studies have reported that texture analysis can be helpful in predicting the response to chemotherapy for colorectal liver metastases, however, the results have varied. Necrotic metastases were not clearly excluded in these studies and in most studies the full range of texture analysis features were not evaluated. This study was designed to determine if the computed tomography (CT) texture analysis results of non-necrotic colorectal liver metastases differ from previous reports. A larger range of texture features were also evaluated to identify potential new biomarkers.

AIM

To identify potential new imaging biomarkers with CT texture analysis which can predict the response to first-line cytotoxic chemotherapy in non-necrotic colorectal liver metastases (CRLMs).

METHODS

Patients who presented with CRLMs from 2012 to 2020 were retrospectively selected on the institutional radiology information system of our private radiology practice. The inclusion criteria were non-necrotic CRLMs with a minimum size of 10 mm (diagnosed on archived 1.25 mm portal venous phase CT scans) which were treated with standard first-line cytotoxic chemotherapy (FOLFOX, FOLFIRI, FOLFOXIRI, CAPE-OX, CAPE-IRI or capecitabine). The final study cohort consisted of 29 patients. The treatment response of the CRLMs was classified according to the RECIST 1.1 criteria. By means of CT texture analysis, various first and second order texture features were extracted from a single non-necrotic target CRLM in each responding and non-responding patient. Associations between features and response to chemotherapy were assessed by logistic regression models. The prognostic accuracy of selected features was evaluated by using the area under the curve.

RESULTS

There were 15 responders (partial response) and 14 non-responders (7 stable and 7 with progressive disease). The responders presented with a higher number of CRLMs (P = 0.05). In univariable analysis, eight texture features of the responding CRLMs were associated with treatment response, but due to strong correlations among some of the features, only two features, namely minimum histogram gradient intensity and long run low grey level emphasis, were included in the multiple analysis. The area under the receiver operating characteristic curve of the multiple model was 0.80 (95%CI: 0.64 to 0.96), with a sensitivity of 0.73 (95%CI: 0.48 to 0.89) and a specificity of 0.79 (95%CI: 0.52 to 0.92).

CONCLUSION

Eight first and second order texture features, but particularly minimum histogram gradient intensity and long run low grey level emphasis are significantly correlated with treatment response in non-necrotic CRLMs.

Key Words: Colorectal cancer; Liver metastases; Radiomics; Computed tomography texture analysis; Response assessment

Core Tip: Radiomics is a rapidly growing field of radiological research which has the potential to assist with the diagnosis, prognostication and therapeutic response prediction of various cancers and may potentially play an important role in personalized patient care. This retrospective study aimed to identify potential new imaging biomarkers with computed tomography texture analysis which can predict the response to first-line cytotoxic chemotherapy in non-necrotic colorectal liver metastases. Eight first and second order texture features, but particularly minimum histogram gradient intensity and long run low grey level emphasis are significantly correlated with treatment response. These preliminary results need to be validated and confirmed on larger patient cohort studies.



INTRODUCTION

Colorectal cancer (CRC) is one of the most common malignant tumors. According to the global burden of cancer worldwide using the GLOBOCAN 2018, it was estimated that colorectal cancer was the fourth most common cancer and second leading cause of cancer related deaths[1].

The liver is the most frequent site of metastatic disease[1] and approximately 20%-25% of the patients with CRC will have synchronous liver metastases at the time of diagnosis and at least another 60% of patients who develop metastatic disease will have metachronous liver-confined metastases[2].

Unfortunately, approximately half of the patients with colorectal cancer have no treatment response or develop disease progression despite first-line chemotherapy[3]. Since the introduction of targeted therapies (e.g., bevacizumab and cetuximab) there has been an increase in the progression-free and overall survival rates in several clinical studies with the median overall survival exceeding 2 years[4-6].

Oncologists monitor their patients closely with regard to their clinical course, performance status and laboratory tests (for instance liver function tests and tumor marker levels) to determine if their patients with cancer are responding to the chemotherapy or potentially progressing. It will be greatly beneficial to the oncologists if we could identify effective predictive biomarkers on the baseline imaging examination which can estimate the response which can be expected during chemotherapy in order to individualize treatment (precision medicine). These imaging biomarkers may prompt the oncologists to perform earlier follow-up imaging studies to determine whether an alternative chemotherapy treatment should be considered.

The Response Evaluation Criteria in Solid Tumors (RECIST 1.1) is typically and mainly used to assess the response to chemotherapy and measures and classifies the changes in the longest axial tumor diameters[7]. Due to the irregular shapes of tumors these size measurements may, however, not be representative of the true tumor volume. Moreover, the correlation between RECIST and the pathological response is known to be limited[8-9].

Radiomics is a rapidly growing field of radiological research where routine patient scans are converted into mineable quantitative data[10] that can be utilized to decode the tumor phenotype for applications ranging from improved diagnostics to prognostication to therapeutic response prediction[11]. In radiomics, computed tomography (CT) texture analysis quantifies tissue heterogeneity by assessing the distribution of grey-levels, texture coarseness and irregularity within a lesion[12-15]. Studies on different tumors have shown that CT texture analysis has promise in predicting pathological features, overall survival and response to therapy[15-17]. In the last few years a few studies have also reported that texture analysis can be helpful in predicting the response to chemotherapy for colorectal liver metastases (CRLMs)[18-22]. Thus far the CT texture analysis results of responding CRLMs in studies have been heterogeneous which can be secondary to many technical factors. In none of the aforementioned studies were necrotic metastases clearly excluded. The contrast injection protocols were not standardized or defined in all the studies. The CT slice thickness varied between 2 mm and 5 mm in the different studies and some studies combined CT scans with different slice thickness reconstructions for texture analysis. A thicker slice thickness can lead to partial volume effects which can affect the accuracy of the texture analysis results. In most of the studies predominately first order CT texture features were assessed and only a few studies included some second order texture features (predominantly grey level co-occurrence matrix features).

The purpose of this retrospective explorative study is to identify potential new imaging biomarkers by assessing a larger range of first and second order texture features with CT texture analysis which can predict the response to first-line cytotoxic chemotherapy in non-necrotic CRLMs and to compare the results with the findings from previous studies.

MATERIALS AND METHODS
Study design

This retrospective study was approved by the BLINDED Ethics Committee and was conducted in accordance with the ethical standards of the Declaration of Helsinki. Patient informed consent was waived.

The study population was selected in a consecutive retrospective manner by using the ICD-10 codes (International Classification of Diseases and Related Health Problems, 10th revision) for CRC to identify all patients on the institutional radiology information system (RIS) of our private radiology practice for the period of March 2012 to May 2020. All the CT scans were performed at one of the branches of our radiology practice in our demographic region.

The inclusion criteria were histopathological confirmed colorectal cancer with synchronous (diagnosed within 6 mo of primary CRC) or metachronous liver metastases; portal venous phase CT scans with archived slice thickness of 1.25 mm; hepatic metastasis minimum size of 10 mm; one of the following standard first-line chemotherapy regimens: FOLFOX, FOLFIRI, CAPE-OX, CAPE-IRI, FOLFOXIRI or capecitabine.

The exclusion criteria included absent baseline CT scan; poor quality portal venous phase CT scan due to inadequate contrast enhancement or artefacts; hepatic metastasis size less than 10 mm; metastases with clear necrosis or calcifications; fatty liver or other chronic liver pathology; previous chemotherapy; first-line chemotherapy combined with targeted or other therapy; more than 2 mo delay between baseline CT scan and start of chemotherapy; more than 7 mo delay since onset of first line chemotherapy and follow-up CT scans; no follow-up CT scan after chemotherapy; previous liver surgery or surgery/radiofrequency ablation after chemotherapy; mucinous colon carcinoma; history of previous or other coexisting malignancies. The final study cohort consisted of 29 patients.

Data

The following clinical and pathological information was collected from our RIS and patient medical records: patient demographics (age at diagnosis, date of diagnosis, gender); original CRC histology and grade of primary CRC; Kirsten rat sarcoma viral oncogene homolog (KRAS) mutation status (mutant or wild-type), if available; TNM staging of CRC; CEA and CA19-9 tumor marker levels around the time of baseline CT scan; details of first-line chemotherapy.

First-line chemotherapy regimens

All the patients received one of the following cytotoxic chemotherapeutic substances according to the National Comprehensive Cancer Network clinical guidelines in oncology: FOLFOX (intravenous (IV) 5-FU, leucovorin and oxaliplatin), FOLFIRI (IV 5-FU, leucovorin and irinotecan), FOLFOXIRI (IV 5-FU, leucovorin, oxaliplatin, and irinotecan), CAPE-OX (oral capecitabine and oxaliplatin), CAPE-IRI (oral capecitabine and irinotecan) and oral capecitabine. None of the study cases received targeted therapy. Chemotherapy was administered until there was radiological evidence of disease progression according to the RECIST 1.1 criteria.

CT acquisition

The CT examination closest to the date of diagnosis of the liver metastases was selected for the radiomics analysis.

All the scans in the study cohort were performed on three different multidetector CT scanners: GE Lightspeed RT16 (n = 16), GE Optima CT540 (n = 11) and GE Discovery IQ (n = 2) (GE healthcare, Milwaukee, WI). The portal venous phase CT scans were used for the radiomics analysis and were acquired as part of either a four-phase (unenhanced, arterial, portal venous, delayed phases, n = 19), a three-phase (unenhanced, arterial, portal venous, n = 8) or biphasic (unenhanced, portal venous, n = 2) contrast enhanced CT examination. The CT acquisition parameters of the study cohort are summarized in Table 1.

Table 1 Computed tomography acquisition parameters in study cohort.
CT scanner model
Number of study cases (n)
Detector collimation
Spiral pitch factor
Rotation time (s)
Voltage (kVp)
Tube current-time product at level of liver metastases (mAs)
Noise Index
Reconstruction kernel
Slice thickness/reconstruction interval (mm)
Field of view (cm)
Matrix size (pixels)
GE Lightspeed RT161616 × 1.25 mm1.375:10.8 (n = 14); 0.9 (n = 1); 1.0 (n = 1)120 (n = 14); 140 (n = 2)96-30011.5SOFT1.25/1.2550512 × 512
GE Optima CT5401116 × 1.25 mm1.375:1 (n = 9); 0.938:1 (n = 2)0.7 (n = 6); 0.8 (n = 4); 0.9 (n = 1)120109.6-277.211.5 -13SOFT1.25/1.2550512 × 512
GE Discovery IQ216 × 1.25 mm0.938:10.8120155.2 and 209.611-11.5SOFT1.25/1.2550512 × 512

All the patients in the study cohort received intravenously 1.0-1.5 mL/kg of iomeprol 400 mgI/mL (Iomeron 400®, Bracco Diagnostics, Milan, Italy) except for one patient who received intravenously 1.8 mL/kg of ioversol 350 mgI/mL (Optiray PF 350®, Guerbet, Aulnay-sous-Bois, France). Contrast medium was injected at a rate of 2 mL/sec with an automatic power injector and a bolus tracking CT density threshold (SmartPrep®, GE Healthcare) of 100 HU. In the standard CT scan protocol, the portal phase scan is acquired at 80 s. The contrast medium injection was followed by a saline flush of 50-60 mL which was injected at 2 mL/sec.

CRLM segmentation and texture analysis

The texture analysis of the CRLMs was performed with the SOPHiA Radiomics beta-hepatic-metastasis software (version 2.1.7) of SOPHiA GENETICS. The DICOM images of the baseline 1.25 mm portal venous phase scans were used for the texture analysis.

Prior to feature extraction trilinear voxel size normalization (resampling) was performed to normalize the voxel size to 1 mm × 1 mm × 1 mm. A mean ± three standard deviations (3SD) for intensity rescaling was used. For the basic first order intensity-based features there was no discretization applied. Grey level intensity discretization was performed by using 32 grey levels for the discretized intensity-based features as well as for the second order texture features (fixed bin number of 32).

A 3D semi-automatic technique was used to perform the segmentation of a single target CRLM in each patient. Where the segmentation was inaccurate, the contours were manually edited. In a few cases complete manual segmentation of the CRLMs was required. All the segmentations were performed by the principal investigator (general radiologist with 20 years of CT experience). The major hepatic vessels, edge of the liver and the hypervascular rims which can be associated with some CRLMs (rarely encountered on portal venous phase scans) were excluded from the radiomics analysis. No intra- or inter-observer variation was evaluated.

The radiomics features which were calculated and extracted meet the standards and criteria of the Image Biomarker Standardization Initiative (IBSI)[23].

The radiomics features extracted with SOPHiA Radiomics are listed in Supplementary Table S1. The radiomics features include morphological indicators (27 features), statistics (21 features), local intensity indicators (4 features), intensity histogram indicators (24 features), volume intensity histogram indicators (5 features), grey level co-occurrence matrix texture indicators (26 features), grey level run length matrix (GLRLM) texture indicators (16 features), grey level size zone matrix texture indicators (16 features), grey level distance zone matrix texture indicators (16 features), neighborhood grey tone difference matrix texture indicators (3 features) and neighborhood grey level difference (NGLDM) texture indicators (17 features).

Response evaluation

A single target CRLM without clear necrosis or calcification was analyzed in each patient on the baseline and follow-up CT scan. The RECIST 1.1 criteria were used to assess the response to treatment[7]. No non-target liver metastases were included in this study.

The patients in whom the liver metastases demonstrated a complete response (CR) or partial (PR) were classified as responders and the patients with either stable disease (SD) or progressive disease (PD) were classified as non-responders.

Following the technique illustrated by Ahn et al[19], a single target CRLM which demonstrated the best PR or CR (not necessarily the largest lesion) was evaluated in each responder. In each non-responder a single target liver metastasis which demonstrated the worst response to treatment (SD or PD) was segmented.

Independent observer

An independent general radiologist (25 years of experience in CT and oncologic imaging) visually confirmed and validated the selected CRLMs and the accuracy of the segmentations of the volumes of interest of target lesions. Where required, further manual editing was performed and a mutual consensus was reached regarding the final segmentations.

Statistical methods

Categorical variables were described by frequencies and percentages and continuous variables by medians and interquartile ranges (IQRs). Associations between exposures and response to chemotherapy were assessed by non-parametric Fisher’s exact tests and Kruskal-Wallis tests, for categorical and continuous variables respectively.

In order to limit the influence of extreme values, radiomic features were categorized into tertiles and the corresponding pseudo-continuous variables were calculated assigning 1 to the 1st tertile, 2 to the 2nd tertile and 3 to the 3rd tertile. Logistic regression models were fitted to estimate the associations between clinical response and each pseudo-continuous variable and the likelihood ratio test was applied to assess the significance of the association.

Redundant features were identified and excluded based on analysis of correlations. Features statistically significant in the univariable models were included in the multiple model. The performance of the multiple model in predicting response to therapy was assessed by the area under the receiver operating characteristic (ROC) curve (AUC). The best cut-off of the linear predictor was identified as the point on the ROC curve nearest to the point with sensitivity and specificity both equal to 1; the corresponding sensitivity and specificity were estimated. AUC estimate adjusted for optimism was obtained with a validation procedure based on bootstrap resampling[24]. A nomogram was built from the multiple model.

All the statistical tests were two-sided with a significance level of 0.05. The analyses were conducted with the statistical software R version 4.0.2, and its package rms.

RESULTS
Patient characteristics

The CT scans of 236 consecutive patients with CRLMs who presented from March 2012 to May 2020 were retrospectively reviewed. Only 29 patients with CRLMs fulfilled all the inclusion criteria (Figure 1).

Figure 1
Figure 1 Patient selection flow chart. RIS: Radiology information system; ICD-10: International Classification of Diseases and Related Health Problems, 10th revision; RFA: Radiofrequency ablation; CR: Complete response; PR: Partial response; SD: Stable disease; PD: Progressive disease.

The demographic, clinical and tumor characteristics of the patient cohort are summarized in Table 2. Fifteen patients were classified as responders (all with PR) and 14 patients were classified as non-responders (7 SD and 7 PD) (Table 3). The median age at diagnosis was 59 years (IQR: 52 to 73) and 62% of participants were male.

Table 2 Characteristics of the patients, overall and by response to first-line chemotherapy.
All
Responders
Non-responders
P valuea

n
%
n
%
n
%

Age at diagnosis (yr)159(52-73)60(52-74)59(54-71)0.79
Sex1.00
Female11(38)6(40)5(36)
Male18(62)9(60)9(64)
Position of colorectal Tumor 0.71
Colon (incl. rectosigmoid)18(62)10(67)8(57)
Rectum11(38)5(33)6(43)
T-stage of the primary tumor1.00
T322(81)11(85)11(79)
T45(19)2(15)3(21)
Unknown220
N-stage of the primary tumor0.85
N05(22)2(20)3(23)
N15(22)3(30)2(15)
N213(57)5(50)8(62)
Unknown651
Primary CRC grade0.60
Moderate25(86)12(80)13(93)
Poor4(14)3(20)1(7)
M-stage of the primary tumor1.00
M03(10)2(13)1(7)
M126(90)13(87)13(93)
KRAS mutation status1.00
Wild type5(42)2(40)3(43)
Mutant7(58)3(60)4(57)
Unknown17107
Extent of metastatic disease0.71
Liver only18(62)10(67)8(57)
Liver and extrahepatic11(38)5(33)6(43)
CRLM timing
Synchronous26(90)13(87)13(93)1.00
Metachronous3(10)2(13)1(7)
Number of metastases0.05
≤ 510(34)2(13)8(57)
6-107(24)5(33)2(14)
> 1012(41)8(53)4(29)
Maximum size of metastases (mm)0.49
< 308(28)4(27)4(29)
30-7015(52)9(60)6(43)
> 706(21)2(13)4(29)
Target liver metastases
Baseline maximum transverse diameter (cm)12.7(2.0-3.3)2.9(2.6-3.4)2.4(1.8-3.0)0.14
Baseline lesion volume (cm³)17.7(3.6-12.7)8.3(6.2-12.2)5.2(3.1-12.3)0.32
CEA (ng/mL)1107(10-171)130(28-239)51(11-136)0.24
CA19-9 (IU/mL)1,2127(37-377)136(40-327)59(21-773)0.77
Table 3 Summary of Response Evaluation Criteria in Solid Tumors response and chemotherapy regimes in response and non-response group.

Response group
Non-response group
RECIST response
CR0
PR15
SD7
PD7
Chemotherapy regimen
FOLFOX44
FOLFIRI43
FOLFOXIRI20
CAPE-OX23
CAPE-IRI23
Capecitabine11
Number of chemotherapy cycles between baseline and follow-up scan
Range in cycles (median)3-12 (8)3-12 (6)
Time between baseline and follow-up scan
Range in d (median)72-203 (141)76-198(111)

Among the patient characteristics, only the number of CRLMs showed a positive correlation with the response group (P = 0.05, Table 2). Only 2 of the responders presented with oligometastases (≤ 5) in comparison with 8 of the non-responders. The responders presented with significantly more extensive CRLMs (> 5 metastases).

Chemotherapy regimens and follow-up periods

The chemotherapy regimens in the response and non-response group are summarized in Table 3. Both groups received between 3 and 12 cycles of chemotherapy between the baseline and follow-up scan, but the median was 8 cycles in the response group and 6 cycles in the non-response group. The FOLFOXIRI regimen was followed by two of the responders, but none of the non-responders. The time interval between the baseline CT scan and the start of chemotherapy varied between 3 and 51 d in the response group (median 18.0 d) and between 6 and 39 d in the non-response group (median 18.5 d). The interval between the baseline and follow-up CT scan varied between 10.3 and 29.0 wk in the response group (median 20.1 wk) and between 10.9 to 28.3 wk in the non-response group (median 15.8 wk).

Radiomic texture features and response to chemotherapy

In univariable analyses eight radiomic features were significantly associated with chemotherapy response (Table 4 and Supplementary Table 1), namely: Minimum histogram gradient intensity (intensity histogram indicator), skewness and discretized skewness (statistics), volume at intensity fraction 10 (volume intensity histogram indicator), three grey level run length indicators (GLRLM, long run low grey level emphasis, low grey level run emphasis, short run low grey level emphasis) and low grey level count emphasis (neighboring grey level dependence matrix, NGLDM). Due to strong correlations within two groups of radiomic features (Figure 2), only minimum histogram gradient intensity (tertiles: 21 and 23) and long run low grey level emphasis (tertiles: 0.0086 and 0.0103) were included in the multiple analysis (Table 4).

Figure 2
Figure 2 Correlations among radiomic features associated with response. Pearson’s correlation between radiomic features tertiles regarded as pseudo-continuous variables.
Table 4 Radiomic features associated with response to chemotherapy.
Univariable models
Multiple model

OR (95%CI)
P value1
AUC
OR (95%CI)
P value1
AUC
Minimum histogram gradient intensity3.82 (1.26-15.3)0.020.743.24 (1.05-12.00)0.040.80
Discretized intensity skewness0.33 (0.11-0.86)0.020.73
Skewness0.33 (0.11-0.86)0.020.73
Long run low grey level emphasis3.01 (1.16-9.26)0.020.732.84 (0.98-10.09)0.05
Low grey level count emphasis3.01 (1.16-9.26)0.020.73
Low grey level run emphasis3.01 (1.16-9.26)0.020.73
Volume at intensity fraction 10%0.33 (0.11-0.86)0.020.73
Short run low grey level emphasis2.83 (1.08-8.81)0.030.71

The AUC of the multiple model was 0.80 (95%CI: 0.64 to 0.96); the best threshold of the linear predictor was 0.42, corresponding to a sensitivity of 0.73 (95%CI: 0.48 to 0.89) and a specificity of 0.79 (95%CI: 0.52 to 0.92). The optimism-adjusted AUC estimate from bootstrap validation was 0.77. Figure 3 shows the prognostic nomogram resulting from the multiple model together with the empirical distributions of the linear predictor from the best model in the two groups. CT images of a few responding and non-responding CRLMs are shown in Figure 4.

Figure 3
Figure 3 Prognostic nomogram of response to chemotherapy for patients. Interpretation is as follows: for each predictor, determine the corresponding points by drawing a straight line up from the patient’s value; sum the points obtained for each predictor and locate the total sum on the upper point line. Identify the corresponding value in the linear predictor scale by drawing a straight line down. Values of linear predictor greater than the threshold (0.42) predict response; values less than the threshold predict no response.
Figure 4
Figure 4 Appearance of typical responding and non-responding liver metastases. A: Responder pre chemotherapy; B: Responder post chemotherapy; C: Responder pre chemotherapy histogram; D: Responder pre chemotherapy; E: Responder post chemotherapy; F: Responder pre chemotherapy histogram; G: Responder pre chemotherapy; H: Responder post chemotherapy; I: Responder pre chemotherapy histogram; J: Non-responder pre chemotherapy with annular carcinoma of transverse colon; K: Non-responder post chemotherapy with metallic stent in the transverse colon; L: Non-responder pre chemotherapy histogram.
DISCUSSION

The aim of this study was to determine if the pre-treatment CT texture analysis of CRLMs can predict the response to first-line cytotoxic chemotherapy with the RECIST 1.1 criteria as gold standard. In our study, only the solid soft tissue component of the CRLMs was analyzed with texture analysis and metastases which demonstrated clear necrosis and calcifications were excluded. Compared with other studies, a larger range of first and second order texture features were also analyzed on thin 1.25 mm portal venous phase CT reconstructions.

Our results showed a correlation between the minimum histogram gradient intensity[23], negative skewness[25], discretized intensity skewness, volume at intensity fraction 10, various low grey level GLRLM features (low grey level run emphasis, short run low grey level emphasis, long run low grey level emphasis)[23,26,27] and low grey level count emphasis (NGLDM)[23,28] in responding CRLMs. Except for skewness, we are not aware that any other studies have reported the predictive first and second order texture features which were associated with response in our study. In the multiple model combining minimum histogram gradient intensity and long run low grey level emphasis the AUC of the multiple model was 0.80 (95%CI: 0.64 to 0.96).

The CRLMs in our study were not biopsied to determine if there are specific histopathological patterns which are correlated with the primary and secondary order textures that were associated with chemotherapy response. Few studies have investigated the correlation between the pathological changes in cancer, texture analysis and various CT density measurements. In general, tumor heterogeneity is associated with higher skewness, higher standard deviation, higher entropy, lower uniformity and higher kurtosis and has been reported to predict a poorer patient prognosis[14,19,29]. Tumor heterogeneity reflects internal variation due to variation in cellularity, hypoxia, distribution of tumor vessels, necrosis, fibrosis, hemorrhage, myxoid changes and other factors[30-32]. Research is suggesting that the CT texture analysis may reflect tumor angiogenesis and hypoxia[31,33] and that tumors with low levels of angiogenesis are more likely to exhibit hypoxia and necrosis[33]. Some studies have demonstrated a correlation between skewness and the presence of an underlying KRAS mutation in CRC. Lubner et al[34] reported a negative trend between skewness and KRAS mutations. In the study by Yang et al[35] skewness also showed power in predicting the presence of KRAS/NRAS/BRAF mutations in CRC. Unfortunately, the KRAS mutation status was only tested in a limited number of our cases and therefore the texture differences between CRLMs with KRAS wild-type vs KRAS mutations were not assessed. Negative skewness may potentially also represent more pronounced low attenuation areas due to small areas of tumoral necrosis, chronic hemorrhage or myxoid change[36] which are not clearly visible to the naked eye. To the best of our knowledge, no studies have investigated the biological correlations of the GLRLM and NGLDM second order texture features.

Patients who received first-line cytotoxic chemotherapy were evaluated in studies by Ahn et al[19] and Ravanelli et al[37]. Ahn et al[19] showed that in the responding CRLMs on cytotoxic chemotherapy two first order histogram features, namely lower skewness in 2D and a narrower standard deviation on the 3D texture analysis, were significantly associated with chemotherapy response. We found no significant correlation between the standard deviation and the prediction of response in our study which can potentially be explained by the fact that we excluded necrotic CRLMs (necrosis will increase the standard deviation) which may be associated with non-responding CRLMs. In the study by Ravanelli et al[37] none of the assessed first-order textures could discriminate between the responders and non-responders in the FOLFOX/FOLFIRI group according to the RECIST 1.1 criteria and this is consistent with our findings.

The responding patients in our study presented with more extensive liver metastases. There was no statistically significant difference in the position of the colorectal cancer, in the TNM stage or tumor grade of the primary CRC or in the size (longest diameters according to RECIST criteria) and volumes of the CRLMs between the responders and non-responders. This leads one to assume that the responding CRLMs were probably associated with a more aggressive biological behavior[38].

Although the role of texture analysis is still being investigated it has the potential to impact positively on the therapeutic management of patients with cancer once predictive and prognostic biomarkers have been validated. The correlation between the texture features and the biological, histological, and genetic variables requires further research with histologically validated studies.

This study shows some limitations. The study design is retrospective and included a relatively small cohort of patients. Moreover, some of the CT acquisition parameters[39-43] and the total volume of contrast (mL/kg) injected varied slightly in a few patients.

The selection of the first-line cytotoxic chemotherapy regimen, the number of chemotherapy cycles administered and the time interval between the baseline and follow-up scans varied in the study cohort. Although this may impact on the results, this is reflective of actual clinical oncology practice and it is important to develop radiomics signatures which will have practical applications in clinical practice.

Finally, the accuracy of the segmentations was checked by an independent observer, but the inter- and intra-observer variability was not evaluated. However, a semi-automatic segmentation technique was used which can reduce inter-user variability[44].

CONCLUSION

Our study identified a few new texture features and a promising radiomics signature which are significantly associated with the response of CRLMs to first-line cytotoxic chemotherapy. These preliminary results need to be validated and confirmed on larger patient cohorts. Further investigations are required to determine if the predictive texture features have any prognostic value and are linked to the KRAS mutation status of CRLMs.

ARTICLE HIGHLIGHTS
Research background

Radiomics is a rapidly growing field of radiological research. In radiomics, computed tomography (CT) texture analysis quantifies tissue heterogeneity and has shown promise in predicting pathological features, the overall survival and the response to therapy in oncology. In the last few years a few studies have reported that texture analysis can be helpful in predicting the response to chemotherapy for colorectal liver metastases, but the results have been heterogeneous.

Research motivation

In previously published texture analysis studies on the first-line chemotherapy response of colorectal liver metastases (CRLMs), necrotic CRLMs were not clearly excluded. Thicker CT slice reconstructions were utilized in most studies which could have influenced the radiomics results due to partial voxel artefacts. Limited first and second order texture features were also analyzed in previous studies.

Research objectives

The aim of this study was to identify new predictive imaging biomarkers in patients with non-necrotic CRLMs who received first-line cytotoxic chemotherapy. CT texture analysis was performed on non-necrotic CRLMs utilizing 1.25 mm portal venous phase CT reconstructions. We also assessed a larger range of first and second order texture features.

Research methods

A total of 236 patients with CRLMs who received first-line cytotoxic chemotherapy in our private institution from March 2012 to May 2020 were retrospectively identified on our radiology information system. There were various inclusion and exclusion criteria and the final study cohort consisted of 29 patients. Multiple first and second order texture features were analyzed with the SOPHiA Radiomics software to identify predictive biomarkers in the responding CRLMs.

Research results

Our study identified a few new texture features and a promising radiomics signature which are significantly associated with the response of CRLMs to first-line cytotoxic chemotherapy. In univariable analysis eight texture features of the responding non-necrotic CRLMs were associated with treatment response, but due to strong pairwise correlations among some of the features, only two features namely minimum histogram gradient intensity and long run low grey level emphasis were included in the multiple analyses and final radiomics signature. The results of this study were unique but need to be validated and confirmed on larger patient cohorts.

Research conclusions

Future radiomics studies should attempt to quantify the difference in the texture analysis results of necrotic vs non-necrotic CRLMs utilizing different CT slice reconstructions in the same study cohort to compare the predictive value of texture analysis. These factors may partially account for the heterogeneous results which have been reported in the last few years. To allow for the better comparison between radiomics studies we should work towards the standardization of study designs, interscanner differences, acquisition parameters, analysis algorithms, the feature extraction techniques, analysis methodologies and the group of texture features which should be evaluated based on the different types of cancer.

Research perspectives

The preliminary results of our study need to be validated and confirmed on larger patient cohorts. Further investigations are required to determine if the predictive texture features have any prognostic value and are linked to the KRAS mutation status of CRLMs. Standardization of radiomics studies is required to compare the texture analysis results of different studies.

ACKNOWLEDGEMENTS

SOPHiA GENETICS for sponsoring their SOPHiA Radiomics software and services for the duration of the Master in Oncologic Imaging. Dr. Dupper L (private oncologist at Cancercare, Port Elizabeth, South Africa) for assisting with the collection of the clinical and pathology results of the study cohort and for providing general clinical information on the management of colorectal liver metastases (CRLMs). Dr. Crocket J (private oncologist at Cancercare, Port Elizabeth, South Africa) for providing general clinical background information on the chemotherapeutic management of patients with CRLMs. Dr. Basson S (general radiologist at Bay Radiology, Port Elizabeth, South Africa) who acted as independent observer to confirm the accurate segmentation and selection of the CRLMs for the study.

Footnotes

Provenance and peer review: Invited article; Externally peer reviewed.

Peer-review model: Single blind

Corresponding Author's Membership in Professional Societies: Radiological Society of South Africa; Health Professions Council of South Africa.

Specialty type: Radiology, nuclear medicine and medical imaging

Country/Territory of origin: Italy

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): B

Grade C (Good): C

Grade D (Fair): D, D

Grade E (Poor): 0

P-Reviewer: Cassese G, Gao W, Sato Y, Zhang Y S-Editor: Wu YXJ L-Editor: Filipodia P-Editor: Wu YXJ

References
1.  Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394-424.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 53206]  [Cited by in F6Publishing: 53391]  [Article Influence: 8898.5]  [Reference Citation Analysis (124)]
2.  Kemeny N. Management of liver metastases from colorectal cancer. Oncology (Williston Park). 2006;20:1161-1176, 1179; discussion 1179.  [PubMed]  [DOI]  [Cited in This Article: ]
3.  Colucci G, Gebbia V, Paoletti G, Giuliani F, Caruso M, Gebbia N, Cartenì G, Agostara B, Pezzella G, Manzione L, Borsellino N, Misino A, Romito S, Durini E, Cordio S, Di Seri M, Lopez M, Maiello E, Montemurro S, Cramarossa A, Lorusso V, Di Bisceglie M, Chiarenza M, Valerio MR, Guida T, Leonardi V, Pisconti S, Rosati G, Carrozza F, Nettis G, Valdesi M, Filippelli G, Fortunato S, Mancarella S, Brunetti C; Gruppo Oncologico Dell'Italia Meridionale. Phase III randomized trial of FOLFIRI vs FOLFOX4 in the treatment of advanced colorectal cancer: a multicenter study of the Gruppo Oncologico Dell'Italia Meridionale. J Clin Oncol. 2005;23:4866-4875.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 520]  [Cited by in F6Publishing: 546]  [Article Influence: 28.7]  [Reference Citation Analysis (0)]
4.  Folprecht G, Lutz MP, Schöffski P, Seufferlein T, Nolting A, Pollert P, Köhne CH. Cetuximab and irinotecan/5-fluorouracil/folinic acid is a safe combination for the first-line treatment of patients with epidermal growth factor receptor expressing metastatic colorectal carcinoma. Ann Oncol. 2006;17:450-456.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 175]  [Cited by in F6Publishing: 192]  [Article Influence: 10.7]  [Reference Citation Analysis (0)]
5.  Saltz LB, Clarke S, Díaz-Rubio E, Scheithauer W, Figer A, Wong R, Koski S, Lichinitser M, Yang TS, Rivera F, Couture F, Sirzén F, Cassidy J. Bevacizumab in combination with oxaliplatin-based chemotherapy as first-line therapy in metastatic colorectal cancer: a randomized phase III study. J Clin Oncol. 2008;26:2013-2019.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2302]  [Cited by in F6Publishing: 2226]  [Article Influence: 139.1]  [Reference Citation Analysis (0)]
6.  Tabernero J, Van Cutsem E, Díaz-Rubio E, Cervantes A, Humblet Y, André T, Van Laethem JL, Soulié P, Casado E, Verslype C, Valera JS, Tortora G, Ciardiello F, Kisker O, de Gramont A. Phase II trial of cetuximab in combination with fluorouracil, leucovorin, and oxaliplatin in the first-line treatment of metastatic colorectal cancer. J Clin Oncol. 2007;25:5225-5232.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 247]  [Cited by in F6Publishing: 234]  [Article Influence: 13.8]  [Reference Citation Analysis (0)]
7.  Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, Dancey J, Arbuck S, Gwyther S, Mooney M, Rubinstein L, Shankar L, Dodd L, Kaplan R, Lacombe D, Verweij J. New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer. 2009;45:228-247.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 15860]  [Cited by in F6Publishing: 20230]  [Article Influence: 1348.7]  [Reference Citation Analysis (1)]
8.  Egger ME, Cannon RM, Metzger TL, Nowacki M, Kelly L, Tatum C, Scoggins CR, Callender GG, McMasters KM, Martin RC 2nd. Assessment of chemotherapy response in colorectal liver metastases in patients undergoing hepatic resection and the correlation to pathologic residual viable tumor. J Am Coll Surg. 2013;216:845-856; discussion 856.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 31]  [Cited by in F6Publishing: 32]  [Article Influence: 2.9]  [Reference Citation Analysis (0)]
9.  Rubbia-Brandt L, Giostra E, Brezault C, Roth AD, Andres A, Audard V, Sartoretti P, Dousset B, Majno PE, Soubrane O, Chaussade S, Mentha G, Terris B. Importance of histological tumor response assessment in predicting the outcome in patients with colorectal liver metastases treated with neo-adjuvant chemotherapy followed by liver surgery. Ann Oncol. 2007;18:299-304.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 369]  [Cited by in F6Publishing: 376]  [Article Influence: 20.9]  [Reference Citation Analysis (0)]
10.  Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F, Rietbergen MM, Leemans CR, Dekker A, Quackenbush J, Gillies RJ, Lambin P. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2262]  [Cited by in F6Publishing: 3013]  [Article Influence: 301.3]  [Reference Citation Analysis (0)]
11.  Court LE, Rao A, Krishnan S. Radiomics in cancer diagnosis, cancer staging, and prediction of response to treatment. Transl Cancer Res. 2016;5:337-339.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 8]  [Cited by in F6Publishing: 8]  [Article Influence: 1.0]  [Reference Citation Analysis (0)]
12.  Ganeshan B, Skogen K, Pressney I, Coutroubis D, Miles K. Tumour heterogeneity in oesophageal cancer assessed by CT texture analysis: preliminary evidence of an association with tumour metabolism, stage, and survival. Clin Radiol. 2012;67:157-164.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 232]  [Cited by in F6Publishing: 246]  [Article Influence: 18.9]  [Reference Citation Analysis (0)]
13.  Ganeshan B, Miles KA, Young RC, Chatwin CR. In search of biologic correlates for liver texture on portal-phase CT. Acad Radiol. 2007;14:1058-1068.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 54]  [Cited by in F6Publishing: 59]  [Article Influence: 3.5]  [Reference Citation Analysis (0)]
14.  Miles KA, Ganeshan B, Griffiths MR, Young RC, Chatwin CR. Colorectal cancer: texture analysis of portal phase hepatic CT images as a potential marker of survival. Radiology. 2009;250:444-452.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 196]  [Cited by in F6Publishing: 206]  [Article Influence: 13.7]  [Reference Citation Analysis (0)]
15.  Ganeshan B, Panayiotou E, Burnand K, Dizdarevic S, Miles K. Tumour heterogeneity in non-small cell lung carcinoma assessed by CT texture analysis: a potential marker of survival. Eur Radiol. 2012;22:796-802.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 364]  [Cited by in F6Publishing: 383]  [Article Influence: 29.5]  [Reference Citation Analysis (0)]
16.  Miles KA, Ganeshan B, Rodriguez-Justo M, Goh VJ, Ziauddin Z, Engledow A, Meagher M, Endozo R, Taylor SA, Halligan S, Ell PJ, Groves AM. Multifunctional imaging signature for V-KI-RAS2 Kirsten rat sarcoma viral oncogene homolog (KRAS) mutations in colorectal cancer. J Nucl Med. 2014;55:386-391.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 57]  [Cited by in F6Publishing: 58]  [Article Influence: 5.8]  [Reference Citation Analysis (0)]
17.  Zhang H, Graham CM, Elci O, Griswold ME, Zhang X, Khan MA, Pitman K, Caudell JJ, Hamilton RD, Ganeshan B, Smith AD. Locally advanced squamous cell carcinoma of the head and neck: CT texture and histogram analysis allow independent prediction of overall survival in patients treated with induction chemotherapy. Radiology. 2013;269: 801-809.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 149]  [Cited by in F6Publishing: 161]  [Article Influence: 14.6]  [Reference Citation Analysis (0)]
18.  Rao SX, Lambregts DM, Schnerr RS, Beckers RC, Maas M, Albarello F, Riedl RG, Dejong CH, Martens MH, Heijnen LA, Backes WH, Beets GL, Zeng MS, Beets-Tan RG. CT texture analysis in colorectal liver metastases: A better way than size and volume measurements to assess response to chemotherapy? United European Gastroenterol J. 2016;4:257-263.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 75]  [Cited by in F6Publishing: 88]  [Article Influence: 9.8]  [Reference Citation Analysis (0)]
19.  Ahn SJ, Kim JH, Park SJ, Han JK. Prediction of the therapeutic response after FOLFOX and FOLFIRI treatment for patients with liver metastasis from colorectal cancer using computerized CT texture analysis. Eur J Radiol. 2016;85:1867-1874.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 73]  [Cited by in F6Publishing: 92]  [Article Influence: 11.5]  [Reference Citation Analysis (0)]
20.  Beckers RCJ, Trebeschi S, Maas M, Schnerr RS, Sijmons JML, Beets GL, Houwers JB, Beets-Tan RGH, Lambregts DMJ. CT texture analysis in colorectal liver metastases and the surrounding liver parenchyma and its potential as an imaging biomarker of disease aggressiveness, response and survival. Eur J Radiol. 2018;102:15-21.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 34]  [Cited by in F6Publishing: 30]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
21.  Liang HY, Huang YQ, Yang ZX, Ying-Ding, Zeng MS, Rao SX. Potential of MR histogram analyses for prediction of response to chemotherapy in patients with colorectal hepatic metastases. Eur Radiol. 2016;26:2009-2018.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 53]  [Cited by in F6Publishing: 54]  [Article Influence: 6.0]  [Reference Citation Analysis (0)]
22.  Zhang H, Li W, Hu F, Sun Y, Hu T, Tong T. MR texture analysis: potential imaging biomarker for predicting the chemotherapeutic response of patients with colorectal liver metastases. Abdom Radiol (NY). 2019;44:65-71.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 45]  [Article Influence: 9.0]  [Reference Citation Analysis (0)]
23.  Zwanenburg A, Leger S, Vallières M.   Image biomarker standardisation initiative. arXiv preprint arXiv:1612.07003. 2016.  [PubMed]  [DOI]  [Cited in This Article: ]
24.  Harrell FE  Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis. 2nd ed. New York: Springer; 2015.  [PubMed]  [DOI]  [Cited in This Article: ]
25.  Lubner MG, Smith AD, Sandrasegaran K, Sahani DV, Pickhardt PJ. CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges. Radiographics. 2017;37:1483-1503.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 422]  [Cited by in F6Publishing: 536]  [Article Influence: 76.6]  [Reference Citation Analysis (1)]
26.  Galloway MM. Texture classification using gray level run length. Comput Graph Image Process. 1975;4:172-179.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1432]  [Cited by in F6Publishing: 1418]  [Article Influence: 28.9]  [Reference Citation Analysis (0)]
27.  Chu A, Sehgal CM, Greenleaf JF. Use of gray value distribution of run lengths for texture analysis. Pattern Recognition Letters. 1990;11:415-419.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 297]  [Cited by in F6Publishing: 296]  [Article Influence: 8.7]  [Reference Citation Analysis (0)]
28.  Sun C, Wee WG.   Neighboring gray level dependence matrix for texture classification. computer vision, graphics, and image processing. 1983; 23: 341-352.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 235]  [Cited by in F6Publishing: 109]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
29.  Ganeshan B, Abaleke S, Young RC, Chatwin CR, Miles KA. Texture analysis of non-small cell lung cancer on unenhanced computed tomography: initial evidence for a relationship with tumour glucose metabolism and stage. Cancer Imaging. 2010;10:137-143.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 232]  [Cited by in F6Publishing: 235]  [Article Influence: 16.8]  [Reference Citation Analysis (0)]
30.  Davnall F, Yip CS, Ljungqvist G, Selmi M, Ng F, Sanghera B, Ganeshan B, Miles KA, Cook GJ, Goh V. Assessment of tumor heterogeneity: an emerging imaging tool for clinical practice? Insights Imaging. 2012;3:573-589.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 592]  [Cited by in F6Publishing: 654]  [Article Influence: 54.5]  [Reference Citation Analysis (0)]
31.  Ganeshan B, Goh V, Mandeville HC, Ng QS, Hoskin PJ, Miles KA. Non-small cell lung cancer: histopathologic correlates for texture parameters at CT. Radiology. 2013;266: 326-336.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 301]  [Cited by in F6Publishing: 347]  [Article Influence: 28.9]  [Reference Citation Analysis (0)]
32.  Nelson DA, Tan TT, Rabson AB, Anderson D, Degenhardt K, White E. Hypoxia and defective apoptosis drive genomic instability and tumorigenesis. Genes Dev. 2004;18:2095-2107.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 179]  [Cited by in F6Publishing: 193]  [Article Influence: 9.7]  [Reference Citation Analysis (0)]
33.  Ganeshan B, Ziauddin Z, Goh V, Rodriguez-Justo M, Engledow A, Taylor S, Halligan S, Miles K, Groves A. Quantitative imaging biomarkers from PET-CT as potential correlates for angiogenesis and hypoxia in colorectal cancer. European Congress Radio. 2012;.  [PubMed]  [DOI]  [Cited in This Article: ]
34.  Lubner MG, Stabo N, Lubner SJ, del Rio AM, Song C, Halberg RB, Pickhardt PJ. CT textural analysis of hepatic metastatic colorectal cancer: pre-treatment tumor heterogeneity correlates with pathology and clinical outcomes. Abdom Imaging. 2015;40:2331-2337.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 177]  [Cited by in F6Publishing: 211]  [Article Influence: 26.4]  [Reference Citation Analysis (0)]
35.  Yang L, Dong D, Fang M, Zhu Y, Zang Y, Liu Z, Zhang H, Ying J, Zhao X, Tian J. Can CT-based radiomics signature predict KRAS/NRAS/BRAF mutations in colorectal cancer? Eur Radiol. 2018;28:2058-2067.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 120]  [Cited by in F6Publishing: 108]  [Article Influence: 18.0]  [Reference Citation Analysis (0)]
36.  Kim HC, Lee JM, Kim SH, Park SH, Lee JW, Lee M, Han JK, Choi BI. Small gastrointestinal stromal tumours with focal areas of low attenuation on CT: pathological correlation. Clin Radiol. 2005;60:384-388.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 17]  [Cited by in F6Publishing: 10]  [Article Influence: 0.5]  [Reference Citation Analysis (0)]
37.  Ravanelli M, Agazzi GM, Tononcelli E, Roca E, Cabassa P, Baiocchi G, Berruti A, Maroldi R, Farina D. Texture features of colorectal liver metastases on pretreatment contrast-enhanced CT may predict response and prognosis in patients treated with bevacizumab-containing chemotherapy: a pilot study including comparison with standard chemotherapy. Radiol Med. 2019;124:877-886.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 29]  [Cited by in F6Publishing: 25]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
38.  Gayowski TJ, Iwatsuki S, Madariaga JR, Selby R, Todo S, Irish W, Starzl TE. Experience in hepatic resection for metastatic colorectal cancer: analysis of clinical and pathologic risk factors. Surgery. 1994;116:703-710; discussion 710.  [PubMed]  [DOI]  [Cited in This Article: ]
39.  Mackin D, Fave X, Zhang L, Fried D, Yang J, Taylor B, Rodriguez-Rivera E, Dodge C, Jones AK, Court L. Measuring Computed Tomography Scanner Variability of Radiomics Features. Invest Radiol. 2015;50:757-765.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 388]  [Cited by in F6Publishing: 457]  [Article Influence: 57.1]  [Reference Citation Analysis (0)]
40.  Buch K, Li B, Qureshi MM, Kuno H, Anderson SW, Sakai O. Quantitative Assessment of Variation in CT Parameters on Texture Features: Pilot Study Using a Nonanatomic Phantom. AJNR Am J Neuroradiol. 2017;38:981-985.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 37]  [Cited by in F6Publishing: 40]  [Article Influence: 5.7]  [Reference Citation Analysis (0)]
41.  Mackin D, Ger R, Dodge C, Fave X, Chi PC, Zhang L, Yang J, Bache S, Jones AK, Court L. Effect of tube current on computed tomography radiomic features. Sci Rep. 2018;8:2354.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 66]  [Cited by in F6Publishing: 79]  [Article Influence: 13.2]  [Reference Citation Analysis (0)]
42.  Rizzo S, Botta F, Raimondi S, Origgi D, Fanciullo C, Morganti AG, Bellomi M. Radiomics: the facts and the challenges of image analysis. Eur Radiol Exp. 2018;2:36.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 413]  [Cited by in F6Publishing: 595]  [Article Influence: 99.2]  [Reference Citation Analysis (0)]
43.  Oliver JA, Budzevich M, Hunt D, Moros EG, Latifi K, Dilling TJ, Feygelman V, Zhang G. Sensitivity of Image Features to Noise in Conventional and Respiratory-Gated PET/CT Images of Lung Cancer: Uncorrelated Noise Effects. Technol Cancer Res Treat. 2017;16:595-608.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 17]  [Cited by in F6Publishing: 17]  [Article Influence: 2.1]  [Reference Citation Analysis (0)]
44.  Parmar C, Rios Velazquez E, Leijenaar R, Jermoumi M, Carvalho S, Mak RH, Mitra S, Shankar BU, Kikinis R, Haibe-Kains B, Lambin P, Aerts HJ. Robust Radiomics feature quantification using semiautomatic volumetric segmentation. PLoS One. 2014;9:e102107.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 354]  [Cited by in F6Publishing: 411]  [Article Influence: 41.1]  [Reference Citation Analysis (0)]