Retrospective Study Open Access
Copyright ©The Author(s) 2021. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Clin Cases. Aug 26, 2021; 9(24): 7009-7021
Published online Aug 26, 2021. doi: 10.12998/wjcc.v9.i24.7009
Novel model combining contrast-enhanced ultrasound with serology predicts hepatocellular carcinoma recurrence after hepatectomy
Hai-Bin Tu, Li-Hong Chen, Yu-Jie Huang, Si-Yi Feng, Jian-Ling Lin, Department of Ultrasound, Mengchao Hepatobiliary Hospital of Fujian Medical University, Fuzhou 350025, Fujian Province, China
Yong-Yi Zeng, Department of Hepatobiliary Surgery, Mengchao Hepatobiliary Hospital of Fujian Medical University, Fuzhou 350025, Fujian Province, China
ORCID number: Hai-Bin Tu (0000-0003-4540-9937); Li-Hong Chen (0000-0002-2124-8203); Yu-Jie Huang (0000-0003-4307-8716); Si-Yi Feng (0000-0001-6305-0337); Jian-Ling Lin (0000-0002-6133-7024); Yong-Yi Zeng (0000-0001-7441-4271).
Author contributions: Tu HB designed and performed the research, and wrote and analyzed the paper; Chen LH, Huang YJ, and Feng SY designed the research, collected the data, and supervised the report; Lin JL provided clinical advice; and Zeng YY supervised the report.
Supported by Startup Fund for Scientific Research, Fujian Medical University, No. 2019QH1302.
Institutional review board statement: The study was reviewed and approved by the Mengchao Hepatobiliary Hospital of Fujian Medical University Institutional Review Board (No. 2010_010_01).
Conflict-of-interest statement: All authors have no conflicts of interest to disclose.
Data sharing statement: No additional data are available.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Yong-Yi Zeng, MD, PhD, Professor, Department of Hepatobiliary Surgery, Mengchao Hepatobiliary Hospital of Fujian Medical University, No. 312 Xihong Road, Fuzhou 350025, Fujian Province, China. lamp197311@126.com
Received: March 13, 2021
Peer-review started: March 13, 2021
First decision: June 3, 2021
Revised: June 12, 2021
Accepted: July 5, 2021
Article in press: July 5, 2021
Published online: August 26, 2021
Processing time: 163 Days and 12.6 Hours

Abstract
BACKGROUND

Surgery is the primary curative option in patients with hepatocellular carcinoma (HCC). However, recurrence within 2 years is observed in 30%–50% of patients, being a major cause of mortality.

AIM

To construct and verify a non-invasive prediction model combining contrast-enhanced ultrasound (CEUS) with serology biomarkers to predict the early recurrence of HCC.

METHODS

Records of 744 consecutive patients undergoing first-line curative surgery for HCC in one institution from 2016–2018 were reviewed, and 292 local patients were selected for analysis. General characteristics including gender and age, CEUS liver imaging reporting and data system (LIRADS) parameters including wash-in time, wash-in type, wash-out time, and wash-out type, and serology biomarkers including alanine aminotransferase, aspartate aminotransferase, platelets, and alpha-fetoprotein (AFP) were collected. Univariate analysis and multivariate Cox proportional hazards regression model were used to evaluate the independent prognostic factors for tumor recurrence. Then a nomogram called CEUS model was constructed. The CEUS model was then used to predict recurrence at 6 mo, 12 mo, and 24 mo, the cut-off value was calculate by X-tile, and each C-index was calculated. Then Kaplan-Meier curve was compared by log-rank test. The calibration curves of each time were depicted.

RESULTS

A nomogram predicting early recurrence (ER), named CEUS model, was formulated based on the results of the multivariate Cox regression analysis. This nomogram incorporated tumor diameter, preoperative AFP level, and LIRADS, and the hazard ratio was 1.123 (95% confidence interval [CI]: 1.041-1.211), 1.547 (95%CI: 1.245-1.922), and 1.428 (95%CI: 1.059-1.925), respectively. The cut-off value at 6 mo, 12 mo, and 24 mo was 100, 80, and 50, and the C-index was 0.748 (95%CI: 0.683-0.813), 0.762 (95%CI: 0.704-0.820), and 0.762 (95%CI: 0.706-0.819), respectively. The model showed satisfactory results, and the calibration at 6 mo was desirable; however, the calibration at 12 and 24 mo should be improved.

CONCLUSION

The CEUS model enables the well-calibrated individualized prediction of ER before surgery and may represent a novel tool for biomarker research and individual counseling.

Key Words: Hepatocellular carcinoma; Recurrence; Prediction; Contrast-enhanced ultrasound; Liver imaging reporting and data system; Alpha-fetoprotein

Core Tip: This study aimed to construct and verify a non-invasive prediction model combining contrast-enhanced ultrasound with serology biomarkers to predict the early recurrence of hepatocellular carcinoma. Records of 292 local patients of hepatocellular carcinoma (HCC) were selected for analysis. A nomogram predicting early recurrence (ER) named contrasted-enhanced ultrasound (CEUS) model, incorporating tumor diameter, preoperative alpha-fetoprotein level, and LIRADS, was developed. The model showed satisfactory results, and the C-index was 0.762 (95%CI: 0.706–0.819). The calibration at 6 mo was desirable. The CEUS model enables the well-calibrated individualized prediction of ER before surgery and may represent a novel tool for biomarker research and individual counseling.



INTRODUCTION

Hepatocellular carcinoma (HCC) is the sixth most common cancer and the third leading cause of cancer-related deaths worldwide[1]. Surgery is the primary curative option in patients with HCC. However, recurrence within 2 years occurs in 30%–50% of patients and is the major cause of mortality[2,3]. Identifying patients with a high recurrence risk after surgery is important so that clinicians can provide appropriate monitoring to detect the earliest stage of recurrent HCC in time and treatment may still be feasible.

The widely used tumor staging system, such as tumor node metastasis (TNM) and Barcelona clinic liver cancer (BCLC) staging, is useful for guiding surgery; however, their ability to predict recurrence has not been fully evaluated. Some models, such as the Singapore Liver Cancer Recurrence score[4], the Korean model[5], and the Surgery-Specific Cancer of the Liver Italian Program[6], have been specially developed to detect tumor recurrence after surgical resection; however, the most important parameter, that is, microvascular invasion, can only be evaluated pathologically on the resected specimens. A prognostic model that only requires preoperative available parameters may assist surgeons in planning a reasonable treatment strategy.

With the development of radiology technology and serology detection ability, predicting postoperative recurrence noninvasively is possible. Many scholars have used radiology technology or serological biomarkers to achieve this goal[7,8], but only a few have combined the two technologies; the combination of ultrasound and serological biomarkers has not been used for preoperative prediction. Ultrasound examination is favored by clinicians and patients for its lack of radiation, repeatability, and real-time monitoring. Contrast-enhanced ultrasound (CEUS) can observe tumor hemodynamics in real time, which plays an important role in evaluating the nature of a tumor. In this study, a nomogram model was constructed by fusing CEUS and a serological biomarker. The predictive ability of the model was evaluated and validated by internal resampling.

MATERIALS AND METHODS
Patient selection and study design

This study was approved by the hospital’s ethics committee (No. 2020-010-01), and all participating patients provided written informed consent. Between January 2016 and January 2018, 744 consecutive patients meeting the study’s criteria who underwent curative resection at our institution were retrospectively recruited. The exclusion criteria were as follows: (1) CEUS of the liver was unavailable; (2) CEUS was performed more than 1 mo before surgery; (3) macrovascular invasion or extrahepatic metastasis was present; (4) previous treatment (i.e., local ablation, repeated liver resection, transarterial chemoembolization, chemotherapy, and radiotherapy) before surgery; (5) liver resection was performed for a ruptured tumor or non-R0 resection; and (6) clinicopathologic or follow-up data were not available. A total of 292 patients were enrolled in this study (Figure 1).

Figure 1
Figure 1 Flow program for patient inclusion. CEUS: Contrasted-enhanced ultrasound.
CEUS technique

Ultrasound scanning was performed by a radiologist (LJL) who had 30 years of conventional ultrasound experience and 15 years of CEUS experience. She used a multi-frequency (5–2 MHz) convex array probe (C5-2) (Esaote) on a Mylab 90 system, and digital storage was recorded at the same time. Before CEUS, the whole liver must be thoroughly examined using a gray-scale ultrasound. Baseline scan included evaluation of lesions on B-mode imaging and color Doppler ultrasound in combination with tissue harmonic imaging.

Before CEUS was performed, each patient rested for 10 min and received breathing training to obtain the best image. In CEUS, 2.4 mL of a microbubble contrast agent (Sonovue, Bracco, Milan, Italy) was rapidly injected via an antecubital vein followed by a 10 mL saline flush. A sufficiently large needle (20-gauge minimum diameter) was used to avoid bubble rupture. A low mechanical index (< 0.1) was used for CEUS examination. Different dynamic phases of contrast enhancement were identified in the liver study after a microbubble-based contrast agent was injected. The contrast side-by-side mode was used via a live dual-image display. The CEUS terminology follows the ACR CEUS LI-RADS working group standard[9]. Continuous scanning was used to observe the tumor. The duration of the study included the arterial phase (0–30 s), portal phase (31–120 s), and late phase (121–300 s). Three radiologists with 5 years of working experience with CEUS classified the tumor according to the LI-RADS (Figure 2)[10], and 5v was defined as 6. If more than one tumor was detected, the biggest one was reviewed. The following parameters were also collected: (1) The maximum diameter of the lesion; (2) Starting time (the time from injection to entering the tumor); (3) Peak time (the time from the injection to the maximum intensity of the tumor); (4) Iso-time (the time from the injection to tumor enhancement was equal to peripheral); (5) Washout time (the time from the injection to the tumor enhancement lower than peripheral); (6) Enhancement type (fast-in fast-out and non-fast-in fast-out); (7) Wash-in type (fast-in and non-fast-in); (8) Washout type (fast-out, < 30 s, and non-fast-out, ≥ 30 s); (9) Enhancement echogenicity (homogeneous and inhomogeneous); and (10) Tumor location (half liver and non-half-liver, half-liver means that the tumor was located only in the left or right liver).

Figure 2
Figure 2 Official ACR algorithmic display for contrasted-enhanced ultrasound model and liver imaging reporting and data system. 1Arterial phase hyperenhancement: Whole or in part, no rim or peripheral discontinuous globular enhancement. 2Late in onset (≥ 60 s) and mild in degree: Whole or in part, with no part showing early or marked washout. 3Early onset washout (< 60 s) and/or marked (punched out) appearance and/or arterial phase rim enhancement. CEUS: Contrasted-enhanced ultrasound; LI-RADS: Liver imaging reporting and data system; US: Ultrasound; HCC: Hepatocellular carcinoma.
Serology parameters

Laboratory data within 3 d of morning fasting blood before curative treatment were obtained from medical records, which included alanine aminotransferase, aspartate aminotransferase, platelet, albumin, total bilirubin, serum creatinine, prothrombin time, prothrombin time activity, and international normalized ratio. Alpha-fetoprotein (AFP) was divided into 0–20 μg/L, 20–200 μg/L, and > 200 μg/L.

Follow-up surveillance

After resection, follow-up examination was performed every 3 mo during the study period, and data on serum AFP, liver function tests, contrast-enhanced computed tomography (CT) or magnetic resonance imaging (MRI) of the chest and abdomen, and ultrasound of the abdomen were obtained. The data were censored on January 3, 2020. Recurrence-free survival was defined as the time from the date of surgery to the date of first recurrence, metastasis, or last follow-up.

Statistical analysis

Continuous variables are expressed as the mean ± SD and were compared using an unpaired, 2-tailed t-test or Mann–Whitney test. Categorical variables were compared using the χ2 test or Fisher exact test. Survival curves were calculated using the Kaplan–Meier method and compared using the log-rank test. Multivariate Cox proportional hazards regression model was used to evaluate the independent prognostic factors for tumor recurrence. All variables associated with recurrence at a significant level were candidates for stepwise multivariate analysis. A nomogram was formulated based on the results of multivariate Cox regression analysis and by using the rms package of R, version 3.6.3 (http://www.r-project.org/). The nomogram is based on proportionally converting each regression coefficient in Cox regression to a 0-to-100-point scale. The effect of the variable with the highest β coefficient (absolute value) is assigned 100 points. The points are added across independent variables to derive the total points, which are converted to predict recurrence probabilities. The predictive performance of the nomogram was measured using C-index and calibration with 1000 bootstrap samples to decrease the over fit bias. For clinical use of the model, we tested the model’s prediction ability at 6, 12, and 24 mo and used X-tile, version 3.6.1 to calculate the optimal cut-off values. Then, Kaplan–Meier curve was analyzed[11]. The prediction error of the CEUS model and variables was assessed using the “Boot632plus” split method with 1000 iterations to calculate estimates of prediction error curves and is summarized as the integrated Brier score, which reflects a weighted average of the squared distances between observed recurrence status and predicted recurrence probability of a model; the integrated Brier score represents a valid measure of overall model performance and can range from 0, for a perfect model, to 0.25, for a noninformative model with a 50% incidence of the outcome[12]. In all analyses, P < 0.05 was considered statistically significant. All analyses were performed using R, version 3.6.3.

RESULTS
Basic characteristics

The basic characteristics are shown in Table 1. We collected 292 patients, including 238 males and 54 females, with a mean age of 55.7 ± 11.2 years.

Table 1 Basic characteristics.

Total
Non-recurrence
Recurrence
P value
Diameter (mean ± SD, cm)3.9 ± 2.33.2 ± 1.54.8 ± 2.8< 0.001
Age (mean ± SD, yr)55.7 ± 11.254.9 ± 11.356.7 ± 11.10.17
ALT (mean ± SD, U/L)35.5 ± 30.131.5 ± 21.440.7 ± 38.10.016
AST (mean ± SD, U/L)36.1 ± 34.630.4 ± 15.343.5 ± 48.90.11
PLT (mean ± SD, /L)150.2 ± 66.4145.0 ± 62.9157.2 ± 70.40.16
ALB (mean ± SD, g/L)38.8 ± 4.638.7 ± 4.838.9 ± 4.30.94
TBIL (mean ± SD, μmol/L)17.6 ± 8.916.9 ± 8.318.6 ± 9.60.16
Cr (mean ± SD, μmol/L)74.0 ± 17.574.3 ± 19.873.6 ± 14.00.42
PT (mean ± SD, s)13.8 ± 1.213.9 ± 1.213.8 ± 1.30.49
PTA(mean ± SD, )92.6 ± 14.992.3 ± 13.792.9 ± 16.30.91
INR (mean ± SD)1.1 ± 0.11.1 ± 0.11.1 ± 0.10.97
Start time (mean ± SD, s)16.8 ± 3.717.1 ± 3.916.5 ± 3.50.17
Peak time (mean ± SD, s)24.1 ± 5.624.1 ± 5.324.0 ± 6.00.45
Iso-time (mean ± SD, s)39.1 ± 16.940.9 ± 19.836.8 ± 11.70.079
Washout time (mean ± SD, s)94.8 ± 63.398.5 ± 63.389.8 ± 63.30.11
Sex, n (%)
Male238 (81.5)129 (77.7)109 (86.5)0.068
Female54 (18.5)37 (22.3)17 (13.5)
LIRADS, n (%)
310 (3.4)8 (4.8)2 (1.6)< 0.001
4176 (60.3)118 (71.1)58 (46.0)
595 (32.5)37 (22.3)58 (46.0)
611 (3.8)3 (1.8)8 (6.3)
AFP [n (%), μg/L]
< 20193 (66.1)133 (80.1)60 (47.6)< 0.001
20-20032 (11.0)13 (7.8)19 (15.1)
> 20067 (22.9)20 (12.0)47 (37.3)
Enhancement type, n (%)
Non-fast-in fast-out42 (14.4)24 (14.5)18 (14.3)1.00
Fast-in fast-out250 (85.6)142 (85.5)108 (85.7)
Wash-in type, n (%)
Non-fast-in4 (1.4)2 (1.2)2 (1.6)1.00
Fast-in288 (98.6)164 (98.8)124 (98.4)
Washout type, n (%)
Non-fast-out80 (27.4)41 (24.7)39 (31.0)0.29
Fast-out212 (72.6)125 (75.3)87 (69.0)
Enhancement type, n (%)
Homogeneous enhancement223 (76.4)127 (76.5)96 (76.2)1.00
Inhomogeneous enhancement69 (23.6)39 (23.5)30 (23.8)
Location, n (%)
Half liver261 (89.4)148 (89.2)113 (89.7)1.00
Non-half liver31 (10.6)18 (10.8)13 (10.3)
Cox regression results

Cox regression results are shown in Table 2. LI-RADS, AFP level, and tumor diameter were entered into the final model. The hazard ratio (HR) was 1.428, 1.547, and 1.123, respectively. A prediction model, named CEUS model, was constructed. The CEUS model’s integrated Brier score of prediction error was the lowest (Figure 3).

Figure 3
Figure 3 Prediction error of contrasted-enhanced ultrasound model and liver imaging reporting and data system, alpha-fetoprotein, and diameter. AFP: Alpha-fetoprotein; LIRADS: Liver imaging reporting and data system; CEUS: Contrasted-enhanced ultrasound.
Table 2 Cox model.
β
P value
HR
95.0%CI
Lower
Upper
LIRADS0.3560.0191.4281.0591.925
AFP0.4360.0001.5471.2451.922
Diameter0.1160.0031.1231.0411.211
Age0.0090.3191.0090.9911.027
ALT0.0070.0751.0070.9991.014
AST0.0030.3221.0030.9971.008
PLT0.0020.2251.0020.9991.005
TBIL0.0190.0521.0191.0001.039
Start time-0.0320.2290.9680.9181.021
Out time-0.0010.5950.9990.9961.002
Sex-0.2700.3120.7630.4531.288
Nomogram structure

The nomogram is shown in Figure 4. Every patient’s score was calculated and divided into three subgroups: 6, 12, and 24 mo.

Figure 4
Figure 4 Nomogram structure based on liver imaging reporting and data system, alpha-fetoprotein, and tumor diameter. LIRADS: Liver imaging reporting and data system; AFP: Alpha-fetoprotein; RFS: Relapse free survival.

For the 6-mo recurrence, 100 was the optimal cut-off. It can distinguish the high-risk group from the low-risk group (Figure 5A). The C-index was 0.748 (95%CI: 0.683–0.813), and the calibration curve was satisfactory (Figure 6A). For the 12-mo recurrence, 80 was the optimal cut-off. It can distinguish the high-risk group from the low-risk group (Figure 5B). The C-index was 0.762 (95%CI: 0.704–0.820), and the calibration curve was insufficient (Figure 6B). For the 24-mo recurrence, 50 was the optimal cut-off. It can distinguish the high-risk group from the low-risk group (Figure 5C). The C-index was 0.762 (95%CI: 0.706–0.819), and the calibration curve was insufficient (Figure 6C).

Figure 5
Figure 5 Kaplan–Meier curves for survival at 6 mo (A), 12 mo (B), and 24 mo (C). RFS: Relapse free survival.
Figure 6
Figure 6 Calibrated curves for recurrence at 6 mo (A), 12 mo (B), and 24 mo (C). CEUS: Contrasted-enhanced ultrasound.
DISCUSSION

This study aimed to construct and validate an early recurrence risk model before surgery, called the CEUS model, based on CEUS and serology for HCC. The CEUS model showed satisfactory results. The C-index at 6, 12, and 24 mo was 0.683–0.820. The calibration at 6 mo is good, although a 12- and 24-mo improvement is still needed. The CEUS model showed lower prediction error than a single indicator, with an integrated Brier score of 0.197. In addition, at the three study time points, using appropriate cut-off value can well distinguish high-risk groups from low-risk groups.

Resection for patients with HCC is still plagued by high recurrence, especially early recurrence[2]. This rate is approximately 30%–50% in early reports[13,14]; similar to a previous report, tumor relapse occurred in approximately half of the patients in the present study. Gene signatures may promote prognosis scoring; however, they are not used in routine clinical process[15]. Conversely, the potential and power of radiological image data, which include CT, MRI, PET, and ultrasound, are increasingly recognized in the field of oncology[16-19]. Meanwhile, serology indicators, such as albumin-to-alkaline phosphatase ratio[7], AFP[20], and neutrophil–lymphocyte ratio[21], are also widely used in this domain. In our study, parameters that may predict recurrence pre-operation were collected, rigorous statistical analysis was performed, and unimportant parameters were excluded. Finally, LIRADS, AFP level, and the maximum tumor diameter were confirmed as independent hazard factors. These factors were combined, and a novel model named the CEUS model was established.

In the past, many imaging techniques have been used for the noninvasive prediction of postoperative recurrence, and satisfactory results have been obtained. However, the use of ultrasound combined with serological biomarkers to build a prediction model is rare. The present study fully explored the advantages of CEUS and serological biomarkers and constructed the CEUS model through a series of rigorous test. We used LI-RADS because of its better accuracy compared with most previous noninvasive prediction models[8]. The overall prediction ability in the present study was as anticipated and was similar to that in previous studies[14,22]. However, the 1- and 2-year calibration degree was slightly insufficient. The main reasons are as follows: (1) The subjects included in the two studies are different. Ji et al‘s study only included patients who met the Milan criteria, but our study included all patients with radical resection. Thus, our model may have a wider applicable population; and (2) Ji et al‘s study recruited external validation queue, while only internal resampling was performed in our study. Although the calibration was insufficient, we used LI-RADS as the operation specification, which was more objective and convenient.

CEUS can dynamically display microvascular and tissue perfusion in real time, and it has good resolution and simple operation, without risk of nephrotoxicity and radiation. It is widely used in the diagnosis of clinical liver diseases. Different contrast patterns reveal varying tumor differentiation[23]. Qin et al found that the faster the washout, the higher the recurrence rate, and the C-index of this parameter was 0.756[24]. In our study, the difference in the washout time and type was not statistically significant. This result may be attributed to the following reasons: (1) The primary study end point was different. Qin et al defined early recurrence as 1 year, and in our study, the early recurrence was 2 years; (2) The definition of washout rate was different. Qin et al divided the washout rate into four grades (120 s, 60–120 s, 30–60 s, and < 30 s), but in our study, the washout time was less than 30 s and defined as fast-out in contrast to others that were non-fast-out; (3) The research subjects were different; Qin et al’s study enrolled the patients who were first discovered and after radical resection, which was pathologically confirmed; and (4) Qin et al’s study only enrolled patients with a single tumor, but our study enrolled patients with single and multiple tumors.

In the past, CEUS evaluation was mainly based on the subjective evaluation of an operator, and it lacked objective criteria. Thus, the American College of Radiology (ACR) convened a working group of international experts to develop the ACR CEUS Liver Imaging Reporting and Data System (LI-RADS) in 2014, which was implemented in 2016[10]. CEUS LI-RADS is highly specific for HCC, enabling its use for a confident non-invasive diagnosis[25]. In our study, we divided patients into different categories according to CEUS LI-RADS, which is objective and suitable for general applications. Our study also showed that LI-RADS can be used as an independent hazard factor for recurrence. The higher the LI-RADS grade, the higher the recurrence rate.

Tumor diameter can be used as an independent risk factor for postoperative recurrence and has been proven by many previous studies[26-28]; tumor size was significantly related to the outcomes in our cohort with an HR per centimeter of 1.12 for recurrence. Our findings are similar to those of Agopian et al[29], and this result supports the use of the Milan and UCSF criteria, which include the tumor size. The increase in tumor diameter suggests that the local proliferation of tumor is in an active state, resulting in the recurrence of liver cancer. The increase in tumor diameter prolongs the whole operation process, affecting the immune system of patients, heightening the response state of the body to tumor cells, and further accelerating recurrence.

AFP is an established and routine tumor marker in patients with HCC and is readily available for patients who are AFP-positive before surgery. AFP values > 1000 ng/mL before surgery have been associated with the risk of HCC recurrence after hepatectomy. High AFP serum levels may be a surrogate parameter for vascular invasion and is a well-characterized predictor of HCC recurrence after surgery[20]. A high serum AFP level suggests that HCC is highly invasive. Elevated preoperative AFP levels indicate an increased risk of tumor cell metastasis via blood route. Therefore, predicting the malignant characteristics and prognosis of HCC through the preoperative serum AFP level is important. Nowadays, the cut-off value of preoperative serum AFP level for predicting recurrence and survival of HCC has not been standardized. Our observation is consistent with that of another study[23]; we divided AFP into three levels and the HR per grade was 1.547 for recurrence. In general, serum AFP levels may be associated with HCC tumors, but not all patients with HCC have AFP levels higher than 250–400 ng/mL. In addition, mildly to moderately elevated AFP may be associated with necrotizing inflammation of the liver but not with malignant tumors[30], which should be given attention.

Limitations

As this work was a single-center and retrospective cohort study, some limitations should be noted due to the inherent defects of the study design. First, selection and management bias is unavoidable. In general, if liver ultrasound examination is not enough, CEUS examination is also insufficient. In addition, the quality of an examination still depends on the skills of the operators. However, the ability of CEUS to observe some parts of the liver is limited, especially for patients with obesity. Further limitations are related to the width of the acoustic window and motion artifacts. The model has not been validated by external cohorts, thereby limiting its wide application. We hope that in the future, we can conduct a multi-center study, with an expanded sample size and prospective verification.

CONCLUSION

In summary, early recurrence of liver cancer after operation seriously affects the health of patients. Our non-invasive prediction model based on CEUS and serological biomarkers can achieve a high prediction efficiency with few indicators and is helpful in planning an appropriate treatment schedule.

ARTICLE HIGHLIGHTS
Research background

Surgery is the main treatment for hepatocellular carcinoma (HCC). However, 30%-50% of patients develop recurrence within 2 years, which is the main cause of death.

Research motivation

Screening patients with high recurrence risk plays an important role in making reasonable clinical decisions.

Research objectives

To combine contrast-enhanced ultrasound (CEUS) liver imaging reporting and data system (LIRADS) with serology biomarkers to construct a non-invasive model predicting the early recurrence of HCC, and verify the model.

Research methods

Records of 744 consecutive patients undergoing first-line curative surgery for HCC in one institution from 2016–2018 were reviewed, and 292 local patients were selected for analysis. General characteristics, CEUS liver imaging reporting and data system (LIRADS) parameters, and serology biomarkers were collected. Univariate analysis and multivariate analyses were performed to evaluate the independent prognostic factors for tumor recurrence. Then, a nomogram called CEUS model was constructed. The CEUS model was then used to predict recurrence at 6 mo, 12 mo, and 24 mo.

Research results

Tumor diameter, preoperative alpha-fetoprotein (AFP) level, and LIRADS were identified to be independent hazard factors, with a hazard ratio of 1.123 (95% confidence interval [CI]: 1.041-1.211), 1.547 (95%CI: 1.245-1.922), and 1.428 (95%CI: 1.059-1.925), separately. A nomogram based on them was constructed; the cut-off value at 6 mo, 12 mo, and 24 mo was 100, 80, and 50, and the C-index was 0.748 (95%CI: 0.683-0.813), 0.762 (95%CI: 0.704-0.820), and 0.762 (95%CI: 0.706-0.819), separately. The calibration at 6 mo was desirable; however, the calibration at 12 and 24 mo should be improved.

Research conclusions

The CEUS model can screen out patients who have a high recurrence risk, it is helpful for making reasonable treatment strategy.

Research perspectives

A multi-center study, with an expanded sample size and prospective verification, is required.

Footnotes

Manuscript source: Unsolicited manuscript

Specialty type: Gastroenterology and hepatology

Country/Territory of origin: China

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): 0

Grade C (Good): 0

Grade D (Fair): D, D

Grade E (Poor): 0

P-Reviewer: Chen Y, Hashimoto N S-Editor: Ma YJ L-Editor: Wang TQ P-Editor: Zhang YL

References
1.  Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, Bray F. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin. 2021;71:209-249.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 50630]  [Cited by in F6Publishing: 53420]  [Article Influence: 17806.7]  [Reference Citation Analysis (123)]
2.  Chan AW, Chan SL, Wong GL, Wong VW, Chong CC, Lai PB, Chan HL, To KF. Prognostic Nutritional Index (PNI) Predicts Tumor Recurrence of Very Early/Early Stage Hepatocellular Carcinoma After Surgical Resection. Ann Surg Oncol. 2015;22:4138-4148.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 158]  [Cited by in F6Publishing: 169]  [Article Influence: 18.8]  [Reference Citation Analysis (0)]
3.  Lv J, Yin H, Mao W, Shi H. Investigating the value of pre-treatment 18F-FDG PET/CT in predicting the pathological characteristic of hepatocellular carcinoma and recurrence after liver transplantation. Abdom Radiol (NY). 2021;46:2490-2497.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 2]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
4.  Ang SF, Ng ES, Li H, Ong YH, Choo SP, Ngeow J, Toh HC, Lim KH, Yap HY, Tan CK, Ooi LL, Cheow PC, Chung AY, Chow PK, Foo KF, Tan MH. The Singapore Liver Cancer Recurrence (SLICER) Score for relapse prediction in patients with surgically resected hepatocellular carcinoma. PLoS One. 2015;10:e0118658.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 27]  [Cited by in F6Publishing: 45]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
5.  Shim JH, Jun MJ, Han S, Lee YJ, Lee SG, Kim KM, Lim YS, Lee HC. Prognostic nomograms for prediction of recurrence and survival after curative liver resection for hepatocellular carcinoma. Ann Surg. 2015;261:939-946.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 151]  [Cited by in F6Publishing: 179]  [Article Influence: 19.9]  [Reference Citation Analysis (0)]
6.  Huang S, Huang GQ, Zhu GQ, Liu WY, You J, Shi KQ, Wang XB, Che HY, Chen GL, Fang JF, Zhou Y, Zhou MT, Chen YP, Braddock M, Zheng MH. Establishment and Validation of SSCLIP Scoring System to Estimate Survival in Hepatocellular Carcinoma Patients Who Received Curative Liver Resection. PLoS One. 2015;10:e0129000.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 10]  [Article Influence: 1.1]  [Reference Citation Analysis (0)]
7.  Zhang F, Lu SX, Hu KS, Gan YH, Chen Y, Ge NL, Yang BW, Zhang L, Chen RX, Ren ZG, Yin X. Albumin-to-alkaline phosphatase ratio as a predictor of tumor recurrence and prognosis in patients with early-stage hepatocellular carcinoma undergoing radiofrequency ablation as initial therapy. Int J Hyperthermia. 2021;38:1-10.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 13]  [Article Influence: 4.3]  [Reference Citation Analysis (0)]
8.  Ji GW, Zhu FP, Xu Q, Wang K, Wu MY, Tang WW, Li XC, Wang XH. Radiomic Features at Contrast-enhanced CT Predict Recurrence in Early Stage Hepatocellular Carcinoma: A Multi-Institutional Study. Radiology. 2020;294:568-579.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 73]  [Cited by in F6Publishing: 156]  [Article Influence: 39.0]  [Reference Citation Analysis (0)]
9.  Lyshchik A, Kono Y, Dietrich CF, Jang HJ, Kim TK, Piscaglia F, Vezeridis A, Willmann JK, Wilson SR. Contrast-enhanced ultrasound of the liver: technical and lexicon recommendations from the ACR CEUS LI-RADS working group. Abdom Radiol (NY). 2018;43:861-879.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 64]  [Cited by in F6Publishing: 77]  [Article Influence: 12.8]  [Reference Citation Analysis (0)]
10.  Kono Y, Lyshchik A, Cosgrove D, Dietrich CF, Jang HJ, Kim TK, Piscaglia F, Willmann JK, Wilson SR, Santillan C, Kambadakone A, Mitchell D, Vezeridis A, Sirlin CB. Contrast Enhanced Ultrasound (CEUS) Liver Imaging Reporting and Data System (LI-RADS®): the official version by the American College of Radiology (ACR). Ultraschall Med. 2017;38:85-86.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 81]  [Cited by in F6Publishing: 101]  [Article Influence: 14.4]  [Reference Citation Analysis (0)]
11.  Lei Z, Li J, Wu D, Xia Y, Wang Q, Si A, Wang K, Wan X, Lau WY, Wu M, Shen F. Nomogram for Preoperative Estimation of Microvascular Invasion Risk in Hepatitis B Virus-Related Hepatocellular Carcinoma Within the Milan Criteria. JAMA Surg. 2016;151:356-363.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 276]  [Cited by in F6Publishing: 409]  [Article Influence: 51.1]  [Reference Citation Analysis (0)]
12.  Cohen ME, Ko CY, Bilimoria KY, Zhou L, Huffman K, Wang X, Liu Y, Kraemer K, Meng X, Merkow R, Chow W, Matel B, Richards K, Hart AJ, Dimick JB, Hall BL. Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. J Am Coll Surg. 2013;217:336-46.e1.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 376]  [Cited by in F6Publishing: 426]  [Article Influence: 38.7]  [Reference Citation Analysis (0)]
13.  Chan AWH, Zhong J, Berhane S, Toyoda H, Cucchetti A, Shi K, Tada T, Chong CCN, Xiang BD, Li LQ, Lai PBS, Mazzaferro V, García-Fiñana M, Kudo M, Kumada T, Roayaie S, Johnson PJ. Development of pre and post-operative models to predict early recurrence of hepatocellular carcinoma after surgical resection. J Hepatol. 2018;69:1284-1293.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 225]  [Cited by in F6Publishing: 353]  [Article Influence: 58.8]  [Reference Citation Analysis (0)]
14.  Ning P, Gao F, Hai J, Wu M, Chen J, Zhu S, Wang M, Shi D. Application of CT radiomics in prediction of early recurrence in hepatocellular carcinoma. Abdom Radiol (NY). 2020;45:64-72.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 28]  [Article Influence: 7.0]  [Reference Citation Analysis (0)]
15.  Villanueva A. Hepatocellular Carcinoma. N Engl J Med. 2019;380:1450-1462.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2066]  [Cited by in F6Publishing: 2831]  [Article Influence: 566.2]  [Reference Citation Analysis (35)]
16.  Bell M, Turkbey EB, Escorcia FE. Radiomics, Radiogenomics, and Next-Generation Molecular Imaging to Augment Diagnosis of Hepatocellular Carcinoma. Cancer J. 2020;26:108-115.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 6]  [Cited by in F6Publishing: 8]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
17.  Hu Z, Yu N, Wang H, Li S, Yan J, Zhang G. Pre-radiofrequency ablation MRI imaging features predict the local tumor progression in hepatocellular carcinoma. Medicine (Baltimore). 2020;99:e23924.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 3]  [Article Influence: 0.8]  [Reference Citation Analysis (0)]
18.  Morio K, Kawaoka T, Aikata H, Namba M, Uchikawa S, Kodama K, Ohya K, Fujino H, Nakahara T, Murakami E, Yamauchi M, Tsuge M, Hiramatsu A, Imamura M, Nakamura Y, Akagi M, Awai K, Kobayashi T, Ohdan H, Chayama K. Preoperative PET-CT is useful for predicting recurrent extrahepatic metastasis of hepatocellular carcinoma after resection. Eur J Radiol. 2020;124:108828.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 9]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
19.  Nakamura I, Hatano E, Tada M, Kawabata Y, Tamagawa S, Kurimoto A, Iwama H, Toriguchi K, Sueoka H, Iida K, Yoshida M, Nishimura T, Iijima H. Enhanced patterns on intraoperative contrast-enhanced ultrasonography predict outcomes after curative liver resection in patients with hepatocellular carcinoma. Surg Today. 2021;51:764-776.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 3]  [Article Influence: 1.0]  [Reference Citation Analysis (0)]
20.  Koch C, Bette T, Waidmann O, Filmann N, Schrecker C, Trojan J, Weiler N, Vermehren J, Schnitzbauer AA, Bechstein WO, Zeuzem S, Herrmann E, Welker MW. AFP ratio predicts HCC recurrence after liver transplantation. PLoS One. 2020;15:e0235576.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 5]  [Article Influence: 1.3]  [Reference Citation Analysis (0)]
21.  Wong L, Bozhilov K, Hernandez B, Kwee S, Chan O, Ellis L, LeMarchand L. Underlying liver disease and advanced stage liver cancer are associated with elevated neutrophil-lymphocyte ratio. Clin Mol Hepatol. 2019;25:305-316.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 16]  [Cited by in F6Publishing: 17]  [Article Influence: 3.4]  [Reference Citation Analysis (0)]
22.  Zhang Z, Jiang H, Chen J, Wei Y, Cao L, Ye Z, Li X, Ma L, Song B. Hepatocellular carcinoma: radiomics nomogram on gadoxetic acid-enhanced MR imaging for early postoperative recurrence prediction. Cancer Imaging. 2019;19:22.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 77]  [Cited by in F6Publishing: 94]  [Article Influence: 18.8]  [Reference Citation Analysis (0)]
23.  Wang Y, Liao J, Qi W, Xie L, Li Y. Predictive Value of Conventional Ultrasound and Contrast-Enhanced Ultrasound in Early Recurrence of Hepatocellular Carcinoma after Surgical Resection. Ultrasound Med Biol. 2016;42:1042-1048.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 17]  [Article Influence: 2.1]  [Reference Citation Analysis (0)]
24.  Xiachuan Q, Xiang Z, Xuebing L, Yan L. Predictive Value of Contrast-enhanced Ultrasound for Early Recurrence of Single Lesion Hepatocellular Carcinoma After Curative Resection. Ultrason Imaging. 2019;41:49-58.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 5]  [Article Influence: 1.0]  [Reference Citation Analysis (0)]
25.  Terzi E, Iavarone M, Pompili M, Veronese L, Cabibbo G, Fraquelli M, Riccardi L, De Bonis L, Sangiovanni A, Leoni S, Zocco MA, Rossi S, Alessi N, Wilson SR, Piscaglia F;  CEUS LI-RADS Italy study group collaborators:. Contrast ultrasound LI-RADS LR-5 identifies hepatocellular carcinoma in cirrhosis in a multicenter restropective study of 1,006 nodules. J Hepatol. 2018;68:485-492.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 159]  [Cited by in F6Publishing: 178]  [Article Influence: 29.7]  [Reference Citation Analysis (0)]
26.  Liu S, Li H, Guo L, Zhang B, Zhou B, Zhang W, Zhou J, Fan J, Ye Q. Tumor Size Affects Efficacy of Adjuvant Transarterial Chemoembolization in Patients with Hepatocellular Carcinoma and Microvascular Invasion. Oncologist. 2019;24:513-520.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 22]  [Cited by in F6Publishing: 40]  [Article Influence: 6.7]  [Reference Citation Analysis (0)]
27.  Goh BK, Teo JY, Chan CY, Lee SY, Jeyaraj P, Cheow PC, Chow PK, Ooi LL, Chung AY. Importance of tumor size as a prognostic factor after partial liver resection for solitary hepatocellular carcinoma: Implications on the current AJCC staging system. J Surg Oncol. 2016;113:89-93.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 56]  [Cited by in F6Publishing: 61]  [Article Influence: 6.8]  [Reference Citation Analysis (0)]
28.  Xu XF, Xing H, Han J, Li ZL, Lau WY, Zhou YH, Gu WM, Wang H, Chen TH, Zeng YY, Li C, Wu MC, Shen F, Yang T. Risk Factors, Patterns, and Outcomes of Late Recurrence After Liver Resection for Hepatocellular Carcinoma: A Multicenter Study From China. JAMA Surg. 2019;154:209-217.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 158]  [Cited by in F6Publishing: 329]  [Article Influence: 65.8]  [Reference Citation Analysis (0)]
29.  Agopian VG, Harlander-Locke M, Zarrinpar A, Kaldas FM, Farmer DG, Yersiz H, Finn RS, Tong M, Hiatt JR, Busuttil RW. A novel prognostic nomogram accurately predicts hepatocellular carcinoma recurrence after liver transplantation: analysis of 865 consecutive liver transplant recipients. J Am Coll Surg. 2015;220:416-427.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 150]  [Cited by in F6Publishing: 186]  [Article Influence: 18.6]  [Reference Citation Analysis (0)]
30.  Kim YI, Kim HS, Park JW. Higher Ratio of Serum Alpha-Fetoprotein Could Predict Outcomes in Patients with Hepatitis B Virus-Associated Hepatocellular Carcinoma and Normal Alanine Aminotransferase. PLoS One. 2016;11:e0157299.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 11]  [Article Influence: 1.4]  [Reference Citation Analysis (0)]