Retrospective Cohort Study Open Access
Copyright ©The Author(s) 2023. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Gastrointest Oncol. Jul 15, 2023; 15(7): 1241-1252
Published online Jul 15, 2023. doi: 10.4251/wjgo.v15.i7.1241
Development and validation of a postoperative pulmonary infection prediction model for patients with primary hepatic carcinoma
Chao Lu, Zhi-Xiang Xing, Xi-Gang Xia, Zhi-Da Long, Bo Chen, Peng Zhou, Rui Wang, Department of Hepatobiliary & Pancreaticospleen Surgery, Yangtze University, Jing Zhou hospital, Jingzhou 434020, Hubei Province, China
ORCID number: Lu Chao (0000-0002-6236-1550); Rui Wang (0000-0002-6992-2287).
Author contributions: Lu C and Xing ZX contributed equally to this research; Wang R was the guarantor and designed the study; Lu C, Xing ZX, Xia XG, Long ZD, Chen B, and Zhou P participated in the acquisition, analysis, and interpretation of the data and drafted the initial manuscript; Lu C, Xing ZX, and Wang R revised the article critically for important intellectual content.
Institutional review board statement: The study was reviewed and approved by the Institutional Review Board of Jingzhou Hospital (Approval No. 2023-JH019).
Informed consent statement: All personal information of the patients was encrypted to prevent leakage and exempted from informed consent by the above ethics committee.
Conflict-of-interest statement: The authors declare that they have no conflicts of interest.
Data sharing statement: No additional data are available.
STROBE statement: The authors have read the STROBE Statement—checklist of items, and the manuscript was prepared and revised according to the STROBE Statement—checklist of items.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: https://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Rui Wang, MD, Surgical Oncologist, Department of Hepatobiliary & Pancreaticospleen Surgery, Yangtze University, Jing Zhou hospital, No. 26 Chuyuan Road, Jingzhou District, Jingzhou 434020, Hubei Province, China. wangrui_20222022@163.com
Received: May 1, 2023
Peer-review started: May 1, 2023
First decision: May 11, 2023
Revised: May 14, 2023
Accepted: June 12, 2023
Article in press: June 12, 2023
Published online: July 15, 2023
Processing time: 71 Days and 22.8 Hours

Abstract
BACKGROUND

There are factors that significantly increase the risk of postoperative pulmonary infections in patients with primary hepatic carcinoma (PHC). Previous reports have shown that over 10% of patients with PHC experience postoperative pulmonary infections. Thus, it is crucial to prioritize the prevention and treatment of postoperative pulmonary infections in patients with PHC.

AIM

To identify the risk factors for postoperative pulmonary infection in patients with PHC and develop a prediction model to aid in postoperative management.

METHODS

We retrospectively collected data from 505 patients who underwent hepatobiliary surgery between January 2015 and February 2023 in the Department of Hepatobiliary and Pancreaticospleen Surgery. Radiomics data were selected for statistical analysis, and clinical pathological parameters and imaging data were included in the screening database as candidate predictive variables. We then developed a pulmonary infection prediction model using three different models: An artificial neural network model; a random forest model; and a generalized linear regression model. Finally, we evaluated the accuracy and robustness of the prediction model using the receiver operating characteristic curve and decision curve analyses.

RESULTS

Among the 505 patients, 86 developed a postoperative pulmonary infection, resulting in an incidence rate of 17.03%. Based on the gray-level co-occurrence matrix, we identified 14 categories of radiomic data for variable screening of pulmonary infection prediction models. Among these, energy, contrast, the sum of squares (SOS), the inverse difference (IND), mean sum (MES), sum variance (SUV), sum entropy (SUE), and entropy were independent risk factors for pulmonary infection after hepatectomy and were listed as candidate variables of machine learning prediction models. The random forest model algorithm, in combination with IND, SOS, MES, SUE, SUV, and entropy, demonstrated the highest prediction efficiency in both the training and internal verification sets, with areas under the curve of 0.823 and 0.801 and a 95% confidence interval of 0.766-0.880 and 0.744-0.858, respectively. The other two types of prediction models had prediction efficiencies between areas under the curve of 0.734 and 0.815 and 95% confidence intervals of 0.677-0.791 and 0.766-0.864, respectively.

CONCLUSION

Postoperative pulmonary infection in patients undergoing hepatectomy may be related to risk factors such as IND, SOS, MES, SUE, SUV, energy, and entropy. The prediction model in this study based on diffusion-weighted images, especially the random forest model algorithm, can better predict and estimate the risk of pulmonary infection in patients undergoing hepatectomy, providing valuable guidance for postoperative management.

Key Words: Primary hepatic carcinoma; Pulmonary infection; Gray-level co-occurrence matrix; Machine learning; Prediction

Core Tip: Identifying risk factors for postoperative pulmonary infection in patients with primary hepatic carcinoma can improve the level of prevention and clinical treatment, ultimately reducing or even avoiding the occurrence of postoperative infection complications, reducing treatment time and costs, and improving patient efficacy and prognosis. The prediction model developed in our study provides valuable guidance for clinicians in predicting the risk of pulmonary infection and effectively preventing, diagnosing, and treating postoperative infection in patients with primary hepatic carcinoma, leading to an improved patient prognosis.



INTRODUCTION

Primary hepatic carcinoma (PHC) is a widespread malignant tumor with high incidence and mortality rates that poses a serious threat to human health worldwide. Surgical treatment remains the most effective treatment option for PHC[1]. However, postoperative infections, including surgical site and pulmonary infections, are among the main complications following surgery[2,3]. Patients with PHC are often accompanied by malnutrition, weakened immunity, and sputum accumulation in the respiratory tract due to prolonged bed rest and increased chronic consumption after surgery[4]. These factors significantly increase the risk of postoperative pulmonary infections in patients with PHC. Previous reports have shown that over 10% of patients with PHC experience postoperative pulmonary infections[5]. Thus, it is crucial to prioritize the prevention and treatment of postoperative pulmonary infections in patients with PHC.

Previous studies have shown that the causes of postoperative pulmonary infection in patients with PHC are related to the condition, respiratory microbiota, anesthesia-related factors, intraoperative procedures, and postoperative care of the patients. Of these factors, intraoperative procedures and the condition of the patients are considered the main triggers[2,6]. However, preoperative indicators that could be effective in preventing postoperative pulmonary infections and predictive models for such infections are still lacking. With the vigorous popularization of information technology in clinical practice, vast amounts of patient imaging data are now available, providing doctors with crucial objective data for clinical diagnosis, disease tracking, and surgical planning[7,8].

In this context, this study aimed to extract the texture features of radiomics of patients with PHC using a gray-level co-occurrence matrix (GLCM) to develop a predictive model to aid doctors in clinical decision-making and medical resource allocation for early interventions and treatments.

MATERIALS AND METHODS
Study population

We conducted a retrospective study on 505 patients with PHC who underwent surgical treatment at Jing Zhou Hospital between January 2015 and February 2023. The study included patients who met the following criteria: (1) Patients who met the diagnostic criteria for PHC (2011 version); (2) Patients with no distant liver cancer metastasis and feasible liver cancer radical surgery; (3) Patients who were confirmed by preoperative imaging to have no pulmonary infection; and (4) Patients whose postoperative adjuvant treatment and follow-up examinations were conducted in the same hospital. Exclusion criteria included: (1) Patients with Child-Pugh grade C; (2) Patients with preoperative pulmonary disease; (3) Patients with other malignant tumors who have a history of chest trauma, surgery, and radiation chemotherapy; (4) Patients with a history of chronic respiratory diseases in the past; and (5) Patients who had not undergone liver and abdominal magnetic resonance imaging (MRI) examinations or whose imaging data collection was incomplete upon admission. As this was a retrospective chart review, informed written consent was not required in accordance with institutional review board policy, and the research scheme was implemented following the artificial intelligence model training specifications of the unit. All personal information of the patients was encrypted to prevent leakage and exempted from informed consent by the above ethics committee. The process of patient selection and development of the prediction model is shown in Figure 1.

Figure 1
Figure 1 Flow chart of patient selection and data process. MRI: Magnetic resonance imaging.
Diagnostic criteria for postoperative pulmonary infection

In this study, postoperative pulmonary infection was diagnosed based on the following criteria: (1) Positive sputum culture after surgery; and (2) Identification of abnormal lung inflammatory rales upon lung auscultation. Both criteria need to be met in order for the diagnosis to be made.

Acquisition of MRI-based radiomics parameters

A GE Signa HD (3.0T) MR scanner was used in this study. The scanning sequence and parameter settings were as follows: Transverse fast spin echo T1-weighted imaging (repetition time, 400-620 ms, echo time, 10-16 ms); transverse, coronal, and sagittal plane fluid-sensitive proton density-weighted imaging (repetition time, 1800-3400 ms, echo time, 24-34 ms); layer thickness of 3-5 mm, layer spacing of 2 mm, matrix of 320 × (192-320) × 256, and field of view of 16 cm × (16-22) cm × 22 cm. We exported the MRI data of all patients in bitmap image file format from the picture archiving and communication system workstation for analysis. To ensure the reliability of the research results, we unified the window width or window level of T1-weighted imaging and fluid-sensitive proton density-weighted images at 1240/460 and 1050/340, respectively, when exporting the imaging data. Two experienced MRI diagnostic physicians selected a total of three layers of images to display the characteristics of the lesion, including the largest and consecutive layers, for measurement and analysis. We selected a sequence that displayed clear lesion boundaries to determine the lesion range as a reference standard and kept the region of interest (ROI) of other sequences consistent with it.

Training and verification of the segmentation model

With the guidance of two senior physicians, one physician manually delineated the ROI along the lesion boundary, covering the maximum layer of the lesion and one layer before and after the lesion. A total of three layers of images were used for calculating texture parameters. The average value was taken, and subsequent analysis was performed using MaZda software (available from: http://www.ele-tel.p.lodz.pl/mazda). To reduce bias caused by changes in brightness and contrast during result analysis, the grayscale of the image was standardized before extracting texture features. The MaZda software was used to calculate histogram and GLCM parameters within the ROI, including energy, contrast, correlation, the sum of squares (SOS), an inverse difference (IND), mean sum (MES), sum variance (SUV), sum entropy (SUE), entropy, and difference variance and entropy.

Analysis and evaluation of the pulmonary infection prediction model

All patients included in this study were randomly assigned to a model training set and an internal validation set at a 7:3 ratio. In the early stages of candidate variable selection, least absolute shrinkage and selection operator (LASSO) regression with minimum penalty coefficient and Pearson correlation coefficient were used to select variables that could ultimately be used to develop pulmonary infection prediction models. Three prediction models with different algorithms were developed, namely the artificial neural network model (ANNM), the random forest model (RFM), and the generalized linear regression model (GLRM)[9-12]. Additionally, LASSO was selected to develop a classification model for predicting pulmonary infection based on MRI images[13]. The effectiveness evaluation of each model mainly included decision curve analysis (DCA)[14], area under the receiver operating characteristic curve, and clinical influence curve[15].

Statistical analysis

The Wilcoxon rank-sum test or t-test was used to compare continuous variables, while the χ2 test was used to compare categorical variables. Pearson’s correlation coefficients were used to assess the correlation between two continuous variables[16]. The charts in this study were analyzed visually using R Studio software (available from: https://www.r-project.org/). Statistical significance was defined as a two-tailed P value of < 0.05.

RESULTS
Clinical characteristics of patients with PHC with or without pulmonary infection

In the study, a total of 505 patients with PHC were included in the development of the pulmonary infection prediction models. Of these, 86 patients developed postoperative pulmonary infections and were categorized as the infected group, while 419 patients who did not have postoperative infections were included in the non-infected group. The incidence rates of postoperative pulmonary infection in the training and validation sets were 17.28% (61/353) and 16.45% (25/152), respectively. The specific surgical procedures performed included left hepatectomy, left hepatectomy and cholecystectomy, right hepatectomy, right hepatectomy and cholecystectomy, left hepatectomy and biliary drainage, right hepatectomy, intraoperative radiofrequency therapy, and left hepatectomy. All patients with pulmonary infections improved after receiving treatment such as anti-inflammatory drugs and thoracic puncture drainage, and no other pulmonary complications occurred. The baseline data and radiomics-related extracted variables of the two groups of patients with PHC were summarized in Table 1 and Supplementary Table 1.

Table 1 Baseline demographic and radiomics of patients with primary hepatic carcinoma.
Variables
Training cohort
P value
Testing cohort
P value
Overall, n = 353
Infection, n = 61
Non-infection, n = 292
Overall, n = 152
Infection, n = 25
Non-infection, n = 127
Age in yr
> 60240 (68.0)37 (60.7)203 (69.5)0.231109 (71.7)16 (64.0)93 (73.2)0.488
≤ 60113 (32.0)24 (39.3)89 (30.5)43 (28.3)9 (36.0)34 (26.8)
Sex
Male234 (66.3)39 (63.9)195 (66.8)0.78106 (69.7)18 (72.0)88 (69.3)0.975
Female119 (33.7)22 (36.1)97 (33.2)46 (30.3)7 (28.0)39 (30.7)
BMI
≤ 18.547 (13.3)10 (16.4)37 (12.7)0.87720 (13.2)4 (16.0)16 (12.6)0.627
18.5-23.9121 (34.3)21 (34.4)100 (34.2)54 (35.5)6 (24.0)48 (37.8)
24.0-27.997 (27.5)16 (26.2)81 (27.7)47 (30.9)9 (36.0)38 (29.9)
≥ 28.088 (24.9)14 (23.0)74 (25.3)31 (20.4)6 (24.0)25 (19.7)
Smoking
Yes114 (32.3)19 (31.1)95 (32.5)0.95263 (41.4)14 (56.0)49 (38.6)0.163
No239 (67.7)42 (68.9)197 (67.5)89 (58.6)11 (44.0)78 (61.4)
Drinking
Yes100 (28.3)18 (29.5)82 (28.1)0.94556 (36.8)8 (32.0)48 (37.8)0.747
No253 (71.7)43 (70.5)210 (71.9)96 (63.2)17 (68.0)79 (62.2)
History of hepatitis B
Yes134 (38.0)27 (44.3)107 (36.6)0.33258 (38.2)10 (40.0)48 (37.8)1.000
No219 (62.0)34 (55.7)185 (63.4)94 (61.8)15 (60.0)79 (62.2)
History of hepatitis C
Yes129 (36.5)22 (36.1)107 (36.6)150 (32.9)9 (36.0)41 (32.3)0.898
No224 (63.5)39 (63.9)185 (63.4)102 (67.1)16 (64.0)86 (67.7)
Hypertension
Yes110 (31.2)19 (31.1)91 (31.2)157 (37.5)11 (44.0)46 (36.2)0.611
No243 (68.8)42 (68.9)201 (68.8)95 (62.5)14 (56.0)81 (63.8)
Diabetes
Yes119 (33.7)21 (34.4)98 (33.6)152 (34.2)9 (36.0)43 (33.9)1.000
No234 (66.3)40 (65.6)194 (66.4)100 (65.8)16 (64.0)84 (66.1)
Cirrhosis
Yes176 (49.9)32 (52.5)144 (49.3)0.7668 (44.7)7 (28.0)61 (48.0)0.105
No177 (50.1)29 (47.5)148 (50.7)84 (55.3)18 (72.0)66 (52.0)
Child-Pugh
A253 (71.7)39 (63.9)214 (73.3)0.187102 (67.1)14 (56.0)88 (69.3)0.289
B100 (28.3)22 (36.1)78 (26.7)50 (32.9)11 (44.0)39 (30.7)
AFP in mg/L
≤ 100206 (58.4)27 (44.3)179 (61.3)0.02189 (58.6)11 (44.0)78 (61.4)0.163
> 100147 (41.6)34 (55.7)113 (38.7)63 (41.4)14 (56.0)49 (38.6)
HBV DNA
Negative233 (66.0)41 (67.2)192 (65.8)0.944106 (69.7)15 (60.0)91 (71.7)0.357
Positive120 (34.0)20 (32.8)100 (34.2)46 (30.3)10 (40.0)36 (28.3)
Tumor size in cm
≤ 4203 (57.5)24 (39.3)179 (61.3)0.00383 (54.6)6 (24.0)77 (60.6)0.002
> 4150 (42.5)37 (60.7)113 (38.7)69 (45.4)19 (76.0)50 (39.4)
Treatment
Laparoscopic95 (26.9)17 (27.9)78 (26.7)0.97945 (29.6)8 (32.0)37 (29.1)0.962
Open258 (73.1)44 (72.1)214 (73.3)107 (70.4)17 (68.0)90 (70.9)
LNM
Yes108 (30.6)17 (27.9)91 (31.2)0.72248 (31.6)7 (28.0)41 (32.3)0.853
No245 (69.4)44 (72.1)201 (68.8)104 (68.4)18 (72.0)86 (67.7)
Energy4.48 (2.97, 5.91)9.05 (7.07, 10.30)4.02 (2.62, 5.26)< 0.0014.52 (2.74, 6.02)8.82 (6.99, 10.91)4.01 (2.45, 5.38)< 0.001
Contrast351.00 (316.00, 384.00)289.00 (275.00, 301.00)360.00 (334.00, 391.75)< 0.001347.00 (319.50, 381.00)306.00 (275.00, 317.00)355.00 (331.00, 388.00)< 0.001
Correlation16.39 (12.49, 20.01)13.77 (11.43, 19.07)16.70 (13.04, 20.11)0.00616.63 (12.02, 20.33)18.08 (14.70, 21.30)16.07 (11.96, 20.02)0.093
SOS0.89 (0.71, 1.08)2.38 (2.01, 2.97)0.83 (0.69, 0.97)< 0.0010.86 (0.73, 1.06)2.61 (2.11, 3.06)0.84 (0.69, 0.96)< 0.001
IND1.46 (1.17, 1.85)3.43 (2.83, 4.07)1.38 (1.12, 1.67)< 0.0011.52 (1.15, 1.90)3.73 (3.11, 4.11)1.44 (1.12, 1.69)< 0.001
MES2.77 (1.95, 3.47)5.24 (4.60, 5.92)2.50 (1.86, 3.12)< 0.0012.55 (1.96, 3.47)4.90 (4.21, 5.93)2.38 (1.89, 3.04)< 0.001
SUV20.10 (15.70, 25.60)56.00 (39.50, 72.00)18.60 (15.20, 22.83)< 0.00121.60 (16.67, 25.22)61.80 (39.00, 70.10)19.50 (15.70, 23.65)< 0.001
SUE21.80 (16.60, 27.00)45.30 (37.20, 55.10)19.85 (16.10, 24.00)< 0.00121.40 (15.97, 26.40)46.60 (35.20, 53.30)20.00 (15.45, 24.35)< 0.001
Entropy0.84 (0.62, 1.07)2.07 (1.51, 2.44)0.76 (0.58, 0.94)< 0.0010.82 (0.60, 1.10)1.84 (1.45, 2.03)0.73 (0.56, 0.94)< 0.001
DIV316.00 (210.00, 404.00)295.00 (193.00, 402.00)318.50 (224.50, 404.00)0.411296.50 (196.50, 391.75)300.00 (191.00, 362.00)296.00 (207.50, 400.50)0.800
DIE234.00 (188.00, 274.00)244.00 (181.00, 274.00)229.00 (188.00, 274.00)0.774232.50 (189.75, 274.50)245.00 (204.00, 283.00)231.00 (188.50, 271.50)0.571
Features selected by LASSO regression analysis

As the included candidate variables were inevitably biased and had a non-normal distribution, we added penalty terms to the loss function (i.e., optimization goal) during the training and parameter-solving processes. This allowed the size of the coefficient to be considered. By setting a reduction coefficient (penalty coefficient), the coefficient of features with less impact was reduced to zero, retaining only important features, which is known as LASSO regression. Specifically, cross-validation was performed on all candidate parameters, and a dashed line was drawn at the optimal parameter (i.e., nine for non-zero parameters) to indicate the best-fit LASSO regression model. In the subsequent prediction model analysis, the optimal lambda value selected was substituted into the LASSO coefficient curve containing 18 variables, including 11 independent variables. This was used to develop an independent variable for predicting the risk propensity of postoperative pulmonary infection (Figure 2).

Figure 2
Figure 2 Predictor variable selection based on the least absolute shrinkage and selection operator regression method. A: Optimal parameter (lambda) selection in the least absolute shrinkage and selection operator (least absolute shrinkage and selection operator) model; B: Least absolute shrinkage and selection operator coefficient profiles of the candidate features.
Development of a nomogram using GLRM analysis

As shown in Supplementary Table 2, we conducted a multivariate logistic regression analysis on all included candidate variables and found that seven variables were independent risk factors for postoperative pulmonary infection, including IND, SOS, MES, SUE, SUV, energy, and entropy. Based on the Akaike information criterion, we developed a predictive model for postoperative pulmonary infection and a nomogram (Figure 3). The nomogram showed the overall variables included in the prediction model on the left side, and each variable was assigned a scale value. The total score can be obtained by assigning scores to each variable for the included patients. Finally, the probability of pulmonary infection in patients can be evaluated based on the corresponding risk scale value of the total score. Moreover, the C-index value, which was verified internally by the bootstrap method, was 0.785, indicating good clinical applicability.

Figure 3
Figure 3 Nomogram prediction model for predicting pulmonary infection in patients with primary hepatic carcinoma undergoing hepatectomy. A: Nomogram predicts risk of pulmonary infection; B: Calibration curves for the nomogram. SOS: Sum of squares; IND: Inverse difference; MES: Mean sum; SUV: Sum variance.
Development of the machine learning-based pulmonary infection prediction model

RFM and ANNM are the most widely used machine learning algorithms in various fields, including healthcare[9]. In this study, four supervised learning algorithms were used to develop the pulmonary infection model. As shown in Supplementary Table 3, top-ranking weight values in the RFM prediction model were obtained for energy, entropy, and variance, indicating their potential as candidate variables for RFM-based prediction of pulmonary infection (Figure 4A). Consequently, in ANNM, energy, entropy, SUV, SUE, IND, MES, contrast, and SOS also served as candidate variables for predicting pulmonary infection, and their assignments in the two different algorithm prediction models were inconsistent (Figure 4B, Supplementary Table 4).

Figure 4
Figure 4 Construction of pulmonary infection prediction model via the random forest model and artificial neural network model. A: Random forest model. The application prediction model formula of the random forest model is as follows: C = argmax (∑(Ci)), where Ci represents the type of in prediction for the i-th tree, C is the final classification result, and I is the number of trees; B: Artificial neural network model. The formula of the artificial neural network model is as follows: θ = θ−η × ▽ (θ). J (θ) among them η is the learning rate, so (θ). J (θ) represents the gradient change of the loss function [i.e., J(θ)]. AFP: Alpha-fetoprotein; BMI: Body mass index; DIE: Difference entropy; DIV: Difference variance; HBV: Hepatitis B virus; IND: Inverse difference; LNM: Lymph node metastasis; MES: Mean sum; SOS: Sum of squares; SUE: Sum entropy; SUV: Sum variance.
Performance of pulmonary infection prediction models

The receiver operating characteristic curves were drawn to evaluate the predictive efficacy of each risk factor and the nomogram model. The receiver operating characteristic curve showed that the RFM model had higher predictive efficacy in both training and verification sets than the ANNM model, with areas under the curve of 0.823 and 0.801 and a 95% confidence interval (CI) of 0.766-0.880 and 0.744-0.858, respectively, compared to areas under the curve 0.815 and 0.787 and 95%CIs of 0.766-0.864 and 0.738-0.836, respectively, for the ANNM model. The predictive performance of preoperative GLCM-based radiomics for pulmonary infection was provided in Table 2. The prediction efficiency of the pulmonary infection prediction model for patients with PHC developed by a machine learning (ML)-based algorithm was better than that of the GLRM.

Table 2 Comparison of predictive efficacy of pulmonary infection prediction models via receiver operating characteristic curves.
Model
Training set
Internal validation set
AUC mean
AUC 95%CI
Variables1
AUC mean
AUC 95%CI
Variables1
RFM0.8230.766-0.88070.8010.744-0.8587
ANNM0.8150.766-0.86480.7870.738-0.8368
GLRM0.7660.717-0.81560.7340.677-0.7916

Furthermore, Figure 5 shows the DCA curve, with the abscissa indicating the threshold probability and the ordinate indicating the net benefit. The black horizontal line indicates a net benefit of zero, indicating that all patients were free of postoperative pulmonary infections. The gray diagonal line represents a scenario where all patients had a postoperative pulmonary infection and received treatment. DCA addresses the practical needs for clinical decision-making by incorporating patient or decision-maker preferences in the analysis. The DCA curve shows that the nomogram is more effective in predicting post-hepatectomy pulmonary infection than administering all or no postoperative treatment to patients.

Figure 5
Figure 5 Prediction performance of pulmonary infection risk based on different supervised algorithm. A: Decision curve analysis for three prediction models in the training set; B: Decision curve analysis for three prediction models in the testing set. ANNM: Artificial neural network model; GLRM: Generalized linear regression model; RFM: Random forest model.
Predictive value of an ML-based pulmonary infection prediction model

After developing three predictive models for pulmonary infection based on candidate predictive factors from preoperative MRI findings, we evaluated the optimal predictive performance of the RFM model. To further evaluate the differentiation efficiency of RFM, we used the clinical influence curve to assess the “classification accuracy” in the training set and internal verification set. As shown in Supplementary Figure 1, RFM effectively distinguished patients with pulmonary infection from those without pulmonary infection, which was consistent with the results of the postoperative pathological examination. Our study suggested that RFM is a reliable tool for the preoperative evaluation of pulmonary infection in patients with PHC and may become a powerful guiding tool for determining postoperative prevention of pulmonary infection. This also demonstrated that RFM was suitable for the preoperative assessment of the risk stratification of pulmonary infection.

DISCUSSION

The advancement in surgical technology has significantly reduced the preoperative mortality rate among patients with PHC. However, postoperative pulmonary infection has become a common and prominent complication, and its incidence rate has not shown significant improvement. Previous studies have reported postoperative pulmonary infection rates ranging from 9.60% to 22.38%[4,17]. The results of this study showed that the incidence rate of pulmonary infection after liver cancer surgery was 17.03%, consistent with previous studies[5,18,19]. The difference in the incidence rate of pulmonary infection can be attributed to the diagnostic criteria used by various diagnosis and treatment centers and the specific types of surgery for distinct populations. Furthermore, anti-infection and expectorant therapies are the main treatment measures for postoperative pulmonary infections in patients with PHC[5,20]. The reasonable selection of antibacterial and expectorant drugs, promotion of sputum excretion, prevention of respiratory difficulties caused by sputum stasis in pulmonary infections, and reduction of the induction of bronchial obstruction and atelectasis are all essential determinants of the incidence of postoperative pulmonary infections. Additionally, preoperative warning and evaluation for patients with primary liver cancer are crucial in reducing the occurrence of postoperative pulmonary infections[21,22]. In this context, our study employed advanced algorithms to explore the risk factors associated with postoperative infection, especially the predictive model developed using preoperative imaging parameters. This model can improve the level of prevention, clinical diagnosis, and treatment, reduce or avoid the occurrence of postoperative infection complications, and decrease treatment time and cost, thereby enhancing patient efficacy and prognosis.

This study used MRI, which has good soft tissue resolution and can perform multiplane and multisequence imaging. Its most significant advantage is its ability to achieve high spatial resolution and large-field scanning, making it the preferred imaging modality for preoperative MRI staging of cervical cancer. A non-inhibitory high-resolution MRI T2-weighted imaging sequence was used, and sagittal and short-axis scans (i.e., perpendicular to the long axis of the liver) were performed to fully display the cross-sectional area of the tumor. Moreover, the higher spatial resolution of MRI was utilized to leverage the natural contrast of pelvic fat and clearly display the depth and extent of invasion of PHC. However, it is important to note that the infiltration of the PHC in T2-weighted imaging may show uneven signal intensity, and most enhancement scans show uneven enhancement. In contrast, inflammatory lesions in the parenchymatous organ show uniform enhancement. Previous studies have highlighted the abundant venous plexus around the liver, which can create an atypical enhancement of high signal intensity on MRI, leading to texture analysis errors[23-25]. Additionally, tumors with a larger volume, worsening inflammation and edema, and an abundant venous plexus around the uterus can also become key factors affecting the preoperative evaluation of pulmonary infection.

Currently, image texture analysis is increasingly widely used in various research fields, including tumor diagnosis, efficacy evaluation, and prognosis[26,27]. Our study showed that the texture feature parameters in various sequences of patients with pulmonary and non-pulmonary infection had certain predictive values in texture analysis. It is speculated that the neovascularization, tumor necrosis, and invasive growth patterns in malignant tumors can contribute to complex internal structures that can be perceived and quantified through image texture analysis. Additionally, the heterogeneity of lesions measured by texture analysis feature parameters can precisely reflect the different texture compositions of different tumors, including their potential invasiveness[28]. Through image texture features, we quantitatively described the spatial distribution of pixels in MRI images. Our results indicated that the parameters based on GLCM showed significant statistical differences, making them potential predictive variables for pulmonary infection. For example, this study found a significant positive correlation between entropy differences and pulmonary infections. Previous studies have shown that entropy difference, a characteristic parameter used to measure structural disorder or complexity of images, is higher in tumors with higher malignancy levels[29,30]. Similarly, this study found that patients with pulmonary infections had a higher entropy value. We also included candidate variables with predictive value in the ML-based algorithm model. The results demonstrated that without distinguishing the predictive variables, the GLCM-based prediction efficiency reached its highest value of 0.823. This suggests that MRI examination before hepatectomy and texture analysis using sequence images have significant potential for predicting the risk stratification of pulmonary infection.

This study inevitably has the following limitations. First, the sample size was relatively small and from a single center, as we had strict requirements for MRI scanning parameters and equipment of the included patients. To overcome this, future studies should expand the sample size and conduct a prospective cohort study across multiple centers. Second, as a retrospective study, selection bias may have influenced the inclusion of the study population, leading to potential bias errors caused by the researcher’s personal experience or subjective judgment. Third, although we extracted GLCM-related parameters from MRI, higher-order textures were not included in the analysis. Thus, future studies should focus on expanding the extraction of higher-order texture parameters and exploring more predictive texture features for pulmonary infection prediction. Nevertheless, our pulmonary infection prediction model based on GLCM still has great development value for future clinical practice.

CONCLUSION

In summary, incorporating ML-based algorithms and GLCM radiomics features can facilitate timely and accurate risk stratification of pulmonary infection in patients with PHC before hepatectomy. Specifically, the RFM based on a random forest algorithm can aid clinicians in identifying high-risk patients with pulmonary infections and determining an appropriate surgical scope in a timely manner. This approach has promising applications for improving clinical outcomes and enhancing patient care.

ARTICLE HIGHLIGHTS
Research background

Primary hepatic carcinoma (PHC) is a widespread malignant tumor with high incidence and mortality rates that poses a serious threat to human health worldwide. Surgical treatment remains the most effective treatment option for PHC. However, postoperative infections, including surgical site and pulmonary infections, are among the main complications following surgery.

Research motivation

To extract the texture features of radiomics of patients with PHC using a gray-level co-occurrence matrix to develop a predictive model to aid doctors in clinical decision-making and medical resource allocation for early interventions and treatments.

Research objectives

To identify the risk factors for postoperative pulmonary infection in patients with PHC and develop a prediction model to aid in postoperative management.

Research methods

Radiomics data were selected for statistical analysis, and clinical pathological parameters and imaging data were included in the screening database as candidate predictive variables. We then developed a pulmonary infection prediction model using three different models: An artificial neural network model; a random forest model (RFM); and a generalized linear regression model. Finally, we evaluated the accuracy and robustness of the prediction model using the receiver operating characteristic curve and decision curve analyses.

Research results

The RFM algorithm, in combination with sum of squares, inverse difference, mean sum, sum variance, sum entropy, and entropy, demonstrated the highest prediction efficiency in both the training and internal verification sets, with areas under the curve of 0.823 and 0.801 and 95% confidence intervals of 0.766-0.880 and 0.744-0.858, respectively. The artificial neural network model and generalized linear regression model had prediction efficiency areas under the curve of 0.734 and 0.815 and 95% confidence intervals of 0.677-0.791 and 0.766-0.864, respectively.

Research conclusions

Postoperative pulmonary infection in patients undergoing hepatectomy may be related to risk factors such as sum of squares, inverse difference, mean sum, sum variance, sum entropy, energy, and entropy. The RFM prediction model in this study based on diffusion-weighted images can better predict and estimate the risk of pulmonary infection in patients undergoing hepatectomy, providing valuable guidance for postoperative management.

Research perspectives

Identifying risk factors for postoperative pulmonary infection in patients with PHC can improve the level of prevention and clinical treatment, ultimately reducing or even avoiding the occurrence of postoperative infection complications, reducing treatment time and costs, and improving patient efficacy and prognosis. The prediction model developed in our study provides valuable guidance for clinicians in predicting the risk of pulmonary infection and effectively preventing, diagnosing, and treating postoperative infection in patients with PHC, leading to an improved patient prognosis.

ACKNOWLEDGEMENTS

We thank all R language and R package developers for their assistance as well as all R package selfless contributors used for statistical analysis and visualization in this study.

Footnotes

Provenance and peer review: Unsolicited article; Externally peer reviewed.

Peer-review model: Single blind

Specialty type: Gastroenterology and hepatology

Country/Territory of origin: China

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): B

Grade C (Good): C, C

Grade D (Fair): D

Grade E (Poor): 0

P-Reviewer: Lee KS, South Korea; Lin HH, China; Patel J, United States S-Editor: Chen YL L-Editor: Filipodia P-Editor: Zhang XD

References
1.  Grandhi MS, Kim AK, Ronnekleiv-Kelly SM, Kamel IR, Ghasebeh MA, Pawlik TM. Hepatocellular carcinoma: From diagnosis to treatment. Surg Oncol. 2016;25:74-85.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 230]  [Cited by in F6Publishing: 317]  [Article Influence: 39.6]  [Reference Citation Analysis (0)]
2.  Ma Y, Tan B, Wang S, Ren C, Zhang J, Gao Y. Influencing factors and predictive model of postoperative infection in patients with primary hepatic carcinoma. BMC Gastroenterol. 2023;23:123.  [PubMed]  [DOI]  [Cited in This Article: ]  [Reference Citation Analysis (0)]
3.  Endo S, Watanabe Y, Abe Y, Shinkawa T, Tamiya S, Nishihara K, Nakano T. Hepatic inflammatory pseudotumor associated with primary biliary cholangitis and elevated alpha-fetoprotein lectin 3 fraction mimicking hepatocellular carcinoma. Surg Case Rep. 2018;4:114.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 2]  [Article Influence: 0.3]  [Reference Citation Analysis (0)]
4.  Chacon E, Eman P, Dugan A, Davenport D, Marti F, Ancheta A, Gupta M, Shah M, Gedaly R. Effect of operative duration on infectious complications and mortality following hepatectomy. HPB (Oxford). 2019;21:1727-1733.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 6]  [Article Influence: 1.2]  [Reference Citation Analysis (0)]
5.  Loncar Y, Tartrat N, Lastennet D, Lemoine L, Vaillant JC, Savier E, Scatton O, Granger B, Eyraud D. Pulmonary infection after hepatic resection: Associated factors and impact on outcomes. Clin Res Hepatol Gastroenterol. 2022;46:101733.  [PubMed]  [DOI]  [Cited in This Article: ]  [Reference Citation Analysis (1)]
6.  Wei T, Zhang XF, Bagante F, Ratti F, Marques HP, Silva S, Soubrane O, Lam V, Poultsides GA, Popescu I, Grigorie R, Alexandrescu S, Martel G, Workneh A, Guglielmi A, Hugh T, Aldrighetti L, Endo I, Pawlik TM. Postoperative Infectious Complications Worsen Long-Term Survival After Curative-Intent Resection for Hepatocellular Carcinoma. Ann Surg Oncol. 2022;29:315-324.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 5]  [Article Influence: 1.7]  [Reference Citation Analysis (0)]
7.  Roth CG, Mitchell DG. Hepatocellular carcinoma and other hepatic malignancies: MR imaging. Radiol Clin North Am. 2014;52:683-707.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 30]  [Cited by in F6Publishing: 30]  [Article Influence: 3.0]  [Reference Citation Analysis (0)]
8.  Kabir T, Syn NL, Tan ZZX, Tan HJ, Yen C, Koh YX, Kam JH, Teo JY, Lee SY, Cheow PC, Chow PKH, Chung AYF, Ooi LL, Chan CY, Goh BKP. Predictors of post-operative complications after surgical resection of hepatocellular carcinoma and their prognostic effects on outcome and survival: A propensity-score matched and structural equation modelling study. Eur J Surg Oncol. 2020;46:1756-1765.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 14]  [Cited by in F6Publishing: 16]  [Article Influence: 4.0]  [Reference Citation Analysis (0)]
9.  Uddin S, Khan A, Hossain ME, Moni MA. Comparing different supervised machine learning algorithms for disease prediction. BMC Med Inform Decis Mak. 2019;19:281.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 288]  [Cited by in F6Publishing: 429]  [Article Influence: 85.8]  [Reference Citation Analysis (0)]
10.  Choi RY, Coyner AS, Kalpathy-Cramer J, Chiang MF, Campbell JP. Introduction to Machine Learning, Neural Networks, and Deep Learning. Transl Vis Sci Technol. 2020;9:14.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in F6Publishing: 169]  [Reference Citation Analysis (0)]
11.  Ghiasi MM, Zendehboudi S, Mohsenipour AA. Decision tree-based diagnosis of coronary artery disease: CART model. Comput Methods Programs Biomed. 2020;192:105400.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 97]  [Cited by in F6Publishing: 70]  [Article Influence: 17.5]  [Reference Citation Analysis (0)]
12.  Huang S, Cai N, Pacheco PP, Narrandes S, Wang Y, Xu W. Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. Cancer Genomics Proteomics. 2018;15:41-51.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 327]  [Cited by in F6Publishing: 335]  [Article Influence: 55.8]  [Reference Citation Analysis (0)]
13.  Alhamzawi R, Ali HTM. The Bayesian adaptive lasso regression. Math Biosci. 2018;303:75-82.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 61]  [Cited by in F6Publishing: 65]  [Article Influence: 10.8]  [Reference Citation Analysis (0)]
14.  Van Calster B, Wynants L, Verbeek JFM, Verbakel JY, Christodoulou E, Vickers AJ, Roobol MJ, Steyerberg EW. Reporting and Interpreting Decision Curve Analysis: A Guide for Investigators. Eur Urol. 2018;74:796-804.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 275]  [Cited by in F6Publishing: 605]  [Article Influence: 100.8]  [Reference Citation Analysis (0)]
15.  Hou N, Li M, He L, Xie B, Wang L, Zhang R, Yu Y, Sun X, Pan Z, Wang K. Predicting 30-days mortality for MIMIC-III patients with sepsis-3: a machine learning approach using XGboost. J Transl Med. 2020;18:462.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 52]  [Cited by in F6Publishing: 187]  [Article Influence: 46.8]  [Reference Citation Analysis (0)]
16.  Fay MP, Malinovsky Y. Confidence intervals of the Mann-Whitney parameter that are compatible with the Wilcoxon-Mann-Whitney test. Stat Med. 2018;37:3991-4006.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 24]  [Cited by in F6Publishing: 38]  [Article Influence: 6.3]  [Reference Citation Analysis (0)]
17.  Vibert E, Schwartz M, Olthoff KM. Advances in resection and transplantation for hepatocellular carcinoma. J Hepatol. 2020;72:262-276.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 64]  [Cited by in F6Publishing: 106]  [Article Influence: 26.5]  [Reference Citation Analysis (0)]
18.  Hu Q, Sun YS, Zhu KF. Minimally invasive vs open primary liver resections for hepatocellular carcinoma. J Surg Oncol. 2021;124:910-912.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1]  [Cited by in F6Publishing: 1]  [Article Influence: 0.3]  [Reference Citation Analysis (0)]
19.  Kaibori M, Ishizaki M, Matsui K, Kwon AH. Postoperative infectious and non-infectious complications after hepatectomy for hepatocellular carcinoma. Hepatogastroenterology. 2011;58:1747-1756.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in F6Publishing: 7]  [Reference Citation Analysis (0)]
20.  Kwon JB, Park K, Kim YD, Seo JH, Moon SW, Cho DG, Kim YW, Kim DG, Yoon SK, Lim HW. Clinical outcome after pulmonary metastasectomy from primary hepatocellular carcinoma: analysis of prognostic factors. World J Gastroenterol. 2008;14:5717-5722.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 27]  [Cited by in F6Publishing: 27]  [Article Influence: 1.7]  [Reference Citation Analysis (0)]
21.  Zhao Y, Jin Y, Wu Y. Postoperative infectious complications after liver resection for hepatocellular carcinoma. J Cancer Res Ther. 2016;12:C268-C270.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 3]  [Article Influence: 0.4]  [Reference Citation Analysis (0)]
22.  Ruan DY, Lin ZX, Li Y, Jiang N, Li X, Wu DH, Wang TT, Chen J, Lin Q, Wu XY. Poor oncologic outcomes of hepatocellular carcinoma patients with intra-abdominal infection after hepatectomy. World J Gastroenterol. 2015;21:5598-5606.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 24]  [Cited by in F6Publishing: 24]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
23.  Schaapman JJ, Tushuizen ME, Coenraad MJ, Lamb HJ. Multiparametric MRI in Patients With Nonalcoholic Fatty Liver Disease. J Magn Reson Imaging. 2021;53:1623-1631.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 36]  [Article Influence: 9.0]  [Reference Citation Analysis (0)]
24.  Donato H, França M, Candelária I, Caseiro-Alves F. Liver MRI: From basic protocol to advanced techniques. Eur J Radiol. 2017;93:30-39.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 57]  [Cited by in F6Publishing: 76]  [Article Influence: 10.9]  [Reference Citation Analysis (0)]
25.  Zerunian M, Pucciarelli F, Masci B, Siciliano F, Polici M, Bracci B, Guido G, Polidori T, De Santis D, Laghi A, Caruso D. Updates on Quantitative MRI of Diffuse Liver Disease: A Narrative Review. Biomed Res Int. 2022;2022:1147111.  [PubMed]  [DOI]  [Cited in This Article: ]  [Reference Citation Analysis (0)]
26.  Shamsil A, Naish MD, Patel RV. Texture-based Intraoperative Image Guidance for Tumor Localization in Minimally Invasive Surgery. Annu Int Conf IEEE Eng Med Biol Soc. 2021;2021:3526-3530.  [PubMed]  [DOI]  [Cited in This Article: ]  [Reference Citation Analysis (0)]
27.  Litvin AA, Burkin DA, Kropinov AA, Paramzin FN. Radiomics and Digital Image Texture Analysis in Oncology (Review). Sovrem Tekhnologii Med. 2021;13:97-104.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 16]  [Article Influence: 5.3]  [Reference Citation Analysis (0)]
28.  Marusyk A, Polyak K. Tumor heterogeneity: causes and consequences. Biochim Biophys Acta. 2010;1805:105-117.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 582]  [Cited by in F6Publishing: 822]  [Article Influence: 58.7]  [Reference Citation Analysis (0)]
29.  de Oliveira ME, Neto LM. Directional entropy based model for diffusivity-driven tumor growth. Math Biosci Eng. 2016;13:333-341.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 3]  [Article Influence: 0.4]  [Reference Citation Analysis (0)]
30.  Dercle L, Ammari S, Bateson M, Durand PB, Haspinger E, Massard C, Jaudet C, Varga A, Deutsch E, Soria JC, Ferté C. Limits of radiomic-based entropy as a surrogate of tumor heterogeneity: ROI-area, acquisition protocol and tissue site exert substantial influence. Sci Rep. 2017;7:7952.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 60]  [Cited by in F6Publishing: 58]  [Article Influence: 8.3]  [Reference Citation Analysis (0)]