Retrospective Study Open Access
Copyright ©The Author(s) 2019. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Clin Cases. Nov 6, 2019; 7(21): 3419-3435
Published online Nov 6, 2019. doi: 10.12998/wjcc.v7.i21.3419
Nomograms for pre- and postoperative prediction of long-term survival among proximal gastric cancer patients: A large-scale, single-center retrospective study
Qi-Yue Chen, Zhi-Liang Hong, Qing Zhong, Zhi-Yu Liu, Xiao-Bo Huang, Si-Jin Que, Ping Li, Jian-Wei Xie, Jia-Bin Wang, Jian-Xian Lin, Jun Lu, Long-Long Cao, Mi Lin, Ru-Hong Tu, Chao-Hui Zheng, Chang-Ming Huang, Department of Gastric Surgery, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
Qi-Yue Chen, Zhi-Liang Hong, Qing Zhong, Zhi-Yu Liu, Xiao-Bo Huang, Si-Jin Que, Ping Li, Jian-Wei Xie, Jia-Bin Wang, Jian-Xian Lin, Jun Lu, Long-Long Cao, Mi Lin, Ru-Hong Tu, Chao-Hui Zheng, Chang-Ming Huang, Department of General Surgery, Fujian Medical University Union Hospital, Fuzhou 350001, Fujian Province, China
Qi-Yue Chen, Ping Li, Jian-Wei Xie, Jia-Bin Wang, Jian-Xian Lin, Jun Lu, Long-Long Cao, Mi Lin, Ru-Hong Tu, Chao-Hui Zheng, Chang-Ming Huang, Key Laboratory of the Ministry of Education of Gastrointestinal Cancer, Fujian Medical University, Fuzhou 350001, Fujian Province, China
Qi-Yue Chen, Ping Li, Jian-Wei Xie, Jia-Bin Wang, Jian-Xian Lin, Jun Lu, Long-Long Cao, Mi Lin, Ru-Hong Tu, Chao-Hui Zheng, Chang-Ming Huang, Fujian Key Laboratory of Tumor Microbiology, Fujian Medical University, Fuzhou 350001, Fujian Province, China
ORCID number: Qi-Yue Chen (0000-0001-6391-4043); Zhi-Liang Hong (0000-0001-8995-9995); Qing Zhong (0000-0002-8214-9129); Zhi-Yu Liu (0000-0002-2207-2932); Xiao-Bo Huang (0000-0002-8571-8980); Si-Jin Que (0000-0002-4156-0659); Ping Li (0000-0002-9418-9339); Jian-Wei Xie (0000-0001-9000-5638); Jia-Bin Wang (0000-0002-2023-0183); Jian-Xian Lin (0000-0002-5006-4454); Jun Lu (0000-0002-8459-4867); Long-Long Cao (0000-0003-3144-3050); Mi Lin (0000-0001-7299-6159); Ru-Hong Tu (0000-0002-7491-3879); Chao-Hui Zheng (0000-0003-0157-5167); Chang-Ming Huang (0000-0002-0019-885X).
Supported by Scientific and Technological Innovation Joint Capital Projects of Fujian Province, No. 2016Y9031; the General Project of Miaopu Scientific Research Fund of Fujian Medical University, No. 2015MP021; Youth Project of Fujian Provincial Health and Family Planning Commission, No. 2016-1-41; Fujian Province Medical Innovation Project, Chinese Physicians Association Young Physician Respiratory Research Fund, No. 2015-CXB-16; and Fujian Science and Technology Innovation Joint Fund Project, No. 2017Y9004.
Author contributions: Chen QY and Hong ZL conceived the study, analyzed the data, and drafted the manuscript; Huang CM, Lin JX, Zhong Q, and Zheng CH helped critically revise the manuscript for important intellectual content; and Liu ZY, Li P, Xie JW, Wang JB, Lu J, Cao LL, and Lin M helped collect the data and design the study.
Institutional review board statement: This study received local ethical approval from the Ethics Committee of Fujian Medical University Union Hospital. The ethical approval number is 2019KY059.
Informed consent statement: This study used administrative data that were unidentifiable. Informed consent was not applicable.
Conflict-of-interest statement: All authors have no conflicts of interest related to this article to declare.
Open-Access: This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Corresponding author: Chang-Ming Huang, MD, Professor, Department of Gastric Surgery, Fujian Medical University Union Hospital, No. 29, Xinquan Road, Fuzhou 350001, Fujian Province, China. hcmlr2002@163.com
Telephone: +86-591-83363366 Fax: +86-591-83320319
Received: March 17, 2019
Peer-review started: March 18, 2019
First decision: May 24, 2019
Revised: June 29, 2019
Accepted: July 27, 2019
Article in press: July 27, 2019
Published online: November 6, 2019
Processing time: 236 Days and 16.9 Hours

Abstract
BACKGROUND

The incidence of proximal gastric cancer (GC) is increasing, and methods for the prediction of the long-term survival of proximal GC patients have not been well established.

AIM

To develop nomograms for the prediction of long-term survival among proximal GC patients.

METHODS

Between January 2007 and June 2013, we prospectively collected and retrospectively analyzed the medical records of 746 patients with proximal GC, who were divided into a training set (n = 560, 75%) and a validation set (n = 186, 25%). A Cox regression analysis was used to identify the preoperative and postoperative risk factors for overall survival (OS).

RESULTS

Among the 746 patients examined, the 3- and 5-year OS rates were 66.1% and 58.4%, respectively. In the training set, preoperative T stage (cT), N stage (cN), CA19-9, tumor size, ASA core, and 3- to 6-mo weight loss were incorporated into the preoperative nomogram to predict the OS. In addition to these variables, lymphatic vascular infiltration (LVI), postoperative tumor size, T stage, N stage, blood transfusions, and complications were incorporated into the postoperative nomogram. All calibration curves used to determine the OS probability fit well. In the training set, the preoperative nomogram achieved a C-index of 0.751 [95% confidence interval (CI): 0.732-0.770] in predicting OS and accurately stratified the patients into four prognostic subgroups (5-year OS rates: 86.8%, 73.0%, 43.72%, and 20.9%, P < 0.001). The postoperative nomogram had a C-index of 0.758 in predicting OS and accurately stratified the patients into four prognostic subgroups (5-year OS rates: 82.6%, 74.3%, 45.9%, and 18.9%, P < 0.001).

CONCLUSION

The nomograms accurately predicted the pre- and postoperative long-term survival of proximal GC patients.

Key Words: Proximal gastric cancer; Preoperative; Nomogram; Prediction; Prognosis

Core tip: The prognosis of patients with proximal gastric cancer (GC) is not ideal. The purpose of this study was to investigate the preoperative and postoperative factors associated with survival among proximal GC patients to establish a corresponding predictive model.



INTRODUCTION

Gastric cancer (GC) is the fourth most common malignant tumor worldwide and currently ranks second among the causes of cancer-related deaths[1]. In recent years, the incidence of proximal GC has been increasing. The biological behaviors of proximal GC and cancer in the lower portion of the stomach exhibit certain differences; most studies suggest that the effect of treating proximal GC is lower than that of treating cancer in the lower portion of the stomach. Currently, although there has been great progress in the early diagnosis of and radical surgery and chemotherapy for proximal GC, the postoperative prognosis of patients with this type of cancer is still not ideal[2]. According to the relevant provisions of the Union for International Cancer Control (UICC), the TNM staging system, which includes infiltration depth, lymph node metastasis, and distant metastasis, is among the most important indexes used to evaluate the prognosis of patients with GC[3]. However, certain differences in the prognosis of patients still exist, even among patients with the same stage of the disease. Determining how to individualize treatment according to the characteristics of cancer patients and the features of the tumor is still a main problem in the treatment of proximal GC.

Nomograms have been used for the construction of several common tumor prognosis prediction models[4-7]. The performance of such nomogram-based models is superior to that of the traditional staging system[8]. Most current studies that analyzed the prognosis of GC patients who underwent individualized treatment and follow-up used a nomogram prediction model based on postoperative factors; however, few scholars have reported a prognosis prediction model associated with a nomogram involving the preoperative factors of proximal GC. A preoperative nomogram prognosis prediction model can be a simple and effective prediction tool for the early identification of a poor prognosis following proximal GC radical surgery and can provide an important reference for choosing appropriate cases for comprehensive preoperative treatment. Therefore, the aim of this study was to develop preoperative and postoperative nomogram prediction models for long-term survival using retrospectively analyzed data from patients with proximal GC based on a prior investigation of the preoperative and postoperative prognostic factors.

MATERIALS AND METHODS
Materials

This study involved a retrospective analysis of a prospectively collected database of 2929 GC patients treated by radical surgery at the Department of Gastric Surgery of Fujian Medical University Union Hospital, Fuzhou, China between January 2007 and June 2013. The following inclusion criteria were used: (1) Histologically confirmed primary adenocarcinoma in the proximal third of the stomach; (2) No evidence of tumor invasion in adjacent organs (the pancreas, spleen, liver, or transverse colon), enlargement or integration of the para-aortic or splenic hilar lymph nodes (LNs), or distant metastasis demonstrated by preoperative abdominal computed tomography (CT), abdominal ultrasound, or endoscopic ultrasound; and (3) Total gastrectomy plus D2 lymphadenectomy with curative R0 resection based on the postoperative pathological diagnosis. The exclusion criteria included the following: Any patients in whom the center of the tumor was located in the middle or lower portion of the stomach (n = 1971); patients with T4b tumors (n = 152); intraoperative or postoperative evidence of peritoneal dissemination or distant metastasis (n = 13); incomplete clinicopathological data (n = 35); or gastric stump carcinoma (n = 12). Finally, in total, 746 patients were included in this study (Figure 1). Of these 746 patients, 613 were men (82.2%) and 133 were women (17.8%) with an average age of 63.14 ± 10.05 years. The data from the laboratory blood tests, which were conducted within 1 week prior to surgery, included the preoperative albumin, hemoglobin, tumor marker (CA125, AFP, CA19-9, CA72-4, and CEA), and fibrinogen levels. The preoperative comorbidities were described according to the classification system of the American Society of Anesthesiologists[9]. The postoperative tumor size was determined based on a measurement of a tumor tissue sample removed from the tumor with the largest diameter[10]. The data regarding the patient demographics, underlying diseases, clinicopathology, and preoperative and postoperative monitoring were recorded in a clinical data system for GC surgery. The type of surgical resection and extent of LN dissection were selected according to the Japanese GC treatment guidelines[11]. The resected specimens were histopathologically examined and staged according to the 7th edition of the UICC TNM classification[12].

Figure 1
Figure 1 Flow chart depicting the patient selection process.

The research proposal was reviewed by the Research Ethics Committee at the university, and all procedures were performed after obtaining written informed consent from the patients following an explanation of the surgical and oncological risks.

Diagnosis and follow-up

The preoperative T and N stages of the neoplasms were assessed in all patients via proximal digestive endoscopy with a biopsy, chest X-ray, total abdominal ultrasound, and abdominopelvic CT. The preoperative T staging criteria were as follows: cT1-3: tumors located between the mucosal and serosal layers with no evidence of the involvement of the serosal surface or adjacent structures; and cT4: cancer affecting the serosal surface or directly infringing on adjacent structures[13,14]. The preoperative N staging criteria were as follows: cN0: short diameter of the regional lymph nodes less than or equal to 8 mm; and cN+: short diameter of the regional lymph nodes greater than 8 mm[14-16]. Trained investigators performed the postoperative follow-up through mail, telephone calls, home visits, or outpatient services. The overall survival (OS) was calculated from the day of surgery until death or the final follow-up date of June 2016, whichever occurred first.

Statistical analysis

The statistical processing of all data was performed using SPSS version 18.0 (SPSS, Chicago, IL, United States). The optimal threshold levels of the preoperative blood CEA, CA19-9, etc. for predicting prognosis were acquired through the X-tile software[17] (Figure 2). Using random sampling methods in SPSS 18.0, the data were divided 75/25; 75% of the patients were used in the training set, and 25% were included in the validation set. The optimal threshold levels of preoperative blood CEA and CA19-9 for the prediction of prognosis, which were acquired using the log-rank test with the X-tile Software, were 4 ng/mL and 33.35 ng/mL, respectively. The continuous data are reported as the mean ± SD, and the differences between the sets were analyzed using t-tests. The categorical data are presented as proportions and percentages and were analyzed using the chi-square test or Fisher’s exact test. The Kaplan-Meier method was used to conduct the univariate analyses, and the log-rank test was used to compare the significant differences among the subgroups. The Cox regression method was applied for the multivariate analysis of the factors influencing the OS in the patients undergoing surgery for proximal GC. The results of the multiple-factors analysis and each risk grouping are shown with hazard ratio (HR) values and the corresponding 95% confidence intervals (CIs). The R software (version 3.2.0) was used to describe the nomogram based on independent prognostic factors[18,19]. Receiver operating characteristic (ROC) and area under the curve (AUC) analyses were used to determine the adequacy of the prediction models. Values of 0.7 and higher were considered clinically significant, and the optimal cut-off values were established according to the Youden index of the ROC[20]. This model was internally validated through the validation set. P values < 0.05 were considered statistically significant.

Figure 2
Figure 2 X-tile used to confirm the cutoff values for CEA (A) and CA19-9 (B).
RESULTS
Comparison of general clinical data between the training and validation sets

Of the 560 patients in the training set, there were 462 men (82.5%) and 98 women (17.5%). The average age was 62.98 ± 10.72 years, and the average body mass index (BMI) was 22.03 ± 3.52 kg/m2. Of the 186 patients in the validation set, 151 (81.2%) were men and 35 (18.8%) were women; the mean age was 63.64 ± 10.00 years, and the average BMI was 21.79 ± 3.57 kg/m2. The preoperative and postoperative clinicopathological data of the patients in the training set did not statistically significantly differ from those of the patients in the validation set (P > 0.05) (Table 1).

Table 1 Comparison of preoperative and postoperative clinicopathology data in the training and validation sets.
Model set (n = 560)Validation set (n = 186)P value
Age (yr)0.648
< 6531398
≥ 6524788
Gender0.446
Female9835
Male462151
BMI (kg/m2)0.382
< 25473162
≥ 258724
Preoperative tumor size(cm)0.736
< 527293
≥ 528893
Preoperative N stage0.965
N026989
N+29197
Preoperative T stage0.066
T1-319077
T4370109
Preoperative CA19-9 (U/mL)0.643
< 33.35463151
≥ 33.359735
Preoperative CEA (µg/mL)0.487
< 4365116
≥ 419570
ASA score0.511
1309114
219558
35514
410
Accompanying disease0.087
No359132
Yes20154
History of epigastric operation0.432
No544183
Yes163
Preoperative Charlson score0.311
0368133
1-218450
≥ 383
HB, g/L0.208
≥ 9.0500172
< 9.06014
ALB, g/L0.096
≥ 35418150
< 3514236
Fibrinogen, g/L0.067
< 4364107
≥ 419679
3- to 6-mo weight reduction0.835
No321105
Yes23981
Lymph node ratio0.158 ± 0.2000.192 ± 0.2270.069
Postoperative T stage0.248
T17335
T26719
T316254
T4a25878
Postoperative N stage0.583
N016965
N19526
N210134
N319561
Involvement of the esophagus with the tumor0.028
No370139
Yes19047
Postoperative tumor size (cm)0.233
< 523186
≥ 5329100
LVI0.72
No408133
Yes15253
Postoperative blood transfusion0.745
No498167
Yes6219
General complications0.495
No486165
Yes7421
Presence of digestive tract fistula0.498
No552182
Yes84
Postoperative obstruction1
No553184
Yes72
Infection of incisional wound0.339
No555186
Yes50
Intra-abdominal infection0.422
No549184
Yes112
Pulmonary infection0.459
No521170
Yes3916
Peritoneal lymphatic fistula0.751
No550182
Yes104
Intra-abdominal hemorrhage0.74
No552183
Yes83
Neoadjuvant chemotherapy1
No548183
Yes123
Adjuvant chemotherapy0.069
No258100
Yes30286
OS among patients in the training and validation sets

As of the June 2016 follow-up, the patient groups had a median follow-up time of 72 mo (36-112 mo), and the follow-up rate was 97.3%. The 3- and 5-year OS rates among the patients in the training set were 64.9% and 57.3%, respectively. Among the patients in the validation set, the 3- and 5-year OS rates were 69.7% and 62.1%, respectively.

Analysis of factors related to OS among patients in the training set

Univariate and multivariate methods were used to analyze the preoperative and postoperative factors associated with OS in the postoperative proximal GC patients. The preoperative single-factor analysis showed that age, preoperative T stage (cT), preoperative N stage (cN), preoperative CA19-9, CEA, ALB, and fibrinogen levels, ASA score, preoperative tumor size, and weight loss in 3-6 mo could significantly affect the OS (P < 0.05). The multi-factor analysis showed that cT, cN, preoperative CA19-9 level, ASA score, preoperative tumor size, and weight loss in 3-6 mo were independent preoperative risk factors affecting OS (Table 2). The postoperative single-factor analysis showed that postoperative T stage and N stage, postoperative tumor size, vascular invasion, postoperative blood transfusion, postoperative complications, and neoadjuvant chemotherapy could significantly affect the OS (P < 0.05). The multiple-factor analysis showed that postoperative T stage and N stage, postoperative vascular nerve invasion, tumor size, postoperative blood transfusion, and postoperative overall complications were also independent postoperative risk factors for OS (Table 3).

Table 2 Preoperative analysis of overall survival.
Univariate analysis
Multivariate analysis
VariableHR (95%CI)P valueHR (95%CI)P value
Preoperative tumor size(cm)< 0.0010.012
< 5RefRef
≥ 52.953 (2.227-3.915)1.480 (1.090-2.010)
Preoperative N stage< 0.001< 0.001
N0RefRef
N+3.219 (2.428-4.268)2.069 (1.536-2.787)
Preoperative T stage< 0.001< 0.001
T1-3RefRef
T44.550 (3.132-6.609)2.767 (1.846-4.148)
Preoperative CA19-9 (U/mL)< 0.0010.003
< 33.35RefRef
≥ 33.352.250 (1.750-2.894)1.569 (1.166-2.110)
ASA score< 0.001< 0.001
1RefRef
21.725 (1.299-2.289)1.675 (1.257-2.230)
33.805 (2.677-5.409)3.257 (2.271-4.670)
3- to 6-mo weight loss< 0.0010.036
NoRefRef
Yes1.588 (1.231-2.049)1.316 (1.019-1.701)
Age (yr)0.008
< 65Ref
≥ 651.412 (1.095-1.821)
Gender0.318
FemaleRef
Male1.178 (0.854-1.625)
BMI (kg/m2)0.473
<25Ref
≥ 250.875 (0.609-1.259)
Accompanying disease0.673
NoRef
Yes0.944 (0.724-1.232)
History of abdominal surgery0.704
NoRef
Yes1.146 (0.566-2.321)
Preoperative Charlson score
0Ref
1-21.007 (0.768-1.322)0.959
≥ 32.202 (0.973-4.982)0.058
Preoperative CEA (µg/mL)<0.001
< 4Ref
≥ 41.673 (1.294-2.164)
HB, g/L0.265
≥ 9.0Ref
< 9.01.239 (0.850-1.808)
ALB, g/L0.014
≥ 35Ref
< 351.410 (1.072-1.854)
Fibrinogen, g/L0.003
< 4Ref
≥ 41.471 (1.137-1.904)
Table 3 Postoperative analysis of overall survival.
Univariate analysis
Multivariate analysis
VariableHR (95%CI)P valueHR (95%CI)P value
Postoperative T stage< 0.0010.005
T1RefRef
T22.743 (1.054-7.139)2.210 (0.843-5.794)
T36.359 (2.759-14.657)2.730 (1.130-6.594)
T4a9.829 (4.345-22.235)3.847 (1.595-9.278)
Postoperative N stage< 0.001< 0.001
N0RefRef
N11.371 (0.820-2.290)0.962 (0.564-1.639)
N21.984 (1.250-3.151)1.251 (0.767-2.041)
N35.967 (4.109-8.663)2.659 (1.708-4.139)
Postoperative tumor size(cm)< 0.0010.022
< 5RefRef
≥ 52.938 (2.172-2.973)1.503 (1.060-2.132)
Lymphatic vascular infiltration (LVI)< 0.001< 0.001
NoRefRef
Yes3.185 (2.447-4.146)2.690 (2.036-3.554)
Postoperative blood transfusion< 0.0010.025
NoRefRef
Yes1.971 (1.402-2.771)1.505 (1.052-2.153)
General complications0.0010.028
NoRefRef
Yes1.784 (1.278-2.490)1.477 (1.042-2.093)
Digestive tract fistula0.125
NoRef
Yes2.001 (0.825-4.855)
Postoperative obstruction0.033
NoRef
Yes2.629 (1.083-6.386)
Incisional infection0.984
NoRef
Yes0.986 (0.245-3.966)
Abdominal infection0.964
NoRef
Yes1.021 (0.421-2.476)
Pulmonary infection0.001
NoRef
Yes2.104 (1.378-3.211)
Peritoneal lymphatic fistula0.565
NoRef
Yes1.297 (0.535-3.147)
intra-Abdominal hemorrhage0.093
NoRef
Yes2.136 (0.880-5.181)
Tumor involvement of the esophagus0.328
NoRef
Yes1.141 (0.876-1.487)
Neoadjuvant chemotherapy0.012
NoRef
Yes2.480 (1.225-5.022)
Adjuvant chemotherapy
NoRef
Yes1.166 (0.902-1.507)0.242
Lymph node ratio1.697 (0.998-2.867)0.053
Development of a preoperative nomogram model for OS in patients and prediction of performance of the model

A nomogram prediction model was developed based on the preoperative independent risk factors that affected the OS in the postoperative proximal GC patients (Figure 3). The C-index of the forecasting model was 0.751 (95%CI: 0.732-0.770). The postoperative 3-year and 5-year OS rate calibration curves indicated that the discriminative ability of the nomogram prediction model was similar to that of actual observation (Figure 4). To further test the validity of the nomogram prediction model, we divided the patients into quartile 1, quartile 2, quartile 3, and quartile 4 to obtain four different prognosis levels according to the score obtained from the forecast model; the 5-year OS rates of the four subgroups were 86.8%, 73.0%, 43.72%, and 20.9% (P < 0.001) (Figure 5).

Figure 3
Figure 3 Preoperative nomogram for predicting overall survival in proximal gastric cancer patients after operation (C-index = 0. 751).
Figure 4
Figure 4 Postoperative 3-year and 5-year overall survival rate calibration curves. A: Training set calibration curve for the preoperative nomogram for predicting the 3-year OS; B: Validation set calibration curve for the preoperative nomogram for predicting the 3-year OS; C: Training set calibration curve for the preoperative nomogram for predicting the 5-year OS; D: Validation set calibration curve for the preoperative nomogram for predicting the 5-year OS. OS: Overall survival.
Figure 5
Figure 5 Survival curve cutoff points for the preoperative nomogram quartiles.
Development of a postoperative nomogram model for OS in patients and prediction of performance of the model

A nomogram prediction model was developed based on the postoperative independent risk factors that affected the OS in the postoperative proximal GC patients (Figure 6). The C-index of the forecasting model was 0.758 (95%CI: 0.739-0.777). The postoperative 3-year and 5-year OS rate calibration curves indicated that the discriminative ability of the nomogram prediction model was similar to that of actual observation (Figure 7). To further test the validity of the nomogram prediction model, we divided the patients into quartile 1, quartile 2, quartile 3, and quartile 4 to obtain four different prognosis levels according to the score obtained from the forecast model. The 5-year OS rates of the four subgroups were 82.6%, 74.3%, 45.9%, and 18.9% (P < 0.001) (Figure 8).

Figure 6
Figure 6 Nomogram for predicting overall survival in postoperative proximal gastric cancer patients (C-index = 0. 754).
Figure 7
Figure 7 Postoperative nomogram 3-year and 5-year overall survival rate calibration curves. A: Calibration curve for the postoperative nomogram for predicting the three-year OS using the training set; B: Calibration curve for the postoperative nomogram for predicting the three-year OS using the validation set; C: Calibration curve for the postoperative nomogram for predicting the five-year OS using the training set; D: Calibration curve for the postoperative nomogram for predicting the five-year OS using the validation set. OS: Overall survival.
Figure 8
Figure 8 Survival curve cutoff points for the postoperative nomogram quartiles.
Internal validation test of effectiveness and accuracy of the proposed prediction model

The 3-year and 5-year OS calibration curves for the preoperative and postoperative nomogram prediction models using the validation set indicated that the discriminative ability was similar to that of actual observation.

In the training set, the optimal cutoff point for the total score in either the preoperative or postoperative nomogram prediction model for the training and validation sets was 18. The sensitivity, specificity, positive predictive value, and negative predictive value for the OS of proximal GC patients predicted by the preoperative nomogram prediction model were 73.6%, 75.3%, 74.9%, and 74.1%, respectively, while these values in the postoperative nomogram prediction model were 70.6%, 76.4%, 81.8%, and 63.4%, respectively.

In the validation set, the optimal cutoff point for the total score in either the preoperative or postoperative nomogram prediction model for the training and validation sets was 18. The sensitivity, specificity, positive predictive value, and negative predictive value for the OS of proximal GC patients predicted by the preoperative nomogram prediction model were 76.8%, 74.4%, 75.5%, and 82.8%, respectively, while these values in the postoperative nomogram prediction model were 85.5%, 59.8%, 70.4%, and 78.7%, respectively (Table 4).

Table 4 Preoperative and postoperative nomograms accurately predicting overall survival in upper stomach cancer patients.
Training set
Validation set
Preoperative nomogramPostoperative nomogramPreoperative nomogramPostoperative nomogram
Area under the curve0.8110.7990.8210.774
Cutoff point18181818
Sensitivity, %0.7360.7060.7680.855
Specificity, %0.7530.7640.7440.598
Positive predictive value, %0.7490.8180.7550.704
Negative predictive value, %0.7410.6340.8280.787
Positive likelihood ratio2.982.9932.127
Negative likelihood ratio0.3510.3850.3040.242
DISCUSSION

GC is among the most common malignant tumors of the digestive system, and the key to enhancing the postoperative survival rate of GC patients is to pursue individualized and effective treatment measures suitable for different patients with GC. Searching for indicators that can effectively predict a poor prognosis in patients with GC may facilitate the formulation of an individualized treatment plan and thereby improve the prognosis of patients[21]. However, most research analyzing the risk factors related to the prognosis of GC has been limited to related postoperative factors, lacking guiding significance for a preoperative prediction. This study first investigated the preoperative and postoperative factors associated with prognosis in postoperative proximal GC patients and then developed an optimal model to predict the prognosis of patients undergoing proximal GC surgery.

A postoperative nomogram prediction model can help patients regarding individualized treatment and follow-up; clinical research designs, postoperative follow-up, and the implementation of adjuvant therapy can be performed according to the guidance of different prognostic levels of the patients. There are a few reports of a prognosis nomogram prediction model for postoperative GC. Kattan et al[4] and Han et al[6] proposed a nomogram to predict the long-term survival of patients after R0 resection for GC based on the postoperative depth of tumor invasion, tumor size, tumor site, and other risk factors. A study conducted by Qian et al constructed a clinical prognostic scoring system for resectable GC patients using the TNM staging, the postoperative rate of lymph node metastasis, lymphovascular invasion, and other risk factors[22]. Considering the overall postoperative GC prognosis prediction model, we found that the related indicators of blood transfusions and postoperative complications during the postoperative recovery process are also important components of the postoperative prediction model for proximal GC. The statistical weights of blood transfusion and postoperative complications in the prediction model were 1.505 and 1.477, respectively. Studies have reported[23-26] that an allogeneic blood transfusion can alter normal immune cells and induce the differentiation of regulatory T cells, thereby inhibiting the activity of natural killer cells, leading to a decline in immune function; therefore, metastatic or residual tumor cells in the human body can escape the surveillance of the immune system. Some scholars have also hypothesized that blood transfusion-related immunosuppression can lead to the recurrence of tiny residual tumor lesions in early GC patients after radical gastrectomy[25,27,28]. Furthermore, data from 751 patients who underwent a radical resection of the stomach were retrospectively analyzed, and the results showed that postoperative complications have a significant impact on the 5-year OS; the patients were divided into grades 1, 2, 3, and 4 according to the grade of the severity of the overall complications, and the 5-year OS in each level was 43.0%, 42.5%, 25.5%, and 9.6%, respectively (P < 0.001)[29]. Therefore, we believe that the occurrence of overall complications is also an important factor in the postoperative GC prediction model. Our model includes not only the condition of the tumor in postoperative patients but also the recovery process, which is difficult to predict preoperatively. The C-index of the prediction model was 0.758, and the training set and internal validation of the OS calibration curve revealed that the discriminative ability of the nomogram prediction model was similar to actual observation. The prediction model was further divided into four different prognostic levels, and the patients among the subgroups exhibited remarkably different OS rates. Therefore, our postoperative model can more accurately predict OS in postoperative proximal GC patients.

In recent years, with progress in preoperative treatments, including new adjuvant chemotherapy, determining how to accurately judge the prognosis of patients preoperatively is critical. In addition, a preoperative prediction model can provide a simple and effective prediction tool to preoperatively distinguish between postoperative high and low mortality risk groups of patients with proximal GC. The targeted adoption of a relevant, more positive and effective operation has important significance for improving the prognosis of patients with proximal GC after operation. Furthermore, physicians could have a more comprehensive preoperative conversation with high-risk patients regarding the poor postoperative prognosis. Additionally, the preoperative prediction model can provide an important reference for choosing the appropriate preoperative cases for radical GC surgery. To date, no accurate and effective prognosis prediction model has been established based on the preoperative risk factors. The development of the preoperative nomogram model for predicting OS in proximal GC patients in our study included preoperative T stage, preoperative N stage, preoperative tumor size, preoperative CA19-9 level, ASA score, and 3- to 6-mo weight loss. According to a previous report[30], a more advanced preoperative T and N stage, a greater preoperative tumor diameter, and a higher CA19-9 level indicate a greater tumor load, and thus, the prognosis is worse. Additionally, by studying 455 patients who underwent radical resection for GC, Liu et al[31] found that weight loss is an independent prognostic factor for OS. A possible reason for this finding is that patients with a preoperative weight loss have nutritional dysfunction; under this condition, the function of the immune system is relatively low, and the level of tumor cell resistance and the amount of various cellular factors in the blood are inadequate. Langius et al[32] believes that patients with preoperative weight loss have a significantly lower content of iNKT cells in the blood, and iNKT cells have significant antitumor effects. Furthermore, weight loss may be affected by cancer cachexia syndrome, and patients with cachexia tend to exhibit a significant weight loss. Previous studies report that patients with cachexia syndrome often have a poor prognosis[33]. Lee et al[34]report that GC patients with a preoperative ASA grade of 3 points or above have a significantly increased incidence of postoperative complications and mortality. Thus, the ASA score is considered an important reference index that influences the prognosis of GC patients. Therefore, incorporating the above index into the development of the preoperative nomogram prediction model for OS in proximal GC postoperative patients enables a more accurate and reliable result. Our results show that the C-index of the preoperative nomogram prediction model (0.751) was similar to that of the postoperative nomogram prediction model, and a simple reference is provided for the prediction of the prognosis of patients preoperatively. The prediction model combined the preoperative risk factors for the prognosis of patients, and the patients could be divided into four different levels; the OS significantly differed among the subgroups. In addition, we conducted an internal validation, which further confirmed the effectiveness and clinical practical value of the postoperative and preoperative nomogram prediction models.

There are certain limitations in this study. First, the study was conducted at a single center, and the included patients originated from Eastern countries. Compared with Western countries, Eastern countries have a higher incidence of GC, there are more cases of advanced GC, and the BMI is lower. Therefore, the results require verification by performing a multi-center, prospective trial with a large sample that combines cases from Eastern and Western countries. Second, the data regarding preoperative systemic inflammatory markers, such as CRP, were incomplete. We aim to further analyze the prognostic factors affecting survival through multi-center data with preoperative inflammatory markers and establish a more powerful application of the new nomogram. However, this study is the first to provide both preoperative and postoperative prognostic models for patients with proximal GC. Clinical surgeons can use this model to accurately assess the prognostic risk in such patients before surgery, and the postoperative model could help patients in terms of individualized treatment and follow-up guidance.

ARTICLE HIGHLIGHTS
Research background

Gastric cancer (GC) is the fourth most common malignant tumor worldwide and currently ranks second among the causes of cancer-related deaths. The biological behaviors of proximal GC and cancer in the lower portion of the stomach exhibit certain differences. Currently, although there has been great progress in the early diagnosis of and radical surgery and chemotherapy for proximal GC, the postoperative prognosis of patients with this type of cancer is still not ideal. Determining how to individualize treatment according to the characteristics of cancer patients and the features of the tumor is still a main problem in the treatment of proximal GC.

Research motivation

Searching for indicators that can effectively predict a poor prognosis in patients with GC may facilitate the formulation of an individualized treatment plan and thereby improve the prognosis of patients.

Research objectives

This study aimed to explore the postoperative prognosis of proximal GC patients and the related preoperative and postoperative factors and establish preoperative and postoperative nomogram prediction models based on the results.

Research methods

Between January 2007 and June 2013, we prospectively collected and retrospectively analyzed the medical records of 746 patients with proximal GC, who were divided into a training set (n = 560, 75%) and a validation set (n = 186, 25%). A Cox regression analysis was used to identify the preoperative and postoperative risk factors for overall survival (OS).

Research results

Among the 746 patients examined, the 3- and 5-year OS rates were 66.1% and 58.4%, respectively. In the training set, preoperative T stage (cT), N stage (cN), CA19-9, tumor size, ASA core, and 3- to 6-mo weight loss were incorporated into the preoperative nomogram for the prediction of OS. In addition to these variables, LVI, postoperative tumor size, T stage, N stage, blood transfusions, and complications were incorporated into the postoperative nomogram. All calibration curves for the OS probability fit well. In the training set, the preoperative nomogram achieved a C-index of 0.751 [95% confidence interval (CI): 0.732-0.770] in predicting OS and accurately stratified the patients into four prognostic subgroups (5-year OS rates: 86.8%, 73.0%, 43.72%, and 20.9%, P < 0.001). The postoperative nomogram had a C-index of 0.758 in predicting OS and accurately stratified the patients into four prognostic subgroups (5-year OS rates: 82.6%, 74.3%, 45.9%, and 18.9%, P < 0.001).

Research conclusions

The nomograms accurately predict the pre- and postoperative long-term survival of proximal GC patients.

Research perspectives

This is a retrospective study only involving participants from Eastern countries. Compared with Western countries, the incidence of GC in Eastern countries is high, and there are more advanced GC patients. The biological characteristics of GC may differ between Eastern and Western countries. Therefore, we hope that the predictive model will be further validated and improved through a single-center RCT trial or even a multi-center prospective trial.

Footnotes

Manuscript source: Unsolicited manuscript

Specialty type: Medicine, research and experimental

Country of origin: China

Peer-review report classification

Grade A (Excellent): 0

Grade B (Very good): B, B

Grade C (Good): 0

Grade D (Fair): D

Grade E (Poor): 0

P-Reviewer: Agolli L, Deans C, Senchukova M S-Editor: Ma YJ L-Editor: Wang TQ E-Editor: Zhang YL

References
1.  Jemal A, Siegel R, Xu J, Ward E. Cancer statistics, 2010. CA Cancer J Clin. 2010;60:277-300.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10002]  [Cited by in F6Publishing: 10384]  [Article Influence: 741.7]  [Reference Citation Analysis (0)]
2.  Sasako M, Sano T, Yamamoto S, Kurokawa Y, Nashimoto A, Kurita A, Hiratsuka M, Tsujinaka T, Kinoshita T, Arai K, Yamamura Y, Okajima K; Japan Clinical Oncology Group. D2 lymphadenectomy alone or with para-aortic nodal dissection for gastric cancer. N Engl J Med. 2008;359:453-462.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 698]  [Cited by in F6Publishing: 729]  [Article Influence: 45.6]  [Reference Citation Analysis (0)]
3.  WC SLG  International Union against Cancer(UICC) TNM Classification of Malignant Tumours. New York: Wiley-Liss. 2010..  [PubMed]  [DOI]  [Cited in This Article: ]
4.  Kattan MW, Karpeh MS, Mazumdar M, Brennan MF. Postoperative nomogram for disease-specific survival after an R0 resection for gastric carcinoma. J Clin Oncol. 2003;21:3647-3650.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 313]  [Cited by in F6Publishing: 339]  [Article Influence: 16.1]  [Reference Citation Analysis (0)]
5.  Kawai K, Ishihara S, Yamaguchi H, Sunami E, Kitayama J, Miyata H, Watanabe T. Nomogram prediction of metachronous colorectal neoplasms in patients with colorectal cancer. Ann Surg. 2015;261:926-932.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 35]  [Cited by in F6Publishing: 40]  [Article Influence: 4.4]  [Reference Citation Analysis (0)]
6.  Han DS, Suh YS, Kong SH, Lee HJ, Choi Y, Aikou S, Sano T, Park BJ, Kim WH, Yang HK. Nomogram predicting long-term survival after d2 gastrectomy for gastric cancer. J Clin Oncol. 2012;30:3834-3840.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 220]  [Cited by in F6Publishing: 272]  [Article Influence: 22.7]  [Reference Citation Analysis (0)]
7.  Wang Y, Li J, Xia Y, Gong R, Wang K, Yan Z, Wan X, Liu G, Wu D, Shi L, Lau W, Wu M, Shen F. Prognostic nomogram for intrahepatic cholangiocarcinoma after partial hepatectomy. J Clin Oncol. 2013;31:1188-1195.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 597]  [Cited by in F6Publishing: 805]  [Article Influence: 73.2]  [Reference Citation Analysis (0)]
8.  Sternberg CN. Are nomograms better than currently available stage groupings for bladder cancer? J Clin Oncol. 2006;24:3819-3820.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 114]  [Cited by in F6Publishing: 146]  [Article Influence: 8.1]  [Reference Citation Analysis (0)]
9.  Keats AS. The ASA classification of physical status--a recapitulation. Anesthesiology. 1978;49:233-236.  [PubMed]  [DOI]  [Cited in This Article: ]
10.  Wang HM, Huang CM, Zheng CH, Li P, Xie JW, Wang JB, Lin JX, Lu J. Tumor size as a prognostic factor in patients with advanced gastric cancer in the lower third of the stomach. World J Gastroenterol. 2012;18:5470-5475.  [PubMed]  [DOI]  [Cited in This Article: ]
11.  Japanese Gastric Cancer Association. Japanese gastric cancer treatment guidelines 2010 (ver. 3). Gastric Cancer. 2011;14:113-123.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1723]  [Cited by in F6Publishing: 1863]  [Article Influence: 143.3]  [Reference Citation Analysis (0)]
12.  Sobin LGM, Witterkind C. International Union against Cancer (UICC) tnm Classification of Malignant Tumors. Oxford: Wiley-Blackwell 2009; .  [PubMed]  [DOI]  [Cited in This Article: ]
13.  Edge SB, Compton CC. The American Joint Committee on Cancer: the 7th edition of the AJCC cancer staging manual and the future of TNM. Ann Surg Oncol. 2010;17:1471-1474.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5537]  [Cited by in F6Publishing: 6271]  [Article Influence: 447.9]  [Reference Citation Analysis (0)]
14.  Kim HJ, Kim AY, Oh ST, Kim JS, Kim KW, Kim PN, Lee MG, Ha HK. Gastric cancer staging at multi-detector row CT gastrography: comparison of transverse and volumetric CT scanning. Radiology. 2005;236:879-885.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 175]  [Cited by in F6Publishing: 184]  [Article Influence: 9.7]  [Reference Citation Analysis (0)]
15.  Dorfman RE, Alpern MB, Gross BH, Sandler MA. Upper abdominal lymph nodes: criteria for normal size determined with CT. Radiology. 1991;180:319-322.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 253]  [Cited by in F6Publishing: 226]  [Article Influence: 6.8]  [Reference Citation Analysis (0)]
16.  Yang DM, Kim HC, Jin W, Ryu CW, Kang JH, Park CH, Kim HS, Jung DH. 64 multidetector-row computed tomography for preoperative evaluation of gastric cancer: histological correlation. J Comput Assist Tomogr. 2007;31:98-103.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 60]  [Cited by in F6Publishing: 69]  [Article Influence: 4.1]  [Reference Citation Analysis (0)]
17.  Camp RL, Dolled-Filhart M, Rimm DL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. 2004;10:7252-7259.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1947]  [Cited by in F6Publishing: 2753]  [Article Influence: 144.9]  [Reference Citation Analysis (0)]
18.  Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol. 2008;26:1364-1370.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1306]  [Cited by in F6Publishing: 2123]  [Article Influence: 132.7]  [Reference Citation Analysis (0)]
19.  Ohori Tatsuo Gondo And Riu Hamada M, Gondo T, Hamada R. [Nomogram as predictive model in clinical practice]. Gan To Kagaku Ryoho. 2009;36:901-906.  [PubMed]  [DOI]  [Cited in This Article: ]
20.  Gervaz P, Bandiera-Clerc C, Buchs NC, Eisenring MC, Troillet N, Perneger T, Harbarth S. Scoring system to predict the risk of surgical-site infection after colorectal resection. Br J Surg. 2012;99:589-595.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 62]  [Cited by in F6Publishing: 61]  [Article Influence: 5.1]  [Reference Citation Analysis (0)]
21.  Becker K, Reim D, Novotny A, Zum Büschenfelde CM, Engel J, Friess H, Höfler H, Langer R. Proposal for a multifactorial prognostic score that accurately classifies 3 groups of gastric carcinoma patients with different outcomes after neoadjuvant chemotherapy and surgery. Ann Surg. 2012;256:1002-1007.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 44]  [Article Influence: 4.0]  [Reference Citation Analysis (0)]
22.  Qian J, Qian Y, Wang J, Gu B, Pei D, He S, Zhu F, Røe OD, Xu J, Liu L, Gu Y, Guo R, Yin Y, Shu Y, Chen X. A clinical prognostic scoring system for resectable gastric cancer to predict survival and benefit from paclitaxel- or oxaliplatin-based adjuvant chemotherapy. Drug Des Devel Ther. 2016;10:241-258.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 3]  [Cited by in F6Publishing: 7]  [Article Influence: 0.9]  [Reference Citation Analysis (0)]
23.  Baumgartner JM, Silliman CC, Moore EE, Banerjee A, McCarter MD. Stored red blood cell transfusion induces regulatory T cells. J Am Coll Surg. 2009;208:110-119.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 67]  [Cited by in F6Publishing: 68]  [Article Influence: 4.3]  [Reference Citation Analysis (0)]
24.  Chen G, Zhang FJ, Gong M, Yan M. Effect of perioperative autologous versus allogeneic blood transfusion on the immune system in gastric cancer patients. J Zhejiang Univ Sci B. 2007;8:560-565.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 40]  [Cited by in F6Publishing: 42]  [Article Influence: 2.5]  [Reference Citation Analysis (0)]
25.  Heiss MM, Fraunberger P, Delanoff C, Stets R, Allgayer H, Ströhlein MA, Tarabichi A, Faist E, Jauch KW, Schildberg FW. Modulation of immune response by blood transfusion: evidence for a differential effect of allogeneic and autologous blood in colorectal cancer surgery. Shock. 1997;8:402-408.  [PubMed]  [DOI]  [Cited in This Article: ]
26.  Sun CF, Hsieh YY, Ngan KW, Wang WT. Search for immunomodulatory effects of blood transfusion in gastric cancer patients: flow cytometry of Th1/Th2 cells in peripheral blood. Ann Clin Lab Sci. 2001;31:171-178.  [PubMed]  [DOI]  [Cited in This Article: ]
27.  Heiss MM, Simon EH, Beyer BC, Gruetzner KU, Tarabichi A, Babic R, Schildberg FW, Allgayer H. Minimal residual disease in gastric cancer: evidence of an independent prognostic relevance of urokinase receptor expression by disseminated tumor cells in the bone marrow. J Clin Oncol. 2002;20:2005-2016.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 59]  [Cited by in F6Publishing: 60]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
28.  Jauch KW, Heiss MM, Gruetzner U, Funke I, Pantel K, Babic R, Eissner HJ, Riethmueller G, Schildberg FW. Prognostic significance of bone marrow micrometastases in patients with gastric cancer. J Clin Oncol. 1996;14:1810-1817.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 125]  [Cited by in F6Publishing: 128]  [Article Influence: 4.6]  [Reference Citation Analysis (0)]
29.  Jiang N, Deng JY, Ding XW, Zhang L, Liu HG, Liang YX, Liang H. Effect of complication grade on survival following curative gastrectomy for carcinoma. World J Gastroenterol. 2014;20:8244-8252.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in CrossRef: 41]  [Cited by in F6Publishing: 42]  [Article Influence: 4.2]  [Reference Citation Analysis (0)]
30.  Borda A, Borda F, Vila J, Fernández-Urién I, Zozaya JM, Guerra A. [Predictive pre-treatment value of the Prognostic Nutritional Index on survival in gastric carcinoma]. An Sist Sanit Navar. 2016;39:227-235.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1]  [Cited by in F6Publishing: 2]  [Article Influence: 0.3]  [Reference Citation Analysis (0)]
31.  Liu X, Sun X, Liu J, Kong P, Chen S, Zhan Y, Xu D. Preoperative C-Reactive Protein/Albumin Ratio Predicts Prognosis of Patients after Curative Resection for Gastric Cancer. Transl Oncol. 2015;8:339-345.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 116]  [Cited by in F6Publishing: 157]  [Article Influence: 17.4]  [Reference Citation Analysis (0)]
32.  Langius JA, Bakker S, Rietveld DH, Kruizenga HM, Langendijk JA, Weijs PJ, Leemans CR. Critical weight loss is a major prognostic indicator for disease-specific survival in patients with head and neck cancer receiving radiotherapy. Br J Cancer. 2013;109:1093-1099.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 160]  [Cited by in F6Publishing: 202]  [Article Influence: 18.4]  [Reference Citation Analysis (0)]
33.  Ockenga J, Valentini L. Review article: anorexia and cachexia in gastrointestinal cancer. Aliment Pharmacol Ther. 2005;22:583-594.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 48]  [Cited by in F6Publishing: 44]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
34.  Lee KG, Lee HJ, Yang JY, Oh SY, Bard S, Suh YS, Kong SH, Yang HK. Risk factors associated with complication following gastrectomy for gastric cancer: retrospective analysis of prospectively collected data based on the Clavien-Dindo system. J Gastrointest Surg. 2014;18:1269-1277.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 86]  [Cited by in F6Publishing: 99]  [Article Influence: 9.9]  [Reference Citation Analysis (0)]