Clinical Research Open Access
Copyright ©2005 Baishideng Publishing Group Inc. All rights reserved.
World J Gastroenterol. Apr 28, 2005; 11(16): 2450-2455
Published online Apr 28, 2005. doi: 10.3748/wjg.v11.i16.2450
Risk-adjustment in hepatobiliarypancreatic surgery
Hemant M Kocher, Paris P Tekkis, Ameet G Patel, Irving S Benjamin, Academic Department of Surgery, King’s College Hospital, Denmark Hill, London SE5 9RY, UK
Palepu Gopal, Simon Cottam, Department of Anaesthesia, King’s College Hospital, Denmark Hill, London SE5 9RY, UK
Author contributions: All authors contributed equally to the work.
Correspondence to: Hemant Kocher MS, MD, FRCS, Department of Health National Clinician Scientist, Senior Lecturer Tumour Biology Laboratory, Cancer Research UK Clinical Centre, Queen Mary’s School Of Medicine and Dentistry at Barts and The London, John Vane Science Centre, Charterhouse Square, London EC1M 6BQ, UK. hemant.kocher@cancer.org.uk
Telephone: +44-207-346-5163 Fax: +44-207-346-3575
Received: June 19, 2004
Revised: June 20, 2004
Accepted: August 22, 2004
Published online: April 28, 2005

Abstract

AIM: The present study evaluates the performance of the POSSUM, the American Society of Anesthetists (ASA), APACHE and Childs classification in predicting mortality and morbidity in hepatopancreaticobiliary (HPB) surgery. We describe especially the limitations and advantages of risk in stratifying the patients.

METHODS: We investigated 177 randomly chosen patients undergoing elective complex HPB surgery in a single institution with a total of 71 pre-operative and intra-operative risk factors. Primary endpoint was in-hospital mortality and morbidity. Ordered logistic regression analysis was used to identify individual predictors of operative morbidity and mortality.

RESULTS: The operative mortality in the series was 3.95%. This compared well with the p-POSSUM and APACHE predicted mortality of 4.31% and 4.29% respectively. Post-operative complications amounted to 45% with 24 (13.6%) patients having a major adverse event. On multivariate analysis the pre-operative POSSUM physiological score (OR = 1.18, P = 0.009) was superior in predicting complications compared to the ASA (P = 0.108), APACHE (P = 0.117) or Childs classification (P = 0.136). In addition, serum sodium, creatinine, international normalized ratio (INR), pulse rate, and intra-operative blood loss were independent risk factors. A combination of the POSSUM variables and INR offered the optimal combination of risk factors for risk prognostication in HPB surgery.

CONCLUSION: Morbidity for elective HPB surgery can be accurately predicted and applied in everyday surgical practice as an adjunct in the process of informed consent and for effective allocation of resources for intensive and high-dependency care facilities.

Key Words: Hepatobiliarypancreatic surgery; Risk adjustment; Operative mortality; Operative morbidity; Regression models



INTRODUCTION

Observed healthcare outcomes (mortality, length of hospital stay, quality of life) are increasingly relied upon for evaluating the quality of medical care. Expected outcomes represent predictions about what ought to happen to a particular patient, or group of patients, given pre-defined standards of care. Predictions are based on relevant prognostic factors including patient’s age, disease severity and co-morbidity. Operative mortality and morbidity are objective measures of outcome that can be readily used for monitoring performance within a center or between centers. However, for this measure to be truly objective it must be adjusted for the patient-related risk factors (case-mix).

The Portsmouth Physiological and Operative Severity Score for enumeration of mortality and morbidity[1] (p-POSSUM) was developed as a modification of the original POSSUM equation which was described by Copeland et al[2], and has been widely applied to adjust for case-mix in general surgery. These scoring systems used a 12-factor, four-grade, physiological score and a 6-factor, four-grade, operative severity score, compensating for the type of procedure. Although the POSSUM scoring systems have been applied in patients undergoing general[3], colorectal[4] and vascular[5] surgery, recent reports have pointed out the limitations of applying the POSSUM scoring for example at the extremes of age in colorectal surgery[6] and in emergency vascular surgery[7].

Other types of risk scoring systems have been devised. The American Society of Anesthetists (ASA) grading system is a subjective pre-operative co-morbid index, which has been shown to be a good predictor of post-operative survival[8]. Specific to cirrhotic patients, the Child-Pugh grading system has been shown to be an adequate predictor of short-term and long-term survival[9]. Other systems such as APACHE II scoring system have also been used[10].

Hepatobiliarypancreatic surgical procedures are complex with difficult post-operative management. Many procedures of heterogeneous complexities are being carried out in the referral centers and in order to compare centers these factors may have to be taken into account. It requires a multi-disciplinary approach to patient management with a high dependence on the intensive care facilities. It is being concentrated akin to cardiac and neurosurgery in large centers with a good throughput. Risk adjustment of patients undergoing complex procedure is imminently needed for a qualified informed consent and allocation of meager high-cost resources. The aim of the present study was to compare the POSSUM equation with other risk scoring systems along with other peri-operative variables in order to identify factors, which may affect the outcome of patients undergoing hepatobiliarypancreatic surgery.

MATERIALS AND METHODS
Data and variables

A team of surgeons, anesthetists and intensivists met to decide the risk factors and scoring systems, which may be valuable predictors for post-operative outcome in hepatopan-creaticobiliary (HPB) surgery. Dedicated proformas comprised of (1) demographic details, (2) pre-operative assessment and clinical staging, (3) surgical treatment, (4) postoperative course and complications and (5) data points for various scoring systems [POSSUM, APACHE, ASA, Child-Pugh] and other possible factors for HPB surgery (these currently available and widely used risk stratification models were used as starting point, other factors such as temperature, transfusion requirement were chosen based on literature review as factors affecting outcome in HPB surgery), (6) anesthetic data included intra-operative routinely collected data on a central computerized system, which included pulse, blood pressure, oxygen saturation, core temperature, blood gas measurements, blood loss and intra-operative fluid management, (7) outcomes as defined below. Data were recorded on a Microsoft Access 2000 database (Microsoft Corporation, USA). The patient records underwent an extensive process of data editing to check for missing or out-range values and inconsistencies between data fields. Following rectification of these records, error-free data were entered into a master file. Primary outcome was in-hospital operative mortality, defined as death during the same hospital admission as the operation, regardless of cause and post-operative morbidity classified as minor (delays discharge), intermediate (requiring non-invasive intervention), major (life-threatening or requiring invasive intervention). In-hospital mortality was validated from case records, hospital mortuary registers and the hospital Patient Administration System. The patient and procedural risk factors included (1) age; (2) gender; (3) POSSUM pre-operative physiological score and operative severity score[2] ; (4) surgical procedure categorized according to the OPCS4 system, (5) APACHE variables, (6) cancer staging according to TNM classification of HPB malignancies where applicable; (7) Child-Pugh classification, (8) ASA grade, (9) other peri-operative variables such as clotting profile, type of previous surgery, intra-operative parameters as defined above.

Patient selection

Patients undergoing major elective hepatobiliarypancreatic surgery at King’s College Hospital were included in the study. Prospective data on 77 consecutive patients were collected for the year March 2000-February 2001. Retrospective data (n = 100) were collected from case notes for the period 1991-1999. Patients were selected randomly from a central prospective database using a computer-generated random number sample. Case notes were then retrieved and other data in surgical and anesthetic computerized data were further added.

Statistical analysis

Unifactorial ordered logistic regression was used to identify risk factors related to in-hospital adverse events[11]. Morbidity and mortality were combined as a single ordinal variable comprising three possible outcomes: (1) no morbidity or mortality, (2) mild to intermediate morbidity, (3) major morbidity or mortality. Continuous variables such as POSSUM and APACHE were categorized into quartiles, representing groups increasing operative risk. Any variable whose univariate test had a P-value of <0.25 was considered as a candidate for the multivariate analysis. In order to maximize the information extracted from the predictor variables, we used a median imputation technique for substituting any incomplete data[12]. Multifactorial ordered logistic regression analysis was used to adjust for multiple risk factors and their interactions, entered into the model in a stepwise fashion. Internal validation was performed by comparing observed and predicted complication rates across the various subgroups of international normalized ratio (INR) values using the Hosmer-Lemeshow χ2 test[13].

Software

The following statistical software packages were utilized: “Intercooled STATA 6.0 for Windows” (STATA Corporation, USA), “Statistical Package for the Social Sciences” version 11 for Windows (SPSS, Chicago, IL, USA).

RESULTS

A summary of the diagnosis and type of operative procedures are shown in Tables 1 and 2 respectively. The patient demographic characteristics and in-hospital operative mortality and morbidity are shown in Tables 3 and 4. The overall observed in-hospital operative mortality was 3.95% and morbidity was 45.2%.

Table 1 Diagnosis.
OrganNumber of patients (% of total)Number of deaths (% mortality)
Hepatic89 (50.3)1 (1.1)
Liver primary14 (7.9)0
Colorectal secondaries47 (26.6)1 (2.1)
Other secondaries5 (2.8)0
Carcinoid tumors10 (5.6)0
Benign liver lesions13 (7.3)0
Biliary63 (35.6)4 (6.3)
Cholangiocarcinoma24 (13.6)4 (16.6)
Iatrogenic biliary strictures24 (13.6)0
Benign biliary strictures15 (8.5)0
Pancreatic25 (14.1)2 (8)
Pancreatic malignancy18 (10.2)2 (11)
Pancreatitis7 (3.9)0
Total177 (100)7 (3.95)
Table 2 Type of procedure and in-hospital mortality.
ProcedureNumber of patients (% of total)Number of deaths (% mortality)
Right hepatectomy29 (16.4)1 (3.4)
Left hepatectomy15 (8.5)0
Extended right hepatectomy16 (9)2 (12.5)
Extended left hepatectomy5 (2.8)1 (20)
Segmental liver resection28 (15.8)0
Hepaticojejunostomy47 (26.6)0
Pancreaticoduodenectomy22 (12.4)3 (13.6)
Total pancreatectomy2 (1.1)0
Distal pancreatectomy2 (1.1)0
Others11 (6.2)0
Total177 (100)7 (3.95)
Table 3 Patient characteristics and associated mortality and morbidity.
DemographicsNumber (% of total)
Age (median, range)54.6 (19, 80)
Female patients96 (54.2)
Length of stay (median, range)
Hospital15 (2-113)
ITU0 (0-20)
HDU0 (0-10)
Mortality (in-hospital)7 (3.95)
Morbidity
No morbidity97 (54.8)
Minor/intermediate56 (31.6)
Major24 (13.6)
Table 4 Types of morbidity.
SystemMinor/intermediate1Severe1
Respiratory25 (14.1)10 (5.6)
Gastrointestinal23 (13.0)12 (6.7)
Hematological20 (11.3)6 (3.4)
Wound15 (8.5)3 (1.7)
Intra-abdominal sepsis15 (8.5)2 (1.1)
Cardiac9 (5.1)3 (1.7)
Renal8 (4.5)3 (1.7)
Venous2 (1.1)2 (1.1)
Others19 (10.7)2 (1.1)
Total56 (31.6)124 (13.6)1

Incomplete data for the 177 cases with 77 variables were 2% and were mainly for clotting profiles such as APTT and fibrinogen (0.5%), intra-operative hemodynamic and fluid balance parameters (1%) in the retrospective data set. Unadjusted odds ratios were calculated for each scoring system or factor’s reference category as shown in Table 5. The POSSUM physiological score, the acute physiologic score of APACHE II, and ASA grade showed a significant association with postoperative morbidity particularly at the highest quartile. For example, patients with an APACHE score of 6-13 would be 2.9 times more likely to have a major adverse post-operative event in comparison with patients with an APACHE score of 0-1. The INR and intra-operative blood loss were the other discriminant risk factors of operative morbidity and mortality. Additional factors mentioned in Methods were tested but were found to be insignificant predictors of adverse outcomes in HPB surgery (results not shown). Adjusting for the type of other confounding variables, pancreaticoduodenectomy (Whipple’s procedure) had the highest risk of operative morbidity (OR 2.27, 95%CI: 1.07-9.97) in comparison with the right hepatectomy, which was treated as the reference category.

Table 5 Analysis of the separate risk scoring systems by unifactorial ordered logistic regression using sampling quartiles for continuous variables.
Risk score/factorGroupNumber of patients(% of total)Minor/intermediate complications (%)Major complications/death (%)Unadjusted odds ratio195%CI1
POSSUM12-1362 (35.0)13 (21)7 (11.3)1
Physiological14-1553 (29.9)20 (37.7)6 (11.3)1.80.24, 3.77
Score1216-1731 (17.5)13 (41.9)3 (9.7)1.90.81, 4.41
18-3131 (17.5)10 (32.3)8 (25.8)3.121.32, 7.38
APACHE II0-130 (16.9)9 (30)3 (10)1
Acute2-366 (37.3)20 (30.3)6 (9.1)0.970.41, 2.28
Physiological4-549 (27.7)14 (28.6)7 (14.3)1.180.48, 2.89
Score136-1332 (18.1)13 (40.6)8 (25)2.861.09, 7.5
ASA147 (26.6)12 (25.5)3 (6.4)1
277 (43.5)27 (35.1)8 (10.4)1.730.15, 3.63
3-431 (17.5)17 (33.3)12 (23.5)3.161.41, 7.07
Missing2 (1.1)
Child-PughA145 (81.9)49 (33.8)16 (11)1
B32 (18.1)7 (21.9)8 (25)1.340.64, 2.94
C0
INR<0.945 (25.4)13 (28.9)4 (8.9)1
0.9-1.1119 (67.2)36 (30.3)16 (13.5)1.320.67, 2.63
>1.113 (7.3)7 (53.9)4 (30.7)5.51.78, 17.5
Blood loss<190 (50.9)24 (26.7)9 (10)1
1-238 (21.5)11 (29.0)2 (5.3)0.850.39, 1.85
->249 (27.7)21 (43.0)13 (26.0)4.11.49, 11.13

The adjusted (multivariate ordered logistic regression) odds ratios and 95% CI for the POSSUM, INR, blood loss and type of operation are shown in Table 6.

Table 6 Multivariate ordered logistic regression analysis of risk factors for HPB surgery.
FactorCategoryEstimate (b)Adjusted ORCI 95%
Physiological10-1 units increase1.181.07, 1.31
score-
POSSUM
INR210-2 units increase1.471.12, 1.94
Blood loss< 2 L1
>2 L4.11.49, 11.13
ProcedureRight hepatectomy1
Pancreaticoduodenectomy3.271.07, 9.97
Sub-factors of
POSSUM3
Serum sodium110-1 units increase0.890.82, 0.97
Serum creatinine10-1 units increase1.011.00, 1.02
Pulse rate (bpm)10-1 units increase1.041.01, 1.06

Of the POSSUM physiologic score, the important factors were the serum sodium, creatinine and pulse rate.

Observed vs predicted probabilities of complications of all types or major complications are shown in Figure 1. There was no significant difference between observed and predicted operative morbidity rates across INR values ranging between 0.8 and 1.25. (Hosmer-Lemeshow χ2 test = 7.762, degrees of freedom = 8, P = 0.457.) Similarly Figure 2 shows prediction curves for major and all complications based on the pre-operative POSSUM physiological score. Figures 3 and 4 show the probabilities of all complications and major complications respectively, based on the POSSUM physiological score and increasing values of INR.

Figure 1
Figure 1 Observed vs predicted values of complications (all types or major only) with respect to INR values.
Figure 2
Figure 2 Prediction of possible complications (all types and major only) on the basis of POSSUM physiologic score in patients undergoing major elective HPB surgery.
Figure 3
Figure 3 Prediction of all possible complications on the basis of POSSUM physiologic score and increasing values of INR in patients undergoing major elective HPB surgery.
Figure 4
Figure 4 Prediction of possible major complications on the basis of POSSUM physiologic score and increasing values of INR in patients undergoing major elective HPB surgery.
DISCUSSION

Quality of care is multidimensional, it may be viewed from the patient’s, the doctor’s or healthcare provider’s perspective and be assessed in terms of structure, process and outcomes of a healthcare delivery system[14,15]. The purpose of the present study was to identify and evaluate possible risk factors and scoring systems for HPB surgery.

Operative morality and morbidity are objective measures of healthcare, which can be easily measured[16]. Furthermore, major complications, which may be life threatening (major hemorrhage) or they may be requiring invasive treatment (percutaneous drainage of biliary tree or collection, or re-operation for intra-abdominal catastrophe). These have to be effectively managed in order to convert the near-misses to successes thereby maintaining low post-operative mortality. The management of major post-operative complications after major HPB surgery is multi-disciplinary requiring intensivists, interventional radiologists, endoscopists, hepatologists, anesthetists and dedicated ward and theatre staff not to mention high-cost technology. Thus, the major complications and mortality both have to be measured and risk adjusted in order to give a true picture of in-hospital and intra-hospital comparisons. Operative mortality and morbidity is expected to vary between hospitals. This variation is a function of differences in patient case-mix, random adverse events and differences in the process and structure of care[15]. Statistical analysis is intended to adjust for the case-mix as much as possible so that the remaining variation is more likely to be due to differences in the quality of care. The present study identifies the important factors associated with the adverse events in patients undergoing major HPB surgery.

Ordered logistic regression allowed us to order the types of complications in three groups of increasing severity of adverse outcome: no complications, minor/intermediate complications and major complications along with death[12]. Thus, the ordinal outcomes as mentioned above could be used to quantify the nature of complications and provide accurate and justifiable risk adjustment to take account of case-mix. Since the procedures in HPB surgery are mainly elective, the risk stratification is skewed towards fitter patients as compared to patients undergoing surgery for vascular or colorectal causes, where up to 40% of the workload may be emergency in nature; thus bringing in unfit patients. As can be seen from the physiologic scores for POSSUM, which ranged in this dataset from 12 to 31 as compared to a theoretical range of 12-96. Moreover more than 80% of patients had a pre-operative physiologic POSSUM score of less than 17. Similar scenario can be seen with the APACHE II acute physiologic score (80% below a score of 5) and ASA grading (around 80% ASA I or II). Also all the patients operated upon were either Child’s A or B. Thus, we can observe a self-selection of fitter patients undergoing HPB surgery.

INR, intra-operative blood loss and type of procedure are other important risk factors, which may be important in predicting the outcome. Deranged INR in an elective situation represents established preoperative liver dysfunction.

Pancreaticoduodenectomy (PD) remains the single operation in the spectrum of major HPB operations, which has to be adjusted for whilst comparing outcomes from different units. Gastrointestinal and respiratory complications are higher in patients undergoing PD. This may artificially distort the outcomes of units performing higher or lower numbers of PD, making them appear worse or better respectively. Thus in these two aspects HPB surgery differs from other types of surgery. In addition, excessive intra-operative blood loss may make a particular patient remain in a high dependency unit for a longer duration than normal. However, this operator-dependent variable should be left out of the equation when comparing units, as it can be a surrogate marker for quality of surgery and the surgeon as a risk factor[17].

In addition, we have shown that it is possible to have demonstrable risk adjusted graphs (Figures 3 and 4), which can calculate risk predictions pre-operatively. This can make an informed consent a more objective procedure and justify the need for high dependency facilities in high risk patients for prolonged use.

The expected outcome for a population of patients can be calculated by summing the probabilities estimates of all patients in the population. Having calculated the expected outcome for a population of patients and adjusted for the patient-related risk factors, the observed to the expected outcomes can be compared. This can be done either as an O/E ratio[18] or as a mortality difference, i.e., the observed minus the expected outcomes (O-E difference)[19,20]. Such methodologies can be used as the basis of cross-sectional audits and for continuous or sequential monitoring of surgical performance within hospitals. Numerous studies have been done to develop audit tools for different specialities of surgery[21-30].

There are a number of limitations in this study. First, the sample size is small and it is a single hospital dataset. However, here we are attempting to identify the risk factors specific to HPB surgery. It needs to be validated across national datasets in order to develop a specific equation applicable to HPB surgery. Secondly, the number of pancreatic resections carried out as a proportion to the total number of operations is low and may affect the overall predictive power. If PD is incorporated as an independent risk factor, this shortcoming can be accounted for.

In conclusion the present study has demonstrated the uses and limitations of risk adjustment using the various scoring systems in HPB surgery. The availability of good quality data and validated models is fundamental for a continuous program of quality improvement. With adequate sample size the new risk scoring system can be devised and used for monitoring surgical outcomes between or within hospitals in order to meet the demands of professional and public scrutiny of outcomes in HPB surgery.

ACKNOWLEDGEMENTS

The present study was initiated by Hemant Kocher and Paris Tekkis. Irving Benjamin, Simon Cottam and Ameet Patel contributed to the proformas model and contributed patients. Data harvesting and aggregation was undertaken by Hemant Kocher, Paris Tekkis and Palepu Gopal. Data analysis and risk-modeling and 1st draft of this study was performed by Paris Tekkis and Hemant Kocher and edited by all investigators who contributed comments and corrections on the final draft. We thank the Agostino Trappani International Foundation, Naples for funding Hemant Kocher and The Royal College of Surgeons of England for funding Paris Tekkis. We are most grateful to Paul Bras, David Green and theater staff who have contributed data and supported the study.

Footnotes

Science Editor Guo SY Language Editor Elsevier HK

References
1.  Prytherch DR, Whiteley MS, Higgins B, Weaver PC, Prout WG, Powell SJ. POSSUM and Portsmouth POSSUM for predicting mortality. Physiological and Operative Severity Score for the enUmeration of Mortality and morbidity. Br J Surg. 1998;85:1217-1220.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 486]  [Cited by in F6Publishing: 493]  [Article Influence: 19.0]  [Reference Citation Analysis (0)]
2.  Copeland GP, Jones D, Walters M. POSSUM: a scoring system for surgical audit. Br J Surg. 1991;78:355-360.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1126]  [Cited by in F6Publishing: 1105]  [Article Influence: 33.5]  [Reference Citation Analysis (0)]
3.  Copeland GP, Sagar P, Brennan J, Roberts G, Ward J, Cornford P, Millar A, Harris C. Risk-adjusted analysis of surgeon performance: a 1-year study. Br J Surg. 1995;82:408-411.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 79]  [Cited by in F6Publishing: 79]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
4.  Tekkis PP, Kocher HM, Bentley AJ, Cullen PT, South LM, Trotter GA, Ellul JP. Operative mortality rates among surgeons: comparison of POSSUM and p-POSSUM scoring systems in gastrointestinal surgery. Dis Colon Rectum. 2000;43:1528-1532, discusssion 1532-1534.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 80]  [Cited by in F6Publishing: 85]  [Article Influence: 3.5]  [Reference Citation Analysis (0)]
5.  Midwinter MJ, Tytherleigh M, Ashley S. Estimation of mortality and morbidity risk in vascular surgery using POSSUM and the Portsmouth predictor equation. Br J Surg. 1999;86:471-474.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 82]  [Cited by in F6Publishing: 86]  [Article Influence: 3.4]  [Reference Citation Analysis (0)]
6.  Tekkis PP, Kessaris N, Kocher HM, Poloniecki JD, Lyttle J, Windsor AC. Evaluation of POSSUM and P-POSSUM scoring systems in patients undergoing colorectal surgery. Br J Surg. 2003;90:340-345.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 84]  [Cited by in F6Publishing: 85]  [Article Influence: 4.0]  [Reference Citation Analysis (0)]
7.  Lazarides MK, Arvanitis DP, Drista H, Staramos DN, Dayantas JN. POSSUM and APACHE II scores do not predict the outcome of ruptured infrarenal aortic aneurysms. Ann Vasc Surg. 1997;11:155-158.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 40]  [Cited by in F6Publishing: 41]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
8.  Belghiti J, Hiramatsu K, Benoist S, Massault P, Sauvanet A, Farges O. Seven hundred forty-seven hepatectomies in the 1990s: an update to evaluate the actual risk of liver resection. J Am Coll Surg. 2000;191:38-46.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 800]  [Cited by in F6Publishing: 778]  [Article Influence: 32.4]  [Reference Citation Analysis (0)]
9.  Pugh RN, Murray-Lyon IM, Dawson JL, Pietroni MC, Williams R. Transection of the oesophagus for bleeding oesophageal varices. Br J Surg. 1973;60:646-649.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5490]  [Cited by in F6Publishing: 5605]  [Article Influence: 109.9]  [Reference Citation Analysis (2)]
10.  Gagner M, Franco D, Vons C, Smadja C, Rossi RL, Braasch JW. Analysis of morbidity and mortality rates in right hepatectomy with the preoperative APACHE II score. Surgery. 1991;110:487-492.  [PubMed]  [DOI]  [Cited in This Article: ]
11.  Hosmer DW, Lemeshow S.  Applied Logistic Regression. 2nd ed. New York: John Wiley & Sons Inc;. 2000;.  [PubMed]  [DOI]  [Cited in This Article: ]
12.  Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361-387.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in F6Publishing: 63]  [Reference Citation Analysis (0)]
13.  Hosmer DW, Lemeshow S. Goodness-of-fit testing for multiple logistic regression analysis when the estimated probabilities are small. Biometrical J. 1988;30:911-924.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 82]  [Cited by in F6Publishing: 81]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
14.  Daley J, Henderson WG, Khuri SF. Risk-adjusted surgical outcomes. Annu Rev Med. 2001;52:275-287.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 85]  [Cited by in F6Publishing: 113]  [Article Influence: 4.9]  [Reference Citation Analysis (0)]
15.  Iezzoni LI. Dimensions of risk. Risk adjustment for measuring healthcare outcomes. 2nd ed: Ann Arbor, MI: Health Administration Press 1997; 43-168.  [PubMed]  [DOI]  [Cited in This Article: ]
16.  Jacobson B, Mindell J, McKee M. Hospital mortality league tables. BMJ. 2003;326:777-778.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 32]  [Cited by in F6Publishing: 40]  [Article Influence: 1.9]  [Reference Citation Analysis (0)]
17.  Carter D. The surgeon as a risk factor. BMJ. 2003;326:832-833.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 32]  [Cited by in F6Publishing: 34]  [Article Influence: 1.6]  [Reference Citation Analysis (0)]
18.  Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR. Bayesian methods in health technology assessment: a review. Health Technol Assess. 2000;4:1-130.  [PubMed]  [DOI]  [Cited in This Article: ]
19.  Poloniecki J, Valencia O, Littlejohns P. Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery. BMJ. 1998;316:1697-1700.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 99]  [Cited by in F6Publishing: 121]  [Article Influence: 4.7]  [Reference Citation Analysis (0)]
20.  Lovegrove J, Valencia O, Treasure T, Sherlaw-Johnson C, Gallivan S. Monitoring the results of cardiac surgery by variable life-adjusted display. Lancet. 1997;350:1128-1130.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 186]  [Cited by in F6Publishing: 202]  [Article Influence: 7.5]  [Reference Citation Analysis (0)]
21.  Tekkis PP, McCulloch P, Poloniecki JD, Prytherch DR, Kessaris N, Steger AC. Risk-adjusted prediction of operative mortality in oesophagogastric surgery with O-POSSUM. Br J Surg. 2004;91:288-295.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 104]  [Cited by in F6Publishing: 97]  [Article Influence: 4.9]  [Reference Citation Analysis (0)]
22.  Hadjianastassiou VG, Tekkis PP, Poloniecki JD, Gavalas MC, Goldhill DR. Surgical mortality score: risk management tool for auditing surgical performance. World J Surg. 2004;28:193-200.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 27]  [Cited by in F6Publishing: 29]  [Article Influence: 1.5]  [Reference Citation Analysis (0)]
23.  Tekkis PP, Poloniecki JD, Thompson MR, Stamatakis JD. Operative mortality in colorectal cancer: prospective national study. BMJ. 2003;327:1196-1201.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 190]  [Cited by in F6Publishing: 190]  [Article Influence: 9.0]  [Reference Citation Analysis (0)]
24.  McCulloch P, Ward J, Tekkis PP. Mortality and morbidity in gastro-oesophageal cancer surgery: initial results of ASCOT multicentre prospective cohort study. BMJ. 2003;327:1192-1197.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 265]  [Cited by in F6Publishing: 268]  [Article Influence: 12.8]  [Reference Citation Analysis (0)]
25.  Tekkis PP, McCulloch P, Steger AC, Benjamin IS, Poloniecki JD. Mortality control charts for comparing performance of surgical units: validation study using hospital mortality data. BMJ. 2003;326:786-788.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 58]  [Cited by in F6Publishing: 64]  [Article Influence: 3.0]  [Reference Citation Analysis (0)]
26.  Mohil RS, Bhatnagar D, Bahadur L, Rajneesh DK, Magan M. POSSUM and P-POSSUM for risk-adjusted audit of patients undergoing emergency laparotomy. Br J Surg. 2004;91:500-503.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 75]  [Cited by in F6Publishing: 83]  [Article Influence: 4.2]  [Reference Citation Analysis (0)]
27.  Bennett-Guerrero E, Hyam JA, Shaefi S, Prytherch DR, Sutton GL, Weaver PC, Mythen MG, Grocott MP, Parides MK. Comparison of P-POSSUM risk-adjusted mortality rates after surgery between patients in the USA and the UK. Br J Surg. 2003;90:1593-1598.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 93]  [Cited by in F6Publishing: 105]  [Article Influence: 5.3]  [Reference Citation Analysis (0)]
28.  Zafirellis KD, Fountoulakis A, Dolan K, Dexter SP, Martin IG, Sue-Ling HM. Evaluation of POSSUM in patients with oesophageal cancer undergoing resection. Br J Surg. 2002;89:1150-1155.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 58]  [Cited by in F6Publishing: 62]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
29.  Yii MK, Ng KJ. Risk-adjusted surgical audit with the POSSUM scoring system in a developing country. Physiological and Operative Severity Score for the enUmeration of Mortality and morbidity. Br J Surg. 2002;89:110-113.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 67]  [Cited by in F6Publishing: 74]  [Article Influence: 3.4]  [Reference Citation Analysis (0)]
30.  Tekkis PP, Prytherch DR, Kocher HM, Senapati A, Poloniecki JD, Stamatakis JD, Windsor AC. Development of a dedicated risk-adjustment scoring system for colorectal surgery (colorectal POSSUM). Br J Surg. 2004;91:1174-1182.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 254]  [Cited by in F6Publishing: 243]  [Article Influence: 12.2]  [Reference Citation Analysis (0)]