The study population includes 11285 and is described in Table 1.
Table 1
Description of the baseline data of the study population (N=11285). Data are expressed as mean ± standard deviation or number (percentage). Preoperative chronic obstructive pulmonary disease (COPD) was defined according to clinical criteria (a patient was considered to be affected by COPD if he was prescribed inhalation bronchodilators or corticosteroids or other drugs labeled for COPD therapy by a pneumologist of the family physician, even without obtaining confirmation from preoperative instrumental data) at the time of hospital admission.
Variable
|
Preoperative value
|
Age, y
|
67.55 ± 13.97
|
Male sex, n (%)
|
9844 (87.2%)
|
Height, cm
|
169 ± 9
|
Weight, kg
|
73 ± 13
|
BMI, kg/m2
|
25.46 ± 3.95
|
Preoperative EF, %
|
56.41% ± 9.77
|
NYHA class > II, n (%)
|
|
Preoperative comorbidities
|
COPD, n (%)
|
920 (8.1%)
|
Hypertension, n (%)
|
7.248 (64.2%)
|
Type II Diabetes, n (%)
|
1.528 (13.5%)
|
Preoperative creatinine, mg/dl
|
0.98 + 0.67
|
Chronic renal failure, n (%)
|
1161 (10.2%)
|
Peripheral vasculopathy, n (%)
|
2036 (18.0%)
|
Smoking habits, n (%)
|
2443 (21.6%)
|
Stroke, n (%)
|
989 (8.8%)
|
Timing of surgery
|
Emergency or urgency, n (%)
|
214 (1.9%)
|
Planned, n (%)
|
11071 (98.1%)
|
Surgery type
|
Valvular surgery, n (%)
|
5178 (45.88%)
|
Coronary surgery, n (%)
|
1814 (16.07%)
|
Ascending aorta aneurysm surgery, n (%)
|
420 (3.71%)
|
Other surgical procedures, n (%)
|
999 (8.85%)
|
Combined surgery (two or more procedures), n (%)
|
5564 (49.31%)
|
BMI – body mass index; EF – ejection fraction; COPD – chronic obstructive pulmonary disease.
|
The most frequent (5564, 49.31%) procedure was combined surgery (Coronary Artery Bypass Graft + valvular procedure), followed by valvular surgery alone (5178, 45.88%). Coronary surgery alone was performed on 1814 patients (16.07%). Aortic surgery was performed on 420 patients (3.71%). The remaining 999 patients (8.85%) underwent other cardiac surgery procedures, such as percutaneous surgery (e.g. Mitraclip® implantation), tumor exeresis, the Maze procedure for atrial fibrillation, or patent foramen ovale closure. The PaO2/FiO2 ratio at ICU discharge was 292.6 ±114.0, showing normal distribution. The initial population’s mean age was 67.55 years ± 13.97. Mean BMI was 25.46 kg/m2 ± 3.95. The mean preoperative ejection fraction was 56.41% ± 9.77.
Intraoperative inotropic support was necessary for 5339 patients (47.31%). Postoperative pulmonary complications occurred in 248 (2.19%) cases. Non-Invasive Mechanical Ventilation, considering both continuous positive airway pressure (CPAP) and pressure support ventilation (PSV), was prescribed in 658 patients (5.83%).
1 In-hospital mortality predictive models
1.1 Preoperative model
Four variables predicted in-hospital mortality in the preoperative multivariate logistic model (whole model P<0.0001; Pseudo R2=0.10), namely age, EF, NYHA class, and elective vs. emergency procedure. When the year of the procedure was considered as a random effect, the resulting mixed effect model did not differ from the correspondent logistic regression model (Likelihood ratio test P=1.000; ICC<0.01). Nevertheless, table 2 reports on the model which entails the year of surgery as a random intercept, given its importance.
This model’s AUROC was 0.81 (95% CI = 0.76-0.85).
When the model was applied to the test set, its AUROC was 0.79 (95% CI = 0.75- 0.83) and did not differ from the training test’s (P=0.6685). The relevant calibration plot exhibited calibration-in-the-large=0.0024 and calibration slope=0.7065.
1.2 Surgery model
Five variables predicted in-hospital mortality in the surgery multivariate logistic model (whole model p<0,0001; Pseudo R2=0,18), namely use of inotropic drugs, use of Intra-Aortic Balloon Pump (IABP), age, NYHA class, and elective vs. emergency procedure. When the year of the procedure was considered as a random effect, the resulting mixed effect model did not differ from the correspondent logistic regression model (Likelihood ratio test P=0,32; ICC=0,02). Nevertheless, Table2 reports on the model, which entails the year of surgery as a random intercept, given its importance.
This model’s AUROC was 0,86 (95%CI = 0,82-0,89). When the model was applied to the test set, its AUROC was 0,85 (95% CI = 0,82- 0,89): this did not differ from the training test’s (P= 0,7417), but was significantly higher than the corresponding test admission model’s AUROC (P=0,0005). The relevant calibration plot exhibited calibration-in-the-large=0,0057 and calibration slope=0,8643 (see figure 1).
1.3 ICU model
Six variables predicted in-hospital mortality in the ICU multivariate logistic model (whole model p<0,0001; Pseudo R2= 0,26), namely serum creatinine peak value in ICU, tracheostomy, use of inotropic drugs, NYHA class, age, and PaO2/FiO2 at ICU discharge. When the year of the procedure was considered as a random effect, the resulting mixed effect model did not differ from the correspondent logistic regression model (Likelihood ratio test P=1,000; ICC=0,11). Nevertheless, Table 2 reports on the model which entails the year of surgery as a random intercept, given its importance.
This model’s AUROC was 0,90 (95% CI = 0,87-0,94). When the model was applied to the test set, its AUROC was 0,89 (95% CI = 0,84- 0,93) and did not differ from the training test’s (P=0,4390), but was significantly higher than the corresponding test surgery model’s AUROC (P=0,0061). The relevant calibration plot exhibited calibration-in-the-large=0,0021 and calibration slope= 0,8443.(see Figure 1)
2 Postoperative NIMV predictive models
2.1 Preoperative /Surgery model
No variable with data available after surgery entered a multivariate model. Hence the “Preoperative” and “Surgery” multivariate logistic models for NIMV use were actually not different from one another.
Four variables predicted NIMV use in the preoperative/surgery multivariate logistic model (whole model P<0,0001; Pseudo R2= 0,05), namely age, EF, Body Mass Index (BMI), and preoperative serum creatinine. When the year of the procedure was considered as a random effect, the resulting mixed effect model differed from the correspondent logistic regression model (Likelihood ratio testP= 0.0002; ICC=0.08). Tab. 2 reports on the model which entails the year of surgery as a random intercept.
This model’s AUROC was 0.71 (95% CI = 0.67-0.75).
When the model was applied to the test set, its AUROC was 0.71(95% CI = 0.67-0.75) and did not differ from the training test’s (P=0.8687). The relevant calibration plot exhibited calibration-in-the-large=0.0057 and calibration slope=0.8643.
Table 2
Results of the logistic regression models.
|
Models for mortality
|
Models for NIMV
|
Models for PPC
|
Preoperative models
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Age
|
1.05
|
1.02 - 1.08
|
<0.001
|
Age
|
1.04
|
1.02-1.06
|
<0.001
|
COPD
|
2.63
|
1.31 -5.28
|
0.007
|
Preoperative EF
|
0.97
|
0.95 - 0.99
|
0.011
|
Preoperative EF
|
0.97
|
0.96-1.00
|
0.023
|
Creatinine Peaks
|
1.48
|
1.19 -1.83
|
<0.001
|
NYHA class
|
2.97
|
1.63 - 5.41
|
<0.001
|
BMI
|
1.10
|
1.05-1.15
|
<0.001
|
EF
|
0.97
|
0.95 – 0.99
|
0.004
|
Elective surgery
|
0.29
|
0.90 - 0.91
|
0.036
|
Preoperative Creatinine
|
1.26
|
1.01-1.58
|
0.043
|
NYHA class
|
1.81
|
1.05 – 3.14
|
0.033
|
Random effect variable
|
SD
|
SE
|
P
|
Random effect variable
|
SD
|
SE
|
P
|
Random effect variable
|
SD
|
SE
|
P
|
Year of surgery
|
<0.001
|
0.37
|
1.000
|
Year of surgery
|
0.53
|
0.18
|
<0.001
|
Year of surgery
|
0.28
|
0.20
|
0.176
|
Surgery models
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Inotropes in the operating room
|
3.09
|
1.45 – 6.6
|
0.003
|
Age
|
1.04
|
1.02-1.06
|
<0.001
|
Inotropes in the operating room
|
2.79
|
1.38-5.64
|
0.004
|
IABP in the operating room
|
3.91
|
1.90 – 8.04
|
<0.001
|
Preoperative EF
|
0.97
|
0.96-1.00
|
0.023
|
IABP in the operating room
|
2.64
|
1.02-6.81
|
0.045
|
Age
|
1.06
|
1.03 – 1.10
|
<0.001
|
BMI
|
1.10
|
1.05-1.15
|
<0.001
|
COPD
|
3.74
|
1.64-8.51
|
0.002
|
NYHA class
|
2.35
|
1.24 – 4.47
|
0.009
|
Preoperative Creatinine
|
1.26
|
1.01-1.58
|
0.043
|
Preoperative creatinine
|
1.39
|
1.07-1.81
|
0.014
|
Elective surgery
|
0.22
|
0.08 – 0.65
|
0.006
|
|
|
|
|
|
|
|
|
Random effect variable
|
SD
|
SE
|
P
|
Random effect variable
|
SD
|
SE
|
P
|
Random effect variable
|
SD
|
SE
|
P
|
Year of surgery
|
0.24
|
0.30
|
0.320
|
Year of surgery
|
0.53
|
0.18
|
<0.001
|
Year of surgery
|
0.53
|
0.25
|
1.329
|
ICU models
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
Predictive variable
|
Odds ratio
|
95% CI
|
P-value
|
|
|
|
|
Creatinine peak
|
1.50
|
1.24 – 1.82
|
<0.001
|
Creatinine peak
|
1.35
|
1.21 -1.51
|
<0.001
|
|
|
|
|
Tracheostomy
|
18.08
|
7.14 – 45.76
|
<0.001
|
Inotropes
|
1.60
|
1.25 – 2.04
|
<0.001
|
|
|
|
|
Inotropes in the ICU in the ICU
|
2.52
|
1.01– 5.77
|
0.029
|
P/F
|
0.99
|
0.991-0.993
|
<0.001
|
|
|
|
|
NYHA class
|
2.79
|
1.35 – 5.78
|
0.006
|
Blood transfusion
|
2.41
|
1.87 – 3.13
|
<0.001
|
|
|
|
|
Age
|
1.08
|
1.03 – 1.12
|
<0.001
|
BMI
|
1.07
|
1.05 – 1.11
|
<0.001
|
|
|
|
|
P/F ratio
|
0.1
|
0.99 – 0.1
|
0.028
|
|
|
|
|
|
|
|
|
Random effect variable
|
SD
|
SE
|
P
|
Random effect variable
|
SD
|
SE
|
P
|
|
|
|
|
Year of surgery
|
<0.001
|
0.44
|
1.000
|
Year of surgery
|
0.83
|
0.18
|
<0.001
|
|
|
|
|
List of abbreviations used
CI: confidence interval – SD: standard deviation – SE: standard error – EF: ejection fraction – NYHA: New York heart association – EF: ejection fraction – NYHA: New York heart association – BMI: body mass index – COPD: chronic obstructive pulmonary disease – IABP intra-aortic balloon pump – ICU: intensive care unit – P/F: PaO2/FiO2 ratio at the discharge from the ICU.
|
2.2 ICU model
Four variables predicted NIMV use in the ICU multivariate logistic model (whole model p<0.0001; Pseudo R2=0.13), namely serum creatinine peak in ICU, inotropic drug use, PaO2/FiO2 ratio at ICU discharge, use of blood products, and BMI. When the year of the procedure was considered as a random effect, the resulting mixed effect model (both intercept and slope) differed from the correspondent logistic regression model (Likelihood ratio test P<0.001; ICC=0.17). Tab. 2 reports on the model which entails the year of surgery as a random intercept.
This model’s AUROC was 0.81 (95% CI = 0.77-0.85). When the model was applied to the test set, its AUROC was 0.79 (95% CI = 0.77 -0.81) and did not differ from the training test’s (P=0.3966) but was significantly higher than the corresponding test surgery model’s AUROC (P<0.0001). The relevant calibration plot exhibited calibration-in-the-large=0.0063 and calibration slope= 0.8814.(see Figure 2)
3 Postoperative pulmonary complication predictive model
3.1 Preoperative model
Four variables predicted PPC in the preoperative multivariate logistic model (whole model P<0.00001; Pseudo R2 = 0.06), namely Chronic Obstructive Pulmonary Disease (COPD), preoperative serum creatinine, EF, and NYHA class. When the year of the procedure was considered as a random effect, the resulting mixed effect model did not differ from the correspondent logistic regression model (Likelihood ratio test P= 0.1767; ICC=0.06). Nevertheless, Tab. 2 reports on the model which entails the year of surgery as a random intercept, given its importance
This model’s AUROC was 0.70 (95% CI = 0.62-0.78).
When the model was applied to the test set, its AUROC was 0.69 (95% CI = 0.61 -0.76) and did not differ from the training test’s (P=0.9299).The relevant calibration plot exhibited calibration-in-the-large= 0.0059 and calibration slope=0.5278.
3.2 Surgery model
Four variables predicted PPC in the Surgery multivariate logistic model (whole model p<0.0001; Pseudo R2=0.088), namely use of inotropic drugs, use of IABP, COPD, and preoperative serum creatinine. When the year of the procedure was considered as a random effect, the resulting mixed effect model (both intercept and slope) differed from the correspondent logistic regression model (Likelihood ratio test P=0.0275; ICC=0.08). Tab. 2 reports on the model which entails the year of surgery as a random intercept.
This model’s AUROC was 0.70 (95% CI = 0.62-0.78).When the model was applied to the test set, its AUROC was 0.68 (95% CI = 0.60-0.76) and did not differ from the training test’s (P=0.3478), but was not significantly different from the corresponding test admission model’s AUROC (P=0.4467). The relevant calibration plot exhibited calibration-in-the-large= -0.0006 and calibration slope=1.1434.(see Figure 1)
4 A new cut-off for the PaO2/FiO2 ratio
A ROC curve was developed using the PaO2/FiO2 ratio at ICU discharge and the incidence of NIMV use during hospital stay. The PaO2/FiO2 ratio cut-off value, maximizing sensitivity, and specificity was 240. At this point in the curve, sensitivity was 66,53% while specificity was 66,06%, correct classification occurred in 66.51% of cases. Figure 2 shows the ROC curve we developed.