Baseline Characteristics of Study Population
From May 1,2006 to December 31,2019, a total of 1036 patients with 1039 breast cases (3 of whom had simultaneity bilateral breast malignancies) met the inclusion criteria. 698 (696 patients) were diagnosed by frozen sections and 341 (340 patients) by paraffin sections. Based on the above data, we calculated that the diagnostic sensitivity of frozen section was 67.18%, the FNR was 32.82%.
After removing patients with incomplete image data, 876 patients (876 cases) had complete image data and were selected for logistic regression analysis and nomogram construction, and randomly assigned to the training set and testing set in a ratio of 7:3. The characteristics of the patients are shown in Table1.
Logistic Regression Analysis
In the training set, of 613 patients, 205 (33.44%) were false negative. In the univariate logistic regression analysis, for patients who were sixty years and older (OR, 1.653; 95% CI, 1.029-2.686; P=0.0396), patients who have PL-CNB (OR, 5.037; 95% CI, 3.468-7.366; P < 0.0001), or patients who have SA-CNB (OR, 2.133; 95% CI, 1.161-3.917; P= 0.014), the FNR of frozen section was higher, but lower for those that showed solid image on ultrasonography (OR, 0.286; 95% CI, 0.158-0.505; P < 0.0001), DPSE on ultrasonic image (OR, 0.205; 95% CI, 0.128-0.319; P < 0.0001), US-BI-RADS 4C-5 (OR, 0.273; 95% CI, 0.101-0.737; P = 0.0094), clustered microcalcifications on mammography (OR, 0.203; 95% CI, 0.138-0.294; P < 0.0001), and MG-BI-RADS 4C-5 (OR, 0.203; 95% CI, 0.190-0.750; P = 0.0049).
In multivariate logistic regression analysis with backward stepwise selection, US-BI-RADS 4C-5 (OR, 0.250; 95% CI, 0.081-0.777; P = 0.0157), clustered microcalcifications on mammography (OR, 0.345; 95% CI, 0.216-0.543; P < 0.0001) were associated with lower FNR, but for DPSE on ultrasonic image, the correlation is slightly weaker (OR, 0.595; 95% CI, 0.335-1.044; P = 0.0727). On the contrary, PL-CNB (OR, 4.251; 95% CI, 2.804-6.492; P<0.0001) and SA-CNB (OR, 3.727; 95% CI, 1.897-7.376; P= 0.0001) were associated with higher FNR (show in Table 2).
Nomogram Development
On the basis of results from multivariable logistic regression analysis, a nomogram was developed to predict the FNR of frozen section. In the nomogram, the total score is calculated by using clinical and pathologic features, contain BI-RADS category on ultrasonography, DPSE on ultrasonic image, clustered microcalcifications on mammography, PL-CNB, and SA-CNB. This total score can then be used to assign a probability of FN to individual patient using the scale at the bottom of Figure 1.
Nomogram Validation
The resulting nomogram was internally validated using the bootstrap method. We use formula to determine the cutoff value of the validation: \(f\left(x\right)=\frac{nx(1-FNRx)}{N-nx(1-FNRx)}\), x represents the total score, nx represents the number of patients with this score and below, FNRx represents the actual false negative rate of patients with this score and below, and N represents the total number of patients. The best cutoff value is obtained at the peak of the formula value curve, that represents the best clinical utility. The cutoff value we set was the total score 135 points (Figure 2), the prediction model had an AUC of 0.794 (95% CI: 0.756-0.831) in the training set, indicating that the multivariate logistic regression model had potentially promising predictive power (Fig. 3A). The model demonstrated an adequate level of accuracy for predicting the FNR of frozen section.
The independent testing set of 263 patients also showed good discriminatory ability, with an AUC of 0.800 (95% CI: 0.736-0.865), indicating that the multivariate logistic regression model in a separate, individual data set of patients had potentially promising predictive power (Fig. 3B).
The calibration was good for the training and testing cohorts and showed no significant difference between the predicted and observed probabilities of failure diagnosis (P = 1.000), indicating that the nomogram was well calibrated (Fig. 4).
On the basis of the predicted probability of FN, we calculated the practical FNR of different cutoff points in total patients (876 patients). When predicting the probabilities of patients who were more likely to be FN, the patients with practical FNR accounted for 10% and 10.16% of those who had a predicted probability of FN ≤10% and ≤15%, respectively. Among patients with a predicted probability of FN ≥60%, ≥70%, and ≥80%, the practical FNR accounted for 71.7%, 73.4%, and 87.5%, respectively (show in Table 3).
These results demonstrated that the individual probability of FN of frozen section could be predicted accurately by combining information from routinely available clinicopathologic variables.