The results of the present study suggest that reporting of postoperative complications using the CDC and CCI by inexperienced interns and residents is neither reliable nor accurate in a low volume district hospital.
Consistent and accurate classification of postoperative complications is critical for the comparison of surgical procedures and outcomes, leading to continuous improvements in patient care [2, 12, 13]. Currently, the CDC and CCI® are widely used as benchmark tools in surgery to establish a baseline for assessing and evaluating the quality of surgical care and outcomes [14–18]. Improving the quality of healthcare and reducing its costs are essential components of modern medicine. The need for high quality healthcare has influenced surgical practice, the reporting of surgical outcomes, and the establishment of benchmarks for surgical treatments [19]. Patients and insurers now have greater access to medical information and expect surgeons to be up to date, competent, empathetic, and to provide high-quality care in an efficient manner [20, 21]. The purpose of reporting and classifying adverse surgical outcomes is to investigate the underlying factors that contribute to them and to identify measures to prevent their recurrence in the future. This, in turn, will improve the quality of care and reduce the cost of complications. It also allows surgeons to objectively assess their surgical skills, improve surgical outcomes to the best possible result, reduce patient mortality rates, and improve patients’ postoperative quality of life.
In our study the review of data on postoperative complications reported by residents has shown a significantly high number of unreported complications, with a true overall complication rate of 18.3% (105/575) compared to 7.8% (42/575) before revision by senior consultants. More than 60% of all postoperative complications were not reported, and the accuracy of reported complications was only 33.3%. According to the literature, under-reporting of postoperative complications is a well-documented problem in surgery [22–26]. Several studies have shown that the true incidence of postoperative complications is often higher compared to the numbers reported in medical records and published studies [27, 28]. Such under-reporting can have serious consequences for patient care, as it can obscure the true prevalence and impact of complications and hinder efforts to improve quality and develop evidence-based practice. To address this issue, many researchers have called for better standardization and documentation of postoperative complications, as well as improved education and awareness among healthcare providers. The use of standardized reporting systems, such as the Clavien-Dindo classification, has also been shown to be effective in improving the accuracy and completeness of outcome reporting.
The most commonly missed postoperative complications in our study were Clavien - Dindo grades I (94.1%) and II (63.3%). Due to their relatively mild nature, the incidence of Clavien-Dindo grade I and grade II complications is often underreported [29, 30]. These factors include a lack of standardization in reporting systems, inadequate documentation, limited communication between healthcare providers, a tendency to focus on more serious complications, and ignorance of the impact of minor complications on outcomes, quality of life and healthcare costs. To improve the accuracy and completeness of surgical outcome reporting, it is critical that all postoperative complications, including grade I and grade II complications, are documented and reported. This not only allows for a more accurate assessment of surgical outcomes, but it also identifies areas for improvement and ensures optimal patient care.
Despite training and additional surveillance by ward consultants during the first three months, there was no difference in the accuracy of the reported data compared to the rest of the study period. This shows, firstly, that even experienced surgeons may be insensitive to the accurate assessment of minor complications (those of grade II or lower) and, thus, need to be trained regularly (train the trainer). Secondly, constant monitoring of the documented outcome reporting is needed to secure the necessary data quality.
To our knowledge, our study is one of the first to compare the accuracy and completeness of outcome reporting using the CDC and CCI® in a low volume hospital setting. Dindo et al. found comparable results comparing resident surgical outcome reporting in a university hospital setting [30]. The authors showed that the training of inexperienced residents in using the CDC did not improve the overall reliability of outcome reporting using the CDC. However, these results do not argue against the use of such a valid outcome reporting system as CDC grading. Rather, it suggests that the importance of recording outcomes has not been equally understood by all protagonists of the healthcare system. There is no doubt that the recording of outcomes is associated with an additional expenditure of time due to the necessity of documentation. However, this should not have a negative impact on the correct outcome recording. In the end, it is necessary to create a culture in which the recording of outcomes is recognized as an essential parameter of an optimized healthcare system and implemented accordingly.
The overall CCI® score of the group of 42 patients with complications initially identified by the interns and junior residents was 30.9 and increased to 39.4 after review by the senior consultants. This relatively high CCIⓇ already demonstrates that more severe complications were preferentially recognized and documented, but that the minor complications were obviously neglected. The average CCIⓇ of all 105 patients who had a more or less severe complicative course after review by senior surgeons was 23.8. This value appears relatively high, considering the low complicative patient collective. However, considering the fact that in this collective every single deviation from the expected postoperative course, no matter how small, was actually evaluated as a CCIⓇ − relevant complication, these data appear to be reliable and robust.
When looking at the average CCI® of all patients divided into the individual surgical subgroups, the extent of postoperative complications largely corresponds to the data in the scientific literature [16, 31–35].
This study supports previous evidence that the poor quality of data collection by surgical interns and residents is often neglected [30]. This may be due to the lack of time, lack of incentives, and lack of recognition of proper CDC reporting as a professional responsibility to assess both individual and institutional performance quality. Most of the interns and residents in this study were in their first and second year of training, which may lead to unfamiliarity with the normal, uncomplicated course of surgical treatment and a lack of awareness of minor complications.
Obviously, it is necessary to point out the importance of correct recording of surgical outcomes to interns and junior residents from the very beginning and to familiarize them with the instruments of outcome reporting in the long term. It seems mandatory to point out the importance of correct outcome reporting already in medical school education. In our view, transferring this activity to non-medical staff is not a solution, as experience has shown that the quality of the data recorded correlates with the degree of medical background knowledge.
Limitations
The present study has several limitations. First, the study was conducted in a single surgical institution with a predominance of low-risk surgical cases. Therefore, the generalizability of the findings to other institutions and higher-risk surgical cases may be limited. Future research should aim to evaluate the reliability of the database according to the CDC in a more diverse range of surgical settings.
Second, the retrospective design of the study prevented us from establishing causality, and only associations could be inferred from the data.
Third, although organized teaching was provided to the interns and residents on two occasions, the effectiveness of this intervention was not formally evaluated. Although both interns and residents reported understanding the CDC, it is uncertain whether they were able to accurately apply this knowledge in practice. Further evaluation of educational interventions and their impact on the accuracy of complication reporting may be warranted.