The main findings from this Norwegian register-based cohort study of patients who had spinal surgery due to lumbar spinal stenosis, were that responsive non-respondents were somewhat younger and tended to smoke more often than those who responded. Moreover, we found no differences in clinical outcomes or proportions of successfully treated responsive non-respondents compared to respondents.
Several studies have demonstrated that non-respondents are younger than respondents (2, 4, 17–19). Completing and posting questionnaires consumes time, and younger patients may be more busy due to work and family obligations. Our finding that non-respondents were more frequently smokers has also been supported by others (2, 4, 6, 18, 19). Also, we found that surgeons reported fewer relevant comorbidities for non-respondents than for respondents. However, the variable “relevant comorbidity” is subject to interpretation by the treating surgeon. The registration of relevant comorbidities by the treating surgeon may be questioned. A validation study of NORspine data found that surgeons tended to underreport relevant comorbidities and that ASA-grading done by the anesthetist could be more reliable in assessment of comorbidity (20). In our study, there was no difference in proportions of ASA 1 and 2 grade patients among non-respondents compared to respondents.
In addition to young age and smoking, previous studies of non-respondents also reported a predominance of the male gender, living alone, and higher preoperative disability at baseline (2, 4–6, 17–19). However, these findings were not reproduced in our study. At baseline, we found no differences in pre-operative ODI between the non-respondents and respondents (Table 1). However, a Swedish spine register study found that non-respondents had higher ODI scores, lower quality of life (EuroQol 5D), and lower function (Short form health survey - SF-36) preoperatively. The aforementioned study implies that non-respondents had a worse starting point and were not quite representative of the entire register population (2).
Another Swedish spine register study reported that non-respondents had inferior clinical outcomes (6), while other studies support our findings of similar postoperative outcomes for non-respondents versus respondents (2, 4, 5, 17–19). Small differences in PROMs have been reported between non-respondents and respondents, but the magnitudes of these differences were assessed as clinically irrelevant (21).
Some studies suggest that loss to follow-up of as little as 5% (22, 23) may cause bias, while rates above 20% (24) could potentially lead to serious bias. There is a variation in loss to follow-up rates in spine register studies ranging from 12% (4) to 42% (2). The loss to follow-up at 12 months post surgery in our study was 27%, hence in the middle of numbers reported by other spine registries. Also, previous studies have implied that it is not the extent of loss to follow-up but the type of attrition that is relevant for assessment of bias (1, 7, 25). Classification of missing data based on Rubin´s and Little´s work differentiates between data missing at random (MAR), missing completely at random (MCAR), and missing at non-random (MNAR) (26). In cases of MAR, the non-respondents and respondents differ at baseline but report similar clinical outcomes after treatment; in cases of MCAR, the groups are similar at baseline and report similar outcomes; in cases of MNAR, the two groups compared report different outcomes. The largest risk of bias in a registry setting arises in cases of MNAR - the results are based on respondents only (1). The use of multiple imputations and mixed linear models are used to manage MNAR (25). Parai et al. found loss to follow-up in the Swedish spine registry to be of the MNAR type (6), while Solberg et al. and Højmark et al. found MAR as the mechanism of loss to follow-up in the Norwegian and Danish spine registries (4, 5). In our study data seem to be missing at random, since baseline characteristics differ somewhat between non-respondents and respondents, but the two groups report similar outcomes.
The methods used by registries to collect data may influence patient response. Reasons for patients not responding can be related to forgetfulness, lack of interest, questionnaires being too time-demanding. Clinical visits and telephone interviews have been shown to increase response rates (5), but are time-consuming, costly, and not practical in a register setting. A web-based registry has shown high loss to follow-up (59%) (18). A combination of postal and web-based methods could complement each other and increase response rates. NORspine is planning to implement a combination of methods to increase the follow-up rate.
Strengths and limitations:
Main weaknesses of our study are that we reached out to a sample of all potential register patients and that responsive non-respondents were compared to respondents at different time points, i.e., 12 months vs 50 (36–64) months post surgery. However, previously published data have shown that patient who are followed longer than one year after spinal surgery keep reporting stable symptoms (27).