The trial was significantly impacted by the pandemic, and as such was under-powered to definitively exclude effects of the intervention. Whilst no effect on the primary outcome was seen, there were some encouraging results regarding QOL, which improved more in the intervention group. It was also notable that very few patients were having unreported (untreated) AECOPD events after 12 months of the trial, though the difference between arms was small.
Recruitment to the study was challenging. The first sites were initiated in early 2020, and when the pandemic began the study was paused by most sites. Patients were also reluctant to be seen, particularly in a hospital setting, because of fear of Covid-19(18). Initially a large proportion of patients were screened out due to co-morbidities which recruiting sites thought could impact self-management; we felt it was important that the trial population reflected the typical COPD patient, in whom heart disease, anxiety and depression are common(19) – 76% of severe COPD patients have at least 1 comorbidity and 40% have 3 or more. Retraining of sites to emphasise the pragmatic nature of this trial resulted in fewer exclusions of this nature. We also experienced issues with AECOPD rate precluding enrolment; this was twofold with the most frequently exacerbating patients never experiencing enough weeks of stability for the COPDPredict™ system to establish a good personal baseline, and patients’ AECOPD falling with social isolation from the pandemic(20), which made them ineligible. We were concerned that lack of confidence in using digital technology might be a factor causing poor uptake, but this was rare (3.5% of patients), and during the study adherence to daily use of the device was equally high as in the initial single site study (98%) by 4 weeks. This is consistent with the wider literature suggesting that patients valued digital support during the pandemic(18).
Our observation of improved quality of life in participants using COPDPredict™ supports the theory that digital reinforcement of self-management may be effective. The minimum clinically important difference (MCID) in CAT score is 1 point(21), and the 95% CI showed that at 3 months intervention arm patients were improved at this level. By 6 months on average patients had improved by more than the MCID, but the bottom end of the 95% CI was less than − 1, and by 12 months there was no significant difference. Statistically, however, there was no time interaction proven. Interestingly maintaining regular e-diary use over longer time periods has been shown to be challenging(22), such that short to medium term use might be more practical.
Other forms of digital education, partially designed to support self-management have been tested in COPD. Real world testing of MyCOPD in rural Scotland showed no effect on admission or healthcare utilisation, and actually suggested an increase in requirement for home visits overall, although there were benefits seen in the 17% of users who engaged highly with the system, reading multiple modules and entering symptom data frequently(23). Our results are consistent with this finding, since patients were required to enter data frequently to remain in the trial and were seen more often at home; healthcare utilisation overall within the trial and consequent cost-effectiveness will be the subject of a separate economic analysis. Home visits were not usual care in all of our sites for AECOPD, with telephone contact more usual to support patient decision making, however the study protocol required face to face contact, in particular for CRP measurement to be obtained, so this observation does not necessarily imply a shift from hospital to community care for AECOPD. Similar results were obtained in a multimorbid population in Canada, where admissions were numerically but not statistically lower, and emotional wellbeing improved significantly.
Quality of life drops markedly in COPD after exacerbation and after hospitalisation(24), such that differences may be easier to detect initially, but it is also conceivable that in the early stages after hospitalisation a more intensive tool such as COPDPredict™ may be more useful; this is supported by the observation that proportionally twice the number of patients were self-managing appropriately by 3 months in the intervention compared to control group. Since more than 90% of AECOPD were appropriately managed by patients at 12 months this implies a time based phenomenon to learning to self-manage, which could be achieved over a long duration with low intensity support, but more quickly with the higher intensity support that COPDPredict™ could provide. This suggests that using it after initial hospital admission may be the most beneficial option, since this is the period when patients feel most unwell and are at highest risk of readmission. Ongoing real-world studies of COPDPredictTM adoption may help answer this question. These study designs may also be more appropriate for tests of digital interventions.
Conceptually COPDPredict™ was designed as a partnership between patients and the health service, such that the device alerts both patient and staff to a deterioration, so that the health service may respond. In a paternalistic medical model this implies someone would attend the patient upon deterioration, and there is an assumption that this engagement will help; if the interaction improves their well-being then an admission might be avoided. However, this requires that the health service be available 24 hours a day, 7 days a week, and for users to respond promptly to alerts. We worked hard with sites to design solutions that would allow them to run the trial, even in the absence of a routine care service that ran in this manner, however we had to be pragmatic and allow within our protocol a response time of 48 hours in the alerts, to account for 5 day services. It is possible that this limited effectiveness of the intervention in prevention of admission, since timelines of AECOPD symptoms suggest that deterioration occurs quickly in this time(22, 25). Other limitations to the work including failure to reach the desired sample size.