For further methodological detail, see previous establishment of this feasibility trial’s protocol and its subsequent update (21–22).
Trial design
This study is reported in accordance with the CONSORT 2010 statement and the extensions for cluster trials (23; see Appendix 1). The current study is a single-blind, cluster-randomised controlled feasibility trial of COB-MS. The study used a treatment-as-usual (TAU), wait-list control group design and a pre-post study design with two additional follow-up testing times: 12 week and six-month follow-up (i.e. four data collection points). Follow-up data were collected to evaluate sustainability of intervention gains, if evident, as well as gathering data on retention over the entire duration of the trial.
People with MS were cluster-randomised to one of the two study arms. Specifically, they were assigned to occupational therapists, based on geographic location. Occupational therapists were randomly assigned using 1:1 allocation, via randomised block permutation (randomised blocks of four and six per block). Clustering was used as the intervention was planned to be delivered in in-person groups (21), but because of COVID-19 impacts the originally planned in-person intervention was delivered online. The randomisation was completed prior to the COVID-19 pandemic and the feasibility of this design was assessed through the trial (22).
Participants
Setting
This was a community-based research study that was originally designed to run COB-MS groups at various locations across the Republic of Ireland. However, due to the arrival of COVID-19, the study protocol was amended and all assessments and interventions were subsequently administrated online, via Zoom for Healthcare. Despite this, the main study site remained the University of Galway and data were collected nationwide.
Recruitment and Eligibility
Both occupational therapists and people with MS were recruited to the trial. Occupational therapists were recruited through a professional body email (Association of Occupational Therapists of Ireland) and through notification on the MS Ireland website, health professionals’ email list and the bi-annual MS Ireland research e-zine. Snowball sampling was also used, in which occupational therapists informed others potentially interested in the trial. Occupational therapists were eligible to participate if they were 1) CORU-registered and working as an occupational therapist in Ireland; 2) had experience working with people with MS; and 3) could commit to the requirements of the study, including online delivery of the COB-MS.
Initially, 50 occupational therapists expressed interest in participating as COB-MS session facilitators, of whom: three were not eligible and 26 declined participation, either explicitly or through null response. Notably, the primary reason for explicit decline was occupational therapists not obtaining permission from their service managers. Also, important to note, in light a six-month delay (resulting from the arrival of COVID-19), trial amendments (e.g. online delivery of the COB-MS) and both health-related and work-related concerns (Dwyer et al., 2023b), yielded an attrition of 13 occupational therapists. Thus, recruitment (using the same strategy as before) was again engaged and another 13 occupational therapists consented to take part. This left 21 occupational therapists (11 intervention arm; 10 wait-list control arm) who delivered the intervention and acted as clustering frame for allocation of people with MS.
People with MS were recruited through trial advertisement in relevant newsletters (e.g. monthly MS Ireland newsletter), on websites offering information and services to people living with MS (e.g. MS Ireland), social media, radio, local newspapers, and at public conferences in the Republic of Ireland. All individuals interested in participating self-selected through contacting the researchers by phone or email. Informed consent was obtained, and eligibility assessed prior to participation. Eligibility criteria were as follows:
Table 1
Eligibility Criteria for participants with MS
Inclusion criteria. Participants: |
• Were aged 18 years of age or older; |
• Were fluent in written and spoken English; |
• Had a diagnosis of multiple sclerosis (consistent with the McDonald Criteria for the Diagnosis of Multiple Sclerosis [29]); |
• Had cognitive difficulties, as shown by a score of > 22 on the Multiple Sclerosis Neuropsychological Screening Questionnaire [30] |
• Were clinically stable (i.e. not having an active relapse); |
• Could provide informed consent; |
• Had no neurologic history other than MS, including evidence of current dementia; |
• Had no history of major depressive disorder, schizophrenia, or bipolar disorder I or II; |
• Had no history of diagnosed substance use or dependence disorder; |
• Were not currently undergoing any other form of cognitive rehabilitation; |
• Were living in the community; • Had reliable internet connection to participate in online delivery of COB-MS |
Exclusion criteria: |
• Cognitive impairment that would affect reliable participation. |
In light of the aforementioned delay and protocol amendments resulting from COVID-19, seven previously consenting participants with MS declined progression onto the trial upon restart and one had become ineligible. Overall, 110 consenting PwMS participated (75f; 35m), having completed baseline assessment and being randomly allocated to one of the two intervention groups. See Fig. 1 for the Consort flow diagram of recruitment and retention in the trial.
Interventions
Cognitive Occupation-Based programme for people with Multiple Sclerosis
The Template for Intervention Description and Replication (TIDieR; 24) checklist was used here to describe the intervention (see Appendix 2).
Wait-list Control Treatment as Usual
Participants randomised to the TAU, wait-list control arm of the study did not receive the COB-MS programme during the trial, but were provided access at the end of the data collection period, as delivered by the occupational therapist assigned to them upon randomised allocation. They received standard clinical care throughout the study’s life cycle, consistent with the aforementioned inclusion/exclusion criteria. Control participants were assessed at the same time points as the experimental arm.
Notably, the risk of contamination was low as cognitive rehabilitation is not standard care for patients with MS (14). To reduce the chance of contamination, occupational therapists trained in the COB-MS were asked not to pass on their knowledge to non-COB-MS trained occupational therapists and this was part of the consent declaration. According to a recent national survey (14), ‘usual’ cognitive care for MS in Ireland typically conforms to the following:
-
Occupational therapists are the health care professionals (HCP) most likely to assess and treat cognitive difficulties for people with MS.
-
Only 34% of HCP who responded (n = 98) screen for cognitive difficulties in practice.
-
36% of HCPs provide information on cognition to patients.
-
There appears to be very little consistency in cognitive assessment and treatment for people with MS.
Participants (across both arms) may have been taking medication that has an effect on cognition–e.g. benzodiazepine antispasmodics, anticholinergic agents. Participants continued with the pharmacological intervention.
Outcomes
No changes were made to the outcomes after trial commencement. No adverse events were reported. All data were collected remotely. Self-report questionnaires were completed by participants either on paper (and posted back) or online through Microsoft Forms. Other outcomes were completed online with participants. The feasibility and equivalence of remote data collection were assessed and reported (see 25).
Primary outcome
The Goal Attainment Scaling (GAS; 26) was the primary outcome. The GAS allows participants to set meaningful goals relating to daily life which can be measured in a systematic way. GAS is responsive, shows reliability, validity and sensitivity (27), and has been used with people with MS (e.g. 28–29).
Secondary outcomes
Secondary outcome are listed here (for full description see protocol; 21): Symbol Digit Modality Test (SDMT; 30); California Verbal Learning Test II (CVLT-II; 31); Trail Making Test (TMT; 32); Brief Visuospatial Memory Test-Revised (BVMT-R; 33); Everyday Memory Questionnaire Revised (EMQ-R; 34); Generalised Self-Efficacy Scale (GSES; 35); Modified Fatigue Impact Scale (MFIS; 36); Multiple Sclerosis Quality of Life − 54 (MSQoL-54; 37); and General Health Questionnaire (GHQ-12; 38).
Progression criteria
A traffic light system—green (go), amber (amend) and red (stop)—which allowed for modification was used (39), in consultation with the Trial Steering Committee (TSC). The key areas of risk were included in the criteria: trial recruitment, protocol adherence and outcomes.
Criteria in the acceptance checklist for clinical effectiveness pilot trials (ACCEPT; 40) were used to evaluate progression – examining: 1) feasibility and appropriateness of the trial design; 2) feasibility and appropriateness of the mechanics, management and safety of interventions; and 3) acceptability and efficiency of implementing the research procedures.
Sample size
A formal sample size calculation to evaluate the clinical effectiveness of COB-MS is not required give the focus on feasibility. A pragmatic approach was adopted that aimed at examining the rate of retention of participants during the intervention and follow-up periods. This was based on an average recruitment rate for funded trials from the National Institute for Health Research (41). A 9% attrition rate was expected (42). If randomised at the patient level a sample of 90 participants would allow for estimation of a retention rate of 91% with a 95% confidence interval (CI) of width equal to 13%. After allowing for clustering, assuming eight participants per cluster (occupational therapist) and an intracluster correlation coefficient (ICC) = 0.05, the sample size becomes 90 × [1 + (8–1) × 0.05] = 121. Thus, the number of occupational therapists needed is 121/8 = 15. A sample size of 15 × 8 = 120 participants with MS was calculated. Follow-up discussions with funders and trial steering committee recommended a final sample size of 100 participants as this was deemed large enough to provide information regarding the practicalities of a potential definitive randomised trial. This follows Consolidated Standards of Reporting Trials (CONSORT) guidelines for sample size calculation in feasibility studies. No interim analysis took place.
Randomisation
All participants provided informed consent prior to randomisation. A web-based clinical trial randomisation service was used (Sealed Envelope), in which an unblinded member of the research team, independent of outcome data collection and analysis conducted the randomisation through Sealed Envelope’s platform.
Occupational therapists were registered to the trial and a unique identification code was assigned to them. Once the participants (with MS) were recruited to the trial and assigned to their corresponding occupational therapist, an unblinded member of the research team, independent of outcome data collection and analysis, generated the randomisation list at the cluster level, using randomly permuted blocks of size 4 and 6 in Sealed Envelope. The code used and the randomisation list was kept and securely stored by the independent researcher. All participants were informed of their allocation (with such implications explained) through both phone call and post/email. Participants’ details were then passed to their allocated occupational therapist to initiate contact and the intervention.
Blinding
The study was single-blinded. The following people/groups were masked to participant allocation: all research staff collecting outcome measure data (not to include the qualitative data), statisticians and those involved in data analysis, and the TSC. It was not possible to mask the participants, nor the occupational therapists providing the intervention.
Participants were provided with written and video information on the importance of blinding and asked to conceal their group identity to research staff conducting outcome measure assessment. Blinded research staff did not have access to any data that might unblind them and were not present for team meetings where there was any risk to unblinding.
Public and Patient Involvement (PPI)
This trial had a PPI member employed as a member of the research team for the entire duration of the trial. There were two PPI members on the TSC, and an external PPI consultation group was also convened. The PPI group contributed to decisions on key trial issues such as outcome measure selection, planning in light of COVID-19 pandemic, recruitment material, handbook design, qualitative evaluation and dissemination. PPI was critical to the success of the trial and was integrated through the entire trial life cycle. PPI processes were developed to evaluate the impact of the activities used (43).
Statistical methods
The key outcomes in this study were the feasibility objectives set. The feasibility outcomes, recruitment rate, acceptability of COB-MS (from the perspective of participants with MS and occupational therapists), rate of unblinding, retention rate and randomisation methods are reported descriptively and narratively. Analysis took place once all data were collected.
Means and standard deviations (or medians and interquartile range [IQR] as appropriate) were used for continuous variables, with counts and percentages reported for categorical outcomes. The retention rate was estimated using a 95% CI. Estimates of the primary outcome variable (i.e. goal attainment scaling), at week 12, was used to inform sample size calculations of a future definitive trial. Data resulting from primary and secondary outcome measures was evaluated in terms of preliminary efficacy. Treatment effects were estimated using linear mixed models (including random intercepts at the occupational therapist level to account for the cluster structure) with the outcomes evaluated at week 12 and adjusted by baseline values. Trends in data over time are also presented to indicate the effect of the intervention over time. A qualitative evaluation of the acceptability of the COB-MS and related feasibility has been completed and reported (44).