objectives, design and setting
Objectives
The study aims to answer the following research questions:
Primary research question:
- In people who report symptoms (scoring at least 5/10 on one or more symptoms on a 0-10 scale (where 0 = no problem and 10 = worst possible problem) and express a desire for intervention, does a facilitator-supported, tailored (to patient needs), online self-management programme for fatigue, pain and faecal urgency/incontinence in IBD improve IBD-related quality of life and global rating of symptom relief 6 months after randomisation, compared with care as usual?
Secondary research questions:
- Is there any difference between the groups in severity of symptoms of fatigue, pain and urgency/incontinence at 6 and 12 months after randomisation?
- Is there any difference between the groups in IBD-related quality of life and global rating of symptom relief 12 months after randomisation?
- Does prior medical optimisation of symptoms (in Stage 3 of this programme) moderate the treatment response (i.e.do those receiving medical optimisation show greater treatment gains than those who don’t) as measured by the primary outcomes?
- Do people with IBD in remission at trial commencement have a better response to treatment (primary outcomes) than those with active disease? (remission defined as faecal calprotectin within normal range (200 or under) and /or IBD-control score (40) of 13 or over.
- Do baseline depression, or the presence of Irritable Bowel Syndrome (Rome IV criteria) moderate treatment response to intervention (primary outcome measures)?
- Do changes in illness perceptions and behaviours, IBD specific anxiety and self-efficacy, and depression from baseline to 6 months mediate intervention effects on the primary outcomes at 12 months?
- Is a facilitator-supported, tailored, online self-management programme for fatigue, pain and faecal urgency/incontinence in IBD cost-effective?
- What are patient’s expectations and experiences of the intervention and what factors may have influenced the intervention implementation (qualitative work in process evaluation)?
Hypothesis for the RCT
A facilitator-supported, online, tailored self-management programme for fatigue, pain and faecal urgency/ incontinence in people with IBD will result in better quality of life compared to care as usual at 6 months after randomisation.
Design for the main RCT
A pragmatic multi-centre two-arm, parallel group superiority RCT. We will compare facilitator-supported online self-management versus care as usual (CAU) to manage symptoms of fatigue, pain, and faecal urgency/incontinence in IBD. One baseline assessment and two assessments at 6 and 12 months after randomisation. Primary outcomes: IBD quality of life and global rating of symptom relief at 6 months. The CONSORT diagram for the RCT is given in Figure 1.
Internal pilot study
An internal pilot study will test planned methods and procedures for the main RCT and identify barriers to the components working together and potential recruitment issues. We will recruit and randomise the first 100 participants in the RCT, aiming to complete this within the first 6 months of the RCT recruitment. The methods planned for the main RCT will be followed. If no substantive changes are made these 100 participants will be included in the main RCT analysis. Note: this pilot has been a little delayed by the Covid-19 pandemic and will now cover the first 10 months of the RCT.
Study setting
The study will be conducted at National Health Service (NHS) hospital sites in England with IBD services and at King’s College London (KCL). A full list of sites is available from the Chief Investigator on request.
Methods: participants, interventions and outcomes
Identifying participants
People with IBD with symptoms of fatigue, pain and/or urgency will be recruited from people responding to our earlier IBD-BOOST survey (Stage 2 of the programme) or from people who have completed the survey plus medical symptom optimisation study (Stage 3 of the programme), who request further intervention for these symptoms and who meet our eligibility criteria (below). The survey was sent by post or an electronic link in an email to unselected patients with IBD by IBD clinic hospital sites, the UK national IBD BioResource or the charity Crohn’s & Colitis UK. The completed surveys were returned by post or electronically.
The central IBD-BOOST research team will screen the IBD Survey (stage 2) responses and the follow up questionnaires of participants in the IBD-BOOST Optimise study (stage 3) who have consented to be contacted for further research. Sufficient English and capacity for consent will be presumed from the previous response to the survey. A link to the online consent form for those who wish to participate in the RCT will be embedded in an email from a member of the central research team. If the online database is not available, paper copies of the Participant Information Leaflet and consent form will be sent.
Eligibility criteria
Inclusion criteria:
- Diagnosis of IBD (self-reported as having been medically diagnosed with IBD including patients with an ileo-anal pouch or stoma)
- 18 years old or over
- Living in England, Scotland or Wales
- Have participated in Stage 2 of the programme (IBD-BOOST survey) and have self-scored one or more symptoms of fatigue, pain or urgency/incontinence as having an impact on their quality of life of 5 or more on a 0-10 scale when completing Stage 2 (IBD-BOOST survey) or Stage 3 (medical symptom optimisation) (whichever is the more recent)
- No “red flags”– see below
- Access to the online intervention via a computer or mobile device
Exclusion criteria:
- One or more “red flags” identified on pre-randomisation screening (such as new bleeding, rapid weight loss or vomiting that has not been previously reported to a health care practitioner), self-reported on a screening checklist. If ineligible because of a red flag, a participant may be re-assessed if they contact the research team and report that the information they originally provided has changed such as the symptom has been adequately investigated or managed, in which case the participant can be included.
- Inability to give informed consent (for example, due to reduced mental capacity)
- Insufficient command of English to understand study documents and procedures
Screening for ‘red flags’ and other risks
After participants consent, they will self-complete an online or paper copy checklist to check eligibility criteria above. Following consent, we will screen patients for ’red flags’. These are potentially serious issues identified by our clinical co-investigators that may be undetected underlying causes of symptoms. If a participant’s responses indicate a potential red flag, the participant will be advised to seek a consultation with their health care team and only recruited to the trial once the symptoms have been adequately investigated.
We will also send consenting participants who have not already taken part in IBD-BOOST Optimise (stage 3 of the programme, who will have already done this) a kit for testing faecal calprotectin level (see below and Additional file 5), but non-response to this test will NOT delay randomisation.
Study interventions
BOOST is a web-based programme for self-management of pain, fatigue and urgency/incontinence symptoms in IBD based on the principles of CBT. ‘BOOST’ was initially mapped out based on the theoretical models described above and then developed with extensive patient and IBD specialist nurse input. BOOST has undergone extensive user feasibility testing prior to the pilot study, as recommended by the Medical Research Council when developing complex interventions (20).
BOOST includes 12 online sessions which can be viewed on computer, smart phone or tablet (however participants are advised that computer or tablet is likely to give a better view of the programme). The content has been developed to be interactive and tailored to patients’ needs. A number of logic pathways have been programmed into the programme alongside self-assessments, so the computer only provides content and tasks relevant to issues identified by the participant.
Sessions 1-7, are core sessions to be completed by all participants experiencing fatigue, pain and faecal urgency/incontinence. Based on a Cognitive Behavioural model of IBD symptoms, the core sessions cover topics around: understanding IBD symptoms, balancing activity and exercise, sleep hygiene, changing negative thoughts, coping with stress and emotions, and making the most of social support. These core sessions have associated tasks for participants to complete in between sessions in their day-to day-life, such as working towards completing goals or keeping a sleep diary. Sessions 8-11 are symptom-specific sessions to be completed by participants experiencing or with a specific interest in fatigue, pain and faecal urgency/incontinence, respectively. Some of the content of the website was adapted from previous manuals using a similar approach for managing specific symptoms in IBD or with different illness populations (41-47). Table 1 provides a summary of each session for all BOOST sessions. The symptom specific sessions provide participants with more in-depth psychoeducation on the interaction between medical and psychosocial factors contributing to the severity and impact of the specific symptom, together with practical tips and ongoing exercises on how to better manage them.
Participants will be able to log into BOOST via a computer, tablet or smart phone, according to their preference, and advised to complete approximately one session per week. Each session takes 30-60 minutes to complete. Participants will be able to complete the sessions at a time and place that is convenient to them and to pace themselves in a way that suits them and their lifestyle.
Facilitator support
Throughout the intervention, the participants will be supported by an assigned healthcare professional, who will act as their facilitator. Facilitators will be recruited (and trained) from our 15-20 sites, aiming for at least 2 per site, enhancing generalisability. Facilitators will predominantly include IBD nurses and a small number of academic psychologists within the research team in instances where nurses are not available, for instance supporting participants recruited through non-hospital sites.
The programme suggests one 30-minute phone call after participants have completed session 1, and then online messaging from the participant to the facilitator as the participant wishes thereafter. During the phone call, the facilitator will review the participant’s personal vicious cycle completed in session 1, guide the participant’s understanding of factors contributing to symptoms from a cognitive behavioural model and review the participant’s programme aims. Each facilitator will use a telephone checklist prompt sheet to guide the telephone call. At the end of each online session, the participant is prompted to consider if they want to send a message. The facilitator can reply to online messaging within the intervention platform. The facilitator will have access to information on how participants are using the intervention (sessions and task completed) and will monitor and help to promote participants’ engagement with the intervention, together with supporting participants work towards achievement of their intervention goals. Facilitators will be encouraged to log in weekly to check their participant’s completion of sessions/tasks and send any necessary messages to promote engagement, as well as reply to messages received.
Participants will log in to the online programme (unique login), undertake symptom self-assessment, prioritise what symptom they want to work on, with signposting to relevant sections depending on symptoms and response to online questions. (Example: link to a section on improving sleep patterns for those with fatigue who nap a lot in the day or with a problem getting to sleep at night).
Group 2 (control): Care as usual (CAU).
All participants will have access to all usual IBD care, including monitoring with clinic visits and/or via the local IBD helpline (this will constitute care as usual for group 2).
Participants in Group 1 with an active IBD flare during intervention will not be expected to discontinue the intervention and will have continued access to the online programme. All randomised participants, regardless of whether they have reported a disease flare or not, will be sent the questionnaires to capture outcome measures at 6 and 12 months after randomisation.
Table 1: Intervention sessions
Session 1. Understanding your IBD symptoms
Session 2. Balancing your activity, eating and exercise
Session 3. Improving your
Sleep
Session 4a. Changing your thoughts: Part 1
Session 4b. Changing your thoughts: Part 2
Session 5. Managing stress and coping with emotions
Session 6. Making the most of your social support and communication
Session 7. Managing and understanding fatigue in IBD
Session 8. Managing and understanding pain in IBD
Session 9. Managing urgency and leakage
Session 10. The role of acceptance and self-compassion in pain
Session 11. Summary and maintaining improvement
|
Factors that can contribute to fatigue, pain and urgency in IBD. Identifying specific factors and developing a personal vicious cycle of symptoms. Use of self-monitoring not symptom focusing. Setting aims for the programme.
Task: Symptom severity and stress level diary.
Importance of activity and exercise. How fear leads to avoidance. Eating patterns. Setting goals for activity and exercise.
Task: Reviewing and working toward goals for activity + sleep diary.
Why is sleep important? Sleep patterns & habits. Improving sleep.
Setting goals for sleep.
Task: Reviewing and working toward goals for sleeping patterns and habits.
Why are thoughts important? Identifying unhelpful thinking.
Task: Thought record.
Developing alternative thoughts.
Task: Alternative thought record.
The effects of stress and finding ways to manage it. The role of emotions and determining how best to take care of oneself. Setting goals for managing stress and emotions.
Task: Reviewing and working toward goals for stress management + stress diary.
Types of social support. Communication and disclosure. Setting goals for social support.
Task: Reviewing and working toward goals for social support.
Types of fatigue. Factors related to IBD fatigue. Exploring a vicious cycle of IBD fatigue; the role of thoughts, emotions and behaviours.
Difference between acute and chronic pain in IBD. Factors related to IBD-pain. Exploring a vicious cycle of IBD pain; the role of thoughts, emotions and behaviours. Common questions around pain in IBD.
Bowel functioning and bowel control difficulties. Stress and anxiety in urgency. Exercises to help reduce accidents. Practical bowel management tips. Using social networks to help manage urgency.
What is acceptance and how can it help? The role of resilience. Practical exercises.
Reviewing programme aims. Preparing for the future. Sustaining and building upon improvements.
|
At 12 months, participants allocated to CAU will be offered access to the online intervention (but no facilitator support). Uptake within 6 months will be reported.
Use of primary and secondary healthcare, other health care resources and medication use will be collected using the baseline, 6- and 12-month follow-up questionnaires (see Economic Evaluation section below).
We have worked with our patient panel to devise strategies to optimise engagement with the online intervention and retention of our sample, such as personalised text or email reminders.
Facilitator Training and Intervention Fidelity
There will be specific training for facilitators on delivering the intervention and the principles of CBT via a manual (which contains the full text of the online intervention for reference) and a one-day intensive course delivered by expert psychologists in the intervention development team. The training will introduce facilitators to the principles of a cognitive-behavioural approach, provide opportunity to observe and practice telephone call role plays and review example models of vicious cycles of symptoms which participants will construct during session 1. The training will also cover responding to online messaging, and what to do in certain situations (e.g. the participant not engaging with the programme, getting stuck, or frequent or persistent use of the messaging service). Adverse events will be discussed and the manual contains standard operating procedures (SOPs) for actions to be taken in certain scenarios, such as the participant appearing very depressed or suicidal).
Facilitators will receive further training and supervision during the site initiation visit from the intervention development/trial team. Prior to starting the trial, facilitators will also receive one-to-one supervision on a ‘practice patient’ (a person with IBD from our Patient and Public Involvement panel) over a two-week period. A practice telephone session between facilitator and patient will be audio-recorded for training purposes, where facilitators will use the telephone checklist prompt sheet to guide the call. Facilitators will receive feedback from a member of the intervention development team on the telephone conversation and online messaging responses with the practice patient.
Discontinuation criteria
We do not have any criteria for discontinuing a participant.
Outcomes
Trial outcome measures have been selected following focus group opinions and refined with our patient panel.
Primary outcome measures:
UK Inflammatory Bowel Disease Questionnaire (UK-IBDQ) (48) and global rating of symptom relief at 6 months after randomisation.
Other measures (at baseline, and as secondary outcomes at 6 and 12 months after randomisation):
- UK-IBDQ (48) at 12 months
- Rating of satisfaction with results of IBD BOOST programme (simple 0-100 visual analogue scale) at 6 and 12 months only
- Global rating of symptom relief at 12 months
- Numerical (0-10) pain rating scale
- Vaizey (faecal) incontinence score (49), reflecting patients’ perceptions of severity (50)
- IBD-Fatigue score (51, 52)
- IBD-Control score; 8-item self-reported score to measure disease control from the patient's perspective (40)
- EQ-5D-5L (53) general health-related quality of life at baseline and 6 and 12 months after randomisation
Health economic measure (at baseline, and 6 and 12 months after randomisation):
- IBD Resource Use Questionnaire to determine health care and other resource use and costs due to IBD, including visits or phone calls to primary and secondary healthcare services, medication use and personal expenses.
Moderators and Mediators: these include measures which may either moderate or mediate the treatment response. These data are important in terms of variables which may help to explain response, to be used as part of process evaluation (see below): (at baseline, 6 and 12 months after randomisation):
- Symptoms which determine a co-diagnosis of Irritable Bowel Syndrome (IBS) and IBD: Rome IV criteria for IBS
- Medications for depression, pain, diarrhoea
- Measures of change in general mood: depression as measured by the Patient Health Questionnaire (PHQ-9) (54). This measure includes a question (item-9) that may indicate suicidal thoughts. The action to be taken if suicidal thoughts are indicated is described in Section 5.1 Assessment and Management of Risk below.
- To measure self-efficacy: Self-efficacy for managing chronic disease 6-item scale (55)
- To measure IBD/illness specific cognitions: Brief Illness Perceptions Questionnaire (BIPQ) (56) (minus the open ended causal items). Items are prefaced in relation to beliefs about IBD symptoms rather than IBD generally.
- To detect symptoms which determine a co-diagnosis of Irritable Bowel Syndrome (IBS) and IBD: Rome IV criteria for IBS
- Medications for depression, pain, diarrhoea
- To measure IBD/illness specific affect: Visceral Sensitivity Index (VSI): gastrointestinal symptom-specific anxiety (57)
- To measure behaviour: All-or-nothing and avoidance/resting subscales from the Cognitive and Behavioural Responses to Symptoms Questionnaire (CBRQ)
Note: this outcome set are questionnaires validated for self-completion and will be compiled into a single online questionnaire (available from the Chief Investigator). We recognise the potential burden on participants of these multiple outcome measures (just under 150 questions). However, as we are assessing multiple symptoms and are keen to include potentially explanatory variables, we feel that these are necessary. We have worked with our PPI representatives on optimising format for outcome measures in a user-friendly online interface.
Participant timeline
This is shown in Table 2. There are no face-to-face visits; all study procedures are completed remotely by post, telephone or online messages.
Table 2: IBD-BOOST RCT Screening and data collection schedule (SPIRIT Figure)
|
Pre- consent
|
Pre- Baseline
|
baseline
|
6 months
|
12 months
|
Ongoing or during treatment
|
Screen for eligibility
|
X
|
|
|
|
|
|
Study within a trial (SWAT) Randomisation
|
X
|
|
|
|
|
|
Invite reply
|
X
|
|
|
|
|
|
Consent form
|
|
X
|
|
|
|
|
Red flags assessment
|
|
X
|
|
|
|
|
Adverse event form
|
|
|
|
|
|
X
|
Drop-out event form
|
|
|
|
|
|
X
|
Faecal Calprotectin test
|
|
X
|
|
|
|
|
Baseline Case Report Form
|
|
|
X
|
|
|
|
Follow up Case Report Form
|
|
|
|
X
|
X
|
|
Participant Qualitative Interviews
|
|
|
X
|
|
X
|
|
Clinician Qualitative Interviews
|
|
|
X
|
|
X
|
|
Randomisation
|
|
|
X
|
|
|
|
Nurse support
|
|
|
|
X
|
|
|
Intervention website User Query
|
|
|
|
X
|
|
|
Sample size
Our primary outcome is the UK-IBDQ, range 0 to 120 where low values indicate poor quality of life. Using several published studies (48, 58, 59), we estimate the standard deviation of the change in score to be between 20 and 30. This would mean an effect size of 0.3 would equate to a difference of between 6 and 9 points on the scale. In the validation study (48) the difference in score between those with mild disease and disease in remission was 12 points and the effect of relapse was 10 points.
An effect size of 0.3 was observed in a small study of dietary advice in patients with ulcerative colitis (58).
We will randomise 680 patients, 340 in each group. Assuming a 20% loss to follow up there will be 270 in each group in the analysis. Assuming there are 30 facilitators they will each support ~11 patients on average of whom ~9 will contribute to the analysis. If the ICC for clustering between facilitator is 0.04 the design effect will be 1+ 0.04*8 =1.32 and the effective sample size in the intervention arm is 270/1.32=204. 270 in the control and 204 in the intervention arm would allow an effect size of 0.3 to be detected with 90% power.
20% drop-out assumption is based on drop-out rates from previous studies of self-management: 19.2% of 682 participants in IBD disease self-management (not online) (60) ; 20.4% of 333 participants for online self-management of Ulcerative Colitis disease flares (33); 18% control and 16% intervention of 1140 participants randomised for chronic disease self-management in other diseases (37).
Recruitment
The previous stage of our programme involves a large-scale survey about symptoms to people with IBD. We will continue sending out batches of this survey until we achieve adequate recruitment for the RCT. Respondents to this separate survey who are apparently eligible to participate in the RCT will be sent an invitation, a participant information sheet, a consent form and a further pre-randomisation eligibility checklist for “red flags” (see eligibility criteria above) electronically or by post. Once a patient has consented and is eligible a baseline questionnaire is sent.
Methods: assignment of interventions
Randomisation procedures
Participants who consent, are eligible and return the baseline questionnaire (which is different form the survey they will have already completed) will be randomised by the central research team using an online randomisation system developed for the study by the PCTU. Allocation will, therefore, be concealed until consent and baseline measurements have been completed. It is not possible to blind participants or Facilitators once randomisation has occurred, due to the nature of the intervention.
The central team will inform the participant which group they are in and inform the clinical sites of participants in Group 1 who will receive local facilitator support (phone call and online messaging). The local facilitator will be given the participant’s details and access to their online tasks.
Stratified central web-based randomisation to 2 groups. Stratified by:
- diagnosis (Crohn’s disease vs. any other type of IBD, including ulcerative colitis and IBD-unclassified)
- whether or not participated in the Stage 3 study in this programme (medical symptom optimisation)
Random block sizes of 4 and 6 will be used. Block sizes will not be disclosed to ensure allocation concealment.
Blinding procedures
Faecal calprotectin level will be entered into the database by a person blinded to group allocation when the result has been returned from the laboratory and the participant informed of the result. Blinding of participants or facilitators is impossible. Data cleaning for the outcome measures will be by a statistician blinded to group allocation. Blinding beyond this will be impossible as data is clustered by the facilitator in the intervention arm only.
Methods: data collection, management and analysis
Data collection methods
Outcome measures will be collected by either direct participant input into a secure online study-developed database managed by the QMUL Pragmatic Clinical Trials Unit (PCTU) or via paper copies sent by central research team at KCL. Paper copies received in the post will be inputted manually into the database by the research team at KCL. The questionnaires will not be available in any languages other than English. Each clinic or site will complete a study log for all their participants who have been contacted for the study. Two email or text reminders will be sent to non-responders. If there is still no response an attempt will be made to collect the primary outcome measure by telephone.
Window for return of outcome measures: up to 8 weeks (with reminders) at the 6 month follow-up and up to 4 weeks (with reminders) at the 12 month follow up (with up to 2 text or email reminders. If primary outcome measure is not returned by 8 weeks after the 6 month time point an attempt will be made to have this (the IBDQ and global rating of symptom relief only) completed over the phone by a member of the central trial team reading out the questions and recording the responses.
Baseline demographic details (age, gender, type of IBD) and ROME IV criteria for irritable bowel syndrome (61) will be collected.
We will adopt evidence-based methods to minimise loss to follow up which have been identified in a systematic review (62). These include providing incentives to participants, contacting respondents prior to sending the follow-up questionnaires and using phone, text and email to contact participants. To optimise our response rates, we will provide an unconditional inconvenience payment of a £5 at 6 months and 12 months by post with a letter at the same time as we send out the follow-up questionnaire electronically or by post.
Data management
Data will be stored on a secure database. Participants will complete the outcome measures via an online link and will input their data directly into the database or complete paper copies and send via a provided stamped addressed envelope. Further details available from the Chief Investigator. All interviews will be digitally recorded, anonymised, professionally transcribed verbatim and analysed using, if appropriate, NVivo8 software for data management.
Statistical methods
Methods of analysis
Baseline demographics, type of IBD classification, Rome IV IBS criteria and baseline values of outcome variables will be presented for both study arms using descriptive statistics only.
The UK-IBDQ and global rating of symptom relief will be compared between the two study arms at 6 and 12 months after randomisation (analysis conducted after 12 month data collection point). The following covariates will be included in the model: baseline value of outcome measures, stratification factors, fatigue, pain and incontinence at baseline, age and gender. Facilitators will be added as a random effect in the intervention arm only.
Secondary outcomes will be analysed in the same way with inclusion of baseline value of respective outcome. Outcomes and covariates may change in the light of new information but will be agreed prior to unblinding of the data.
Pre-specified subgroup analyses to investigate subgroups who might respond better to treatment will be conducted as part of the process evaluation (see below).
A sensitivity analysis using imputation methods to allow for missing data and reasonable assumptions for those lost to follow-up will be carried out.
A detailed statistical analysis plan will be completed and signed off by the Programme Steering Group prior to unblinding of data.
Economic Evaluation methods
An economic evaluation using recommended methods (63) will be undertaken from the National Health Service /Personal Social Services and patients’ perspectives to evaluate the cost-effectiveness of the intervention at 12 months. The cost of the intervention, including facilitator’s contacts with each patient, website hosting and maintenance and facilitators’ training (venue, trainers’ and facilitators' time, travel and subsistence, administrative support and materials) and supervision will be evaluated.
Data on the use of health, social care and other services will be collected from all study participants using a study-specific IBD Resource Use questionnaire, developed within this Programme Grant, asking about contacts with primary and secondary care, investigations, medications, hospitalisations, employment and out-of-pocket expenses.
Unit costs will be sourced from national sources (e.g. Personal Social Services Research Unit: Unit Costs of Health and Social Care; Department of Health: NHS reference costs; British National Formulary; NHS Improvement: National tariff payment system) and will be applied to categories of resources used to estimate individual participant total costs. Health-related quality of life data will be collected using the EuroQoL EQ-5D-5L questionnaire.
We will follow the intention-to-treat principle and missing data will be handled using multiple imputation approach. We will calculate quality-adjusted life years (QALYs) and total costs for each participant in the trial during the 12 months follow-up. We will evaluate the incremental QALYs and costs with allocation to the BOOST intervention and the intervention’s cost-effectiveness at 12 months follow-up. The costs and EQ-5D-5L utilities will be compared between the two study arms at 6 and 12 months after randomisation, with adjustments made for baseline values of outcome measures (costs in previous 3 months and EQ-5D-5L at baseline), stratification factors, fatigue, pain and incontinence at baseline, age and gender. Facilitators will be added as a random effect in the intervention arm only.
An incremental cost-effectiveness ratio (ICER) will be estimated as the additional cost per an additional QALY gained. Uncertainty around the ICER point estimate will be assessed (64). The probability of the online IBD self-management intervention being cost-effective compared to usual care will be estimated at the NICE threshold values of £20,000 to £30,000 per QALY gained. One-way sensitivity analyses will be conducted to explore the uncertainty associated with the cost of the intervention and use of healthcare services.
A health economics analysis plan, specifying the health economics analyses in detail, will be finalised and signed off prior to unblinding of data.
Methods: Process evaluation
Research question
What factors (promoters and blockers, individual and organisational) impact on the completion and effect of the intervention?
A mixed methods process evaluation of the RCT will be conducted based on the MRC guidance (65). The design of the process evaluation is based upon the logic model and consequent discussion within the study team, so that the process evaluation can explore the areas of greatest uncertainty.
Aims
To investigate the processes through which the intervention is delivered, and what is actually delivered in practice, to aid the interpretation of the results of the main trial and to inform future rollout and implementation of the intervention, if successful.
Objectives of the process evaluation are to:
- Determine expectations at baseline through interviews
- Determine if the intervention was delivered as planned (intervention fidelity)
- Explore participant responses to the intervention both quantitatively (through routinely collected study process data) and qualitatively (through interviews)
- Explore participants’ responses to being in the control arm of the study through interviews
- Understand IBD nurses’ views of the intervention and its integration and usability in everyday NHS care through interviews
- Consider any potential contextual influences on the intervention implementation and outcomes.
Based on the logic model developed for the intervention, which provides a detailed description of the intervention and its causal assumptions, we will seek to monitor intervention fidelity and provide insights into how the intervention did or did not work in practice, any unintended consequences, as well as providing information to aid future implementation and dissemination. A list of key assumptions and uncertainties has been developed by the intervention development team. These will be explored and tested in this process evaluation.
The process evaluation will run concurrently with the RCT in a largely “passive” model (65). However, this passive model will not be operational during our internal pilot study and the teams will work closely together during the pilot to address any issues raised.
Adherence:
Fidelity to the protocol: proportion of people randomised to the intervention who clicked on the link to the online intervention and commenced the intervention and completed a minimum of four online sessions will be considered to have adhered to the intervention. We will also assess the date the baseline CRF is completed, date “red flags” were completed, and the date randomised to check study processes worked as intended.
Quantitative:
- monitoring on-line log-ins (number and spacing/timing of log-ins and time spent on each section and in total): automatically collected by the programme software, enabling us to see how participants interact with the intervention.
- a record of number and time of facilitator telephone support sessions or emails.
- Section 2.2.18 gives details of quantitative analysis of possible moderators and mediators of response to intervention.
Qualitative:
- Fidelity to the intended facilitator support: a sub-set of facilitators’ messages will be analysed and compared with instructions in the training manual for fidelity to the intended facilitator support. All facilitator interactions online with participants will be captured and randomly selected interactions (messaging) will be stripped of all personal identifying data and subjected to content analysis (66), to enable assessment of intervention fidelity (as defined by the training day and intervention manual).
- Face-to-face, telephone or Skype interviews with a purposive sample of up to 30 recruits (or until apparent data saturation) before and after the intervention (attempting to recruit the same people before they know their group allocation and then the same people 6 months later; if it is not possible to recruit people for a second interview at 6 months (or when they drop out if this is sooner), these participants will be replaced by another participant who was allocated to the same group with broadly the same characteristics). Interviews will be completed at different times after recruitment, to understand expectations and experiences of the intervention, its acceptability and which aspects they felt were most or least helpful (informing adjustment to the intervention before future roll-out), and for their opinions on changes in their cognitions and behaviours. We will also interview at least two thirds of the facilitators who are IBD nurse specialists (approx. 20: or until apparent data saturation) to understand their views on supporting the online intervention and fit with their existing workload.
Participants who have indicated on the trial consent form that they are happy to be approached about interviews will be purposively selected and consented for interviews. Facilitators indicating willingness will be interviewed. The topic guides for interviews have been developed with our PPI panel. Data will be analysed iteratively and as the interviews progress the topic guide will be adapted, based on themes which emerge from earlier interviews, to enable exploration of issues which appear relevant in later interviews.
The interview sample will be purposively selected to include both sexes, a range of ages, both IBD diagnoses and those who completed or did not complete (the intervention), or were in the CAU group to better understand patient perspectives on the intervention, experiences of being in a wait list control and whether this altered behaviours and cognitions around symptoms, whether non-completion was due to the design and demands of the intervention, or due to other factors.as well as any unanticipated pathways and consequences. Analysis: Interpretive data analysis will be informed by the Analytical Hierarchy Framework (AHF) (66), guiding methods for handling, analysing and generating findings from qualitative data.
We will train patient volunteers to co-analyse anonymised qualitative data (as we have done successfully in other studies (4, 67-70)), and help us interpret and present our findings widely to patient and media audiences. NVivo software will be used to manage data and enable sorting, labelling and retrieval of data segments prior to the human endeavour of interpretation and representation of findings.
The process evaluation team will work to integrate these sources of qualitative and quantitative data into a coherent report which seeks to illuminate the results of the RCT. There will also be a mediation analysis (see above).
Evaluation of moderators and mediators of treatment effects.
The purpose of this additional quantitative process analysis is to two-fold:
- To explore moderators of intervention effect.
This will allow us to assess if there are any key subgroup effects and if the intervention should in future target specific groups of patients. For instance, if depression and disease activity moderate treatment effects, it may be best to focus the intervention on patients in remission and provide alternate treatment to people with depression. If medical treatment optimisation moderates outcome, then again this confirms best practice would be to provide optimised medical treatment before the intervention. Alternately, if there are no significant moderators of effects, the intervention may be generalisable to the broader IBD population.
Subgroup analyses to be investigated are those who underwent Optimise (Stage 3); IBD in remission (see definition above); baseline measure of anxiety and depression (PHQ-9 and VSI); ROME IV criteria for IBD met at baseline or not. These will be investigated by adding interactions terms to the analysis models used for the primary outcomes (UK- IBDQ and global symptom relief).
- To explore mediators of change.
Mediation analysis using structural equation models allows us to explore if a treatment effect occurs through hypothesised treatment mechanisms. We have based our choice of mediator measures on our cognitive behavioural model underpinning the intervention and described in our logic model (available on request form the lead author). Putative mediators have been mapped onto the key intervention components i.e. the factors the intervention attempts to target to bring about improvements in symptom and quality of life. These include: the Visceral Sensitivity Index (VSI (57) and PHQ-9 (54) for symptoms of anxiety and depression; Self-efficacy for managing chronic disease 6-item scale (55); Brief Illness Perception questionnaire (56); All-or-nothing and avoidance/resting subscales from the Cognitive and Behavioural Responses to Symptoms questionnaire (CBRQ); IBD-Control (40); faecal calprotectin (71); satisfaction with outcome.
We are looking at whether proximal change in the mediators at 6 months predicts improvement in the outcomes at 12 months.
Methods: monitoring
Data monitoring
A study monitoring and auditing plan will be produced. The risk assessment for the trial will be under continual review to assess relevance, applicability and to identify any actions that may be required. The study may be subject to inspection and audit by the sponsor and other regulatory bodies to ensure protocol compliance and adherence to GCP and the UK Policy Framework for Health & Social Care Research 2017. Protocol deviations, non-compliances, or breaches from the approved protocol must be reported to the Sponsor R&D Office and PCTU within 24 hours of becoming aware of the event.
Harms
Assessment and management of risk
This is a low risk study (as assessed by PCTU), although there is potential for participants to become distressed when thinking about their symptoms. The intervention site will include a link / website address to CCUK who provide support via their helpline, and contact details are included in the Participant Information Leaflet. The outcome measures include questions on anxiety and depression and the PHQ-9. The central research team will monitor responses to suicidal thoughts and contact the patient and undertake a risk assessment if necessary. At the end of the questionnaire there are helplines listed that can offer support.
Risks/benefits
Stopping the trial
There is no Data Monitoring Committee for this low risk study. The trial may be prematurely discontinued by the Sponsor or Chief Investigator on the basis of new safety information or for other reasons given by the Programme Steering Committee or REC concerned. There will be no formal stopping rules based on the intervention outcomes. In the unlikely event that the study is prematurely discontinued, active participants will be informed and no further participant data will be collected.
Adverse events (AEs)
Adverse events will be assessed using the follow up questionnaire at the 6 and 12 month follow up and may also be recorded by facilitators through communication with participants in the intervention arm. We will also attempt to capture any unforeseen consequences in the qualitative interviews.
Expected events
Expected AEs include planned/elective hospitalisations, or unplanned but expected hospitalisation due to flare-up of IBD: these are expected during the course of the trial and will not be collected or reported as Serious AEs (SAEs).
After a SAE, a decision will be made by the trial team, after advice from the relevant authorities and the participant’s IBD team, as to whether the participant should be withdrawn from either their randomised treatment or from the trial. However, we do not envisage a situation, except death, in which a participant would need to be withdrawn. Arrangements will be made by the trial team for further assessment and management as agreed with the relevant authorities, GP and participant.
The investigator will provide the trial team with a 1-month follow-up report on all SAEs. Further monthly reports should be provided in the absence of resolution. These reports will be communicated to the Programme Steering Committee, REC, and to the local R&D office. Blank Adverse Event Forms will be distributed to sites that are recruiting.
Ethics and dissemination
Research ethics approval
The Chief Investigator has obtained approval from a recognised NRES Research Ethics Committee & Health Research Authority (HRA) (Additional file 2). The study will be conducted in accordance with the recommendations for physicians involved in research on human subjects adopted by the 18th World Medical Assembly, Helsinki 1964 (incl. later revisions) and any other relevant ethical guidance.
Protocol amendments
After obtaining a favourable ethical opinion and HRA approval any subsequent changes to the study conduct, design or management will be notified to the original approving REC & HRA and any other relevant regulatory authority via the UK Amendment process (http://www.hra.nhs.uk/research-community/during-your-research-project/amendments/).
Consent
Written information about the RCT and an invite email/letter will be emailed or posted to potential participants who have previously completed the IBD-BOOST Survey (stage 2 of the research programme) and have consented to further approaches to participate in research. Participants will be able to participate by providing consent online on the study website or by returning a completed consent form by post (Additional file 4). There will be two reminders by text or email after one and three weeks for non-responders.
All participants are free to withdraw from the study at any time without giving reasons and without prejudicing further treatment. In line with GDPR guidelines, participant rights to access, change or remove their information will be limited. If a participant chooses to withdraw from the study, we will keep the information that we have already obtained. To safeguard participant rights, we will use the minimum personally identifiable information possible at all stages of the study. Study participants will notify the chief investigator and/or lead research team based at KCL if they wish to withdraw, using the contact details provided in patient information leaflets for the study and on the website.
Confidentiality of participants
The Chief Investigator will preserve the confidentiality of participants taking part in the study and will work in accordance with the Caldicott Principles, Data Protection Act 2018, NHS Code of Confidentiality and any relevant NHS Trust organisational policies or other applicable Data Protection legislation. Data collected may be used to support other research in the future and may be shared anonymously with other researchers as stated in the PIL and consent form subject to the necessary regulatory approvals being in place.
Access to data
Trial investigators and the relevant members of the study team (i.e. trial statistician, health economist and those involved in process evaluation) at KCL and the PCTU will have access to the final trial data set. The sponsor will archive trial data including identifiable information for 10 years after the trial has finished.
Ancillary and post-trial care
The study is sponsored by the LNWUH NHS Trust; the NHS Litigation Authority (NHSLA) Indemnity scheme will cover the study.
Dissemination
It is not intended to use professional writers.
Participants can request copies of a lay summary of the final report of the outcome of the study by indicating that they want this and giving permission to store contact details for this purpose on the consent form.
To health professionals who could develop services, and the academic community
We will submit results for publication in multidisciplinary academic journals (such as Inflammatory Bowel Diseases and Journal of Crohn’s & Colitis) to disseminate to professional audiences. We will submit to key IBD conferences, including the UK British Society of Gastroenterology, the European Crohn’s & Colitis Organisation and the USA Digestive Diseases Week.
Anticipated professional publications:
- Primary and secondary outcomes paper
- Health Economics evaluation paper
- Mediators and moderators of outcome
- Process Evaluation paper
- Study Protocol (current paper)
We will also work with our patient and public volunteers, training those who are willing to present results at local and regional Crohn’s & Colitis UK meetings. We will alongside patients to construct a user-friendly lay summary for the CCUK newsletter and website. We will prepare a more detailed summary of results in lay language for participants and people with IBD who request this and adapt the charity information sheet on bowel control, fatigue and pain accordingly. We will discuss dissemination via their newsletter with the European Federation of Crohn’s & Colitis (patient) Associations. The study team are members of all these groups.
Patient & Public Involvement (PPI)
People with IBD have been extensively involved in developing this research. In particular, PPI has informed or will inform:
- Identification of the research questions for the programme
- Development of the intervention
- Design of the research (including development of patient-facing materials)
- Management of the research
- Undertaking the research
- Analysis of results
- Dissemination of findings