Participants, interventions and outcomes
Study setting {9}
This study protocol describes a cohort study embedded in a multicenter cRCT, will be conducted in 10sites in Ontario, Canada. Once site allocation is completed, the Principal Investigator (PI) [SH] will contact members of the Department of Psychiatry and Department of Emergency Medicine at each intervention site to be site co-Investigators, to assume responsibility for all study-related activities at their respective site. The PI will then travel to each study site in order to present information about the study in a rounds-style presentation and meet with key stakeholders who will be responsible for the implementation of the study.
Eligibility criteria {10}
Eligible participants will be men 18 years or older who present to EDs in the intervention arm of the cluster randomized trial with intentional self-harm. They will be eligible regardless of whether they are hospitalized or discharged during the index ED visit.
Table 3. Participant Eligibility Criteria
Inclusion Criteria
|
1.
|
Identifies as male.
|
2.
|
18 years of age or older
|
3.
|
Has presented at a participating ED with self-harm within the preceding four weeks. Self-harm is defined as self-reported intentional self-poisoning or self-injury, whether or not there is evidence that the act was intended to result in death. Where there is ambiguity about intent inclusion will be guided by discussion with the principal investigator to allow consistency between sites.
|
4.
|
Able to read and understand English or French
|
5.
|
Willing to attend six problem-solving therapy sessions for a period of up to six weeks
|
6.
|
Willing to use a smartphone application to facilitate the treatment of self-harm
|
7.
|
Willing to return to hospital for follow-up appointments
|
8.
|
Willing and able to provide informed consent
|
There are no exclusion criteria beyond the opposite of the inclusion criteria. Participants are not required to have a smartphone with a data plan in order to participate. Participants who do not have a smartphone with a data plan will be provided with one for a period of one year from the date of their study enrolment.
Who will take informed consent? {26a}
All informed consent discussion will be completed by a site delegated study staff member, such as a Research Coordinator or Research Assistant.
Additional consent provisions for collection and use of participant data and biological specimens {26b}
On the consent form, participants will be asked if they agree to use of their data should they choose to withdraw from the trial. Participants will also be asked for permission for the research team to share relevant data with people from the Universities taking part in the research or from regulatory authorities, where relevant. This trial does not involve collecting biological specimens for storage
Interventions
Explanation for the choice of comparators {6b}
Neither a systematic review nor a large multicentre study found a clear relationship between the nature and intensity of standard hospital care and subsequent fatal or non-fatal repetition of self-harm (1). Given this, rather that randomizing participants to a control group, we opted to use a within-subject design in which participants act as their own controls. To assess whether completion of PST results in decreased suicidal thoughts and behaviours, we will evaluate changes in suicidality from baseline throughout the course of the study using a repeated-measures ANOVA.
Intervention description {11a}
Intervention: Problem-Solving Therapy
PST is a cognitive behavioral therapy, that aims to teach a cognitive skill to improve people’s ability to cope effectively with both minor (e.g., chronic daily problems) and major (e.g., traumatic events) stressors. The use of problem-solving therapy following self-harm is supported by the literature which suggests that those who self-harm often struggle with how to problem-solve (3–5). The major treatment goals of PST include: 1) the adoption of a positive orientation toward problems in living (for example optimism, positive self-efficacy, acceptance that problems are a common life occurrence); and, 2) the effective implementation of specific problem-solving behaviors (for example recognizing problems when they occur and the ability to stop and think about potential solutions) (6).
BEACON Rx Management System
Smartphone Application
The original version of this smartphone application was tested in an RCT in male Veterans in the USA (7) and found to be effective in reducing harmful substance use. It has been re-designed for the purpose of this study to facilitate the treatment of self-harm in men who present to the ED. The sections of the smartphone application are outline in Table 4.
Table 3. Description of the BEACON smartphone application
Smartphone Application Screen
|
Description of Features
|
User Profile
|
Participants are asked to setup a user profile, which includes an image and their personal motivation/mantra as well as a safety plan to prevent future self-harm. This will be done in conjunction with their therapist at their initial PST session.
|
Surveys
|
Participants will be prompted daily to provide an update on their mood.
|
Therapy
|
This section will walk the user through the steps of problem solving and end with the creation of a smart goal. This section will allow not only the creation of new goals based on current problems, but also allow users to look at the goals they’ve created and update their progress on them. The creation of a goal will be a step by step process that follows the principles of PST.
|
Journal
|
The journal allows participants to create a written entry complete with images and audio. The smartphone application will then check back in with the user after a chosen amount of time to ask if they are still feeling upset. Should they still be feeling negatively after the chosen amount of time has passed they will be recommended an activity or action to help negative feelings pass.
|
Connect
|
Allows participants to maintain instant and time-delayed contact with their important contacts (family, friends, coworkers) as well as their therapist.
|
Progress
|
This feature allows participants to monitor their progress throughout the study, including their achievements, mood log history and trackable history.
|
Resources
|
In this section of the smartphone application, participants will have access to content uploaded by their clinicians, which can be targeted to participants on an as-needed basis. Participants will also have access to a map which geo-locates the nearest local mental health services as well as a list of local crisis line telephone numbers which they may access as needed.
|
BEACON
|
When participants are in crisis, they may access the BEACON screen. This section of the smartphone application allows participants to assess their current situation and safety plan for warning signs that they may be at risk for subsequent self-harm. It also provides activity recommendations to help participants reduce stress, including relaxation and breathing exercises. Participants also have quick access to their important contacts directly from this screen, including their therapist and emergency contacts. At any time, participants can also press the BEACON button and be connected to a crisis line.
|
Clinician Dashboard
Clinicians will have access to a clinician dashboard where they can see their patient lists of people using the smartphone app. Through this dashboard they can push resources to patients, see when they have activated their BEACON button, initiate survey measures, manage appointments and program reminders for goals agreed in face to face therapy.
Timing of Sessions
Men who present with intentional self-harm to an ED will be offered, in addition to usual care, six sessions of PST with a “booster” session at six months supplemented by the BEACON Rx management system. The initial six sessions will be delivered in an 8-week window after the index presentation to allow some flexibility in the timing of the therapy.
Criteria for discontinuing or modifying allocated interventions {11b}
The cohort study will be stopped if there are more than 12 deaths per year.
Strategies to improve adherence to interventions {11c}
The use of a blended therapy approach, the addition of the BEACON Rx management system to face-to-face PST, may increase adherence to the face-to-face sessions. The patient-facing smartphone application was previously identified as increasing feelings of connectedness of the participant between face-to-face sessions (8). To improve adherence to the use of the BEACON Rx smartphone application, the application has included daily activities to encourage daily use, as well as the option to set reminders by either the clinician or participant, which will push notifications to the participant’s phone, serving as an additional prompt to continue using the application.
Relevant concomitant care permitted or prohibited during the trial {11d}
Not Applicable, participants will continue to receive usual care while enrolled in this study.
Provisions for post-trial care {30}
In the event of a study-related injury or illness, participants will be provided with appropriate medical treatment and care. Financial compensation for lost wages, disability or discomfort due to an injury or illness is not generally available.
Outcomes {12}
Primary Outcome
The primary outcome measure will be changes in the severity of suicidal ideas, as measured by the Beck Suicide Ideation Scale (BSS). This is a 24-item self-report questionnaire for detecting and measuring the current intensity of participant’s attitudes, behaviors, and plans to die by suicide during the past week. The BSS has strong internal consistency (α=0.89) and has been found to be significantly correlated with the suicide ideation item on the Beck Depression Inventory (BDI) (24) and is a strong predictor of admission to hospital for managing suicide risk (24).
Secondary Outcomes
Depressive Symptoms
Changes in depression severity will be assessed using the Patient Health Questionnaire (PHQ-9), a 9-item questionnaire that assesses the severity of self-rated depression symptoms experienced within the last two weeks. Participants are asked to rate each symptom of depression on a frequency scale from 0 (not at all) to 3 (nearly every day), with total scores ranging from 0 (minimal depression) to 27 (severe depression). The PHQ-9 has an internal consistency of 0.89 and strong test re-test reliability (25).
Anxiety Symptoms
Changes in anxiety symptom severity will be assessed using the Generalized Anxiety Disorder (GAD-7), a 7-item questionnaire that assesses the severity of Generalized Anxiety Disorder symptoms experienced within the last two weeks. The initial validation study, conducted by Spitzer et al. (2006), demonstrated high internal consistency (α=0.92) and test-retest reliability (intraclass correlation = 0.83) (26).
Post-Traumatic Stress Disorder (PTSD) Symptoms
Changes in PTSD symptoms will be evaluated using the Primary Care Post-Traumatic Stress Disorder (PC-PTSD) screening tool, which consists of four-items which evaluate the presence of PTSD-related symptoms. The screening tool was initially developed and validated in a population of male and female veterans in a primary care setting (27). Prins et al. (2003) recommend using a cutoff score of three (out of a possible four points) to detect possible PTSD, with a sensitivity of 0.78, specificity of 0.87 (27).
Health-Related Quality of Life
Health-related quality of life will be assessed using the EuroQol 5 Dimensions questionnaire (EQ-5D-5L). This is a 5-item questionnaire that assesses health-related quality of life, including mobility, self-care, ability to participate in one’s usual activities, pain or discomfort, and anxiety or depression. The measure also includes a Visual Analogue Scale (VAS) which asks participants to evaluate their overall health on a scale from 0-100.
Meaning in Life
Previous research has demonstrated perceived ‘meaning in life’ to be negatively associated with depression and suicide ideation (28). In the current study, meaning in life will be evaluated using the Experienced Meaning in Life Scale (EMIL) (28), which consists of four 10-item sub-scales: Creative, Experiential, Attitudinal and Ultimate meaning in life. This measure was developed to be consistent with Frankl’s treatment of the construct and was validated in a community-based sample of older adults (28) and has high internal consistency (α=0.95). For the purposes of this study, we will only use the Creative and Attitudinal subscales in order to reduce the burden on participants and investigators.
Perceived Social Support
Perceived social support will be assessed using the Multidimensional Scale of Perceived Social Support (MSPSS) (29). The MSPSS is a 12-item questionnaire that addresses the following sources of perceived social support: Family, Friends or Significant Other. Each sub-scale consists of four-items that are rated on a seven-point Likert scale from “very strong disagree” (1) to “very strongly agree” (7). The MSPSS performs well psychometrically with high internal consistency and test-retest reliability.
Alcohol Misuse
Alcohol misuse will be evaluated using the Alcohol Use Disorder Identification Test (AUDIT). Participants will initially complete the first 3-items of this questionnaire assessing potential alcohol misuse; those who score above 4 on these items will be asked to complete the remaining seven items. Among those known to misuse alcohol, the AUDIT successfully detected an alcohol use disorder 99% of the time (30). Similarly, among those who did not misuse alcohol, only 0.5% were categorized as potentially having an alcohol use disorder (30).
Drug Misuse
Drug misuse will be measured using the Drug Abuse Screening Test (DAST-10), a 10-item questionnaire that assesses drug abuse within the last 12 months. Participants are asked to answer 10 questions about their substance use using a binary response of yes or no, with each response indicating a possible drug use problem being awarded one point. The total possible scores on this instrument range from 0 to 10, with higher scores indicating a greater likelihood of a substance use problem. The DAST-10 has been evaluated among psychiatric patients and has been found to have high internal consistency (α=0.94) (31) and a test-retest reliability score of 0.71 (32). Scores on the DAST have been found to be significantly correlated with the frequency of drug use (r ranging from 0.19 to 0.55).
Health Service Use
Health service use 12 months after the index presentation will be captured using routinely collected administrative health data housed at the Institute for Clinical Evaluative Sciences (IC/ES) linked to participants’ Ontario Health Insurance Plan (OHIP) number. This will include hospitalizations for self-harm; presentation to hospital for self-harm; presentations to hospital for any reason other than self-harm; admission to hospital for any reason; outpatient appointment for any reason; and primary care visits. We will collect this information for all participants regardless of whether they complete their treatment.
We will also administer a Health Care Cost Questionnaire which has been created by the research team to capture health service use data not available in IC/ES. Specifically it includes elements from the Client Service Receipt Inventory (CSRI) and the Work Productivity and Activity Impairment Questionnaire: Specific Health Problem (WPAI:SHP) as well as other health cost indicators.
Confounding Variables
Adherence to Masculine Gender Roles
The Conformity to Masculine Norms Inventory (CMNI) (33) is a 94-item questionnaire that assesses the conformity to the following masculine gender norms: Winning, Emotional Control, Risk-taking, Violence, Power over Women, Dominance, Playboy, Self-Reliance, Primacy of Work, Disdain for Homosexuals, and Pursuit of Status. The CMNI has strong measures of internal consistency across all 11 subscales ((α ranging from 0.72 to 0.91) (33). It is also strongly correlated with other measures of masculinity including: Brannon Masculinity Scale (34), the Gender Role Conflict Scale (35) and the Masculine Gender Role Stress Scale (36). For the purposes of this study, only the following subscales will be used: Emotional Control (CMNI-EC) and Self-Reliance (CMNI-SR) as they are the most applicable to the study population. This will also reduce participant and investigator burden.
Influence of the Media and Internet use
In order to assess the potential impact of the media and the internet on self-harm presentations, each participant will be asked if, in the month prior to his index self-harm episode, he was i) aware of any high profile suicides in the news, ii) whether he used the internet to research self-harm methods and iii) whether he used the internet to get access to help for his emotional distress.
Assessing Potential Processes of Change
Problem-Solving Skills
In order to assess the impact of the smartphone-assisted PST intervention, we will be assessing participant’s social problem-solving skills throughout the study intervention period using the Social Problem Solving Inventory- Revised Short Form (SPSI-R:S) (37). This is a 25-item questionnaire that assesses an individual's strengths and weaknesses in problem-solving abilities and is a reliable and valid instrument for assessing problem solving abilities (37).
Process Evaluation
Table 4. Process Evaluation Outcomes
Data Collection Method
|
Data Collected
|
Program documentation and observation (to assess fidelity, dose, reach and context)
|
Number of PST sessions attended.
|
Smartphone Application Usage, including: total number of mood log entries; surveys completed; journal entries; goals completed; views/downloads of resource material and BEACON button presses.
|
Whether or not each site implemented other hospital-based suicide reduction measures during the study intervention period.
|
Structured qualitative interviews (to assess barriers, facilitators and suggestions for improvement)
|
Interview a purposive sample of participants regarding what helped and what did not help and the effect of the intervention on help seeking behaviours.
|
Participant timeline {13}
Table 5. Schedule of Enrolment, Interventions, and Assessments
|
STUDY PERIOD
|
|
Enrolment
|
Post-Enrolment
|
Close-out
|
TIMEPOINT
|
Screening (-t1)
|
Baseline/ Session 1 (t1)
|
Sessions 2-5 (t2- t6)
|
Session 6 (t7)
|
6 Months (t8)
|
12 Months (t9)
|
ENROLMENT:
|
|
|
|
|
|
|
Eligibility screen
|
X
|
|
|
|
|
|
Informed consent
|
X
|
|
|
|
|
|
Installation and Set-up of Smartphone Application
|
X
|
|
|
|
|
|
INTERVENTIONS:
|
|
|
|
|
|
|
Problem-Solving Therapy
|
|
|
|
|
|
|
ASSESSMENTS:
|
|
|
|
|
|
|
Demographics
|
|
X
|
|
|
|
|
Influence of Media (Media Questionnaire)
|
|
X
|
|
|
|
|
Masculinity (CMNI-EC and CMNI-SR) (33)
|
|
X
|
|
|
|
|
Suicidal ideas (Beck Suicide Ideation Scale, BSS) (24)
|
|
X
|
X
|
X
|
X
|
X
|
Depression (Patient Health Questionnaire, PHQ-9) (40)
|
|
X
|
X
|
X
|
X
|
X
|
Anxiety (Generalized Anxiety Disorder Questionnaire, GAD-7) (41)
|
|
X
|
X
|
X
|
X
|
X
|
PTSD (Primary Care Post-Traumatic Stress Disorder Questionnaire, PC-PTSD) (27)
|
|
X
|
|
X
|
X
|
X
|
Health-Related Quality of Life (EuroQol 5 Dimensions 5 Levels, EQ-5D-5L) (42)
|
|
X
|
|
X
|
X
|
X
|
Experience Meaning in Life (Experienced Meaning in Life Scale, Attitudinal and Creative Subscales, EMIL) (28)
|
|
X
|
|
|
X
|
X
|
Social Support (Multidimensional Scale of Perceived Social Support, MSPSS) (29)
|
|
X
|
|
|
X
|
X
|
Alcohol Misuse (Alcohol Use Disorder Identification Test, AUDIT-C and AUDITa) (30)
|
|
X
|
|
X
|
X
|
X
|
Drug Misuse (Drug Abuse Screening Test, DAST-10) (32)
|
|
X
|
|
X
|
X
|
X
|
Health Care Use and Costs (Heath Care Cost Questionnaire)
|
|
X
|
|
X
|
|
X
|
Problem-Solving Skills (Social Problem-Solving Inventory, SPSI-R:S) (43)
|
|
X
|
|
X
|
X
|
X
|
Health Service Data (previous hospitalizations, presentations to hospital for self-harm, presentation to hospital for any reason other than self-harm, admission to hospital for any reason, outpatient appointment for any reason, and primary care visits)b
|
|
X
|
|
|
X
|
X
|
Sample size {14}
The number of sites for the BEACON study was determined by the cluster randomized trial. Using IC/ES data, we determined that identifying a cohort of men who present with intentional self-harm over a year and them following them up for 12 months in 10 intervention sites and 15 control sites in Ontario would give us 80% power to detect a relative reduction in repetition rate of 41%, (i.e. from a control arm rate of 13% to an intervention arm rate of 7.7%). For this sub-study embedded within the intervention arm of the trial, we anticipate that we will be able to recruit 20 to 50 men at each of the intervention sites with an average of 35 men per site, , for an anticipated total of 350 men. To test our primary hypothesis that the severity of suicidal thinking at one year will decrease with the number of PST sessions completed by participants, we will use both linear and dichotomous modelling approaches. For linear correlations, we will have 80% power to detect a correlation of r=0.15 between number of PST sessions and severity of suicidal thinking measured by the BSS. For the dichotomous approach we will divide participants into those who have received fewer than three sessions (0-2 sessions) and those who have received three or more sessions. The rationale for this is that 3 sessions of PST is the minimum number to complete one “cycle” of problem solving. Previous studies have found a mean score of 18 on the BSS for individuals who present with self-harm (38). To achieve 80% power to detect an effect size of 0.3, or an absolute decrease of 2.4 points from a mean of 18 points on the BSS will require 350 participants. Assuming the ratio of those with 3 or fewer sessions to those with more than 3 is between 0.75 and 1.25, we anticipate 175 in each group (e.g. 0-2 session/3+ session)). This assumes a common standard deviation on the BSS of 7.9 points based on a comparison of suicidal and non-suicidal samples of adults receiving psychiatric care (38).
Recruitment {15}
Men who present with intentional self-harm to an ED that has been randomized to receive the study intervention, will be approached by ED or study staff with information about the study. A delegated study staff member at each site will also routinely review the Electronic Medical Records (EMR) at their respective site to ensure that no potentially eligible patients have been missed. These patients will be provided with information about the study by telephone. Patients interested in participating in the study will be scheduled for a baseline intake appointment with a delegated study staff member. We will manage the transition from the ED to outpatient care by providing staff training, written information for patients and an electronic referral service at each site.
At their baseline intake appointment with a research assistant, eligible participants will download the BEACON Rx smartphone application and they will be introduced to the onboarding process and set-up of their profile. Once this is complete, participants will be asked to complete the baseline intake assessments and will be referred for their first PST session. In order to limit participant burden, they will have the choice either to complete their baseline visit and first PST session in one study appointment or to split these visits into two study appointments.
Assignment of interventions: allocation
Sequence generation {16a}
This is a cohort study embedded in a cluster randomized trial (cCRT) so no randomisation.
Concealment mechanism {16b}
Not Applicable.
Implementation {16c}
Not Applicable.
Assignment of interventions: Blinding
Who will be blinded {17a}
There is no blinding in this study as all patients who consent to participate in this study will receive the study intervention.
Procedure for unblinding if needed {17b}
Not applicable.
Data collection and management
Plans for assessment and collection of outcomes {18a}
All outcome measures will be administered via paper-based questionnaire at the Baseline Visit. Questionnaires will then may be administered via the BEACON Suicide Prevention smartphone application as per Table 5.
Plans to promote participant retention and complete follow-up {18b}
A major difficulty in all clinical trials is ensuring that patients attend their baseline appointment. As such, a key component to our patient recruitment strategy is to ensure minimal loss to follow-ups between the point of referral and study enrolment. One way that we are addressing this is through the use of an electronic referral system in which referring clinicians can schedule a Baseline Intake Appointment with interested patients while still in the Emergency Department. The goal is to schedule these appointments within one to two business days of the presentation.
Once enrolled in the study, standard lost to follow-up procedures will be followed for patients who do not complete their follow-up appointments. This is an escalated response which may include any combination of the following: continued attempts to contact the participant by postal mail, telephone and/or email, contacting a participant’s emergency contact and contacting a participant’s family physician.
The BEACON Suicide Prevention smartphone application will also be designed to increase participant engagement with the study. For instance, participants will have instant and time-delayed communication with their Research Therapist through the messaging feature of the mobile application. Research Therapists will also have access to a Clinician Dashboard which will allow them to identify patterns of use which might indicate that a participant may at risk of being lost to follow-up (i.e. through decreased use of the smartphone application). This will provide Research Therapists with an opportunity to reach out to participants and attempt to re-engage them in the intervention.
Data management {19}
All data, with the exception of the Beck Suicide Ideation Scale (BSS) and Social Problem-Solving Inventory (SPSI-R:S), will be completed directly by participants using a centralized Electronic Data Capture (EDC) system, developed and maintained by the Ottawa Methods Centre. Participants will create a unique login to the system and will complete the questionnaires remotely or onsite at their visit. The BSS and SPSI-R:S will still be completed in paper format due to unavailability of an electronic license. On a monthly basis, each site will send upload their de-identified study data via secure network OHRI SharePoint folder (password protected and encrypted) to the Research Coordinator via email as per N2 Standard Operating Procedure 106 File Transfer and its associated OHRI Addendum. Data exported from the EDC will be combined with the uploaded site data will be combined into a single study master database in SPSS. This database will be stored on the OHRI hospital server at the Coordinating Site and only the TMC will have access to it.
All hardcopies of original study documentation will be stored in the participant research charts which will be categorized in numerical order, according to sequential numbering (i.e. 001 to 350). Data collected via the EDC will be direct entry and no paper copy will exist. Once all data monitoring, validation and cleaning activities are complete, an export of the final EDC database as well as any paper records will be archived at a secure storage facility for a period of ten years, as required by ICH GCP.
Confidentiality {27}
All study-related documentation will be double-locked in areas with limited access at the appropriate study site. All participants will be assigned a unique participant identification number, which will appear on all documentation included in a participant’s research chart, including study forms, questionnaires, participant progress notes and correspondence in order to maintain participant confidentiality. All correspondence with participants’ will be de-identified in order to remove names and other potentially identifying information prior to being included in the study chart. All documentation, including eligibility screening forms, signed Informed Consent Forms and messaging logs will be stored in double-locked filing cabinets in areas with limited access and stored separately for participant research charts to avoid linking a participant’s name and unique identification number.
Each study site will have a separate Master Tracking Log which will link participants’ names and identification numbers. The combined Master Tracking Log for all study sites will be stored at the Coordinating Study Site. These will be password-protected and only delegated research staff at that site will have access to it. Participant information will be stored on the secured hospital servers at each study site. The password-protected documents containing participant information will be transferred to the coordinating study site by email, as per N2 and OHRI guidelines. All data is encrypted at rest as well as in transit. Participants’ study information will not be released unless a delegated study staff member obtains written permission from the participant or where required by law. Participants will not be identified in study presentations or publications. All participant records will be kept for a period of ten years, as indicated in the ICH GCP guidelines.
Plans for collection, laboratory evaluation and storage of biological specimens for genetic or molecular analysis in this trial/future use {33}
If this study protocol is amended to include any ancillary studies, upon approval of the REB, all participants involved in these ancillary studies will be asked to sign a Consent Update Form. If a separate Informed Consent Form is required, a copy of the consent form will be stored with the BEACON Study consent documentation. Copies of all REB approvals for the ancillary studies will be stored at the Coordinating Study Site. A data file tracking all signed ancillary consent forms must be maintained by the ancillary study and provided to the Clinical Research Coordinator of the BEACON Study.
Statistical methods
Statistical methods for primary and secondary outcomes {20a}
Categorical participant characteristics, such as gender identity, marital status and education level will be reported using descriptive statistics, using frequencies and percentages. Continuous characteristics, such as age, will be reported using mean ±SD for continuous variables that are normally distributed and as median and 25th and 75th percentiles for non-normally distributed variables. Non-normally distributed variables will also be dichotomized and analyzed as categorical data, as described above. Changes in participants’ scores from their baseline visit to follow up at one year will be by repeated measures ANOVA with generalized linear mixed modelling (GLMM) to account for missing variables. Multivariate linear regression analyses will be performed to determine which participant characteristics moderate primary and secondary treatment outcomes.
Interim analyses {21b}
An interim analysis will be performed after 9 months by an external party who is blinded to the site allocation. The results of this analysis will be reviewed with the DSMC who will make the appropriate recommendations regarding continuation, modification or termination of the study.
Methods for additional analyses (e.g. subgroup analyses) {20b}
Additional subgroup analyses will be carried out to determine the impact of smartphone-assisted PST for the following subgroups: first time presentations of self-harm compared to repeaters; Francophone versus Anglophone; men with substance abuse disorders versus no substance abuse disorder; and rural versus urban residence.
Process Evaluation
We will also conduct a process evaluation to explore the implementation, receipt and context of the intervention with a view to helping understand the results in accordance with the Medical Research Council’s guidelines on assessing complex interventions [75]. This will describe the processes of the intervention group, provide information about the contexts in which the treatments are delivered and supply information about the experience of being part of the trial. This will also include an exploration of the uptake of the intervention at various sites, including subgroup analyses of the number of face-to-face sessions completed as well as the extent to which participants used the smartphone application.
Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data {20c}
The analysis of the primary outcome will be based on self-report data collected through the BEACON Suicide Prevention Smartphone Application. As such, the completeness of the data will be impacted by participant withdrawals. In order to minimize the impact of participant drop out, withdrawal and those who are lost to follow-up, the research team will follow-up with participants regarding the completion of the study questionnaires at their PST appointments. The smartphone application will also be used to prompt and remind participants to complete the study questionnaires. Should participants be lost to follow-up, a delegated study staff member will follow-up with them directly to complete the questionnaires either by telephone or by mail. Where possible, a delegated study staff member will attempt to ascertain the reasons for drop out or withdrawal from participants in order to address any issues within the research team’s control in order to prevent future study withdrawals. As such, it is possible that there may be missing data. Characteristics of participants with missing data will be compared to those of participants with complete data to examine the assumption of Missing at Random. In the case of substantial missingness (e.g., >5%), missing outcomes will be imputed using multiple imputation prior to analysis.
Plans to give access to the full protocol, participant level-data and statistical code {31c}
Anonymized research data will be deposited in an online repository, hosted by the Open Science Framework (OSF) (refer to: https://osf.io/).The Open Science Framework (OSF) is a tool that promotes open, centralized workflows by enabling capture of different aspects and products of the research lifecycle, including developing a research idea, designing a study, storing and analyzing collected data, and writing and publishing reports or papers. It is developed and maintained by the Center for Open Science (COS), a nonprofit organization founded in 2013 that conducts research into scientific practice, builds and supports scientific research communities, and develops research tools and infrastructure to enable managing and archiving research
Oversight and monitoring
Composition of the coordinating centre and trial steering committee {5d}
Principal Investigator (SH) and co-Principal Investigator (SH):
- Design and conduct of the BEACON Study;
- Preparation of protocol and revisions;
- Preparation of study documentation;
- Organization of Steering Committee meetings;
- Publication of study reports; and
- Participation as members of Trial Management Committee (TMC).
Steering Committee
- Includes: Principal Investigator (SH), Co-Principal Investigator (MH), and Site Principal Investigators.
- Approval of the final protocol;
- All co-Investigators at each intervention site will be steering committee members;
- Recruitment of patients and liaising with Principal Investigator and co-Principal Investigator; and
- Reviewing progress of study and, if necessary, approval of changes to the protocol and/ to facilitate the smooth running of the study.
Trial Management Committee (TMC)
- Includes: Principal Investigator (SH), co-Principal Investigator (MH), and Clinical Research Associates (NE, SM).
- Study planning;
- Organization of Steering Committee meetings;
- Organization of Data and Safety Monitoring Committee (DSMC) meetings;
- Provide annual reporting to Research Ethics Board (REB);
- Serious Adverse Event (SAE) reporting to DSMC and REB;
- Responsible for Master Tracking Log;
- Budget administration and contractual issues with individual centres;
- Advice for lead investigators;
- Coordination of study monitoring;
- Assistance with REB applications;
- Data verification;
Composition of the data monitoring committee, its role and reporting structure {21a}
The Data and Safety Monitoring Committee (DSMC) is comprised of four members from the following fields of expertise: statistics/biostatistics, epidemiology, methodology, psychiatry and the ethics of clinical trials.
Responsibilities:
- Ensures the ongoing safety of study participants;
- Reviews the conduct of the study, including protocol violations and deviations;
- Reviews data on participant recruitment, accrual, and retention, as well as assessments of data quality, completeness, timeliness, data retention, data storage, data transmission and data access;
- Reviews Adverse Events (AEs) and Serious Adverse Events (SAEs) reported between meeting dates;
- Protects the confidentiality of the study data and the DSMC discussions; and
- Makes recommendations to continue, modify, or terminate the study.
Adverse event reporting and harms {22}
During the active treatment period (baseline visit to session 6), the following occurrences will be routinely collected and assessed by delegated study staff members: Death by suicide; subsequent self-harm; visits to the Emergency Department or other unscheduled hospitalizations; and, re-presentations to the Emergency Department for self-harm. All AEs will be reviewed and classified by the site co-Principal Investigator, at his/her discretion. Investigators will determine relatedness of an event to the study intervention based on a temporal relationship to the study intervention, as well as whether the event is unexpected or unexplained given the participant’s clinical course, previous medical conditions/history, and concomitant medications or interventions. It is estimated that approximately 1% of participants enrolled in the study will die by suicide and 1% of participants will die from causes other than suicide each year of the study (1). This results in an anticipated rate of approximately six deaths per year. To address this, the research team has developed standard operating procedures (SOPs) to manage participant suicidality and mitigate potential staff burnout.
Throughout the study, participants will be able to contact the appropriate local mental health crisis teams at any time. This emergency information will be provided to participants during their baseline visit. Suicidal thoughts and self-harm will be monitored closely at each participant follow-up appointment using both the BSS and the Columbia-Suicide Severity Rating Scale (C-SSRS) (44). If the participant’s suicidality worsens, this will be recorded as an Adverse Event (AE) or Serious Adverse Event (SAE), as appropriate, and monitored. Participants will also have access to a licensed professional in between study visits up until the six-month study follow-up and connected with mental health services, as needed. Between the six- and twelve-month follow-up visits, participant activity will be monitored via the Clinician Dashboard and follow-up by a delegated study staff member, as needed.
Frequency and plans for auditing trial conduct {23}
Following site initiation, an internal monitor will be selected. This monitor will not be involved in data collection activities and will be one-step removed from the clinical trial. The internal monitor will perform the first monitoring visit at each site shortly after the site has recruited their first participant to ensure that research personnel have implemented the appropriate recruitment processes and procedures, such as eligibility sign-off and consent. This visit will be completed prior to the site recruiting more participants. Any corrective actions implemented regarding inconsistencies identified during the previous monitoring visits will be assessed for completeness. Based on the research category and participant/institute risk exposure, remote monitoring visits will occur every month after the first monitoring visit. The internal monitor may schedule more visits or on-site visits as needed.
Plans for communicating important protocol amendments to relevant parties (e.g. trial participants, ethical committees) {25}
Any subsequent modifications to the study protocol, including changes to study objectives, study design, patient population, sample sizes, study procedures, or significant administrative changes will be agreed upon by the Steering Committee and submitted to the REB for review and approval prior to implementation.
Dissemination plans {31a}
Data Analysis and Release of Results
To protect the scientific integrity of this study, data from all clusters will be analyzed and reported together. Although sub-analyses with specific groups will be conducted, no centre is expected to report data collected from their centre alone. The primary data analysis will be conducted by the Ottawa Methods Centre (OMC) at OHRI in conjunction with ICES. All statisticians will be blind to the allocation of the study sites. All study publications and presentations are expected to adhere to the BEACON Study objectives as detailed in this protocol.
Review Process
A Publications Committee, a subcommittee of the Steering Committee, will be established to coordinate all study publications and presentations. All presentation and publication abstracts must be submitted for review by the Publications Committee. This committee will create a running list of all potential publications, review all abstracts submitted for publication by the Investigative Team, identify a lead author for each publication, review all publication manuscripts, and submit publications to peer-reviewed journals for publication. They will also ensure that all publication guidelines and regulations are respected, including adherence to the study’s objectives and the CONSORT statement for cluster RCTs.
Each presentation or publication abstract/manuscript must be submitted to the Research Coordinator prior to each Publications Committee Meeting. The abstracts will be reviewed at the subsequent Publications Committee meeting. All members will vote on each abstract and will provide feedback. The Research Coordinator will include all feedback in the meeting minutes and, after each meeting, will circulate all feedback appropriately. Authors will be expected to review the committee’s feedback and re-submit their final abstract or manuscript for final approval by the Publications Committee.
Primary Outcome Publications
The Publications Committee will ensure that no presentation or publication undermines the dissemination of any primary outcomes publications. Primary outcomes publications refer to any presentation or publication that presents data on the primary outcomes as detailed in this protocol. During the review process, the Publications Committee will determine if an abstract/manuscript will undermine any primary outcome publications. If it is determined that this is the case, the author will be asked to delay publication until such a time as the primary outcome publication is released.
Other Study Papers, Abstracts and Presentations
This refers to all presentations and publications that do not report on the primary outcome of this trial, as detailed in this protocol. All presentation and publications abstracts/manuscripts must be reviewed and approved by the Publications Committee prior to submission.
Close-Out Procedures
The primary outcome publication is expected to be submitted for publication within two years of the completion of follow-up data collected (i.e. after the last study participant has completed the study). However, this may occur at an earlier or later date if the circumstances warrant. Study close-out will occur in two stages:
- Period of analysis and documentation of primary outcome results; and
- Debriefing of participants and dissemination of all other study results.
Reporting of Study Results
All study results will be released to study participants, referring clinicians, patients and the general medical community. Results will be communicated to study participants through the use of a newsletter or presentation, as per the overall preference of the participants. Other forms of dissemination include: academic publications, conference presentations and presentations to the general public.
SPIRIT guidance: Plans for investigators and sponsor to communicate trial results to participants, healthcare professionals, the public, and other relevant groups (eg, via publication, reporting in results databases, or other data sharing arrangements), including any publication restrictions.