Participants
This study is powered to detect a significant within-subject effect over time on the TDF measures. When using within subject pre-post analyses, our previous evaluation of the ProACTIVE training amongst physiotherapists demonstrated a very large effect size when averaged across TDF outcomes (d = 1.7) (9). A minimum of five participants are needed to yield a significant effect of this magnitude in a within-subject, repeated measures ANOVA (4 time points), with β = .80, α = .05, and a conservative 0.25 correlation among repeated measures. It should be noted that this paper includes only the first two time points of data collection. The protocol of the full study is reported elsewhere (22).
Participants were recruited through email from GF Strong Rehabilitation Hospital and SCI BC in Vancouver, Canada, from June 2019 to January 2020. Specifically, the GF Strong clinical practice coordinator (CLCL) and executive director of SCI BC (CM) invited relevant staff physiotherapists and SCI BC peer mentors to participate. GF Strong is British Columbia’s largest rehabilitation hospital, providing inpatient, outpatient, outreach and clinical support services. SCI BC serves as a major non-profit organization in the province that supports people with SCI. Within SCI BC, SCI BC peer mentors are individuals with SCI who have been trained to provide peer support, education, and information resources to others with SCI. Given the pragmatic focus of this study, all interested physiotherapists at GF Strong who worked on the spine unit were recruited, and SCI BC peer mentors were recruited by the executive director based on availability, coaching skills, training, and geographical location. Ethics approval for the protocol was granted by the Behavioural Research Ethics Board at the University of British Columbia (H19-02694). Written informed consent was obtained from each of the participants. This study was performed in accordance with the standards of ethics outlined in the Declaration of Helsinki.
Study design
This study employed a single-group, pre-post design. GF Strong physiotherapists and SCI BC Peers received two in-person training sessions on how to implement the ProACTIVE SCI intervention. The two training sessions were each two hours in length, and administered over two days, separated by four weeks. Between training sessions, interventionists were instructed to practice delivering the ProACTIVE SCI intervention. A 20-minute survey was administered prior to the first training session and immediately after the second training session. All procedures were conducted at GF Strong Rehabilitation Hospital or if the questionnaire was completed online, this was done in the setting of the participant’s choosing.
Measures
Demographics
Participant demographics were collected using an online form and included age, sex, role (in-patient physiotherapist, out-patient physiotherapist, or SCI Peer), and years of experience in their role.
Implementation Survey
Participants completed an online or paper survey to identify barriers and facilitators (determinants) to physical activity coaching. The Determinants of Implementation Behaviour Questionnaire (DIBQ) was used to inform the content of the survey (23, 24). The DIBQ is a Theoretical Domains Framework (TDF)-based questionnaire, of which support for the internal consistency, reliability and discriminant validity of the DIBQ has been demonstrated among physiotherapists previously (24). The TDF identifies 14 domains or behavioural determinants that resulted from a synthesis of 128 theoretical constructs from 33 behaviour change theories (23, 25). Physical activity coaching determinants (e.g. “I know how to educate my clients on how to be physically active”) were evaluated using a 7-point Likert scale, where 1 = strongly disagree and 7 = strongly agree. Response options also included the ability to select “not applicable”; these responses were not included in the analysis. To address clinician time constraints, the DIBQ was shortened from its original 93 items to 32 items in consultation with stakeholders during pilot-testing. Additionally, the TDF domains of optimism and emotion were removed, as pilot-testing feedback suggested these domains were not relevant. The survey also included a 7-item evaluation of the effects of the implementation intervention on interventionist physical activity coaching behaviour (e.g. “I currently use the ProACTIVE SCI Toolkit with my clients”). Current behaviour was evaluated using a 5-point Likert scale, where 1 = never and 5 = always.
Adaptation of the ProACTIVE SCI intervention to the local context
Over a six-month timeframe prior to study commencement, the team worked to systematically address the steps of the KTA and QIF frameworks and adapt the ProACTIVE SCI intervention. Specifically, the KTA was used to guide the phases of the research process in which both researchers and end-users (physiotherapists and peers with SCI) could be involved to adapt the ProACTIVE intervention content and its implementation. The QIF action steps were re-ordered for our local context and used to guide the execution of KTA phases (Table 1). For a detailed description of the step-by-step process used in this study, see Additional file 1.
Table 1
Quality Implementation Framework action steps used to guide the execution of the Knowledge to Action framework phases
KTA phase
|
QIF action step in order of use
|
Knowledge synthesis
|
N/A
|
Problem identification
|
1.2 Identify an implementation team leader
1.3 Identify and recruit content area specialists as team members
1.4 Identify and recruit other agencies and/or community members such as family members, youth, clergy, and business leaders as team members
4.2 Identify and foster relationship with a trainer(s) and/or TA provider(s)
1.5 Assign team members roles, processes, and responsibilities
2.1 Identify and foster a relationship with a champion for the innovation
1.1 Decide on structure of team overseeing implementation (e.g., steering committee, advisory board, community coalition, workgroups, etc.)
2.2 Communicate the perceived need for the innovation within the organization/community
2.3 Communicate the perceived benefit of the innovation within the organization/community
|
Identify, review, select knowledge
|
N/A
|
Adapt knowledge to the local context
|
N/A
|
Assess barriers/facilitators to knowledge use
|
4.1 Determine specific needs for training and/or technical assistance (TA)
2.4 Establish practices that counterbalance stakeholder resistance to change
2.5 Create policies that enhance accountability
2.6 Create policies that foster shared decision-making and effective communication
2.7 Ensure that the program has adequate administrative support
|
Select, tailor, implement interventions
|
3.1 List tasks required for implementation
3.2 Establish a timeline for implementation tasks
3.3 Assign implementation tasks to specific stakeholders
4.3 Ensure that trainer(s) and/or TA provider(s) have sufficient knowledge about the organization/community’s needs and resources
4.4 Ensure that trainer(s) and/or TA provider(s) have sufficient knowledge about the organization/community’s goals and objectives
4.5 Work with TA providers to implement the innovation
|
Monitor knowledge use
|
5.1 Collaborate with expert developers (e.g., researchers) about factors impacting quality of implementation in the organization/community
6.1 Measure fidelity of implementation (i.e., adherence, integrity)
6.2 Measure dosage of the innovation—how much of the innovation was actually delivered
6.3 Measure quality of the innovation’s delivery—qualitative aspects of program delivery (e.g., implementer enthusiasm, leader preparedness, global estimates of session effectiveness, leader attitudes towards the innovation)
6.4 Measure participant responsiveness to the implementation process—degree to which participants are engaged in the activities and content of the innovation
6.5 Measure degree of program differentiation—extent to which the targeted innovation differs from other innovations in the organization/community
6.6 Measure program reach—extent to which the innovation is delivered to the people it was designed to reach
6.7 Document all adaptations that are made to the innovation—extent to which adjustments were made to the original innovation or program in order to fit the host setting’s needs, resources, preferences, or other important characteristics
|
Evaluate outcomes
|
N/A
|
Sustain Knowledge Use
|
5.2 Engage in problem solving
|
Note. KTA = Knowledge to Action Framework (16), QIF = Quality Implementation Framework (20, 21) |
Briefly, prior to the study commencement, a core implementation team was developed including researchers (JM, HS, KMG), a clinical consultant (KW), a hospital physiotherapy practice coordinator (CLCL), and the executive director of the provincial SCI support organization (CM). The core implementation team worked to iteratively adapt the ProACTIVE SCI intervention and its implementation methods to meet the needs of the local context in the hospital and community settings. Six meetings were held amongst the core implementation team to discuss guiding principles for communication, goals of the project, additional team members needed, barriers and facilitators to implementation, training needs, and timelines and tasks. Two hospital physiotherapists (in-patient and out-patient) and a trained peer support provider from a SCI-focussed community service organization were recruited as champions to facilitate the adaptation and adoption of the intervention.
Four additional meetings were conducted with participating GF Strong physiotherapists and SCI BC peer interventionists to communicate the perceived need and benefit of the intervention, review the intervention content and implementation intervention procedure, and identify additional supporting documents for implementation. Supporting documents were created, and included an aerobic and strength training prescription guide, tailored forms to document coaching conversations with physiotherapists and SCI Peers, and an exercise intensity chart adapted for clients with SCI. Iterative drafts of the implementation intervention procedure and supporting documents were circulated amongst the GF Strong physiotherapists and SCI BC peers until all stakeholders were satisfied. The FRAME framework was used to document the adaptations made to the implementation process and is reported in Additional file 2 (26, 27). Lastly, the primary investigator (JM) established a temporary office at the hospital site, making herself accessible to physiotherapists and SCI peers for informal communications important for adapting the intervention content and implementation.
Implementation intervention
The implementation intervention has been described in detail previously (22). Briefly, the implementation intervention consisted of two training sessions (see Additional file 3 for training slides), provision of the ProACTIVE SCI intervention toolkit (https://sciactioncanada.ok.ubc.ca/resources/proactive-sci-toolkit/), resources to guide physical activity prescription and document the coaching conversation (see Additional file 4), the addition of a physical activity prompt in patient discharge forms, and engagement of clinician and peer champions. During the four weeks following the first training session, the interventionists were instructed to practice delivering the ProACTIVE SCI intervention in the clinical or community setting.
Statistical analyses
Descriptive statistics were used to summarize demographic data, and paired, two-tailed t-tests were used to detect a significant within-subject effect from pre- to post-training on the TDF implementation survey data. All TDF survey implementation data were reported by mean and standard deviation, and current behaviour findings were further dichotomized by combining “usually” or “always” responses into one category, and “never”, “seldom”, or “about half the time” responses into another. Internal consistency of TDF domains was assessed using Cronbach’s alpha. Only the domain, environmental context and resources – innovation strategy, showed acceptable internal consistency (Cronbach’s alpha > 0.7) across its three items in both pre- and post- implementation scores. All other domains with three or more items, did not show acceptable internal consistency (Cronbach’s alpha < 0.7) across its items in both pre- and post- implementation. Consequently, item scores for all TDF domains, with the exception of environmental context and resources – innovation strategy, were not averaged to provide an aggregate score, and individual physical activity coaching determinants were analyzed for significant within-subject effects from pre- to post-training using Bonferroni-adjusted alpha levels.