Context
ProActive Physical Therapy was initially adopted at one urban, outpatient department within a large healthcare organization, a designated Parkinson’s Center of Excellence. Spread occurred to two smaller suburban sites within the same rehabilitation system of care. The original outpatient department had volumes of 137 to 152 patients per day during the study period, while the suburban sites had volumes of 36 to 73 patients per day. The team leading the efforts included one research-trained physical therapist, one clinical expert, the department managers, a physical therapist from the organization’s staff development program, and an external knowledge translation mentor.
Implementation and Sustainability Intervention
Implementation and sustainability strategies were identified through meetings with various stakeholders including therapists and organization leadership. As initial implementation transitioned to sustainment phases, using the Dynamic Sustainability Framework (DSF), promoted adaptability for strategies targeting the intervention, context, and ecological system (9). Key strategies to aid the spread and sustainment included a program facilitator to lead stakeholder meetings and organize implementation strategies; site champions to facilitate local implementation; organizational programs to maintain resources and mentor staff; and monthly meetings for monitoring program barriers and facilitators, delivering feedback, and providing informal support. A list of the implementation strategies from year one (Y1), as well as the modifications applied for program fidelity and sustainment, categorized using the Expert Recommendations for Implementing Change taxonomy are included in supplemental materials [Additional file 1](14, 15). These strategies include site-specific modifications at the suburban clinics related to implementation strategies of building and maintaining relationships with clients and referral sources for scheduling and long-term adherence; staff support of clinical processes and paperwork; leadership support; clinician training; and providing interactive evaluative strategies to ensure fidelity.
Study of Intervention
Data Sources and Participants
Data sources include: [1] administrative data from the outpatient department on referrals and utilization (2016-2019), [2] retrospective electronic medical records (EMR) of first-time PAPT users in Y1 (2016) and year 3 (Y3) (2018), [3] quality improvement interview recordings of first-time PAPT users from Y1 and Y3 who responded to a quality improvement phone interview request, and [4] stakeholder survey results from the NHS Sustainability Model and CSAT to evaluate sustainment after completion of year four (Y4). PAPT users include those who were referred and attended the PAPT program. Eligible PAPT users were referred with a mild or moderate PD diagnosis or suspected prodromal PD (e.g. REM sleep behavior disorder, hyposmia) who accessed the program for the first time in Y1 and Y3. Participants were excluded from this analysis if they were referred to the PAPT program with a different diagnosis. Three champions and one facilitator completed the NHS Sustainability Model assessment tool and the CSAT. Additionally, five organization leaders and one referrer completed the CSAT only.
Measures
The RE-AIM framework was used to assess and describe the spread and sustainment outcomes of PAPT. Reach of the program was measured by providing the number of PAPT users across all sites, the number of first-time users, and the number retained each year (i.e.an individual who accessed PAPT in a previous year). Demographics of PAPT users were compared between Y1 and Y3.
Effectiveness was evaluated with quality improvement phone interviews. Sustained clinical effectiveness is operationalized through (1) PAPT user self-reported changes in exercise, (2) self-reported benefit of PAPT on an 11 point scale from 0 (not beneficial) to 10 (extremely beneficial), and (3) program recommendation to others on a similar scale from 0 (not likely to recommend at all) to 10 (extremely likely to recommend). The results from interviews in Y3 were compared to Y1 as able. Adoption was measured as the 1) number of sites, 2) number of physical therapists trained and using the PAPT care model, 3) referral numbers from targeted referrers, 4) proportion of PAPT users who attended versus the number referred to PAPT, and 5) number of PAPT users who engaged in a long-term follow-up episode of care. Sustained implementation fidelity was assessed by EMR review of (1) physical activity and exercise prescription for PAPT users through documented home exercise prescription and (2) PAPT care path utilization.
Maintenance was assessed through sustainability assessments were issued after year four. The NHS Sustainability Model includes ten questions in three domains: staff, organization, and processes. Each item is measured on a 4-point categorical scale, and summed into a total score with a maximum of 100 points. This models’s training materials propose that a score over 55 indicates optimism toward sustaining the program (11). The CSAT contains 35 questions in seven domains: engaged staff and leaders, engaged stakeholders, organizational readiness, workflow integration, implementation and training, monitoring and evaluation, outcomes and effectiveness. Each item is scored on a 7-point response scale, which is averaged within each domain and across domains for a total score from 1-7 (12).
Analysis: Data are presented with descriptive statistics. PAPT user characteristics, interview responses, and documentation of information related to program fidelity from Y1 and Y3 were compared with an unpaired t-test or Chi-square test based on the type of data.
Ethical considerations: Because of the nature of quality improvement and program evaluation the Northwestern University Institutional Review Board determined that this EMR data extraction and semi-structured interviews did not qualify as human subjects research. Data from all sources were collected and maintained using HIPAA compliant methods. Reporting was completed using the Standards for Quality Improvement Reporting Excellence (Additional file 2) (16).