Bright IDEAS Intervention
Bright IDEAS is a cognitive-behavioral coping skills training approach that allows caregivers to identify problems or challenges they are encountering that they wish to resolve (Fig. 1). No constraints are placed on the type of problem or challenge and, interestingly, the majority of selected problems are not related to pediatric cancer.5–7Optimum engagement is gained by focusing on problems the caregiver identifies as particularly relevant to him or her and the family. This approach also enables the caregiver and interventionist to review the effectiveness of selected solutions over time and changing circumstances. Notably, improved problem-solving skills mediates less distress.6, 8
Bright IDEAS has established clinical effectiveness among mothers of children with recently diagnosed cancer and has demonstrated dramatic and sustained improvement in caregiver mental well-being by decreasing negative affectivity as a result of improved problem-solving skills.5, 8 Clinical trials have shown that Bright IDEAS is acceptable to caregivers and, when used in six to eight 30- to 60-minute face-to-face sessions, enhances problem-solving skills and alleviates distress in mothers of children recently diagnosed with cancer.5 In particular, Bright IDEAS has proven to be significantly more effective over time than the most common form of psychosocial support, non-directive supportive counseling.10
Training Format
Grant R25CA65520 was designed to train 200 pediatric psychosocial oncology professionals through 10 interactive workshops (2015–2018). Practitioner recruitment for the workshops was leveraged through networks of professional organizations intimately involved in pediatric oncology: Children’s Oncology Group (COG), Association of Pediatric Oncology Social Workers (APOSW), the Association of Pediatric Hematology/Oncology Nurses (APHON), and the Society of Pediatric Psychology (SPP). The national reach of these groups creates the optimal environment to disseminate Bright IDEAS across the country and reach the approximately 200 pediatric oncology centers in North America.
The 1½-day training workshops were held in conjunction with association national meetings and endorsed through co-advertising. The workshops included summary information about the three large multi-site randomized controlled trials conducted to date demonstrating the efficacy of Bright IDEAS; role plays to observe and practice administration of the intervention; and in-depth discussions about implementation at an attendee’s specific home institution. Workshop participants received up to $1,000 to reimburse expenses associated with travel and lodging.
The original training agenda was modeled from the research training protocol and is detailed in Appendix A. After completing training, practitioners were asked about their perspective on their ability to adopt, implement, and maintain Bright IDEAS at their institution. The aim of the initial qualitative interviews was to identify factors for improving training delivery to improve implementation of Bright IDEAS in real-world clinical settings. After feedback from practitioners following initial implementation, adaptations were made to the training agenda which are presented in Appendix B. Table 1 summarizes the modifications and their rationale.
Table 1
Bright IDEAS training modifications.
Initial Training Concerns
|
Adaptive Training Modifications
|
Rationale for training modifications
|
Research intensive
pre-workshop study materials
Research-focused implementation of Bright IDEAS
|
Watch online training videos and practice working through a challenge
Creation of “Bright IDEAS Essential Elements” handout
|
Streamline training process and reduce learning materials
Clarify the transition from research to clinical applicability
|
Incorporating Bright IDEAS into clinical workflow
|
Inclusion of clinical workflow role plays
|
Improve clinical implementation
|
Personal case studies
Lack of institutional support and post-training
clinician participation
|
Patient/family-focused case studies
Letter of supervisor support required for attendance (participant expectations outlined in letter)
|
Increase clinical relevance
Emphasize managerial support of training and follow-up consultation calls to implement Bright IDEAS
|
The first adaptation made to the Bright IDEAS training was to the role-playing sessions. Training now uses real-world, family-centered scenarios, as compared to practitioner-focused scenarios to demonstrate the use of Bright IDEAS. The scenarios now reflect the key characteristics and attributes of Bright IDEAS recipients as identified by practitioners. Second, there is the additional role play of situations faced by practitioners’ patients. Third, it was reported that a heavy emphasis on the empirical evidence for the efficacy of Bright IDEAS may actually have been too intimidating and seemed to discourage practitioners from asking about modifications to the protocol. Therefore, Essential Elements of Bright IDEAS (see supplementary material) was developed to clarify the transition from research to clinical applicability and help stream-line materials used during sessions. Finally, practitioners expressed a strong need to have institutional and community support to sustain Bright IDEAS as an embedded part of usual practice. Accordingly, acceptance into Bright IDEAS training sessions now requires a formal written commitment from a supervisor that supports the trainee’s ability to attend the training workshop, implement Bright IDEAS in their clinical setting, and participate in the four consultation conference calls after training. After completion of the adapted training schedule, practitioners were asked about their perspective on their ability to adopt, implement, and maintain Bright IDEAS in the clinical setting.
To facilitate implementation and promote trial, one-hour consultation conference calls were also held at 1, 2, 3, and 5 months after the workshop. Each call was attended by 3–5 workshop participants and led by 2 workshop leaders. All attendees were expected to participate and were asked to complete the intervention with at least three patients, caregivers, or patient-caregiver dyads over the 5-month course of the conference calls. The practitioner’s experiences were discussed on the calls in a supportive peer mentorship atmosphere.
Study Population
National Training Workshops
We purposively sampled psychosocial practitioners who completed the Bright IDEAS training and delivered the intervention. A total of 209 practitioners representing 47 unique institutions completed the training. The interviews were scheduled to provide data from 3, 6, and 12 months following training in two waves to reflect the effect of modifying the workshop presentations in response to attendee suggestions. The project was approved by the Colorado Combined Institutional Review Board (COMIRB).
Practitioner Interviews
Study participant recruitment occurred between January 2017 and March 2020: Pre-adaptation: Wave 1- more than 12 months since training (N = 11), Wave 2- between 6 and 12 months (N = 9), and Wave 3- less than 6 months (N = 10). Post-adaptation: Wave 1- more than 12 months since training (N = 6), Wave 2- between 6 and 12 months (N = 4), and Wave 3- less than 6 months (N = 4). Practitioners were contacted via email and invited to participate in a 30-minute telephone interview. A random sampling of participants was contacted initially. Depending on response rate, the decision was made to continue or discontinue contact to secure additional interviews as needed. In total, 106 professionals were contacted, 68 responded to the study invitation (64% response), and 44 were scheduled (65% participation) for interviewing allowing up to three contact attempts. Non-participation by three providers who originally agreed to participate was due to scheduling challenges. An honorarium of a $25 gift card was offered for participation.
Semi-structured interviews
Semi-structured interviews were conducted over the telephone in their office or other private setting by the first author (DMM) who had no prior relationship with any of the respondents (range: 24–47 minutes per interview). All interviews were audio-recorded and transcribed verbatim.
Conceptual Framework For Evaluation
The RE-AIM framework, which is recognized by the NCI as a leading implementation framework in cancer control research, was used to guide the evaluation process we employed to assess the effectiveness of this national effort to disseminate Bright IDEAS.9
The interview guide was developed to be consistent with dimensions of the RE-AIM framework and explored adoption, implementation, and maintenance of Bright IDEAS in the clinical setting. Table 3 gives example questions from the interview guide used to focus the conversation. The interview guide was used flexibly with respect to the order of questions and the depth to which some issues were explored. The guide was pilot tested with a small sample of psychosocial providers (n = 5) prior to finalization.
Table 3
Examples of interview questions.
RE-AIM dimensions
|
Example of questions
|
Adoption
|
Would you consider Bright IDEAS to be a completely new approach to working with parents with a child newly diagnosed with cancer?
Probe: If yes, ask: how so? If no, ask: what is it most similar to that you have used or are more familiar with?
|
Implementation
|
Please tell me about the ways you deliver Bright IDEAS to your clients?
Probe: How do you select appropriate clients for Bright IDEAS?
Probe: How do you determine the number of sessions? How do you determine how long the sessions should be?
|
Maintenance
|
What factors might influence your (dis) continuation of Bright IDEAS?
Probe: How significant a role does [insert factors stated by practictionr] play in determining your future use of Bright IDEAS?
|
Data Analyses
Analyses were completed using data analysis package ATLAS.ti 8.0 (Scientific Software Development GmbH, Berlin, Germany) for coding by study authors (DMM, SB) who are PhD and PharmD trained researchers with experience in qualitative methods, health services research, and D&I science. All of the transcripts were double coded. The coders familiarized themselves with the data by carefully reading the transcripts. They then deductively coded the data using the constructs of the three RE-AIM dimensions: adoption, implementation, and maintenance. Discrepancies were resolved through discussion. Interviewer and analytic biases were managed during regular analysis meetings among all authors. Two study authors (DMM, SB) engaged in regular discussion of cases throughout the data analysis phase to ensure rigor. Transcribed interviews were coded by marked text with phrases indicating content of the discussions. Data appeared to become redundant (i.e., thematic saturation) following the 23rd interview during the pre-adaptive phase and following the 11th interview during the post-adaptive phase. All authors agreed that no unique responses were emerging within the data and that saturation had been reached. As practitioners had already agreed to participate, seven more interviews were completed during the pre-adaptation phase and three more during the post-adaptation phase.
Maintaining Research Quality
The Consolidated Criteria for Reporting Qualitative Research (COREQ) framework was used to guide the reporting of findings.11 Additionally, criteria for credibility, transferability, and confirmability were used to ensure rigor of this study.12, 13 Strategies used to address credibility included recording interviews and transcribing them; authors frequently discussing findings; encouraging participants to pursue their own line of thinking; and searching the data for conflicting patterns.12, 14 Confirmability was addressed by rigorous review of interview transcripts, the codes used to identify them, and drafts and revisions of the findings.14