Design
The study will answer the research question: Is a full-scale RCT of interpersonal counselling for young people with mild depression delivered in non-specialist community services feasible? In this feasibility RCT, 60 eligible young people will be randomised on a 1:1 ratio to receive to IPC-A or treatment as usual. Participants will be assessed at baseline (pre-randomisation) and followed-up at 10 weeks and 23 weeks. The feasibility trial will recruit young people presenting with low mood, who are receiving support from participating services in Norfolk and Suffolk Counties in the UK. A process evaluation has been incorporated to explore how the intervention is implemented across the two sites. Qualitative data will be collected by site profile questionnaires, observations of IPC-A training workshops and supervision, video/audio recordings of treatment sessions (both IPC-A and TAU), interviews with participants (and parents) from the IPC-A and TAU arms and focus groups with youth mental health workers and wider stakeholders.
Participants
Inclusion and exclusion criteria
Participants will be young people accessing participating services via each service’s standard referral pathways as detailed below. Young people will be triaged and assessed according to each service’s standard procedures. If this assessment identifies low mood as a presenting difficulty, the case will be discussed with a clinical member of the research team (without identifying the young person) to ascertain likely suitability for the trial. The service will have the option of using the RCADS depression scale to help determine suitability, with a cut-off of 11 or over suggesting suitability (this cut-off will not be an absolute). RCADS is a primary outcome measure for the feasibility trial and for that matter it will be completed as part of the baseline assessment irrespective of its use by services to determine eligibility.
Inclusion Criteria
-
Aged 12–18 years
-
Seeking help for low mood (as the primary presenting difficulty)
-
Of a level of illness where they would normally receive treatment from the participating service
-
Able to provide written informed consent or, for under 16 s, written informed assent and parent/guardian consent
Exclusion Criteria
-
Learning disability necessitating non-mainstream schooling
-
Current psychotic disorder
-
Current substance dependence
-
Current significant suicidal ideation (K-SADS-PL – ‘suicidal ideation’ threshold – ‘often thinks of suicide and has thought of a specific method’, determined at baseline assessment)
Setting
The trial will be conducted in two counties in England. While the sites are in the area served by one NHS mental health trust, Tier 1/2 services or services for mild depression are not delivered by this mental health trust, as the severity of illness of young people is generally below the thresholds for NHS specialist child and adolescent mental health services. Treatment at this level is delivered by a range of services locally. This will give a good balance of generalisability while making the study feasible within the cost envelope.
Non-specialist mental health support services for children and young people provided by county councils such as Early Help teams, Young People’s teams, Family Support services, school nurses, and other organisations which provide counselling services for younger people will participate in the study.
Intervention: Interpersonal Counselling For Adolescents (ipc-a)
Intervention: Interpersonal Counselling for Adolescents (IPC-A)
IPC-A is a brief manualised psychological intervention, derived from IPT. IPC helps clients to identify the reciprocal interaction between their current depressive symptoms and interpersonal relationships, with a focus on one of four domains: grief, relationship disputes, big changes and loneliness & isolation. The therapist works with the client to identify effective strategies to deal with their interpersonal problems, which should improve depressive symptoms.
IPC-A is an adapted form of IPC designed to suit the needs of adolescents. The intervention is delivered over three to six (30–60 minute) sessions, depending on participant needs. IPC-A is based on the manual developed by Weissman et al. (28), with minor modifications to make it suitable for young people. IPC-A arm participants will also have access to standard health and care provision (treatment as usual) throughout their participation, such as family work; the extent to which provision of IPC-A alters use of these services will be monitored using the Client Service Receipt Inventory (CSRI).
Staff to be trained as IPC-A therapists will receive two full-days of initial training, followed by weekly supervision until adequate competency levels have been demonstrated (two sessions for each of two cases above quality threshold on IPC audiorecording rating scale (27). Following successful completion of this training, therapists will receive monthly clinical supervision. Where possible, Supervision will be provided in a group format to allow therapists to explore the theory and practice of IPC through engaging in shared discussion of real-world cases. Each supervision session will last up to 1.5 hours. Supervision will be delivered by PW, VC and ST, all trained IPT/IPC supervisors, with VC having overall responsibility for co-ordinating the provision of clinical supervision. Attendance at and costs of training and supervision will be recorded as therapy costs.
Control: Treatment As Usual
The control arm will receive ‘treatment as usual’ (TAU): the standard support provided by services. Participants will not be denied access to any treatment option available as part of current provision; however, staff providing individual support to TAU participants will not have attended any IPC-A training and will not receive any IPC-A supervision, to minimise contamination. Staff trained as IPC-A therapists will be required by contract not to discuss any aspect of their training or supervision with colleagues not trained in IPC-A.
There appear some variations in TAU options offered to young people by participating teams. County differences in service commissioning, locality or team differences in service provision may contribute to these variations. The process evaluation arm of this study and the CSRI has been designed to capture the interventions that constitute TAU as part of the study. At its core, all TAU encompasses a risk assessment framework used together with the families to identify and assess risk and appropriately plan to meet the needs of young people and their family. Where appropriate, practitioners offer counselling, themed group sessions, advice and information for parents/carers, and telephone support. Early Help Family Practitioners offer direct work to children and young people and their families who may focus on building self-esteem, supporting access to other services, supporting reintegration into education (if applicable) and working with the young person and families to understand and prevent risk.
Although the practitioners delivering these services in both IPC and control arms are do not have core mental health professional training, they may consult with or offer a joint appointment with a mental health professional (e.g. primary mental health worker or clinical psychologist) or signpost/refer the young person to other local services.
Recruitment Procedure
Young people will be triaged and assessed by the referring service according to each service’s standard procedures. If this assessment identifies low mood as a presenting difficulty, the case will be discussed with a clinical member of the research team (without identifying the young person) to ascertain likely suitability for the trial. Potentially suitable young people (and/or parents/carers if under 16) will be invited to participate. If they express an interest, consent will be given to the service to pass on their details to the research team.
Those who express an interest will be contacted by the trial’s research practitioner who will further explain the study, answer any queries and provide copies of participant information sheets. Potential participants will be given at least 48 hours to read and consider the information before being asked for consent.
If the young person wishes to participate following this process, the research practitioner will arrange a meeting at a convenient venue (e.g. their home address, school/college or a community venue), where the young person will be asked to complete a consent form (if 16 or over) or assent form (if under 16) at the start of the first research assessment to document the informed consent/assent process and their willingness to participate. For young people under 16, in addition to the child’s assent to participation, the consent of a parent or carer (adult with parental responsibility) will be required for the young person to be included in the study. Consent to participate in an interview as part of the process evaluation will be sought during the main consent procedures. However, it will not be a requirement that a young person/parent consents to a process evaluation interview in order to be included in the study.
After informed consent has been appropriately obtained, participants will be asked to complete all baseline assessment measures. Only those who meet the eligibility criteria outlined above will be randomised. It is envisaged that a close liaison between the research practitioner and referring teams, and the subsequent telephone conversation with potential participants before baseline visit will ensure most referrals will conform to the eligibility criteria before the baseline assessment. However, in cases (which will be rare) where young persons do not meet the eligibility criteria after baseline assessment, it will be conveyed to them sensitively, and the research practitioner will liaise with the referring team to ensure the appropriate service is sought for the young person.
All staff members to be trained in the intervention will be given a verbal explanation of the objectives of the study, what he or she will be asked to do if they choose to participate, and the possible risks and benefits of participation. Participation in the trial is not a condition of training. Participation in the process evaluation (listening to audiotapes of therapy and/or focus groups) is optional; staff will be given participant information sheets and asked for informed written consent to take part. Fig I is a flowchart diagram for this study.
Sample size
Sixty eligible young people will be randomised all together. The sample size is not based upon estimation of efficacy but is in keeping with published suggestions (29) and believed to be practically possible within the limits of the project. Further, it should enable us to assess rates of recruitment and retention to a reasonable degree of precision; assuming an attrition rate of around 20%, a sample of 60 would provide an estimate with 95% confidence interval of width 20% (i.e. +/- 10%). For a recruitment rate of around 50% the interval width would be around 25% (i.e. +/- 12.5%).
Randomisation
Randomisation will be co-ordinated remotely by the Norwich Clinical Trials Unit (CTU). Participants will be randomised in a 1:1 allocation ratio, using a stochastic minimisation algorithm to minimise imbalance between groups in baseline symptom severity, gender and study site. Allocation will be managed by the Data Management Team at Norwich CTU via a web-based system; it will not be accessible by anyone outside of this team, including the research team, trial therapists and participants; thus allocation concealment will be maintained.
Blinding
Research practitioners collecting follow-up data will be blind to the participant’s treatment allocation. Another member of the research team will pass details of allocation to the clinical service. Given the nature of the intervention, it will not be possible for participants and those involved in delivering the intervention to remain blind. Following allocation, all participants in the study and therapists will be asked not to reveal the group to which the participants were randomised to the research practitioner. Participants will be reminded at the beginning of each contact with the research practitioner post-randomisation not to disclose their allocation. Any potentially unblinding data will be stored separately in a database to which the research practitioner will not have access. In the case of accidental unblinding during the research process, a second research practitioner will complete the outstanding measures.
Data Collection
Outcome measures
Participants will be assessed at baseline (pre-randomisation) and followed-up at 10 weeks and 23 weeks, with an additional 5-week follow-up (online with telephone support). The following outcome measures will be used: Demographic characteristics of young person, Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS) depression Sect. (30, 31), Revised Children’s Anxiety and Depression Scale (32), Family Assessment Device (33), Cambridge Friendships Questionnaire (34), Employment, Education or Training in previous 4 weeks (NEET status), Short Warwick-Edinburgh Mental Wellbeing Scale (29), Modified Client Service Receipt Inventory (35), Child Health Utility 9D (36).
The Revised Children’s Anxiety and Depression Scale (32), Family Assessment Device (33) and Cambridge Friendships Questionnaire (34) will be repeated at an online week 5-follow-up. All outcome measures will be repeated at week weeks 10 & 23 follow-up except for Demographic characteristics of young person and the Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS) depression section. Information about gender of therapist, attendance/non-attendance at planned therapy sessions, and location of sessions will be collected by therapists in both treatment arms.
Figure II below shows the schedule of enrolment, interventions and assessments in accordance with the SPIRIT guidelines.
Health Economic Data
We shall measure use of NHS and community resources related to mental health. All resources required to implement the intervention, including providing training, ongoing clinical supervision, staff time to deliver the intervention, any consumables and materials required, and any other necessary expenditure will be captured. We will use a modified version of the Client Service Receipt Inventory (CSRI)(35) completed at each follow-up time point (baseline, 10 and 23 weeks). We shall use the CHU-9D (36) to measure health-related quality of life (HRQoL), which will be administered at baseline, week 10 and week 23.
Process Evaluation Data
The trial will employ a mixed-methods ethnographic process evaluation to: (a) provide a description of how IPC-A and TAU are delivered, (b) assess implementation and theoretical fidelity to the IPC-A model over time, (c) observe how delivery is shaped by the context of differing service models, (d) identify any harms arising from treatment (including end of treatment) and (e) establish the extent and source of any contamination of the control arm.
Data collection methods will include:
-
Site profile questionnaires (one per provider administered at the beginning and end of the trial)
-
Observations of IPC-A training workshops and supervision
-
Video/audio recordings of treatment sessions (both IPC-A and TAU; all treatment sessions will be recorded, subject to consent)
-
Interviews with participants (young person and a parent/carer) from the IPC-A and TAU arms (n = 20)
-
Focus groups with youth mental health workers (one per arm per provider)
-
Focus group with wider stakeholders
Video/audio recording of treatment sessions
A random selection of therapy sessions (15% in each arm) will be rated by one of the supervisors according to the IPC-A Audiorecording Rating Scale (27), to monitor implementation fidelity to the IPC-A treatment model and to assess the degree of contamination. This scale includes ratings of techniques for the assessment (eg ‘Complete an Interpersonal Inventory’) and ending sessions, for specific focus areas (eg ‘Exploration and discussion of differences in expectations’ for relationship disputes), and general IPC techniques to be used for all sessions (eg ‘Clear focus on depressive symptoms and interpersonal relationships’).
Selection of sessions will be ongoing throughout the study. Feedback will be given to the therapist from the supervisor for IPC-A cases, to aid continued development. This process will be ongoing through the study so such feedback is timely. We accept that therapists in the TAU arm are less likely to submit sessions, but we shall regularly meet with teams and explain the importance of us rating sessions from both arms of the study, and that the aim of this is to check what TAU is, and whether it contains IPC-A- the purpose is not to rate the quality of their therapy. Using findings from supervisor’s ratings of IPC-A sessions, a purposive sub-sample of extracts from recordings will also be selected (sampled to include maximum variation in delivery) and qualitatively analysed to evaluate theoretical fidelity.
Young Person/Parent Interviews
Twenty young people participating in the RCT (10 per arm) will be invited to take part in in-depth interviews after their final assessments (23-week assessment). A separate interview will be undertaken with a parent/carer (all parents whose child participates will be invited). These parents/carers will complete a separate consent form for this interview. The research practitioner will have ongoing dialogue with parents/carers about their potential participation in the interviews during the follow-up visits. Participation in the interviews will be ascertained at the final research assessment. Participants will be asked about their experience and views of the process of accessing help, the content of sessions, contacts had in addition to study therapy sessions, how they feel they have benefitted or not from receiving the intervention, the experience of ending therapy, and suggestions for improvement.
As with all clinical trials, there remains the possibility for some participants to withdraw from the study. There is a process in place to accurately record participant withdrawals/dropouts from the study. It will be established whether participants withdraw from the therapy (either IPC-A or TAU) and/or from the whole trial. Those who withdraw from therapy only will be followed-up and invited to participate in the process evaluation interviews, while those who withdraw from the whole trial will be lost to follow-up and interviews.
Staff Focus Groups
Following completion of delivery of the IPC-A and TAU arms, focus groups will take place in participating services to understand staff perspectives of each study arm. These will be separate for IPC and TAU therapists. For IPC-A therapists, discussion will focus on barriers and facilitators to successful delivery, experiences and views of intervention sessions, additional work required to support delivery of IPC, and suggestions for improvement. For TAU therapists, discussion will focus on how TAU is delivered, additional support YP in TAU have received, and their awareness and perspectives of IPC-A.
Focus Group with Professional Stakeholders
At the end of the study, an additional focus group will be conducted with commissioners, education representatives, and service managers to review study findings and discuss implementation barriers and sustainability of implementation.
Site profile questionnaires
Questionnaires at the beginning and end of study will aim to understand the broader service context in which the intervention is delivered, including TAU for young people with mental health needs; policies, protocols and procedures used by staff; numbers of YP with mental health needs and proportion with depression; training and experience of staff in treating depression in YP; and allocation and distribution of staff to support YP with mental health needs.
Analysis
Statistical
Recruitment and retention rates will be estimated with 95% confidence intervals (CIs). Assuming sufficient information, time until drop-out will be analyzed using ‘time-to-event’ methods, i.e. in an effort to identify baseline factors likely to be related to drop-out. The proposed primary outcome measure for the definitive RCT is the RCADS depression score at 10 weeks. Although the proposed study is not designed to assess efficacy, the mean between-group difference will be estimated using a general linear model including baseline RCADS depression score and treating therapist as a random effect. A 95% CI will be constructed to assess whether the treatment benefit is feasibly greater than the minimal clinically significant difference, i.e. whether or not it is included within the CI. A similar approach will be undertaken for the secondary outcome measures. The rate of completion of each outcome measure will be reported. If appropriate, depending on the proportion of missing values, multiple imputation will be undertaken and between-group differences re-estimated as a sensitivity analysis. Further parameters, such as within group variation, needed for the design of a subsequent full-scale trial, will also be estimated. All statistical analysis will be undertaken using STATA.
Health economic analysis
As this is a feasibility study, it will not be possible to demonstrate the cost-effectiveness of the intervention because the study will not be powered to demonstrate effectiveness. However, we shall collect information to inform the design of the economic evaluation planned for the future definitive trial. This will yield useful information, such as the likely cost of the intervention and key components of resource use. It will also inform the design of health economic data collection instruments in the future fully-powered trial.
The resources required to provide the interventions (IPC-A and TAU) will be recorded. These would include: training; ongoing clinical supervision; staff time and salary costs required to provide the intervention; consumables and materials required; any other necessary expenditure. Each session offered (and its location) in both arms will be explicitly recorded. Recording of all events will be built into the design of the study and study CRF. These will be combined with appropriate unit cost data to provide an estimate of the cost of providing IPC-A. It will also be possible to conduct scenario analyses to estimate changes in the cost of provision if any assumptions about how the service is provided are changed. It will be important to measure any resources related to participants’ mental health in both the intervention and control groups. This will be conducted by means of a modified CSRI(35) conducted at baseline, 10, and 23 weeks. The time frame requested for the baseline and 10-week CSRI will be any use of services in the last 10 weeks. For the 23-week assessment the time frame will be the last 13 weeks. To reduce burden on participants the a priori aim is to make the modified CSRI as simple as possible but to still capture relevant and important service use. Any modifications made will be made in consultation with other ICALM investigators. The CSRI will be collected by means of a face-to-face interview.
Resource use data will be analysed to highlight any potential areas of differences between trial arms in use of NHS and social care services, including emergency department attendances. The measure of health-related quality of life (HRQoL) used in this study will be the CHU-9D. One important outcome of the feasibility study will be an assessment of the suitability of this instrument and the modified CSRI for use in a future full-scale trial.
Process evaluation analysis
A linguistic ethnographic methodology (37, 38) will be employed to analyse how relationships, roles and moments of intervention delivery are organised within the contexts of delivery. This will be achieved by: 1) setting out macro, meso and micro contextual features relevant to implementation within each provider; 2) targeting where likely tensions in implementation are likely to occur at each contextual level; then 3) searching for ‘disruptions’ to targeted activities involved in intervention delivery; and 4) considering the consequences of these disruptions for how the intervention was implemented and the implications of these for scaled up implementation in a future definitive trial.
The linguistic ethnographic process evaluation methodology combines strengths of linguistics and ethnography to systematically investigate human behaviour within context. A particular strength is that it provides methodological tools for empirically exposing relationships between talk, non-verbal behaviour and the contexts in which such behaviour is produced. This is particularly helpful for evaluating the interpersonal counselling intervention, which trains local authority and other non-NHS services to communicate effectively with adolescents.
To manage the quality and range of data collected as part of the process evaluation, analysis will involve working laterally across data types. We will seek to provide a broad description of intervention delivery but, instead of allocating equal time to the analysis of each case, we will focus on identifying ‘telling cases’, triangulating and looking for connections between data. The analysis of qualitative data will be iterative, moving between data collection and data analysis to test emerging theories. Care will be taken to identify and follow up deviant cases which do not fit into emerging theories. Emerging theories and the relationship of the data to the conceptual literature underpinning the intervention will be discussed and refined at team meetings throughout the research.
Researchers’ field notes from observations of training and supervision of IPC-A therapists will be analysed thematically to provide a detailed description of process and content of staff training and supervision. Interviews with individual young persons and focus groups with staff and stakeholders will be transcribed verbatim and thematically analysed with the aid of NVivo software. For intervention arm participants, we will then develop a coding scheme to evaluate how the process and content of IPC-A as delivered by the youth mental health workers have functioned from the participants’ perspective. In the control arm, we will assess how participants experienced the treatment as usual provided by their youth mental health worker and any other sources of support used. A constant comparison approach will be adopted, working iteratively between data obtained from different interviewees within and between implementation sites.
The ratings of IPC-A sessions will be used to monitor implementation fidelity to the IPC-A treatment model and to assess the degree of contamination. If contamination of the TAU arm is identified, data generated through observations, interviews and focus groups will be used to explore the mechanisms by which contamination occurs and how this might be mitigated against in a future trial. To evaluate theoretical fidelity, the purposive sample of extracts of recorded IPC-A sessions will be transcribed according to Jeffersonian conventions and subject to conversation analysis in order to identify how IPC-A components are communicated by therapists and received by young people, including how the mechanisms of the IPC-A intervention function to affect change within and across individual counselling sessions.
By framing the analysis of intervention implementation within a macro, meso and micro contextual framework, we will be able to make the transition from the identification of routines and patterns of use in the specific services participating in the current study, to theoretical explanations of how different structural relations and mechanisms of the intervention organise moments of delivery, which then impact on specific outcomes. In drawing case comparisons across participating services, we will develop hypotheses about why the intervention is linked to outcomes which we can test in a future definitive trial. This may lead us to identify factors which are plausibly and/or consistently related to successful or unsuccessful delivery of the components of the intervention. Emerging theories and the relationship of the data to the theory underpinning IPC-A will be discussed and refined in team meetings throughout the research.
Patient and Public Involvement
Protocol development was informed by two PPI events attended by 14 young people, most with personal experience of accessing mental health services. The first event was held at a local school and the second with members of Suffolk Children & Young People, Action and Transformation (CAT) group. The young people we consulted stressed the inadequacy of current mental health provision for young people and supported the idea of extending access to treatment by training existing staff working with young people to deliver IPC-A. They told us that knowing workers have appropriate training is important to building trust and that they would prefer to be treated somewhere familiar to them rather than attend a specialist clinic.
We have engaged two Youth Advisory Groups, made up of young people with personal experience of low mood, for the feasibility RCT stage. Based in the two counties in the UK where the study will be conducted, each group is made up of 4–5 members, and they have been involved and will continue to be involved in key decisions regarding the conduct of the trial, interpretation of the results, and dissemination of the findings. The Youth Advisory Group will be facilitated by ST who will be the dedicated PPI lead co-applicant for the trial. ST is a Co-Production Advisor who works as part of Suffolk County Council’s Engagement Hub. She is skilled in facilitating the engagement of young people with mental health needs. ST will act as a point of contact for the young people involved and ensure their welfare by offering emotional support and signposting to appropriate services if young people need further support as a result of the sensitive nature of the research.
Two representatives of the Youth Advisory Group sit on the trial steering committee (TSC). They will be supported by ST to prepare for and attend these meetings. Involving this number of young people will increase the breadth of experience and skills, allow for group members to support and encourage each other, while ensuring that all members are able to contribute meaningfully; it will also allow for attrition, as young people choose to leave the group.
Based on our experience in previous trials, we anticipate that involving young people with relevant lived- experiences as members of the research team will enhance our ability to successfully recruit and retain participants, and to effectively communicate the study’s findings to a broad range of stakeholders. The Youth Advisory Panel will be involved in hosting the public dissemination event and in preparing reports of the findings for trial participants and the public.
Progression criteria
Feasibility Outcomes
The primary output of this feasibility trial will be the design of the subsequent full-scale trial. The TSC will assess the trial against the following criteria and make recommendations regarding the suitability of the proposed design for the full-scale trial, based on the extent to which these criteria are met.