Focusing a realist evaluation of peer support for paediatric mental health

doi:10.21203/rs.3.rs-2446868/v1

Download PDF

Research Article

Focusing a realist evaluation of peer support for paediatric mental health

https://doi.org/10.21203/rs.3.rs-2446868/v1

This work is licensed under a CC BY 4.0 License

Version 1

posted

You are reading this latest preprint version

Objective

Mental health problems are a leading and increasing cause of health-related burden in children across the world. Peer support interventions are increasingly used to meet this need using the lived experience of people with a history of mental health problems. However, much of the research underpinning this work has focused on adults, leaving a gap in knowledge about how these complex interventions may work for different children in different circumstances. Realist research may help us to understand how such complex interventions may trigger different mechanisms to produce different outcomes in children. This paper reports on an important first step in realist research, namely the construction of an embryonic initial programme theory to help ‘focus’ realist evaluation exploring how children’s peer support services work in different contexts to produce different outcomes in the West Midlands (UK).

Methods

A survey and preliminary semi-structured realist interviews were conducted with 10 peer support service staff. Realist analysis was carried out to produce context-mechanism-outcome configurations (CMOC).

Results

Analysis produced an initial programme theory of peer support for children’s mental health. This included 12 CMOCs. Important outcomes identified by peer support staff included hope, service engagement, wellbeing, resilience, and confidence; each generated by different mechanisms including contextualisation of psychoeducation, navigating barriers to accessing services, validation, skill development, therapeutic relationship, empowerment, and reducing stigma.

Conclusion

These data lay the groundwork for designing youth mental health realist research to evaluate with nuance the complexities of what components of peer support work for whom in varying circumstances.

Interviews

Paediatric mental health

Peer support

Realist evaluation

1.1. Background

Mental health problems are a leading cause of health-related burden across the world, representing as much as a third of disability-adjusted life-years (DALYs) lost during childhood (1). Between 2017 and 2021 in England, rates of probable mental health problems in children aged 6–16 increased from 11.6–17.4% (2). Referrals have increased by nearly 60% over the same period. During 2019-20, 144,384 children were turned away – their referral was closed before treatment – and 64% of children referred to children’s services had not yet received treatment within the year despite the benefits of early intervention (3, 4). The problem is magnified upon examination of regional variations. Thirty percent of people residing in the West Midlands (England) are in the most socioeconomically deprived quintile (5). Twenty-six percent of children in the West Midlands live in relative low-income families (5). Seventeen percent of people residing in the West Midlands, particularly in the most deprived areas, are from ethnic minorities (5). Twenty percent of the West Midlands population lives in rural areas, and for those in industrial towns, there has been a decline in local jobs markets. The proportion of children aged 16–17 not in education, employment or training in the West Midlands is statistically higher than national average (5.5%) and as high as 10.3% in Shropshire and 8.5% in Birmingham (5). The intersectionality of childhood inequalities in this milieu play out in health outcomes observed across the region. Through mechanisms (e.g., shame & withdrawal from social participation) related to these socioeconomic circumstances, children in these communities may experience reduced access to services that improve health (6).

A report commissioned by all 11 Integrated Care Systems across the Midlands aimed to understand the reasons why the region had the lowest percentage of children accessing mental health services across England (7). Key findings highlighted that, [1] as a region the West Midlands has complex processes for children accessing services, disadvantaging some children more than others; [2] that demand for mental health services outstrips supply, with demand expected to rise further due to the effects of the COVID-19 pandemic; and [3] there is a lack of prioritisation of continual service improvement. Recommendations from the report included the need to collate and share good examples of service user involvement in improving access to services; to work with service users to understand wider sociocultural needs to inform service provision; to develop a workforce strategy for eating disorder services; to evaluate different service models across the region; and explore the association between demographics and workforce on access and outcomes.

Peer support is widely regarded to improve hope for recovery, and access to mental health services (8). Peer support involves people with lived experience of mental health problems supporting others in their recovery from mental health problems (9). Peer support is part of the recovery movement that recognises the right and capability of people with mental health problems to participate fully in society, that they can recover from illness and lead productive fulfilling lives in recovery (10). Here personal recovery is distinguished from clinical recovery in which people are encouraged to ‘return to normal’. Much of the history of peer support and peer support evaluation has traditionally focused on adults. However, recovery is policy in the UK for all (11), and efforts are increasingly oriented towards personal recovery through peer support in children (12).

Gopalan and colleagues (2017) conducted a scoping review of youth peer support in the US (13). They recommended that future research in youth peer support focus on specific mechanisms of influence, and in particular, whether matching between patients and peer support workers’ characteristics influences treatment outcomes (13). Realist evaluation is particularly suited to this line of enquiry, which aims to improve our understanding of how such complex interventions may trigger different mechanisms to produce different outcomes (14). One existing realist evaluation aiming to understand the underlying mechanisms contributing to what works in peer support for children was undertaken in the Toronto-based Transitional Aged Youth program at LOFT Community Services (15, 16). LOFT Community Services implemented peer support services alongside case management, mental health and housing support services for children and young people aged 14–26 years of age most of whom experience mental health and substance use problems. During the study, most procedures moved online due to COVID-19 pandemic public health restrictions, which incidentally may provide useful contextual information for how peer support works in a pandemic for older children and young adults. However, the study may lose some explanatory power as the impact of the pandemic begins to fade. In their realist evaluation, Halsall identified peer empathy, authenticity, openness, and similarity between peers as necessary components of peer support that contributes to service engagement (16).

Taking all of this in, peer support in our context in a post-lockdown West Midlands, when a sense of self-reported hopelessness in children has been on the rise during the pandemic (17), and where the supply ratio for children and young people’s mental health services has been constrained (7), presents a target for investigation to refine understanding of how peer support produces outcomes. Cumulation in realist research to improve services is typified by progressive problem shift, represented here by exploring the complexities of peer support in a socioeconomically deprived and ethnically diverse region amplified since the onset of the COVID-19 pandemic. An important first step in realist evaluation is to construct an initial programme theory to ‘focus’ the evaluation including determining the scope of data collection processes, and direction of analysis of context-mechanism-outcome configurations (18).

1.2. Aim

The aim of this study was to explore professionals’ theories of how peer support services work in different children’s mental health service contexts to produce different outcomes in the West Midlands (UK) as a means of transparently creating preliminary data that may be used to inform further evaluation of peer support.

A realist evaluation focusing study was conducted and is reported here with regard to RAMESES II Quality Standards for Realist Evaluation (18) (Appendix 1).

2.1. Ethical approval

This study has been reviewed and has received a favourable opinion by the Science, Technology, Engineering and Mathematics Ethical Review Committee at University of Birmingham (reference: ERN_21-1786).

2.2. Setting

Children’s peer support settings included NHS mental health services, schools, charitable organisations, and private companies where a programme of intentional peer support is delivered in the West Midlands (UK). The West Midlands region (Birmingham, Coventry, Dudley, Herefordshire, Sandwell, Shropshire, Solihull, Staffordshire, Stoke-on-Trent, Telford and Wrekin, Walsall, Warwickshire, Wolverhampton, & Worcestershire) has a population of approximately 6 million people and is home to one of the youngest cities in Europe, with children and young people (0-25) representing approximately 40% of the population. Each type of eligible study setting may cater for children and adults, for instance NHS children’s mental health services often support ages 0-25, though the focus of this study was children only (<18 years) and participants were asked to reflect on this group of service users. Peers in services formally employing peers may refer to adult peers, though reciprocal peer support services refers to child peers. Further particulars of service settings are reported in section 3.1 on survey responses.

2.3. Programme theory

Initial programme theory in realist evaluation may ordinarily be derived from engagement with programme leaders (the purpose of this transparent preliminary data collection), or the extant literature, in this case borrowing from the adult peer support evidence base, which was used to inform discussion with participants on how peer support may work with professionals in the present realist-focusing exercise.

Gillard’s change model of adult peer support invoked Social Comparison Theory (19), Social Learning Theory (20), Bordin’s Trans-Theoretical Formulation (21), and Attachment Theory (22, 23) to articulate how peer support works by building a trusting relationship based on shared lived experience by triggering positive recovery role modelling, and community and service engagement (24). In peer support between children, Social Comparison Theory would posit that peers role-model how children may think or behave (19). Where the child attends to the peer’s words or actions that possess relevance and perceived value, the child may be motivated to internalise new more adaptive ways of thinking or behaving. Similarly, Social Learning Theory would posit that sharing lived experience normalises mental health problems, and when a comparison is made by the child whom perceives that their peer is in ‘a better place’, the child derives hope with the peer as their frame of reference (20). Moreover, where children have trouble in forming trusting bonds, they may more readily relate to peers who demonstrate the requisite understanding to underpin a resilient therapeutic relationship (21, 22). Indeed, these theories employed to explain how peer support works recur throughout the chronic condition peer support literature (25).

2.4. Sampling and recruitment

A preliminary, realist-focusing multi-site case study sample of professionals working alongside peers was recruited to capture a small albeit broad view of peer support across geographical locations and service type across the West Midlands, UK. As part of an asset mapping exercise to catalogue peer support assets in the West Midlands, each local NHS Trust and secondary school, and charities (identified via a Google search comprising term combinations of ‘peer support’ and regional localities) were approached to complete a survey about their peer support offer (see section 2.5.1 on survey data collection). All respondents who provided their contact details and permission to be contacted for the purpose of recording an interview were invited for a follow-up interview.

2.5. Data collection

2.5.1. Survey

A survey was administered to professionals working in services where peer support is offered to children to gather information about where peer support is offered in the West Midlands, to whom it is offered and how, including initial views on how they think peer support causes outcomes. The survey was developed in Jisc Online Surveys (26), and comprised categorical fixed response and open-ended free-text questions about [1] the respondent’s role and where they are based; [2] how peer support is delivered (content & modality), to whom, and what resources are in place to support this; [3] who peers are, how they are screened, trained and matched to other children, and [4] what outcomes are important and how these are generated by underlying mechanisms. The survey was piloted by two clinicians working in services where peer support is offered to children, who were asked to complete the survey and comment on usability and relevance of questions and response format.

2.5.2. Interviews

Qualitative semi-structured interviews were conducted with professionals working in services where peer support is offered to children to explore how peer support works, for whom and in what circumstances. Interviews were supported by a topic guide informed by the RAMESES II Project ‘starter set’ of questions (27). The topic guide consisted of open-ended questions and prompts addressing variability in outcomes across children; how their local peer support offer may have caused those outcomes; how their peer support intervention may have changed their views on the objectives of peer support (to probe for participant reasoning about specific aspects of how peer support works); and how the participant would adapt their peer support offer to make it more effective to elicit experience of programme failure where mechanisms have not be triggered by the peer support intervention.

Interviews were undertaken by DT from 28^th April to 12^th July 2022. DT is a chartered psychologist with experience of conducting qualitative research, consulting on research design including realist research studies, and delivering psychological therapies independently of the sampled services. Interviews were audio-recorded and transcribed clean verbatim and anonymised by a professional transcriber for data analysis.

2.6. Data analysis

Categorical survey data were tabulated, and free-text survey item responses underwent simple content analysis by DT [13], except for the survey item designed to elicit CMOCs, which fed into the realist interview analysis. The realist epistemological position holds a theory of causal explanation based on generative principles. Ontologically speaking, realism assumes that regularities in patterns of social activity or interventions are generated by underlying mechanisms that may be triggered in particular contexts (14). Methodologically, this analysis seeks to explain the relationship between context, mechanism, and outcome (CMOC) to explain how contextual components of peer support (C) work to produce an outcome (O), because of an underlying mechanism (M).

Mechanisms in realist research are often challenging to parse even for the experienced realist evaluator. At their core, mechanisms may refer to the choices or capacities resulting in regular patterns of social behaviour. So, we may hypothesise based on existing non-realist theory that a social peer support intervention may be introduced to counter problematic social causal mechanisms like stigma and barriers to inclusion and diversity in services. At the core of any realist analysis is the imperative to uncover whether a programme (of peer support) has nullified the problematic mechanisms responsible for the original problem. In this case, that problem would appear to be focused on a lack of local service engagement contrasted against the potential for a more diverse workforce acting out alternative causal mechanisms to mitigate this (7). During analysis, we adopted the realist principle of embeddedness to guide analysis of programme systems. Analysis rejected the notion that programmes in general (including peer support) are solely targeted at patients and that an effective intervention only changes individual patient behaviours or thoughts. The realist principle of embeddedness fits well with peer support, which may target and benefit the patient, peer, mental health service and their staff, and the wider community. Peer support programmes may be designed to be uni-directional (the peer supports a patient), or mutual (support between two peers/patients) (28). This analysis considers outcomes for both child and peer across social interactions that may be one-directional or mutual, and considers propositions accounting for micro and macro social processes.

Realist interview data were imported into QSR International’s NVivo version 12 software (29), and organised using Gilmore’s transparent approach to realist analysis (30). DT read each transcript line-by-line. Coding into nodes occurred where a CMOC was observed (or part of a possible CMOC), and child nodes created where theory was revised. Nodes were also created where participants referred to context or outcomes where potentially relevant to CMOCs noted elsewhere in their interview transcript. A memo was linked to each node articulating decision-making underpinning any theory refinement. During the coding process for each new interview transcript, memos were reviewed, and CMOCs were combined or divided where resemblances or differences between them were observed. The resulting CMOCs and associated illustrative quotes from the interview transcripts were reviewed by all other members of the study team (MB, BM, TH & JM) including one member with experience of realist evaluation (TH) for agreement.

3.1. Survey responses

Participants included a CEO, commissioner of services, service manager (n=2), recovery/project leads (n=5), clinical psychologists (n=3), teacher, and community moderator. Service setting and programme details are presented in Table 1.

***INSERT TABLE 1 AROUND HERE***

3.2. Initial programme theory

Analysis of 10 preliminary interviews with peer support service staff produced an initial programme theory of peer support for children’s mental health (Figure 1). This web of CMOCs takes on a complex presentation in keeping with its embryonic stage of development and limited preliminary data from staff only across a range of sites with subtly (or more obviously) different contextual implementation (e.g., peer support delivered as delivered in health services contrasted against delivery in schools). This includes 12 context-mechanism-outcome configurations (CMOCs). ‘Context’ of what works is represented by individual components of the peer support intervention that trigger a mechanism to elicit an outcome.

***INSERT FIGURE 1 AROUND HERE***

3.3. Individual Context-Mechanism-Outcome Configurations (CMOCs)

In this section, explanatory summaries underpinned by illustrative quotes are provided for each individual CMOC, organised by Outcome

3.3.1. Hope

3.3.1.1. Presence of matched peer, role-model of recovery

When a child is matched with a similar peer (C), they develop hope for personal recovery (O) because they have been inspired by a similar peer modelling recovery (M).

***INSERT FIGURE 2 AROUND HERE***

Hope for recovery predominated participant accounts of the value of peer support. They considered this to be an outcome in the context of peer support, with more distal clinical outcomes (i.e., anxiety and depression) compartmentalised as a consequent outcome that some though not necessarily all children may derive from more traditional clinical service provision alongside peer support. Staff consistently and deliberately avoided being drawn on what distal outcomes may be generated by hope (acting as context) because ‘personal recovery’ was deemed to be a uniquely independent experience and not necessarily intended as a necessary outcome of peer support as part of a wider treatment package. Peer support worked well when children were matched to similar peers who would embody the possibility that recovery is possible:

“People perhaps don’t always understand the role of a peer and expect them to go about sharing all the difficulties in their life, but they are not there to share all the difficulties, they are there to model hope.” [#13]

“I think it’s always helpful to have someone who you know has been there and has experienced this and has found this is harder than perhaps you’re finding it, who almost is your model. So, it’s easier to do something when someone is modelling it for you, and they’re wearing their experience on their sleeve of right I have been here, ‘I have done this, I know how it feels to do this, but it is possible’. So again, instilling that hope that this feels really hard, and this is overwhelming right now, but it is possible.” [#12]

Here, the nature of the similarity is left unspecified by the professional, other than to allude to a past albeit similar overwhelming hardship, that may be focused on mental health symptoms, sociodemographic intersectionality, or challenges when attempting to engage with services (more on this to follow). Of note in the above illustrative quote, is the implied use of downward comparison ‘[the peer] found this is harder than perhaps you’re finding it’ which was not generally elicited in other interviews with professionals.

3.3.2. Service engagement

3.3.2.1. Peer advocates for child, navigating barriers to service

When a peer advocates for a child (C), service engagement increases (O), by navigating barriers to accessing or continuing to engage with services access (M).

***INSERT FIGURE 3 AROUND HERE***

One way in which peer support could lead to greater service engagement and access to care was through peers advocating for children to help them to access adult services when transitioning from childhood:

“When they are transitioning from children’s mental health services to adult mental health services. So again, that’s where that waiting list remit might come into it or those other areas where they are transitioning, we can go in and act as advocates and support them.” [#10]

Children’s perception of services as ‘oppressive’ was described as a problematic mechanism preventing service engagement. Participants indicated this could be interrupted by the introduction of peers to support children in this context to change children’s reasoning in favour of service attendance where a similar peer may be able to mitigate undesirable components of traditional care. Peers may help children to overcome perceived institutionalisation and oppression experienced in clinical settings, with peers in a position to help children in these services, in part by bypassing other clinical care within these services entirely:

“I think there’s possibly an issue there where there’s the same groups of people who might not want to access services because they are traditionally seen as oppressing them in some way, and then peer support could be a really viable alternative.” [#13]

However, this mechanism may not be triggered in service contexts in which peers are subsumed by clinical systems and teams and may have limited capacity to advocate for the children they work with:

“We definitely see it with statutory services, there’s this idea of institutionalisation where a peer might start to align themselves more with the team… but due to the way that it’s perhaps set out or functions within the system it doesn’t always keep that same transformative element that it could hold to it.” [#13]

3.3.2.2. Child matched to similar peer, mitigates experienced stigma

When a child is matched with a similar peer (C), service engagement increases (O) by reducing experienced (instigated by others) stigma (M).

***INSERT FIGURE 4 AROUND HERE***

Staff recognised the stigma experienced by children and how it may be realised in their interactions with others in a way that could inhibit children accessing care. Furthermore, peer support was described as a way to match children to similar peers (by age, religion, gender, lived experience of mental problems) so that mental health interactions could be normalised or effectively disguised as an ordinary social interaction:

“A young Muslim man wouldn’t really want to come for a walk with me if I was his care co-ordinator, if I was his nurse, because his friends would see him and say, “What are you doing with that middle aged white woman?” So, there’s something around the stigma, so if we can try and match them to a younger person that they might be more likely in real life to have a relationship within their social network that’s helpful too.” [#04]

3.3.2.3. Authentic empathy from lived experience, therapeutic relationship

When peers display empathy (C), service engagement increases (O), reinforced by a developing power-balanced therapeutic relationship between the child and their peer (M).

***INSERT FIGURE 5 AROUND HERE***

Mechanistically, the potential for a traditional therapeutic relationship between patient and clinician is not refuted, though is replaced by a particular therapeutic relationship that is characterised by a balanced power dynamic. In our interviews, staff suggested peers possess a more authentic empathy through their first-hand lived experience, with a willingness to suffer with the child they are supporting to maintain engagement with the service in which they are situated:

“They are more there because they have got this authentic empathy of being able to say I have been in that place where it’s like I understand how it can feel for people to look at you in this way, or to not believe in you, or for you yourself to feel that there’s not a road forward, but I am here to explore with you the ways in which we can construct this way forward and I will walk with you alongside it together.” [#13]

The idea of ‘walking alongside’ here was invoked not to suggest literally walking with the child in the community (although this was referred to previously in this analysis). Rather, it is used to denote compassion as in the Latin root compati, ‘to suffer with’.

Openness of peers lends itself to perceptions of authenticity, which balances power between child and peer, enabling the child to let their guard down so that they are better able to engage with their service beginning with their peer. However, one caveat was noted – remunerated peers may lessen the appearance of authenticity:

“This idea of being able to have a mutual and reciprocal relationship in that sense, being able to sit with someone and the power balance being as close to equal as possible. Obviously with intentional peer support someone is paid, so that has to be addressed, but I think part of the authenticity is being open and honest and not holding bits of information back because they see the young person as not being able to handle it, and with these conversations I think there’s maybe a feeling of having to be a rescuer or the protector of the young person, and I guess be able to be authentic and be ourselves, allow the young person to be themselves, maybe let them bring their guard down” [#13]

3.3.2.4. Use of shared interest between child and peer, Trust in services

When peers use shared interest to engage with children (C), service engagement increases (O) because children feel that they can trust services (M).

***INSERT FIGURE 6 AROUND HERE***

Staff noted that for the use of shared interests to improve service engagement, it was important that children were motivated and that any opportunity to engage in shared interests together (i.e., hobbies) is funded. Trust in this case may be generated by a perception that recovery is not purely medicalised, the use of medication highlighted by this member of staff:

“When we break it down and look at some of the groups that aren’t engaging well with that we tend to find a lot of young males are not interested in it, we find that don’t want to engage in anything physical health and wellbeing. The feedback can be either I don’t need it, not interested in it. There are some things where they say I don’t have the opportunity, there’s nothing in my area, I can’t afford it, I can’t do that, and I think so there are those groups… we have got a couple of young black peer workers that are in the team who are doing some activities around music… What that’s leading into is a bit of more of a trust in the service and a bit more of a trust in actually you’re not just there to pump me full of meds, you’re not there just to do this to me, that to me, there’s an opportunity there… that has helped with a wider engagement, it’s something they’re interested in, the peer worker is interested in themselves.” [#07]

3.3.3. Confidence

3.3.3.1. Support others, develops skills

When a peer supports others (C), their confidence improves (O), because they have had the opportunity to practice and develop skills (M).

***INSERT FIGURE 7 AROUND HERE***

The potential for peers to develop confidence via skill development was situated within a social context that values career (as a more distal outcome), although the social interaction of children and peers could trigger social skill development in peers to generate confidence as an end in and of itself:

“I think there’s also something about the peer workers themselves gaining skills and confidence, and to be able to get a foothold on a career ladder, see themselves differently, so the peer worker and the person they’re working with gets a benefit.” [#02]

“Identify some young people for whom peer mentoring might be a really positive social learning tool and a positive thing for them to do to give them confidence.” [#08]

3.3.4. Resilience

3.3.4.1. Build social network, engage with community

When a peer helps to build a child’s social network (C), the child develops resilience to recover from setbacks (O) because they can engage with individuals or assets within their community (M).

***INSERT FIGURE 8 AROUND HERE***

Staff acknowledged the isolation associated with mental health problems, compounded by the potential for disrupted community engagement due to the COVID-19 pandemic. In peer support, peers can actively help children to (re)build their social network. In contrast to the value of peer support as an intervention to help children to engage with clinical services, staff also described how peers may help to build awareness of assets within their community that they would feel able to engage with going forward so that they felt that they no longer required clinical services:

“To continue that support without us, they access like I was saying earlier about social isolation, they have built those networks, they have brought those links within the community or the professionals or identify links within their own home and family and friends. So, they built that resilience to say ‘actually I don’t need you anymore’.” [#10]

3.3.4.2. Peer shares lived experience, contextualise psychoeducation

When the peer shares lived experience in a context where psychoeducation is delivered by the peer or clinicians (C), the child’s resilience may be improved (O) by understanding how to apply the psychoeducation in practice (M).

***INSERT FIGURE 9 AROUND HERE***

Professionals suggested that peers could provide an example of how children can help relate learned models of resilience to their day-to-day lives:

“Resilience is something that might be talked through sessions on transactional analysis, of part of a PHSE [Personal, Social, Health and Economic education] programme, but actually there might be some pupils that they just need a bit more of a reminder of what that looks like. The scenarios that we have looked through in class they aren’t enough, they need to actually relate it to their here and now, their personal experience, and that’s where this [peer support] comes in, it complements it. It’s all part of that bigger picture.” [#11]

3.3.5. Wellbeing

3.3.5.1. Peer shared lived experience, sense of validation

The act of supporting others (C) improves peer wellbeing (O), by helping peers to feel validated (M).

***INSERT FIGURE 10 AROUND HERE***

One service staff member describes sharing lived experience as cathartic when enacted between similar peers due to the depth of their shared understanding. Here, peer support is contrasted against clinician-delivered care.

“I think it’s [sharing lived experience] a release mechanism. I think it’s a way that firstly it’s acknowledgement but on a deeper level. It’s rather than somebody just sitting there and going oh that’s interesting or oh I’ve not had that before, or oh wow, it’s yeah, I get you, I understand. It’s that depth of understanding I think that comes from it. It’s acknowledgement, it’s being seen and being heard.” [#01]

This sense of validation was also triggered by the work context and the service clinicians within it – the act of peers sharing their lived experience as part of, or alongside of a clinical team (that may in some circumstances have previously supported the peer) providing a sense of community belonging beyond any prior illness identity:

“There’s also an aspect of the impact of this on peer workers themselves, so for example when people talked about the interview process afterwards what people were saying was that to be able to have their experience of psychosis and their recovery valued, to have it as something that was there to be talked about in a really positive way was such a different experience to how they have approached working interviews before where they have had to hide that, and there’s been a degree of shame about that as well. So to be in an interview when people are positively looking for that, and want to talk about that, again for them it’s something really positive.” [#06]

3.3.5.2. Peer shares lived experience, feels empowered

When a peer shares information about their experience of a problem common to the child and peer (C), their wellbeing improves (O) because they have been empowered to control their own recovery journey (M).

***INSERT FIGURE 11 AROUND HERE***

Participants described empowerment as a programme mechanism that can be contrasted against disempowering ‘traditional’ clinical care that may have limited children’s control over their recovery. When peers are employed in a role that enables them to share their experience of a mental health problem, the role provides a sense of recognition or affirmation that the peer’s experiences and contributions are valid and worthwhile. This capacity effectively authorises (empowers) them to identify their own definitions of personal recovery that is meaningful to them to provide control over their own recovery:

“It is such a contrasting role compared to I guess a lot of traditional in inverted commas mental health roles in it’s empowering, drawing upon that lived experience to validate… and looking at allowing that individual to define what recovery is for themselves.” [#13]

However, in the context of eating disorder services, staff located empowerment as displaced from the child to their parent:

“We do need to empower them, and we do need to disempower the eating disorder when actually it’s making decisions for the child. When the child is out from the grips of the eating disorder then we can empower them to make decisions. But when they are that unwell, they just make decisions to not eat, and that’s when we have to empower parents to do that for them.” [#12]

3.3.5.3. Peer supports others, sense of purpose

When a peer support worker helps other children (C), their wellbeing improves (O) because they develop a positive sense of purpose or meaning to their own experiences.

***INSERT FIGURE 12 AROUND HERE***

Staff relayed common narratives in their peers’ attempts to generate a positive understanding of the mental health challenges they had experienced, including for example, reducing feelings of guilt by supporting others:

“I would hope going back to the CHIME [Connectedness, Hope, Identity, Meaning and Empowerment] model (31) they get some sense of meaning. Many of my patients have said to me that… “I have been here for so long I have just lost so much time and it just feels like what was the point?” And all of this, and I wonder if this helps them feel like actually there was some meaning to this, at least there was something that I could say that it was there was a point to it, so I was unwell, my eating disorder hijacked my life, and I lost this massive chunk of my life, but I am able to create some meaning from it by using it to support somebody else to make their recovery journey, and that makes it worthwhile. I don’t have to feel guilty about the fact that I left that bit behind.” [#12]

However, it is acknowledged that working in the peer role poses risk to peer wellbeing where the work triggers latent mental health difficulties:

“But then on the other end we have got one peer support worker who he is one of the older ones, he has had to take time off because he’s really struggling doing engagement with people because it’s triggered his mental health condition and he’s not very well at the moment. So, it’s a real challenge, it is for anybody, but I think particularly this group because it’s ongoing recovery and it is ups and downs.” [#04]

3.3.5.4. Use of shared interest between child and peer, community engagement

When peers use shared interest to engage with children (C), children’s wellbeing improves (O), because they have developed a social network within their community (M).

***INSERT FIGURE 13 AROUND HERE***

Staff recognised that peers may tap into their shared interests to help children to engage with community assets in a way that benefits their wellbeing by engaging with community assets that are associated with social determinants of good health and wellbeing:

“We have some flexibility to do other drop-in one to one kind of support, and they will then network with volunteers, some of whom will be in the age range, some of whom will have specialist skills in things like football or fishing or whatever… because then we can instil a public health social determinants kind of way, not just in a you’re going to have counselling because you’re a bit depressed.” [#02]

“It will also be the connectivity, so it’s a community asset-based approach… because [the area] is very focused on community, and there are very definite neighbourhoods to leverage some of that community support and to connect people… So, if we’re talking about more public health wellbeing approach to connect people through peer working into the communities and how to access local support and friendship groups and those kind of things are going to keep people well, not just fix what ails them now.” [#02]

Peers were described as a relevant culturally competent point of contact (contrasted against other staff who may only signpost children to community assets), uniquely placed to support children in their shared interests:

“I think the fundamentals remain the same wherever you are, whoever you’re with, whatever you’re doing actually. There are some things that you need to be mindful of and you need to adapt to. So, for example quite often I think it’s about placing the right people within the right areas to do that specific thing. So, we run a creative arts programme, we have also done the community, we have supported the community dance group with the first pilot of the young people’s programme. I have not done either of those because I haven’t got the right skills to be working with young people, but we have got two people on our team who are trained to work with young people, that’s what their background is, that’s what their experience is, and they also have got lived experience of being a young person and having a mental illness, which is really important. It’s about knowing your people and putting the right people in the right place as much as anything, I think. I don’t run the creative arts programme because I wouldn’t have a clue, I couldn’t. So, we have got somebody who specialises and who is a fine artist and has done artwork within her local community and all her training is in art and set design, and she delivers that with her lived experience of mental illness as well. I think I would say that for us that’s the only difference, right people right place, but everything else remains.” [#01]

The preliminary data reported in this paper provides transparency in the decision-making process of developing an initial programme theory to contribute to the development of cumulative realist evaluation of peer support for children by focusing the scope of context-mechanism-outcome configurations (18). This study proposes an embryonic initial programme theory based on a preliminary survey and interviews with professionals across healthcare and education settings. The professionals interviewed in this study identified six peer support outcomes, presented here in the initial programme theory (Figure 1). The outcomes foregrounded by participants were hope for recovery and service engagement, which tallies with existing research with adults and children in other peer support settings (24). There was also evidence of improved resilience, confidence, and wellbeing. These outcomes were consistently targeted across the variety of peer support models and populations they support, though professionals reiterated throughout that personal recovery is very much about what is important to individual patients, and that what these outcomes look like to different children will vary significantly from person to person. This is in keeping with Halsall’s realist evaluation of peer support at the Toronto-based LOFT Community Services for children and young people aged 14-26 years (16), which posited an overarching ‘recovery’ outcome generated by mechanisms familiar to the present evaluation (e.g., participation in social activity roughly synonymous with community engagement. Divergences between the two realist evaluations will have been caused by the different intervention context inherent in each study, resulting in subtle differences in outcome focus (participants in the present paper highlighting experienced stigma rather than self-stigma as in Halsall’s evaluation, while both are acknowledged in Gillard’s work with peer support between adults) (24). The underlying reason for the differences here may be due to design (the preliminary ‘focusing’ purpose of the present paper with staff only less able to reflect on individual stories of self-stigma) rather than contextual programme variation.

Realist methodology represents a fitting approach for exploring what intervention contexts produce these outcomes and for whom. Professionals perceived that service engagement increases in response to careful matching of peers to children by reducing experienced stigma from others, advocacy by navigating barriers to services, use of shared interests between the peer and child to improve trust, and authentic empathy by developing a therapeutic relationship between child and peer. In contrast to these myriad routes to service engagement as an outcome of peer support, professionals articulated that hope was singularly generated by peers sharing their lived experience which may inspire other children. The mechanisms and outcomes reported in this paper resemble Gillard’s change model of adult peer support interventions (24, 25), albeit reformulated from a realist perspective (14).

Indeed, some caveats to how peer support interventions generate outcomes in different contexts were revealed by professionals, indicating when mechanisms may not be triggered when working with peers in particular service settings. In eating disorder services and when children are experiencing acute mental health problems, the problem of power imbalance between patient and clinical professionals (M) is not countered by triggering empowerment (M) due to staffs perceived risk of harm (disordered eating). However, the capacity for empowering children was nonetheless triggered vicariously by displacing power from clinical professionals to parents to manage wellbeing (O).

This study was concerned also with the peer supporter and the potential benefit derived from inhabiting and working within the role, for instance, peer support worker skill development benefitting their confidence with the potential for more distal outcomes for further education and employment. However, working with people experiencing distressing mental health problems can itself be challenging for professionals (32), and on this evidence, peers alike. The risk of peer worker relapse was acknowledged in our interviews with staff. However, the use of screening of prospective peers was limited in the study services. One potential ‘abuse’ of recovery-oriented (i.e., peer support) practices described by Slade concerns allowing contribution to society only after a person is recovered, which has been described as a ‘major injustice’ (33). Moreover, provided that the peer can fulfil the peer role (i.e., not functionally impaired by severe distress), the use of indicators of mental health stability may fall foul of disability and employment legal protections. Thus, the lack of screening reported by staff in this study fits within the legal and recovery-oriented framework prevailing in the UK, notwithstanding the likelihood that the stress of working may be preferable to the challenges of prolonged unemployment (9).

The effect of peer support on improved service engagement was welcomed across the professionals interviewed in this study. This is consistent with existing evidence (16). However, the local challenge of demand outstripping capacity in children’s mental health service provision in the West Midlands (7) risks programme failure due to ‘inappropriate contextualisation’ (where interventions do not work due to inhospitable contexts perpetuating problematic mechanisms). Namely, the use of peer support to increase service engagement may risk building up further unmet demand for support which could risk burnout or moral injury of peers employed within the healthcare system (34, 35). A recovery orientation underpinned by peer support is not justification for cutting service provision (33). Professionals interviewed in the study also refuted programme mechanisms leading to increased service engagement where children have the resilience to maintain their mental health recovery in their community using the community assets available to them while reducing service engagement.

The perennial debate on the relative merits of casual vs more formal professionalised peer support worker roles is broached again in this study and was similarly polarising (36). More specifically here, children’s capacity to navigate barriers to services may not be triggered by peer support where peers may be perceived by children as being aligned with the clinical team. This notion was also refuted by one interviewee who argued that children are likely to pick up on peers’ affiliation with clinical services regardless. However, it would be challenging to assess this even with further research with children and peers for whom service engagement is wholly deterred at the point of entry (rather than maintaining engagement).

The theory explored in this paper fits with processes set out in Leamy and Bird’s conceptual framework of personal recovery for adults which was raised in conversation with participants in this study (31). For example, when discussing children from UK ethnic minorities, professionals placed emphasis on matching peers to children (based on religion, ethnicity, gender, and age) to improve engagement by reducing experienced stigma associated with the interaction between peer support provision situated in the community. Similarly, Leamy and Bird highlight the value of belonging to a particular cultural group or community which is salient here particularly in relation to the age gap between child and peer (although the exact nature of the effect of any age gap by year is not explored in this paper) (31). Where the present paper departs – in placing peer support at the centre of enquiry – is a multifaceted appreciation of peer support that is explicitly interconnected with the other processes of personal recovery, namely inspirational (peer) relationships leading to hope for the future; overcoming stigma by matching children with similar children (peers); and inhabiting the (peer) supporter role to empower young people by validating their experiences and control over their care. Crucially, the realist approach beginning here attempts to do away with Leamy and Bird’s finding that the recovery journey can be a process of trial and error, throwing intervention component context into the wind and hoping it sticks. Such is life we might say. However, our responsibility as healthcare professionals, teachers, researchers, anyone working to improve children’s mental health is one of continual service improvement. Here we call for more research designed to uncover what works for whom and in different circumstances, and a little less trial, and a little less error.

4.1. Limitations

Though professionals in this study did raise wellbeing, hope and resilience as important outcomes generated by peer support, interviews did not draw out these outcomes as potential distal outcomes generated by service engagement. Given all that we know about traditional clinical care in mental health services, there is extensive evidence of some effect of peer support on these outcomes as well as other more traditional clinical outcomes. This omission was in part due to intervention context moving from peer support to the more traditional clinical intervention, which was not the focus of this study. However, this may not exclusively be the case. For instance, inclusive peer support culture and practices in organisations may further influence outcomes, including the potential impact for the presence of peer support workers to have an impact on clinician’s perspectives on the possibility of recovery for some patients.

Clinical psychologists interviewed in this study, will typically have been trained in and routinely work from a cognitive behavioural stance. Thus, much of what was discussed concerned cognitive and behavioural theory potentially to the exclusion of other relevant theory. There are two counterarguments to this as a potential limitation from a realist perspective. First, realist evaluation seeks not to generalise to every context (e.g., services taking a different therapeutic approach) where it may be inappropriate to do so. Rather, a realist approach is concerned with evaluation towards service improvement in a particular context. Therefore, if clinical psychologists in the UK tend to favour a cognitive behavioural approach and way of formulating patient experience, then there may be reasons for this position, and the realist evaluation therefore explores what is relevant to this context. Second, this preliminary realist data collection with professionals was developed to explore the views of a range of professionals, including professionals who are not psychologists who will not necessarily have been trained in the cognitive behavioural tradition.

Exclusively interviewing staff may not represent an appropriate sample for determining where peer support does not quite work (to better understand how peer support could work or how to better target implementation) due to organisational affiliation and a preference to avoid criticising peers or their service. Furthermore, ineffective interventions may result in children disengaging with services to the extent that staff do not always have the opportunity to learn why things are not working for some people in some circumstances. However, this study was not intended as a complete realist evaluation, rather a transparent approach to publishing details of initial programme theory development. Moreover, it is common practice in realist research to initially work with the professionals who organise programmes, because they are knowledgeable about the intentions behind their programme (14). Nonetheless, further research ought to engage with patients directly in a thorough realist evaluation to understand further what may and may not be working and why (13, 16).

These data lay the groundwork for designing realist research to evaluate with nuance the complexities of what components of peer support work for whom in varying circumstances. Peer support may represent a promising investment where workforce development in more inclusive services is warranted as in diverse communities in the West Midlands of the UK (7). Moreover, cumulative realist evaluation of such interventions in unique circumstances where implementation issues arise may help evaluators to explore different models of peer support delivery, and the association between demographics and workforce on service access and outcomes.

CHIME: Connectedness, Hope, Identity, Meaning and Empowerment; CMOC: Context-Mechanism-Outcome Configurations; DALYs: Disability-Adjusted Life-Years

Ethics approval and consent to participate

Consent for publication

Not applicable.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request

Competing Interests

The authors declare that they have no competing interests.

Funding

This project was funded by University of Birmingham Covid Support Programme.

Authors’ contributions

DT conceived the research and all authors contributed to the study protocol. DT contributed to recruitment, developed the online survey, and designed and conducted interviews. DT lead on analysis, and all authors contributed to final analysis. DT drafted the initial manuscript. JM provided oversight of the research design, conduct and analysis, and helped with final manuscript revisions. All authors revised the manuscript for important intellectual content and gave approval of the final version.

Acknowledgements

We would like to thank the healthcare professionals who kindly responded to the survey and spent time discussing their work. We would also like to acknowledge the contribution of our public involvement partners.

Lopez AD. Global burden of disease and risk factors. 2006.
Children’s Commissioner. The state of children’s mental health services. Office of the Children's Commissioner; 2020.
Reichert A, Jacobs R. The impact of waiting time on patient outcomes: Evidence from early intervention in psychosis services in England. Health Econ. 2018;27(11):1772–87.
Aceituno D, Vera N, Prina AM, McCrone P. Cost-effectiveness of early intervention in psychosis: systematic review. Br J Psychiatry. 2019;215(1):388–94.
Office for Health Improvement and Disparities. Health Profile for the West Midlands 2021. 2022.
Bell R. Psychosocial pathways and health outcomes: Informing action on health inequalities. 2017.
Hood A, Mulla A, Callaghan D, Moore E, Ward R, Jemmett T et al. Inequities in Access to Children and Young People Mental Health Services in the Midlands. 2021.
Repper J, Carter T. A review of the literature on peer support in mental health services. J Mental Health. 2011;20(4):392–411.
Davidson L, Chinman M, Kloos B, Weingarten R, Stayner D, Tebes JK. Peer support among individuals with severe mental illness: A review of the evidence. Clinical psychology: Science and practice. 1999;6(2):165.
Davidson L. The Recovery Movement: Implications For Mental Health Care And Enabling People To Participate Fully In Life. Health Aff. 2016;35(6):1091–7.
Perkins R, Slade M. Recovery in England: Transforming statutory services? Int Rev Psychiatry. 2012;24(1):29–39.
Ballesteros-Urpi A, Slade M, Manley D, Pardo-Hernandez H. Conceptual framework for personal recovery in mental health among children and adolescents: a systematic review and narrative synthesis protocol. BMJ Open. 2019;9(8):e029300.
Gopalan G, Lee SJ, Harris R, Acri MC, Munson MR. Utilization of peers in services for youth with emotional and behavioral challenges: A scoping review. J Adolesc. 2017;55:88–115.
Pawson R, Tilley N. Realistic Evaluation. London: SAGE Publications; 1997.
Halsall T, Daley M, Hawke L, Henderson J. Exploring peer support services for youth experiencing multiple health and social challenges in Canada: A Hybrid Realist-Participatory Evaluation model. Int J Qualitative Methods. 2021;20:1609406921995680.
Halsall T, Daley M, Hawke L, Henderson J, Matheson K. “You can kind of just feel the power behind what someone's saying”: a participatory-realist evaluation of peer support for young people coping with complex mental health and substance use challenges. BMC Health Serv Res. 2022;22(1):1358.
Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. 2020;395(10227):912–20.
Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. 2016;14(1):1–18.
Festinger L. A theory of social comparison processes. Hum Relat. 1954;7(2):117–40.
Bandura A, Walters RH. Social learning theory. Englewood cliffs Prentice Hall; 1977.
Bordin ES. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory research & practice. 1979;16(3):252.
Bowlby J. Attachment and loss: Volume II: Separation, anxiety and anger. Attachment and loss: Volume II: Separation, anxiety and anger: London:The Hogarth press and the institute of psycho-analysis; 1973.pp. 1–429.
Martin A, Buchheim A, Berger U, Strauss B. The impact of attachment organization on potential countertransference reactions. Psychother Res. 2007;17(1):46–58.
Gillard S, Gibson S, Holley J, Lucock M. Developing a change model for peer worker interventions in mental health services: a qualitative research study. Epidemiol Psychiatric Sci. 2015;24(5):435–45.
Thompson DM, Booth L, Moore D, Mathers J. Peer support for people with chronic conditions: a systematic review of reviews. BMC Health Serv Res. 2022;22(1):1–16.
Jisc. Online Surveys 2022 [Available from: https://www.onlinesurveys.ac.uk/.
Westhorp G, Manzano A. Realist Evaluation Interviewing – A ‘Starter Set’ of Questions 2017 [Available from: https://www.ramesesproject.org/media/RAMESES_II_Realist_interviewing_starter_questions.pdf.
Bellamy C, Schmutte T, Davidson L. An update on the growing evidence base for peer support. Mental Health and Social Inclusion. 2017;21(3):161–7.
NVivo qualitative data analysis software. Version 12 ed: QSR International Pty Ltd.; 2018.
Gilmore B, McAuliffe E, Power J, Vallières F. Data Analysis and Synthesis Within a Realist Evaluation: Toward More Transparent Methodological Approaches. Int J Qualitative Methods. 2019;18:1609406919859754.
Leamy M, Bird V, Le Boutillier C, Williams J, Slade M. Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J psychiatry. 2011;199(6):445–52.
Johnson J, Hall LH, Berzins K, Baker J, Melling K, Thompson C. Mental healthcare staff well-being and burnout: A narrative review of trends, causes, implications, and recommendations for future interventions. Int J Ment Health Nurs. 2018;27(1):20–32.
Slade M, Amering M, Farkas M, Hamilton B, O'Hagan M, Panther G, et al. Uses and abuses of recovery: implementing recovery-oriented practices in mental health systems. World Psychiatry. 2014;13(1):12–20.
Williamson V, Murphy D, Phelps A, Forbes D, Greenberg N. Moral injury: the effect on mental health and implications for treatment. Lancet Psychiatry. 2021;8(6):453–5.
Čartolovni A, Stolt M, Scott PA, Suhonen R. Moral injury in healthcare professionals: A scoping review and discussion. Nurs Ethics. 2021;28(5):590–602.
Faulkner A, Basset T. A helping hand: taking peer support into the 21st century. Mental Health and Social Inclusion. 2012;16(1):41–7.

Table 1

Service settings and programmes
#	Service type	Location	Modality*					Programme
#	Service type	Location	F2F	Online	1:1	Group	Mutual pairs	Programme
01	Charitable organisation partnering with NHS	Currently North Birmingham - plans to expand to cover WMCA	X			X		Four-week co-designed interactive peer support. Sessions focus on themes (self-esteem, resilience, confidence, identity, stress, peer pressure) with journal entry and 12-month follow-up. Informal peer support between children encouraged between appointments and after completion of programme.
02	Local authority (public health)	Walsall	X	X		X		Not reported
03	NHS CAMHS (Child and adolescent mental health services)	North staffs and Stoke	X	X	X		X	Peer-delivered talking therapies
04	NHS, Early Intervention in Psychosis Service	Birmingham	X		X	X		Sharing of lived experience, including treatment experience to provide hope. Organisational involvement through providing patient voice in service team meetings, recruitment interviews and liaising with other organisations.
05	NHS mental health service	Solihull	X	X		X		Patients are involved in co-facilitating some groups (psychoeducation, carers & relaxation/self-care/mindfulness groups), offering input in quality improvement initiatives and recruitment interviews.
06	NHS Early Intervention in Psychosis / Community Recovery teams	Coventry and Warwickshire	X	X	X			Peers use their lived experience and recovery to build a relationship with the person they are working with to build hope and a sense of connection. They develop recovery goals, and use wellness and recovery action plans and problem-solving.
07	NHS Forward Thinking Birmingham	Birmingham	X	X	X	X		Peer support focusing on physical health and wellbeing; recovery groups; and support into social inclusion activities, education, training and employment
08	Charitable organisation partnering with schools	Walsall/Wolverhampton/Dudley and Sandwell.	X		X	X	X	Training (including certificates) and ongoing monthly support
09	Peer Mediation		X			X		Peer support guided by mediation resource packs.
10	Charitable organisation	Coventry and Warwickshire	X		X	X		Peers use their lived experience as the basis of support, complemented using 'walk and talk', focus on the interests and needs of the service user (i.e., cooking, safety planning, setting goals & helping to empower & build confidence)
11	Secondary school	Handsworth, Birmingham	X		X			Peers who listen, advise, and signpost.
12	NHS Eating Disorder Service	Birmingham	X	X	X	X		Peer support focused on recovery and relapse prevention, including co-facilitation of clinical group work.
13	Private company	West Midlands	X	X		X		Deliver training around how to get children and young people involved at all levels in the running of service; and training around the specific mental health needs of disempowered and diverse groups (LGBTQ+, neurodiverse & people of colour) as well as diagnostic specific training (Eating Disorders & Personality Disorder).
14	Private company	Online (West Midlands)		X		X		Anonymous and moderated online peer support community, including articles written by peers and professionals to help inform and educate on a range of mental health and wellbeing topics. Moderators signpost to in-house Emotional Wellbeing Practitioners and counsellors for 1:1 support
* F2F (Face to face); 1:1 (One to one)

Appendix 1 is not available with this version

Additional File 1 is not available with this version

No competing interests reported.

Download PDF

Version 1

posted

You are reading this latest preprint version

Focusing a realist evaluation of peer support for paediatric mental health

Status:

Version 1

Abstract

Objective

Methods

Results

Conclusion

Figures

1. Introduction

1.1. Background

1.2. Aim

2. Methods

3. Results

4. Discussion

5. Conclusions

Abbreviations

Declarations

References

Tables

Appendix 1

Additional File 1

Additional Declarations

Status:

Version 1