The results are presented in two sections. In the first section, we describe the key activities involved in the three stages of PAR to pilot the model. In the second section, we present the analysis of the experiences of participants involved in the PAR process.
Description of the PAR process
The PAR process case description covers activities in the three stages of PAR, each with cyclical activities of plan, act, observe and reflect (See additional file2):i) Establishing partnership, capacity building, and prioritization exercise, ii) program development and action planning, iii) Implementation and process evaluation.
Stage 1: Establishing a partnership, capacity building and prioritization exercise (March-2018-August 2019)
During this first stage, we established the RPG and RAG. In our ToC, building capacity of stakeholders was a key intervention to facilitate involvement(9). Accordingly, prior to involvement and during the PAR process, the stakeholder groups were equipped and empowered through participatory training and consultative workshops. The trained service users and caregivers established a service user association with 24 members (12 service users and 12 caregivers), the first grassroots association in Ethiopia. We also convened three consultative workshops and capacity building sessions to create a receptive community environment, involving engagement with diverse stakeholder groups in addition to the RPG and RAG (n=47);See Table 4 for stakeholder characteristics. The objectives of the training courses, consultative workshops and activities are briefly summarized in Additional file 3.The stakeholders collaborated with the researchers throughout the PAR process and actively contributed to the success of the study as insiders, being members of the community (See figures 1-3).
Table 4.Characteristics of stakeholders in the study
Types of Participants
|
|
Characteristics
|
|
Number of participants
|
Gender
|
Age range
|
Highest formal education
|
Workshop 1
|
Workshop 2
|
Workshop 3
|
Male
|
Female
|
18-29, 30-49, 50+
|
None, Primary, Secondary, Tertiary
|
Government sector office leaders
|
8
|
16
|
18
|
13
|
5
|
18-30(3), 30-49(13), 50+(2)
|
BSC/BA(11), Diploma(6),MSC(1)
|
Community institution leaders(Idir leaders, Religious and faith-based)
|
6
|
-
|
3
|
7
|
-
|
50+(7)
|
Non-formal (4), BA (2), Diploma (1)
|
Health professionals
|
5
|
6
|
6
|
3
|
3
|
18-29(3),30-49(3)
|
Diploma(1), BSc(5)
|
Service-users
|
14
|
9
|
11
|
5
|
9
|
18-29(5),
30-49(5), 50+(4)
|
No literacy(4),None(3), primary(7)
|
Caregivers
|
14
|
6
|
8
|
7
|
7
|
18-29(3),30-49(9), 50+(2)
|
No literacy(7) None(1), primary(5), secondary(1)
|
Total
|
47
|
37
|
46
|
35
|
|
|
|
Table 4 about here
To identify which specific aspect of mental health system strengthening was a priority for action, we convened a two day prioritization exercise with the stakeholders (n=37) using principles of PAR based on Nominal Group Techniques, as detailed elsewhere (12) and summarized in Figure 1. Participants identified their top ten concerns, which included multilevel lack of awareness about mental illness, and stigma and discrimination at the top of list (See Additional file 4).
Figure 1 about here
STAGE 2.Programme development and Action planning, September -December 2019
The purpose of this stage was to develop interventions and action plans based on the priorities identified in stage 1. Members of the RPG, SA and a research assistant worked together over eleven biweekly sessions, each approximately two hours long, to explore the priorities in more depth, selected a priority, develop an intervention and action plan(See Figure 2).
Figure 2 about here
Stage 3. Implementation and process evaluation, December 2019-January 2020
In stage3, the RPG conducted reflective and implementation strategy development sessions on how to apply the plan into doable action and reconvened a one-day consultative workshop (December 2019) with a broad range of stakeholders (See Table4, workshop 3). An overview of stage 3 PAR processes is summarized in Figure 3.
Figure 3 about here
Experiences of RPG involvement in PAR processes
In this section, we present the findings of the case study about the experiences of members of RPG involved in the pilot model. All service-user participants had a confirmed diagnosis of psychosis/bipolar, epilepsy, or alcohol use disorder (See Table 5 for demographic characteristics).The thematic analysis resulted in four main themes, illustrated with sub-themes and key codes in Figure 4 and also see Additional file 5 for more illustrative quotes.
Table 5.Demographic characteristic of RPG members
Characteristics
|
Frequency
|
Gender
Male
Female
|
6
6
|
Age range
23-30
31-39
40-49
50+
|
4
3
3
2
|
Highest formal educational attained
Non-literate
Primary school
Secondary school
University
|
4
4
1
3
|
Diagnosis
Depression
Schizophrenia
Bipolar disorder
Alcohol user disorder
Epilepsy
|
1
2
1
1
1
|
Length living with mental health condition/service
3-5
6-10
11+
|
5
5
2
|
Figure 4 about here
Participants’ expectation and motivation for involvement
The various reasons for participants’ motivations and expectations were captured using two subthemes: prior experiences, and desire to learn and contribute.
Prior experiences of involvement
Prior to this study, none of the participants had experiences of active involvement in research. Many of the participants mentioned their experiences of involvement in the capacity building training delivered to prepare them for the current role or the ToC model development/refinement processes leading to this study (P1, P2, P3, P5, P6) as a favorable experience that motivated them to join the current study.
I have never been engaged …except participation in interviews. I had experience of participation only related to this study…to Addis Ababa two times where I shared my experienced on large meeting at big hotel…When coming to this group I was expecting that they have planned to expand that more (previous capacity building training)…I expected that they might have planned to organize service user more so as to achieve our goal… (P2)
At the beginning, some participants had low motivation and were skeptical about the value of being involved, which was explained in relation to lack of prior experiences of active involvement or unpleasant experiences of involvement. However, their motivation gradually improved after getting clarification about the objective, making sense of the relevance of the activities to improve their life and opportunities for active participation. For example, two participants described:
…at the beginning I was not that much motivated and expected something good. I appeared only to sit and see what would happen ... I had some concerns in the previous training, which was too long (whole day), very intense and was a bit boring. …[But] as sessions progressed, I realized that the PAR is actually doing about my own problems, we [the group] discussed and worked together something important for people with mental illness...Finally I said to myself “I should actively participate”. (P1)
“I was expecting them (researchers) to ask me questions as they usually do. But this [work] was very different from the previous, we developed a roadmap, established a user organization and developed action plans. I am very happy. Totally different, I get what I did not expect; very interesting thing”. (P6)
Desire to learn and contribute something valuable
The common thread among many of the participants regarding their key motivation to get involved was wishing to gain more (personal or professional) knowledge and skills that could help them to address issues related to mental health conditions, help others, and address deficits within the healthcare system. Many of the participants expressed emphatically a desire to engage in advocacy and to improve multifaceted injustices experienced by people with mental health conditions (e.g. stigma and discrimination, chaining). Some participants’ motivation was rooted in their own painful lived experiences and observations of how badly people with mental health conditions have been treated at home, within healthcare systems and the community (P2,P3, P6, P7,P9).
…I felt pain when observing many service-users suffering just like I used to. I felt a sort of like the same bad experience. I have been in the same situation for 10 years. Now thanks to God I have passed that bad stage. So I want to contribute. I want to make things better for those suffering with mental illness (P2).
Experiences of the social dynamics in the PAR process
This theme illustrates how participants experienced and described the active participation, inclusiveness, and respectfulness of the team atmosphere in the PAR process.
Experience of activeness and inclusiveness of the PAR process
When asked about personal experiences of and others active participation, and inclusiveness of the PAR process, many participants narrated details of activities they had engaged during the training and ToC development process in previous years(P1, P3, P4, P6). Many of the participants described the process gradually progressed from passive participation at the earlier sessions to more active, and inclusive participatory process overtime as described in the following account.
“…In my group (caregivers), the participation of all individuals was not the same. But we used to let everyone to express idea to his/her level of understanding. Everybody contributed to his/her level of understanding. There was no situation where anyone was passive observer and other individual dominate the discussion...everyone contributed his/her opinion. That was how we used to run the group discussion”… (P1)
Many of the participants appreciated the techniques used to enhance interactive involvement (e.g., small group discussion, reflection sessions) as well as the facilitation process to accommodate all viewpoints by encouraging all participants to share ideas, find solutions, freely interact with each other and make decisions during the PAR process. For example, participants described the process as follows:
“The facilitator…‘operated’ very well to bring all together and discussed in a way that made all open to discuss idea. So my feelings were generally very positive about it [group technique]. I used to anticipate the next session eagerly”.(P3)
“I appreciated… used to encourage high level of involvement of all participants in the PAR process… accommodated everyone to have chance to express opinion. I think everybody got a time to reflect opinions. That is one of the reasons I committed and stay engaged in the PAR process”. (P5).
Many participants spoke about the logistical practicalities, including the convenience of the time and place of the PAR sessions, and financial compensation for their time (P1, P2, P10, P3, P11) as key factors for their active participation.
“… We utilized our time efficiently; because we come on time, engage in the discussion effectively and complete on time…because we scheduled it [the meetings]during public holidays (out of our working time). We used to meet two days per week for two to three hours, which was very easy contribution of time". (P1).
The experience of active inclusiveness of the PAR process was not homogeneously reported by all participants. For example, one participant noted that: “there was one participant who did not say anything” P3,and expressed concern that potentially articulate participants were not recruited. Some participants expressed some challenges encountered in group activities that involved writing and reading because of their low literacy (P2, P6, P7,P10). However, they appreciated the oral reflection and use of various techniques that helped them to get adequately involved.
…our involvement is very active…although that was challenging to me when that required doing it in writing…although we cannot write we effectively contributed in the discussion and generating ideas (P7).
RPG perceived outcomes/benefits of the PAR process
Linked to their involvement in the PAR process, the participants described experiences of positive outcomes/benefits at personal, social, research and healthcare service.
Personal benefits
All the participants made positive comments and reported personally gaining from being part of the PAR process in terms of improved knowledge and skills, self-confidence, health, and feeling of achievement and contribution.
Almost all participants spoke of gaining knowledge about mental illness, treatment, and about managing mental illness during PAR sessions from each other, and education delivered by professionals. Some participants particularly appreciated the discussions with RPG members outside of the clinical context. The value of critical reflection instilled into the PAR process enabled them to uncover issues which had received inadequate attention and gain a deeper understanding of service users` expectations, unmet needs and the gaps in the healthcare service and their own gaps (e.g. inadequacy of information about medication use, lack of focus on physical health).
“There was a lot of education in the group…we discussed ideas, freely exchanged ideas in small groups. We exchanged education from the facilitators and our presentations…The education works for service users... We can identify people chained at home through education….I got additional knowledge…. Now I can teach my neighbors during coffee ceremony and at work place. I advised them to go to healthcare service and take medicine and medicine can help for recovery. Now I am teaching how to safely use medicine”. (P10).
Some participants spoke about improved communication skills (writing and public speaking) through the writing and reflection during the group sessions, public dissemination and public speaking, and developing research skills that could be immediately applied in their daily lives or professional development.
The PAR process taught me a lot. First, I noticed that I can generate useful ideas from beginning to the end of all sessions; there were several thought provoking ideas discussed during the research process that creates ‘Ha!’ here am correct and I have created sense of being of value. Second, I have gained knowledge about how to develop action plan; how to start planning, with whom to work, about sources of support…HA! … This is not only for the study, but it is very important for personal life. I have learned how to live planned in my personal life. (P3)
Some participants described health related benefits such as improvements in their mental health or healthcare habits/coping mechanisms and improved social life. For example, some participants reported increased medication adherence and visiting healthcare service more often (P2, P9), reducing (P1, P9) or totally stopping (P4) alcohol consumption, observed others stopped drinking alcohol while taking medication (P1), improved self-and others care (P2,P7, P10), reduced family (P4) or neighbors disturbance (P7). Some participants mentioned that participation in PAR process offered them a platform to exchange experiences with people who have similar mental health conditions, which helped them in terms of reduced feelings of depressed, worries or anxiety (P2,P6), combating loneliness (P6,P7, P8,P9), improved satisfaction with life and hope (P2, P6,P7, P9), being able to comfortably talk about mental illness (P2,P6, P9).
I have developed the confidence to take medication without fear of side effects. I am taking advice from health professionals about all side effects…I have great improvement after getting this experience in many aspects of my life. I have improvement. I am happy. I have hope. Thanks to God now I am health. I have recovered in health… I am relaxed... Thanks to God…I have passed that difficult/crisis time, that dark time; now I am in light… (P2).
The participants reported that involvement in the PAR processes positively influenced them in terms of improved self-confidence, which was evident in some participant comments about the personal changes in their capacity to communicate in situations outside of the group sessions:
…That helped her very much. She had no training before and lacked knowledge; after the training and involvement in the research she gets improved much more. For example, before she did not speak more in public, now she started expressing herself very well in group discussion; … I saw her asking and speaking in social association(Idir)…,during coffee ceremony at home and neighborhoods she started teaching about the causes and problems of mental illness. … (P1)
All participants reported that the PAR process was a valuable investment of their time working together to address issues of relevance to themselves and that directly impacted on mental health service improvement. The participants mentioned the action plan developed to raise public awareness, the establishment of service user association, and to empower the association as their valuable contribution, which they expressed as sense of achievement, contribution, and agency:
“…We become united… because of the participation in the research group we have got freedom, now we are organized as service user association…we started saving money in bank…we started saving that can strengthen our relationship. I am very happy”. (P2)
“…One of the hopeful gains is the established service user association. More than what we put in our stomach (eat) and pocket, better to support this hopeful organization. We are expecting the licensing of the service user association”. (P7)
Social benefits
The participants mentioned the opportunity to meet other people, combating loneliness and engagement in important activities and improved social acceptance as key social benefits of their involvement in the PAR process. Some participants expressed their experiences of living alone or having very limited opportunity to get out of home to interact with other people outside of their family circles (P2, P7, P8,P9). Some placed high value on spending time together and the positive experiences of the informal interaction and laughing (energizer in-between sessions), sharing ideas and experiences during the PAR sessions. Some participants explained the value of the PAR process looking back to the painful experiences of feeling ignored by people who were close acquaintances, including family members.
“…I consider participation in this group as my rebirth. This is the chance I missed in my entire life. … I have been a person discriminated and neglected for a lifetime…Now other people started appreciating the improvements observed in myself; they are saying to me “you are really getting young”. They say “she becomes new person… improved” talking at my back. When I hear this, I feel deep satisfaction... I keep my hygiene, dress very well and enjoy with my children. I dress my hair well and just I am free. Thanks to God…This is new beginning of my life…” (P2)
“…This helped me to improve my relation and communication with people; the value people give has improved. This makes me happy… I developed skills of participation with people, sitting with others and working with others. I used to pass time locked up at home; passing time here is very interesting. This is leisure time and recreational…there was no such opportunity…this helped me not to remain hidden or neglected. Here I have freedom to share my ideas. I have nice times here…”. (P8)
Some participants (P2, P3, P4,P6, P7) spoke about social acceptance and improvement in public attitude towards them.
“…I have received feedback from different people. I have presented the finding of the research to representatives of different community and government offices. Our findings touch every sector, gender office, health office, psychiatry and others. People appreciated my presentation and commented that I was unnecessarily quiet for too long. There were good things”. (P3)
Benefit to research and the health care system
When asked about what their involvement in PAR benefit or potentially contributed to healthcare improvement, the participants mentioned many examples of activities during and after the PAR process that could improve mental health services. For example, some participants reported volunteering in various activities, including giving support to people with mental health conditions(peer support), e.g., finding cases and supporting them to access healthcare (P1,P2, P7), and giving education and advice (P1,P3,P7,P10).
“…In addition to the lesson I get here, I shared a lot from my lived experience to change and motivate people to take their medication properly. In my neighborhood I have supported many people to take medication properly and told them that they could recover through proper use of medicine. Even if the patients resist taking the medicine, caregivers need to help with the medication [of a family member] through negotiation. For many people, I personally, gave education. I have tried all my best”. (P10)
When asked about any improvements in the hospital or healthcare centers after their involvement in the PAR process, some participants who had chances to visit the health facilities expressed their observation in improved receptiveness and healthcare service delivery.
“...We have clearly discussed with health professionals about their problem in patient care, receptiveness, medication availability and …we discussed many issues. After I got involved in the research I had visits to the hospital for another individual and for my child, and I noticed that they are doing well…There is some improvement that can be appreciated”. (P6)
The health professional participants also spoke about readiness to apply the knowledge and skills they gained from the PAR process to improve the healthcare service delivery (e.g., the way they diagnose and treat patients, provision of sufficient information).
“…Before involvement in the research, health professionals had self-distancing or pushing behavior towards mental health service users. We (health professionals) used to say the psychiatric nurse`s (…named) people came (mental service users)… consider only the psychiatric nurse in charge of the mental health service. More recently we are working with him at the psychiatric unit. This collaborative work needs to be strengthened”. (P5)
Some participants (P1, P3, P5) mentioned that the increased involvement and collaboration of the diverse local stakeholders’, political officials` willingness to undertake empowering actions for service-user involvement and promises to solve problem of availability of medication could be an important initiative towards improving the mental health service.
“… If we are able to work sustainably with these stakeholders including religious institutions, schools teachers and students we can bring change. The community stakeholders who participated in the workshop can support and build capacity. The hospital management body, including the medical director and CEO participated in the final stakeholder consultative meeting and discussion on research participant group findings’ dissemination. They have agreed to integrate the research participant group in the health education mainstream routine of the hospital”. (P5)
“…There is some change; now a roadmap has been developed with stakeholders. A range of stakeholders that included religious leaders, education sectors, community associations (Idir), health professionals and all others received some training. Now, there is good beginning. (P1)
Implementation challenges and recommendations
When asked about challenges experienced during the PAR process, most participants gave neutral responses, e.g. ‘no problem ‘or ‘everything is ok, or no need for modification’ and only few participants (P1, P3, P5, P6, P7) made comments about ways to improve the study, which focused on the need to cover wider healthcare areas and involve more participants, and enhance support for the service user association at follow up.
However, when asked about what support they would need for strengthening service-user involvement, the participants mentioned various logistics, funding, systemic and organizational constraints to be resolved. As an immediate challenge, the participants mentioned logistical problems (meeting places/office). The participants also stated the need for financial support to cover engagement related costs, including time compensation and transport costs for members who could be involved in future PAR activities, as well as the need for more capacity building and training materials for community awareness-raising to pursue their next action plans.
All participants had deep concern regarding the long time taken by district officials to reach a decision about licensing/registration of the new service user association. Some participants also noted that mental healthcare was not effectively integrated within the healthcare/hospital settings, where there are general health workers trained in first line mental health care.
“I repeatedly visited the relevant administration office in the district to facilitate the registration of the association. But it is still challenging and took a lot of time for them [administrators] to respond and endorse the registration of the service user association. There was little practical support and I have completely giving up hope. I find that they are not moving as they promised during the workshop”. (P4)
“There is a tendency to push the healthcare service for people with mental health conditions to the psychiatric nurse alone. There are trained professionals in mhGAP, but are not appointed to the psychiatric service unit…the system has been working as it was for years… (P5).
The participants (P1, P4, P6, P7) suggested for expanding the scope of the study, more collaborative working at different levels within the healthcare system, enhancing stakeholder collaboration, community mobilization and addressing mental health medication problems to support the initiative sustainably.
“The current study was a bit narrow. First, it seems it had limited budget to involve more people over longer time. This is one important area that needs improvement. Secondly, the political leader should make mental illness a mainstream routine activity. Unless mental illness was supported with political leaders and government, this research group alone with external assistance… may not last long …and be able to bring sustainable change…Government has to put their hand in this initiative… Therefore, as ownership to these initiatives our local government needs to give attention, allocate budget, take it as mainstream agenda, otherwise I do not think this would be sustainable…the involvement of political leaders in this initiative need to improve”...(P1)