Study participants described barriers and facilitators to capacity building within three broad themes: 1) training, 2) supervision, and 3) quality assurance. Responses regarding training, supervision, and quality assurance highlighted the importance of these activities as well as the challenges that arise during their implementation. Running throughout these thematic areas were the crosscutting themes of contextual understanding, human resources, and sustainability. Additionally, participants described approaches and mechanisms for successful capacity building which are summarised in Table 1.
Training
In relation to training, factors such as appropriateness and acceptability, retention, and time emerged as well as differences between training health sector and non-health sector providers. ‘Provider’ here is defined as mental health service providers, with ‘health sector’ referring to specialist or non-specialist health workers and ‘non-health sector’ referring to those in other sectors such as education, or lay workers such as peer counselors or traditional healers.
Training of Health Sector Providers - Barriers
Many projects focus their training efforts on providers that function within formal health system settings (e.g. clinics or hospitals) but do not have specialized training in mental health (e.g. nurses or primary care doctors). Participants reported health system pressures and competing priorities as challenges to training these providers. In LMICs, high caseloads and multiple responsibilities are often spread across a limited workforce. This can make pulling health sector providers away from existing duties for initial training difficult. Afterward, integrating mental health training into practice within health systems can be challenging due to competing pressures and priorities:
“Training health workers – what does that mean? The health system[s] in low- and middle-income countries are not working, so every project starts with strengthening the system by at least training people. But is that the solution? I feel it is a short-term solution, because you have people trained, but no other supporting environment.” (Participant 19)
Contextual factors were reported as challenges to both receptivity to training and the ability to carry out trainings as planned. These ranged from gender norms influencing willingness to participate, to security issues and conflict preventing travel, to extreme weather events:
“So, the trouble was that as soon as we finished the first two days of training, there were the terrible floods... So, everything was impacted, some of the computers got destroyed… so what they did was they moved the whole operation of training higher up… and they basically did it out of make-shift places.” (Participant 25)
Differences in knowledge and beliefs also hindered training efforts. Stigma, unfamiliarity, and feelings of discomfort related to mental health and related topics such as human rights can present a challenge, especially when paired with the complexity of mental health issues that must be conveyed within the limited amount of time available for training health workers.
Training of Health Sector Providers - Drivers
Two themes emerged relating to drivers for training of health sector providers. The first was the importance of motivation. Participants mentioned finding highly motivated people with an interest in mental health as an important contributor to the success of training. Many health workers were motivated by the offer of professional development opportunities and recognized the lack of mental health training otherwise available. The second theme was the importance of factors promoting the sustainability of training and the continuation of effects of training. Integration of mental health training for health sector providers into existing programs and curricula promotes this element of sustainability, as does selecting and training health workers who are connected to their communities:
“…one thing that might be positive in the long-run is the role of the [providers] becoming mental health workers, because they’re not going to go away once the intervention is done. They’re going to have the mental health training, and they’re going to remain in the community, and they’re going to make a connection to the people that they’re working with…” (Participant 12)
In addition to health sector providers’ motivation and connection to communities, attaining buy-in from policy makers was a key driver of sustainability and long-term success of training:
“We want primary care doctors to take ownership of this, so it’s very exciting for me that we’ve got to a stage where the directorate of health is saying, ‘Yes, please come and train them,’ so it’s the first step, and we are kind of hopeful that this will help to scale up one component of the program through the directorate of health services, without having to put in any extra funds." (Participant 17)
Training of Non-Health Sector Providers - Challenges
The types of non-health sector providers mentioned by participants were diverse, and included schoolteachers, traditional healers, and general community members. This diversity sometimes presented difficulties, as skills and competencies among lay providers varied, and trainers sometimes found it challenging to tailor training to ensure consistent outcomes when baseline skills, competencies and experiences were so different.
Once training has been completed, there remains a challenge of maintaining quality and fidelity. Participants expressed concern regarding retention of skills as well as adherence to the intervention protocol among non-health sector providers, even when competency is ostensibly sound:
"We do pre- and post-training testing for competency. Of course… intervention enactment is another thing entirely. Yes, it’s not hard to recognize depression, they know how to treat, they are very good at it, so they are competent, fine. You clap for yourself, ‘Oh you’ve achieved so-and-so competency.’ But when it gets to doing the work, are you sure they are going to do what you want them to do? Even when you are not there? It’s another thing entirely." (Participant 21)
For some non-health sector providers, there are system pressures and priorities that differ from those of the health system, therefore presenting their own unique challenges. Bureaucratic structures and requirements in non-health sector public systems were burdensome and often caused delay of training:
"… you have to book things way in advance. Even for one of the [providers] to come to our training they had to have a piece of paper that came all the way from the [system administrators], all the way down to the [facility] and then to the [provider] itself [sic]. So, for every session that they attended they had to have all this paper work done." (Participant 9)
Training of Non-Health Sector Providers - Drivers
Like with health sector providers, the benefit to sustainability that training local non-health sector providers offers was mentioned as a driver for success. Specifically, investing in capacity building at the local level was an important factor in the promotion of sustainability:
“What we want is actually to build their local capacity, so they can take it forward, because they are there to stay… So even if the project has stopped right now, they have those skills, they have those learnings, so they can continue working at least in their own community…" (Participant 22)
Fostering collaboration instead of competition between non-health sector providers and the formal medical system was also important for participation. This form of engagement provides an opportunity to tap into existing roles and capacities of providers such as traditional healers and religious or community leaders:
“…the good thing about [religious leaders] is that they’re going to do this anyway and this is what they’ve been doing, so there’s no need for additional resources really because we’re not asking them to become mental healthcare workers, we’re just asking them to add this [training] with whatever else they’re using in the way that they do it.” (Participant 29)
Capacity building of non-health sector providers at the local level also aids the scale up of mental health projects and the management of difficulties such as geographical challenges:
“Now if you are talking about scale, in one council there are about fifteen villages and you know there are rivers, there are mountains, the trains they are not connected, and everything like that, so there could be no one person roaming around and doing everything. So, you have to be innovative about it, and again, there were people who come from within the community, who said, ‘OK, you train us in supervision, we’ll do it, and we’ll roam around.’ Yeah. So, this is how adversity creates innovation!” (Participant 6)
Another driver of successful non-health sector provider training was the utilization of an iterative process. As a project progresses, ongoing learning can be used to hone training and selection processes over time, resulting in better training outcomes:
“But I think at the end, when we put people through the third round of training, the output was far better than the first two rounds… Initially we would just take anybody who was interested, right? Because we wanted to try it out. I think by the third time, we became better at selecting counselors who had the necessary skills to be good counselors.” (Participant 7)
Training: Appropriateness and Acceptability - Challenges
Participants noted the difficulties that cultural differences can present regarding appropriateness and acceptability. The varying acceptability of intervention specifics such as talking therapies or the shifting of traditional roles or views can challenge receptivity to training:
"There’s so much of these therapies that are really western in thinking, right? And they’re not, it’s not that they’re contradictory to the culture but they’re a little bit [different] than the ordinary thinking. That’s a shift, so it took our teachers a while to actually understand that, and I think we should give them the time to absorb this stuff, to repeat it.” (Participant 9)
Training and service delivery must also be perceived as meaningful or beneficial to providers to ensure uptake and follow through post-training:
"The health workers are going to be the ones who do this. You cannot force them, and you have to listen to them. Because you can’t just sit down here and have a ritual and think this is going to work… No. They just won’t do it. To them, it’s just one project, within a year you move on with your project, they stay, they’re still there in the health center. If you’re not going to change their life or make things easier for the health workers, they probably won’t support you." (Participant 21)
Training: Appropriateness and Acceptability - Drivers
Regarding appropriateness and acceptability, participants also emphasized that adapting training to the local context was essential to success. This did not stop at translation, as adapting to the best manner of communication for the target audience meant more than just speaking in the same language as trainees:
"The critical thing that actually transformed it was when we got the first [leader] that we worked with, who was implementing the techniques in her school, to come and address them in their own language… we realized that different technical groups speak completely different languages, and if you are not careful you lose a lot in the translation… we had groups where even the senior educators don’t necessarily speak the language of the teachers." (Participant 28)
Training: Retention - Challenges
A common theme among participants was the difficulty of retaining a skilled workforce. A lack of mobility, career progression, and further opportunity in mental health contributed to movement towards better opportunities both within their country and outside of it. Participants emphasized that this was especially prevalent in settings with weak health, education, or economic systems. In some cases, capacity building itself threatened retention, as trainees became more eligible for outside opportunities:
“…people who are trained will always have a huge turnover rate because in those environments they make far less than they would make in a middle-income country or a high-income country. So there’s no incentives for them to stay…” (Participant 29)
Low rates of retention, and the additional trainings that were therefore necessary, resulted in larger numbers of trainees and further inputs required to overcome turnover– proving burdensome for project teams:
"The first training we did, I believe we trained 15–16 people but at the end we were only able to retain six, which meant that we then had to train double the amount of people that we needed. By the last training we trained three times as many people as we actually ended up with… and the amount of time and effort we put into capacity building and HR was a huge bulk of our time spent" (Participant 7)
Training: Retention - Drivers
Alternatively, in some cases the projects provided meaningful work for well-educated people in contexts where there were low employment prospects or high rates of unemployment:
“…there were only two [lay health workers] that actually left the project before it was over. So the retention was not a problem. We said in our requirements for a lay health worker that they had to have high school education. Everyone who applied had at least some college… so it’s a reflection on more the lack of employment, especially in rural areas.” (Participant 22)
Providers finding meaning in the work—for example by seeing improvement in patients, or by training providers from (or with significant connections to) the target communities—were also drivers for success more generally:
"So then our group leaders are able to see the change in these women’s lives that they’ve facilitated so it’s a highly rewarding job. We have 23 facilitators today, next year we’re hiring another 25, we’ve never had a single group leader quit yet." (Participant 15)
Training: Time - Challenges
Challenges related to time served as barriers for both implementers and recipients of training. For implementers, capacity-building activities take time and delays cannot always be anticipated, often because of challenges mentioned earlier. This can lead to inconsistencies between reality and project goals or timelines, putting pressure on budgets:
“…we were supposed to train 320 primary health care workers… but the project was stopped for three months, and by the time it resumed, we had to retrain everybody all over again. So that, we spent so much money in trying to do that." (Participant 21)
Similarly, the amount of time required to attend training sessions can be challenging for service providers due to both work schedules and other competing demands on time:
"Getting staff to be relieved from their regular work to attend those trainings is very difficult because most of these facilities work with very limited number of staff and so if you had to run a training… that can impact the service, so finding staff time has always been the most difficult part of doing the training." (Participant 1)
These project timelines, service provider pressures, and challenging contextual factors mean that the limited available for training may not be sufficient to address more nuanced aspects of mental health—especially for health workers or other providers who have limited prior knowledge or training in mental health:
"…this is what is so different about mental health skills. Because these skills are internal skills as opposed to a drug or a surgical procedure… so it takes a little bit more time to absorb that, so that’s one issue, that we’re trying to find ways of actually shortening the learning curve..." (Participant 9)
Training: Time - Drivers
The one driver for success mentioned by participants regarding time was shortening or breaking up training sessions, e.g. holding half-day sessions instead of full-day ones and integrating them into other training or routine activities. This made training providers with competing demands more feasible:
“This can be used in any kind of low or medium-income kind of setting, because the training is not too difficult… just two days of training for the maternal providers, they are able to do this a little bit more seamlessly within their routine provision of care." (Participant 21)
Supervision - Challenges
Two major factors were identified as challenges for supervision. The first is the scarcity of human resources for management and supervision. The existence of these projects and their capacity building components is usually a result of the lack of human resources for mental health and often for health in general. This can make finding existing staff with the required skills for supervision difficult. Health providers may also be reluctant to take on the additional work and responsibilities attached to a supervisory role:
"…the whole idea was that we would train these medical officers to... to monitor and supervise the health workers… but they were not really interested or keen on getting an additional task being added to their worklist, because they’re generally seeing like 50–100 patients in a few hours’ time… But we’re doing all of this because we don’t have enough psychiatrists." (Participant 17)
Logistical challenges often further complicate supervision models. Beneficiaries of these projects and the providers trained to reach them are often spread-out or in different locations than suitable supervisors. This can make common methods used to meet human resource challenges such as group supervision more difficult.
Participants also mentioned how resistant providers can be to supervision due to differing understandings of the practice or previous experiences with supervision. This can lead to the interpretation of supervision activities as critical or unhelpful rather than constructive.
“When you try and talk about supervision, people think you want to scrutinize them. Checking their things, checking on their weakness, checking on things they did not do. This is the way many people perceive, in the beginning, supervision… When they realize that what the supervisors were doing is not related to their first perception, to their beliefs, they realize that having someone supervising is more helpful than harmful.” (Participant 20)
Supervision - Drivers
The importance of investing in supervision and fostering strong relationships between supervisors and staff came up frequently. Respondents cited the utility of supervision for showing support and for monitoring the increase in skill and knowledge to ensure that providers are ready for greater independence. However, finding a balance between supervision and empowerment of providers was emphasized as it allows space for innovation and ownership. Shifting from specialist supervision to local or peer supervision was a commonly mentioned way to strike this balance, promoting both sustainability of capacity building efforts and empowering the recipients of training:
"...in each one of these programs, we’ve progressed from a supervisor-led supervision to eventually move it towards a peer-led supervision, because a supervisor, or an expert-led supervision is not sustainable. It’s not sustainable, it’s not scalable, we don’t have enough experts to do that." (Participant 17)
Quality Assurance - Challenges
Discussion of supervision frequently overlapped with the theme of quality assurance, as supervision can be integral to maintaining intervention fidelity and successful monitoring and evaluation, while quality assurance measures can feed back information to inform supervision. Suggested approaches to supervision often facilitated successful quality assurance, but there were distinct drivers and barriers as well. For example, participants described the challenge of measuring the complexity of their mental health project’s impact or outcomes. As one participant stated:
It’s hard, because it’s a… multidimensional intervention, where we’re trying to impact social networks, we’re trying to impact self-esteem, we’re trying to impact violence issues, communication, so it’s a lot of different dimensions. And then of course, psychosocial, health, well-being, knowledge, all of these things!" (Participant 16)
Contextual elements, such as variations in language or informal delivery settings, and unexpected events such as natural disasters, can challenge the validity and reliability of quality assurance methods or confound the outcomes of interventions:
"They may have improved in terms of the scale of depression, but then this trauma happens, so they may rightly be more depressed than when we actually got them… it may seem as if there was no improvement, but there may have been [an] improvement but that was lost due to the hurricane." (Participant 29)
Quality assurance processes and logistics can be resource intensive, especially when implemented in low-resource settings that require investment in infrastructure or technology, such as telephone lines to allow communication, or when adapting to the above-mentioned contextual challenges. This can hinder quality assurance capacity by limiting the scope, regularity, or method of assessment. A tension between being flexible enough to allow situational adaptation during implementation and retaining fidelity in the name of quality assurance was described:
“…one of the things that we’ve found is that people change the delivery methods because they know how to best apply it to their particular situation. And when we were working with the four schools, there were differences throughout the entire four schools. The process, however, was completely the same. The differences were in the delivery… but the overall change in behavior was the same, in other words the children still improved.” (Participant 28)
Participants also highlighted the need for benchmarks to help interpret the findings of quality assurance and monitoring and evaluation (M&E) assessments and inform implementation and decision-making:
"And even if you’re at thirty percent, is that bad or good? On one hand it’s bad but on the other hand that’s thirty percent who are now depression-free who without these groups would certainly have been depressed. So, we have to decide at what level do we want to reinvest our resources to improve that quality… when do we call in the cavalry to get the quality back up? What’s our minimum threshold before the red light goes off and the production line stops and we have to fix it?" (Participant 15)
Quality Assurance - Drivers
The use of effective frameworks to help capture pathways and mechanisms of implementation was considered a key driver for successful quality assurance. As a participant explained about using one such methodology (which was required by GCC), Theory of Change:
“But when you implement variables that you don’t know about those are the ones that determine that – variables such as the fact that teachers don’t like doctors. That’s a real thing, something like that can throw off everything. And so it’s a whole different kettle of fish, so that’s why I think the Theory of Change is one of the critical things for successful implementation, after you have a product that has been proven to be effective. Because developing efficacy is the first step, it doesn’t translate to success." (Participant 28)
Continued monitoring and evaluation beyond the timeframe of initial implementation, especially if service delivery is integrated into and handed off to the government health system, was also seen as essential for successful scale-up.
Approaches and Mechanisms
Finally, participants shared various approaches and mechanisms they found important to successful capacity building for mental health projects, which are summarized in the table below:
Table 1
Approaches and Mechanisms for successful capacity building
Theme | Approach/Mechanism |
Training | • Training of Trainers approach and peer-to-peer learning promotes sustainability and adaptation to local context • Refresher or booster trainings help maintain skills and promote fidelity • Flexible training schedules or shorter sessions make it easier for busy providers to attend • Low intensity training is easier to scale or pass on to local stakeholders • Teaching problem solving skills (such as troubleshooting) builds independence • Active learning approaches (group work, role playing, hands-on training) complement more theoretical or didactic approaches |
Supervision | • Regular face-to-face meetings or check-ins between staff and supervisors (when possible) foster strong relationships • Taping sessions to be reviewed by a specialist can provide ongoing feedback and learning • Periodic performance evaluation helps monitor increases in skill and knowledge and assess readiness for greater independence • Debriefing with supervisors can help address challenges of service delivery |
Quality Assurance | • Client feedback can be used to monitor quality and satisfaction • Audio-recorded sessions can be used to give feedback on quality of counselling sessions • Effective mechanisms and approaches to supervision provides quality control (e.g. peer supervision) • Using technology can support effective quality assurance processes |