In total, 220 datasets were added to the Wash’Em software between March 2020 and June 2021. 62 of these datasets were discarded as they were marked as test data by the users. Owners of the remaining 158 datasets were contacted to seek consent and validation. In total, 48 datasets were verified, and owners provided informed consent for the data to be used for research purposes. However, only 38 of the datasets stated that COVID-19 was one of the health outcomes of interest. Table 1 summarises the characteristics of the contexts these 38 datasets came from.
Table 1
A summary of the contexts where Wash'Em was used as part of COVID-19 response
Contexts where Wash’Em was used as part of COVID-19 response | Number | Percentage |
Number of humanitarian organisations using Wash’Em to inform their COVID-19 response during the study period. | 38 | 100% |
Number of countries represented by the data sets |
Sub-Saharan Africa | 18 | 47% |
Latin America and the Caribbean | 13 | 34% |
East Asia and Pacific | 4 | 11% |
Other (Middle East, North Africa, South Asia and Europe) | 3 | 8% |
Disease outcome of interest identified in the datasets |
COVID-19 | 38 | 100% |
Diarrhoeal diseases or respiratory infections | 30 | 79% |
Other outbreak-related disease (e.g. Cholera or Ebola) | 19 | 50% |
Datasets indicating they were responding to multiple crises |
COVID-19 and another disease outbreak | 26 | 68% |
COVID-19 and a disaster | 11 | 29% |
COVID-19 and armed conflict or political or social unrest | 13 | 34% |
Duration of the humanitarian crisis |
More than 10 years | 7 | 18% |
5 to 10 years | 1 | 3% |
1 year to 5 years | 9 | 24% |
6 months to a year | 5 | 16% |
Within the last 6 months | 15 | 39% |
Within the last month | 0 | 0% |
Location of the target population |
People residing in a formal camp setting | 9 | 24% |
People residing in an informal or unregulated camp settings | 8 | 21% |
Damaged buildings | 2 | 5% |
Their homes, in their place of origin | 28 | 74% |
Host communities in another community, not their place of origin | 5 | 13% |
People are on the move and have no regular place of residence | 4 | 11% |
Diversity of the target population |
From a similar religious or cultural background | 19 | 50% |
Multiple religious or cultural groups in the area of operation | 19 | 50% |
Access to latrines |
Most of the population have access to household latrines | 12 | 32% |
Most of the population have access to shared latrines | 18 | 50% |
Most of the population practice open defecation | 7 | 18% |
Responsibility for handwashing infrastructure, water and soap |
Humanitarian organisations responsible | 18 | 47% |
Households responsible | 20 | 53% |
Contexts where Wash’Em was used
The main regions where COVID-19 response programs adopted Wash’Em were Sub-Saharan Africa and Latin America and the Caribbean. In many of these settings COVID-19 was not the only disease outcome targeted by the hygiene programme, with 79% of programmes targeting diarrhoeal diseases or respiratory infections more generally and 68% also targeting other outbreak-related diseases, such as Ebola and Cholera (Table 1). Similarly the majority of Wash’Em users were responding to ongoing protracted humanitarian crises in addition to COVID-19. For example, 29% were delivering programmes in the wake of a disaster, and 34% were working in settings which were experiencing armed conflict or political or social unrest. The majority of programmes (63%) included a focus on people who were displaced. Programmes targeted both displaced populations and host communities. Exposure to risk and loss was common, with two-thirds of Wash’Em users reporting that the targeted populations had lost either their house or belongings due to prior or ongoing humanitarian crises. This has left humanitarian crisis-affected populations little or no option but to either reside in formal or informal camp settings (17, 45%), with host communities (5, 13%), or to remain on the move (4, 11%). Whilst others live in their own homes in their place of origin (28, 78%).
Fifty percent of the included Wash’Em projects were delivered in regions where the majority of respondents had access to shared latrines, 7 (18%) of Wash’Em projects said that open defecation was most common in their area of operation, with the other projects reporting household level latrine ownership. 20 (53%) of the projects using Wash’Em indicated that households were responsible for the provision of handwashing infrastructure, soap and water in their settings while the remainder indicated that this responsibility for provision fell to humanitarian organisations or the local government.
Programme Constraints
Over half of the projects using Wash’Em as part of their COVID-19 response programmes indicated that their programme duration was six months or less (20, 53%), 21% indicated that their programme would cover a timeline of between six months to one year (8, 21%) and the remaining 26% indicated their programme would run for one to two years. The amount of funds available for hygiene programming (including human resources) varied across the projects which Wash’Em was part of, however 53% of projects were working with budgets of less than USD $50,000.
The correlation between the duration of the grant and the funding allocated for hygiene programming is presented in Table 2. This illustrates that the majority of COVID-19 programmes that used Wash’Em covered a short timeline and a relatively small injection of funds.
Table 2
Budget and timeframe available for COVID-19 focused hygiene programming during use of Wash’Em
Budget & Timeframe | Less than $10,000 | USD $10,000 - $50,000 | USD $50,000 - $100,000 | USD $100 - $500,000 | More than $500,000 |
6 months or less | 11 (29%) | 5 (13%) | 3 (8%) | 1 (3%) | 0 (0%) |
6 months to 1 year | 1 (3%) | 1 (3%) | 2 (5%) | 2 (5%) | 1 (3%) |
1 year to < 2 years | 0 (0%) | 2 (5%) | 5 (13%) | 4 (11%) | 0 (0%) |
More than 2 years | 0 (0%) | 0 (0%) | 0 (0%) | 0 (0%) | 0 (0%) |
Nearly half of the organisations using Wash’Em (18, 47%) worked in collaboration with other smaller local organisations or community volunteers to deliver their hand hygiene programmes. 26 (68%) of the organisations using Wash’Em anticipated that there would not be any barriers to effectively reaching populations during the pandemic. The remaining 32% indicated that programmatic activities were likely to be suspended due to safety and security concerns. In most projects, Wash’Em users reported that donors had not provided any specific direction on the delivery channels that they should use within their projects. Table 3 indicates the delivery channels that were recommended by donors during the pandemic, indicating that despite the health risks, a mix of in-person and remote delivery channels were still being encouraged.
Table 3
Delivery channels suggested by a donor for COVID-19 response
Delivery channels suggested by a donor for COVID-19 response | Number | Percentage |
No channel suggested | 15 | 39% |
Radio | 20 | 53% |
Television | 9 | 24% |
House to house visits | 18 | 47% |
Mobile phones or social media | 16 | 42% |
Women’s groups, men’s groups or youth groups | 18 | 47% |
Patterns of Wash’Em Use
There were similarities in the ways organisations used Wash’Em during the pandemic. On average organisations trained 9.8 people (median of 3.5) on the Wash’Em process. Wash’Em provides a range of learning materials, including written guides, videos, in-person training, remote training, and role play guides for doing small-scale pilot data collection exercises. During the pandemic organisations used a mix of these training tools, as is recommended, however a relatively high proportion of users (18, 47%) opted to deliver Wash’Em trainings remotely.
Wash’Em training ranged from 0.5 to five days, with a median of two days. Thereafter, data collection using the Rapid Assessment Tools took on average two days to complete. In almost all cases organisations used all 5 Rapid Assessment Tools. One data set did not use the Touchpoint Tool, two did not use the Motives Tool, and six data sets did not use the Personal Histories Tool. However, the Wash’Em guidance does recommend omitting the Personal Histories tool in settings where supportive services (e.g. psychosocial support) are not present. The majority (36, 95%) of Wash’Em data collection was done fully face to face during the pandemic, despite recommendations to minimise face-to-face interactions. However, some users conducted remote interviews or FGDs through online platforms or phone calls.
At the point of being surveyed, 40% (15) Wash’Em users indicated that some or all of the Wash’Em programme recommendations had been implemented in their hygiene programmes. A further 37% (14) said they had been used but that the activities had to be adapted to suit their contexts better. One Wash’Em user said the recommendations had not been used while 5 others were intending to implement them soon. Follow up emails were sent to users who indicated that they had had to make adaptations to the programme recommendations, with the aim of understanding the kind of changes that occurred. Respondents indicated that most changes were to make the recommendations more feasible in their context. For example, one user explained that they combined two of the infrastructural activities (a competition to build or improve handwashing facilities and the distribution of mirrors to place over the handwashing facilities). Another indicated that they had adjusted the materials that were used in an activity due to the products that were available locally.
Handwashing determinants based on the Wash’Em Rapid Assessment Tools
Handwashing demonstrations
The Handwashing Demonstrations Tool is designed to understand how aspects of the behavioural setting [30, 31] enable or constrain the practice of handwashing. It involves asking people to demonstrate how they would normally wash their hands after using the toilet or before food preparation, videoing this sequence of action and then answering a set of questions about the availability, desirability and convenience of soap, water, and handwashing infrastructure. The tool also focuses on describing how the individual interacted with the setting to perform the behaviour. The Handwashing Demonstrations Tool is typically done with about 10 individuals, depending on the homogeneity of the setting and when a point of saturation is reached. It is recommended that participants are selected purposively to include a mix of ages, gender, abilities, socio-economic brackets, and variations within the local geography (e.g. access to water).
Among the included projects, only 4 (11%) reported that the majority of participant households had permanent dedicated handwashing facilities near the toilet or kitchen. 13 (34%) projects reported that the majority of households had no facilities at all. The remainder of the projects indicated that there was a place where hands were often washed but that this was done using mobile devices (e.g. use of a jug to pour water onto hands) or that people washed hands at multifunctional facilities (e.g. a shared tap stand). 10 (26%) projects reported that the handwashing facilities that did exist were convenient and easy to use, while the remainder indicated that the available facilities were often undesirable and unclean (16, 42%), were desirable and attractive (3, 8%), and clean and undesirable (8, 21%). Additional barriers to handwashing were identified through this tool including that handwashing facilities were often not at a convenient height (15, 40%), that the facilities allowed people to only wash one hand at a time (8, 21%), that the facilities were too far from the kitchen or toilet areas (13, 34%) and that handwashing infrastructure was fragile or easy to break (2, 5%).
Most projects (31, 82%) reported that households had soap available within the household. 16 (42%) projects had soap near the toilet, or in the kitchen, or at the handwashing facility. Meanwhile, 13 (34%) projects stored elsewhere in the house potentially making it potentially inconvenient to practice handwashing with soap and water at key times. Furthermore, 16 (42%) of the projects found that participants used products which were not primarily intended for handwashing (e.g. laundry soap, dishwashing liquid or ash) and 11 (29%) projects used bar soap designated for handwashing and bathing.
Like soap, water was found to be stored elsewhere in the house. 16 (42%) projects reported that the majority of Wash’Em research participants had to collect water from elsewhere in the compound and 4 (10%) reported water scarcity.
Disease Perception
The Disease Perception Tool helps Wash’Em users to understand local constructions of disease, health priorities, perceived vulnerability to the disease, the severity of health and non-health consequences of the disease, and action-efficacy related to disease prevention. The Tool is undertaken within focus group discussions (FGDs) typically involving 6–10 individuals. Wash’Em users are required to do a minimum of 2 FGDs, one with women and one with men but are also encouraged to do additional FGDs with other population sub-groups (e.g. older people, people with disabilities, young adults, etc.) to collect diverse opinions and ensure a degree of saturation is met. The Disease Perception Tool uses a colour coded Likert scale to encourage participants to debate how they feel about the disease-oriented questions. The tool can be adapted based on which disease outcome the users programme is trying to address (e.g. diarrhoeal diseases, respiratory infections, Ebola, Cholera, etc). However, among the included studies it was used to explore perceptions related to COVID-19.
30 (79%) of the included projects found that FGD participants listed COVID-19 among their five greatest health concerns at that point in time. Regarding perceived susceptibility, 15 (39%) of the projects reported that FGD participants thought they would definitely get COVID-19 in the next six months, whilst participants in 18 projects (47%) reported that they felt they might get infected during this time period. When asked who is more likely to get sick with COVID-19 between their own family and other families in the community, most projects (32, 84%) reported that participants felt they were all at equal risk of infection.
When asked about the perceived impacts associated with getting COVID-19. Wash’Em participants mentioned impacts on their physical and mental wellbeing (21, 58%). Economic impacts associated with either loss of income when sick (27, 75%), or costs associated with travelling to and accessing healthcare services were mentioned by 20 projects (56%). 16 projects (44%) found that participants were concerned about being less productive if they were to get COVID-19. Others mentioned social impacts that they associated with COVID-19 including with feeling isolated or stigmatised (17, 47%) or having to take on additional responsibilities because of others getting sick (11, 31%).
When asked about COVID-19 prevention, 24 projects (63%) reported that FGD participants felt that they were able to take actions to prevent the disease, however in 11 projects (29%) participants did not think that handwashing with soap was an effective mode of prevention. Despite this, in 16 projects (44%) participants reported that they thought handwashing behaviour had increased recently due to fear around COVID-19.
Motives
The Motives Tool explores motivations associated with handwashing behaviour, perceived identity, and aspirations. The Tool is also conducted within FGDs, with a similar sample process as for the Disease Perception Tool. When using the Motives Tool, facilitators introduce participants to a set of character cards. The character cards contain visuals and descriptions of a person with a particular characteristic. Each characteristic is linked to a core human motive as defined by Aunger and Curtis [32], with some adaptations made so that these were more relevant to the experiences of crisis or outbreak affected populations. For example, one character card depicts a person looking in the mirror who is described as a person who wants to look attractive. This character card is linked to the motive of attract. Another one of the cards shows someone socialising and they are described as a person who values having friends. This card is therefore linked to the motive of affiliation. In total there are 13-character cards. Once facilitators have introduced all the cards to participants, the participants are asked to rank the characters in order of who they think is most likely to always wash their hands with soap, down to who is least likely to do so. Participants are encouraged to debate and discuss the order of the cards. They are then asked to talk about which characters they currently feel like and which they aspire to be like.
The motives most commonly associated with handwashing across all projects were status and disgust. FGD participants across all projects identified themselves as hard-working, neat and orderly. In most projects, FGD participants said that they aspired to be respected because of their education or wisdom, because they were good parents. Others aspired to be able to be neater and wealthy. Figure 1 illustrates what currently people feel like and their aspirations.
Personal Histories
Unlike the Wash’Em Tools described above, the Personal Histories Tool is not focused on handwashing behaviour specifically, but rather is designed to explore the broader experiences of a crisis or outbreak on people’s lives. The tool is done through individual interviews and there are different worksheets that can be used to explore experiences of displacement and conflict, experiences of disasters, or experiences during an outbreak of disease, such as COVID-19. In the included studies the worksheet related to outbreaks was used. This requires Wash’Em users to identify individuals who have recent experience with the disease (e.g. have recently recovered from COVID-19 and are no longer infectious or who have had a family member who was ill with the disease). Wash’Em users are required to do a minimum of six Personal History interviews and are encouraged to do more until a point of saturation is met. As with the Handwashing Demonstrations Tool participants are sampled purposively to reflect the diversity of the region. Staff facilitating the interviews start by asking the participant to draw three pictures of themselves or their life at different time points: prior to the outbreak, during their illness, and while recovering. The drawing process is designed to help participants open up about their experiences. Subsequent questions are then asked about how different aspects of their lives changed at each of these time points, including questions related to the individual’s role and responsibilities, their social life, their hopes and goals, and their perceived sense of control over aspects of their day-to-day life.
During the pandemic, 34 (89%) of projects found that interview participants reported their role within their family or community had changed. For example, parents often felt less able to provide for their families or fulfil their normal day-to-day duties/roles, or their professional role. Others reported taking on a role that they would not normally do because they have been separated from their immediate family or have been put in a difficult situation. Interview participants in 15 projects (45%) reported that friends and family had avoided them because of stigma. In 16 projects (48%) the majority of participants reported choosing to be less sociable during the pandemic. However, in 7 of the projects (21%) the interview participants felt their existing social network was a source of great support during the pandemic. 35 projects (92%) reported that interview participants said their hopes and goals for the future had changed because of their experiences associated with COVID-19. People reported an increased fear about their future and that of their children, including concerns around mental and physical health. Many felt that the future was in God's hands and there was little they could do. 23 projects (70%) reported that the majority of interview participants felt their economic situation was not precarious and 19 projects (57%) found that most participants felt that they had lost agency during the pandemic and were now reliant on others for basic aspects of survival.
Touchpoints
The final Wash’Em Tool, Touchpoints, is designed to understand the multiple ways that organisations could reach and engage with populations when delivering programmes. The Touchpoints Tool is done within FGDs, with sampling being similar to the Disease Perception Tool and the Motives Tool. Facilitators using this tool work with FGD participants to learn about which delivery channels are available, describe potential reach and reflect on whether there are certain population sub-groups who might not be reached through specific channels (e.g. women, men, children, older people or people with disabilities). The Tool also asks participants about whose views or opinions they listen to and respect.
Among the included projects, the three most effective Touchpoints for reaching crisis-affected populations during the pandemic were television (prioritised in 26 projects, 68%), radio (prioritised in 22 projects, 58%), and mobile phones (prioritised in 20 projects, 53%). To a lesser extent, local information sharers (e.g. town criers), religious institutions and health workers were also highlighted as other important ways of engaging with communities. When FGD participants were asked about whose opinions they respected most, community leaders or elders and religious leaders were reported by the majority of FGD participants (87% and 84% of projects respectively).
Consistency in the determinants of hand hygiene behaviour across contexts
Figure 2 is a heatmap illustrating the level of consistency in user responses to the Wash’Em questions (all questions and response options are available in SM2) and is divided by each of the sections in the software. Bright yellow colours, which indicate a high proportion of sites selecting the same response, are not common. Responses tended to be varied for most questions. There was a low level of homogeneity across the 38 COVID-19 datasets in terms of both the contextual factors, programming constraints and determinants of handwashing behaviour during the pandemic. This is supported by the Fleiss’ Kappa results, which for all categories indicated poor agreement or slight agreement only (most were approximately 0.20 or lower) [33]. Higher levels of agreement across the datasets were seen within the responses to questions on programmatic context and constraints, motives and disease perception and delivery channels.