Study design
The MFF intervention was designed as a prospective cluster randomized control trial, with 17 Protestant congregations in Kinshasa, DRC randomly assigned to either experimental (n = 8) or control (n = 9) conditions. A two-stage stratified sampling design was used to assign congregations and ensure demographic similarity between control and experimental congregations. A baseline survey was conducted between November 2016 – January 2017, immediately prior to the 18-month implementation period of MFF. By endline, conducted between December 2018 – February 2019, the longitudinal aspect of the study was unable to be maintained, resulting in a two-group, pre-test/post-test design. Because we were interested in examining the effects of the MFF intervention on couple communication and did not have a longitudinal sample, data for this analysis comes exclusively from the endline survey. The study was approved by the institutional review board at Georgetown University in the United States and the Ethical Committee of the School of Public Health, Kinshasa University, DRC.
MFF Intervention Components
MFF was a multi-component intervention organized around three core activities: 1) community dialogues, 2) couple- and congregation-focused diffusion activities, and 3) service activities. Details of all intervention components are elaborated elsewhere.[25] The primary intervention was community dialogues conducted with congregations in the experimental group, which consisted of structured small group discussions with 10 mixed-sex newly married couples (NMC) and first-time parents (FTP). Community dialogues included up to 20 participants per experimental congregation, with some variability by week of the cycle, and were facilitated by trained gender champions each week over an 8-week period. The intervention was repeated for up to 8 cycles per congregation.
The intervention’s TOC posited that religious leaders and faith communities talking about gender, FP, and IPV would lead to behavior change, such as improved couple communication for FP, through collective/social norm change. Because the intervention aimed, in part, to understand whether faith leaders could be used to catalyze reflection about gender norms that would then contribute to FP-related behavior change, experimental congregations also participated in diffusion ideation activities at the congregation- and couple-level. This included activities such as sermons by faith leaders, couple testimonials, and community celebration events. Both experimental and control congregations also received service activities to ensure changes in outcomes could be attributed to changes in social norms rather than differences in access to quality FP services between groups. Service activities were provided by a local affiliate of PSI, Association de Sante Familiale (ASF), and included health talks, referrals to health services, linkages to youth-friendly health services, and access to a youth-friendly hotline providing FP and gender-based violence service referrals.
Study Sites and Population
Endline data were collected in Kinshasa, DRC from male and female participants at experimental and control congregations. Within each congregation, we sampled NMC and FTP. NMC were couples that had been married or in a committed monogamous relationship for three years or less. These couples did not have children and were not expecting a child. Couples could self-identify as newly married and did not need to be legally married or cohabitating. The definition includes those in pre-marriage counselling or engaged to be married. FTP were couples that had their first child within the last three years (i.e., child is 3 years or younger). They could be married or unmarried. This definition includes those couples that were expecting a child for the first time. Female study participants were between 18–35 years, while male participants were at least 18 years and partnered with a woman meeting age criteria. Only one member of an eligible couple participated in the survey.
Sampling & Data Collection
The endline survey was designed to recruit 30 men and 30 women from each of the 17 congregations, totaling 1,020 participants. Congregations were randomized to the intervention and control conditions. Because congregational assessments completed during start-up indicated insufficient numbers of NMC and/or FTP in congregations, the methodology was adjusted to include a convenience sample wherein as many participants as possible were recruited, up to 30 men and women per congregation. At endline, significant loss to follow up occurred among participants in the baseline survey and the original longitudinal structure of the study could not be maintained. The sample was supplemented with additional individuals at endline in both experimental and control congregations.
Participants were recruited after a church service; all who volunteered, gave their written consent, and met the eligibility criteria were accepted. Data collectors closely monitored sampling frame lists to ensure only one member of each couple participated in the couple survey. Data collectors were matched to the participant’s gender and administered the surveys on tablets in private locations near the church using a computer-assisted personal interviewing platform.
Survey instruments & Measures
Data collection tools were developed by the Institute for Reproductive Health in consultation with MFF partners (FHI 360, Tearfund, and ASF). Survey data were designed to assess the prevalence of attitudes, behaviors, and individual and community-level norms regarding FP acceptance and use, IPV acceptance and perpetration, and positive masculinities and gender equality. The survey was developed and validated through a multi-step process. We first selected dimensions for our measures based on theoretical understanding,[26, 27] existing measures,[28–30] and guidance on how to measure norms,[28, 31–33] all of which suggested that social norms measures: a) are composed of descriptive and injunctive norms, which should be separately assessed; b) occur at the social level and should distinguish the reference group within the measure; and c) may affect multiple behaviors but often relate to/affect a single behavior and therefore necessitate a separate measure per behavior. Once dimensions and items were finalized, we conducted focus group discussions with newly married men and women in the DRC to establish face validity of the instrument. We then collected baseline data, after which we conducted exploratory factor analysis (EFA) and correlational analyses. In these EFA, we used Chronbach’s alpha to examine inter-item correlation and establish reliability of measures based on the baseline data.[34] We used a Chronbach’s alpha of 0.70 or higher for each measure, confirming that items included in the survey picked up on different dimensions of social norms. Finally, we tested our model on a sub-set of social norms, including couple communication, descriptive norms for FP, and injunctive norms for FP and gender equity, all of which helped establish construct validity of the norms included in this analysis.[35, 36]
Our analysis includes a combination of latent and directly observed variables. The main exposure variable, whether the participant belonged to an experimental or control congregation, is directly observed. However, the main outcome variable, couple communication, as well as mediators explored in this analysis represent several latent variables that are defined and measured as outlined in Supplementary Materials Annex 1. Specifically, we included three variables of descriptive social norms, one each pertaining to FP, IPV, and gender equity. We included six variables of injunctive norms, one each pertaining to FP, household gender equity regarding chores, household gender equity regarding child care, community perceptions of IPV (separate variables for men and women), and husbands’ perceptions of IPV. These variables were constructed as continuous variables based on average agreement to questions on descriptive and injunctive social norms. All norms variables were scored 1 to 4 (i.e., strongly disagree to strongly agree), with higher scores representing stronger agreement. The MFF evaluation survey asked participants about their self-efficacy to use FP, which has been shown to be a critical component of agency. As such, we also included measures of FP-related self-efficacy and attitudes as mediating variables.
Analysis plan
In order to examine the effect of the MFF intervention on couple communication, we used SEM to explore the direct, indirect, and aggregate pathways between the MFF intervention, descriptive norms, injunctive norms, self-efficacy and attitudes and couple communication. SEM allows us to run all these regression simultaneously so as to decompose correlations, assess directed dependencies, and then examine the synergistic effect of the combination of regression models. Figure 1 depicts the hypothesized structure from intervention to couple communication. For clarity, this figure is a simplified model and does not depict all possible pathways examined. For example, Pathway A is represented by a single arrow in the figure; however, our analysis in reality included three arrows – one from the MFF intervention to each of the three descriptive norms. Also, in a previous analysis, we explored the direct effect of the MFF intervention on couple communication and did not find evidence of a significant direct effect. Therefore, this pathway is shown as a dotted line in Fig. 1, as it was not included in this analysis. In our models, although descriptive and injunctive norms are conceptualized and measured separately, they are all considered mediating variables, in addition to individual-level self-efficacy and attitudes. Pathway B is unidirectional from descriptive to injunctive norms following the TNSB.
In revisiting the intervention’s TOC and the peer-reviewed literature, we instead hypothesized that there would be an aggregate effect (i.e., A*B*D + A*E + C*D) of the intervention on couple communication mediated by descriptive norms, injunctive norms, self-efficacy, and attitudes. We also explored indirect effects of the intervention, which included the effect of the intervention on descriptive norms, which were then hypothesized to have an impact on the outcome (i.e., A*E). We examined the pathway from the intervention to descriptive norms, from descriptive norms to injunctive norms, self-efficacy and attitudes, with those mediators ultimately affecting the outcome (i.e., A*D*E). We also explored the pathway from the intervention to injunctive norms, self-efficacy and attitudes, which then may affect the outcome (i.e., C*D).
Finally, we examined the direct effects for each of the individual pathways listed in Fig. 1, including the direct effect of: the intervention on descriptive norms (a); descriptive norms on injunctive norms, self-efficacy, and attitude (b); the MFF intervention on injunctive norms, self-efficacy, and attitudes (c); injunctive norms, self-efficacy, and attitudes on couple communication (d); and descriptive norms on couple communication (e). We modeled the descriptive and injunctive social norms as the aggregate scale measures identified in our previous work.[35] These models were run separately for women and men. We also controlled for participant age, education, number of living children with current partner, and food security as we expected these characteristics would impact our outcomes of interest. For each model, we assessed goodness of fit using the Comparative Fit Index (CFI; [37]) and the Root Mean Square Error of Approximation (RMSEA; [38, 39]) to assess model fit. To answer the question of whether our models fit the data well, we adopted a 0.95 cut off for the CFI (i.e., CFI larger than or equal to 0.95) and a cut off of 0.10 for the RMSEA with a 95% upper bound of 0.12 (i.e., RMSEA less than or equal to 0.10 with an upper bound for the 95% confidence interval less than or equal to 0.12).[40]