Aims
We aim to test the effectiveness of the multifaceted Samaki Salama (“fish security” in Kiswahili) intervention as it intersects with nutrition security and fisheries sustainability in Kilifi county, Kenya. Table 1 details the specific aims and hypotheses.
Design
Samaki Salama intervention will target communities matched based on location (rural), livelihoods, and child nutritional status. The matched sample will be divided into three groups: (1) control; (2) multi-tiered nutrition social marketing intervention to fishers, mothers, and health workers; (3) multi-tiered nutrition social marketing intervention plus modified fishing traps with escape gaps and training. Figure 2 provides an overview of the study design and implementation process.
Both process and impact evaluations will be carried out using mixed methods. Primary and secondary nutrition outcomes will be longitudinal difference-in-difference analyses of parameters – height-for-age Z score, stunting prevalence, child fish food intake, child dietary diversity, and child diarrheal morbidity. Other outcomes in the pathways to impact include awareness of the social marketing campaign and knowledge transfer. Primary and secondary fisheries outcomes will be longitudinal difference-in-difference analyses in fisheries yield of mature fish and fisher income and earnings.
The Samaki Salama bundled intervention precludes randomization due to the high risk of spill-over effects and the limited number of trap fishers with children under the age of 5. Thus, for the impact assessment, we will conduct a matched intervention/control design to minimize selection bias and test effectiveness on nutrition and fisheries production. Steps have been taken to reduce the risk of selection bias that might arise from the matched design. A pilot study and additional formative research will be used to identify and match communities on important characteristics (socioeconomic status (SES), child nutrition, livelihoods, etc.). This preliminary data provides additional information needed for external validity and extrapolation of findings to other small fisher households in Kenya and internationally. The longitudinal difference-in-difference design further contributes to the internal validity, accounting for residual confounding, and increases the statistical power to detect intervention effects.
Sample size
Sample size calculations for the cluster design applied a mean − 1.3 height-for-age (HAZ) for the coast region and a hypothesized 0.20 effect size (19).Thus, we estimate requiring a sample size of 400 households (200 per group), which includes approximately 4 clusters per arm (4 villages per BMU) and 50–75 households per cluster – assuming 20% losses-to-follow-up (α = 0.05 and 1-β = 0.80). Although this is small number of clusters, we will apply matching techniques a priori and during data analyses (e.g. propensity score matching) to better ensure internal validity.
Setting
The study will be carried out in five distinct areas in Kilifi county, Kenya: Mayungu, Uyombo, Takaungu, Kuruwitu, and Kanamai (Fig. 3). Study sites were chosen based on established relationships with the research team, receptivity to the proposed intervention, and proximity and access to marine resources. Kilifi county covers an area of 12,370 km2 with a population of 1.45 million and average household size of 4.8 persons (20, 21). The population primarily relies on small-scale fishing, farming activities (raising livestock, tree-cropping, and food-crop production), tourism, and migration to urban centers for their livelihoods (20). Close to half the population lives in poverty (46.4%) and the stunting prevalence (39%) is nearly double the national average, indicating high levels of malnutrition (19, 22). Education levels are low, and the populations are marginalized with limited formal rights to the marine resources on which many of their livelihoods depend.
Participant eligibility, recruitment, and retention
At the outset of the study, we will identify comparable communities associated with BMUs on the coast of Kilifi county using potential confounding variables: proximity to shoreline or ability to participate in the fishery; presence of no-take fisheries closures; composition of fishing gears used; background nutritional status; usual diets; income and assets; and access to market information. We will draw on existing relationships and data from communities where formative research was previously conducted by the project team. BMU leaders and other stakeholders will be convened to first inform them of the potential project and solicit permission to act in partnership with BMUs to conduct the research.
In order to be eligible to participate in the study, an individual must meet all of the following criteria:
1. A household member works in small-scale fisheries (self-employed fishers)
2. At least one child in the household aged 6–60 months
3. Provision of signed and dated informed consent form
4. For children, informed assent and parental informed consent to participate in the study
5. Stated willingness to comply with all study procedures and availability for the duration of the study
We anticipate a total sample size of 400 small-scale fisher household units (mother, father, and child 6–60 months); there will be 200 in intervention groups and 200 in the control group. Table 2 provides a summary of the total number of individuals and anticipated demographics.
Participant recruitment and enrollment will be conducted by the two Samaki Salama Kenyan partner universities (Egerton University and Pwani University). Pwani University, located in Kilifi County and on the coast, is well-positioned to be in continuous interaction with community stakeholders. The Kenya P.I. from Pwani has established relationships in Kilifi over many years of working there and teaches many university students from the neighboring fishing villages. Additionally, the US Co-P.I. from the University of Rhode Island (URI) has worked in this area for over 10 years conducting research on coral reef fisheries management and has long-term working relationships with fishers and BMU leaders. The Kenya Co-P.I. from Egerton University was involved in formative research along the coast and has made contacts with local health care workers and clinics for collecting data and measuring nutrition outcomes.
Recruitment efforts will begin with consultations with key community stakeholders including BMU leaders and board representatives; health care workers in local clinics; community health workers (CHVs); religious leaders; municipal administrators. With their agreement, communities will be matched based on the closest set of characteristics and assigned to control and intervention groups.
Retention efforts will be primarily carried out in tandem with the social marketing campaign. Activities to increase participant engagement – both in control and intervention groups – will include meetings, social gatherings, and project materials (e.g. T-shirts, flyers, lifejackets). These efforts are modeled from the Lulun Project in Ecuador (23) and adapted to the Kenyan context should help retain participants.
Interventions
Our 12-month Samaki Salama intervention introduces practices and technologies that build on existing community assets and expressed needs and preferences of small-scale fishers and their households. The first component of the intervention package, nutrition social marketing, is a novel approach to increase nutrition awareness across multiple stakeholders that draws on psychology, marketing, and communications disciplines (23). Distinct from conventional nutrition education interventions that to tend to use more didactic approaches and standardized materials, this strategy draws heavily on contextual factors to identify key messages and delivery platforms. Nutrition-focused social marketing campaigns have been shown to promote active engagement of participants throughout the trial, high compliance to the intervention, sustained behavior change, and low losses to follow-up (24). Social marketing has been shown to be more effective if targeted messages are repeated and delivered across different platforms (25) and previous studies indicate that 6 months of animal source food nutrition messaging may not be enough to sustain impact (26). Therefore, we propose a 12-month intervention period.
The nutrition social marketing approach will be developed in close collaboration with the social and behavioral change group at USAID Advancing Nutrition. The focus is on promoting four priority behaviors among infants, young children and women of reproductive age in SSF households: 1) caregivers feed fish to young children 6 months to 5 years daily; 2) caregivers feed an age-appropriate diverse diet, including fish, to children 6 months – 5 years daily; 3) caregivers wash hands and the child’s hands with soap or ash before feeding; 4) fathers reserve and take home a small portion of fish for child each day. The social marketing plan and audience analysis, including all materials, messaging, and delivery platform relies on formative research conducted in the study area and piloting of materials prior to implementation. As shown in Table 3, messaging centered on the four priority behaviors will be delivered through diverse channels to mothers/caregivers, fathers, and leaders/members of local institutions. The plans to engage these participants groups reflects a multi-level approach to supporting improved feeding and care behaviors through individual, family and community level change.
Home visits are a key component of the social marketing campaign and will occur at a three time points (3 mo., 6 mo., 9 mo.) in both intervention groups. During visits, the team’s nutrition education specialists will actively engage with the caregiver and child/children to build a positive relationship, understand their individual needs, and foster change. The nutrition team will discuss and identify illnesses before introducing age and stage-specific child feeding and hygiene habits (or recommendations) and help caregivers identify next steps and agree on actions geared toward improving feeding and hygiene practices and better health care. The overarching message caregivers will receive is that fish can be a critical source of nutrients for their child and paying special attention to their child’s growth and development now has life-long benefits. Discussions, agreements, and actions taken will be documented and tracked by the nutrition team. Local CHVs in both intervention and control communities will be trained to conduct the home visits so caregivers will have a reliable source of information and support even after the project is completed.
Fifteen cooking demonstrations will be conducted in intervention communities with an anticipated 10–15 mother/caregiver participants and their children per demonstration. The demonstrations will provide an overview of key nutrition concepts, important nutrients found in fish, and different approaches for fish preparation. Participants will be asked to plan a meal and snacks for their children using a ‘star foods’ menu game and work together to prepare a fish centered meal. Questions will be asked at the beginning and end of the demonstration to better understand participants’ nutrition knowledge, what they gained from the demonstration, and feedback for improving future demonstrations. Demonstrations will be conducted in local community spaces identified by the field team.
The project nutrition team will work together with the fisheries team to conduct a series of ten fisher workshops at local BMU offices with fishers in both intervention groups. Table 4 provides a summary of the themes and topics that will be covered at each workshop.
Fisher training, gear modification, and fishing trap distribution constitute the second piece to our integrated intervention. There are a handful of ways in which gear modifications can achieve the intervention goals. First, the use of fishing gears modified to decrease juvenile catch has been shown to lead to greater catch diversity and improve the economic value of fishes (15). Second, fishers can gain a competitive advantage when using new gears by fishing new habitats to catch previously targeted species in novel ways (14). This can reduce the impact of fishing on the environment, and in the case of coastal Kenya, coral reefs. Last, gear modifications have been shown to improve harvest efficiency and promote sustainable fish populations by selecting for mature individuals while at the same time improving fisher revenue (27). Using these rationales, our intervention targets fishers using basket traps and provides them with traps modified with escape gaps so immature fish can escape. Trap distribution will occur at landsides utilized by participating fishers and at local BMU offices. The fishers will also receive training on how to properly maintain the traps they receive. We hypothesize this type of intervention will reduce fishers’ dependence on immature fishes, as well as buffer them from potential market variability (28) and enable them to be more resilient to environmental change (29).
Data collection and management
Data collection will be conducted by the research staff at the study site under the supervision of the Kenyan investigators. A household and fisher survey will be used to gather data on demographics, socioeconomics, hygiene, sanitation, mother and child health, diet, anthropometry, COVID livelihood impacts, household decision making, awareness/knowledge of fish consumption, and fishing characteristics at baseline and endline. The survey will be developed using the Research Electronic Data Capture (REDCap™) platform and collected electronically using password protected tablets. To assure the quality of data entry the survey will utilize REDCapTM’s built-in data validation. The team will also be able to track access of data, instruments, and reports through an electronic audit trail. To minimize missing data the field team coordinators will review all REDCap™ records for completeness prior to uploading the data to the secure REDCap™ server hosted by Washington University in St Louis. If any issues are found the coordinators will follow up with the enumerator responsible for the data entry. Fisheries catch, take home amount, and income data will be collected at least four times monthly at landing sites using paper forms that are then entered into Microsoft Excel by the fisheries field team and stored on password protected computers. Excel data entry is mediated with built-in validation to a given list of marine fish species found locally. All paper forms will be stored in a locked filing cabinet when not being processed. Data will be screened for completeness and consistency on a bi-weekly basis, with archival data stored in the password-protected Box cloud storage platform, and if any issues arise, the research team will follow up with the data collectors.
A process evaluation will be used to monitor and ensure consistent administration of the intervention (fidelity of delivery), adoption, and sustainability, three key implementation outcomes (30). The primary focus of the evaluation is on documenting the transition from inputs (nutrition social marketing and fisher support (modified traps) to the anticipated outputs, outcomes, and impact (Fig. 1). Systematically tracking, documenting, and assessing this part of the impact pathway will allow for a more nuanced understanding of the implementation process, how and why the intervention does/does not have the anticipated impact, and facilitate future replication. Mixed methods will be used to collect information along the impact pathways. Table 6 provides an overview of the implementation process outcomes, methods, and data types.
All data collected for this study will be stored on the REDCap™ platform and on Box, a secure, Health Insurance Portability and Accountability Act (HIPAA) and Family Educational Rights and Privacy Act (FERPA) compliant data storage and sharing online platform.
Study measures
To evaluate intervention impacts, we will assess primary outcomes of child growth along with fish food intakes, and fisheries yield of mature fish. Secondary outcomes of interest, which are also hypothesized to serve as mediating factors between the intervention and primary outcomes, include indicators for child health and diet (dietary diversity, prevalence of diarrhea) and fisheries earnings. Measurement of the targeted nutrition endpoints will occur at two timepoints as part of a household level survey. The household surveys will also collect information on other relevant measures and potentially confounding factors including household expenditures, and household decision-making. Measurement of fisheries focused endpoints will occur at regular intervals over the course of the 12-month intervention at commonly utilized fish landing sites within the study area. Table 5 summarizes measures that correspond with outcomes of interest.
Primary outcomes
Child growth. Anthropometric measures (length/height, weight) will be collected from children and mothers at baseline and endline. The Seca Model 874 (Digital) 440 lbs. x 0.1-lb. resolution and the ShorrBoard® stadiometer will be used to collect weight and length measures, respectively. Measures will be converted to weight-for-age Z (WAZ), length-for-age Z (LAZ)/HAZ, weight. HAZ and WAZ will be generated using World Health Organization (WHO) Growth Standards (2006). The Stata Macro available from WHO will be run to derive the indicators using data on child age in months, sex of the child, and child height/weight. Outliers above HAZ/WAZ > 6 or HAZ/WAZ<-6 will be removed.
Dietary assessment/fish food intakes. Dietary intakes will be measured using Kenya-specific semi-quantitative food frequency questionnaire (FFQ) (31). A comprehensive list of foods consumed in Kenya, and specifically along the coast, will be compiled along with ingredients in common dishes. This will be integrated into the survey as an FFQ for 24-hr intakes of women of reproductive age, youth, and children ages 6–60 months. Particular attention will be given to fish foods and other animal source foods which will be asked as 24 hr. and 7-day recalls. Findings from the FFQ will later be converted to the Feed the Future (FTF) indicators of minimum dietary diversity for women and young children. Finally, infant and young child feeding practices (IYCF) practices will be assessed in accordance with the FTF minimum acceptable diet indicator.
Fisheries yield of mature fish. Research assistants and trained field enumerators will record fish catches at landing sites (fishery-dependent data). The field team will ask permission to count and weigh a fisher’s catch when they return from fishing. Upon consent, they will identify the fish to species or genus level and measure the lengths of a sub-sample of the individuals (n = 20). Sampling will occur at least four times per month at randomly stratified days, as determined by the moon phase and considering dominant gear types. This will occur during the bundled intervention to detect change and compared with the control population. We will determine the monthly catch per unit effort (CPUE) as the mean daily catch multiplied by the fishing days per month. We will also evaluate species-specific length-frequency distributions to determine the yield of mature individuals. Sustainable yields will be determined by comparing the initial yields versus the rate of change of yields for each landing site or BMU, based on average length of catch for given species.
Secondary outcomes
Child diet diversity. The Child Dietary Diversity Score (CDDS) will be calculated using the total number of food groups reported in the food frequency intake portion of the survey. We will use WHO defined food groups: 1) grains, roots and tubers; 2) legumes and nuts; 3) dairy products (milk, yogurt, cheese); 4) flesh foods (meat, fish, poultry and liver/organ meats); 5) eggs; 6) vitamin A rich fruits and vegetables; and 7) other fruits and vegetables. If new indicator guidelines are released before data analysis activities of this project are undertaken, we will apply the new definition.
Diarrheal morbidity will be calculated using a standard two-week recall conducted during the household survey and home visits. Questions will assess diarrheal severity including the frequency of diarrhea in the children, presence of blood or fever, use of antimicrobials, and requirement for additional medical care at a clinic or local provider. This data will be used to estimate indicators for acute diarrhea (3 or more liquid or semi-liquid stools in a 24-hour period over the last 2 weeks) and persistent diarrhea (lasts 14 days or longer).
Fisher revenue. During fisheries yield data collection, enumerators will also ask fishers about their operational costs and the revenue generated from selling the fish. Fisher revenue will be represented as Kenyan shillings (Ksh) per fishing trip. These questions will be informed by cultural norms and objects such as food and equipment used as currency when Kenyan Shillings cannot be estimated (e.g. bags of rice). Comparisons will be made at the landing site or BMU level to measure the change in earnings pre- and post-intervention as described by Wamukota, Brewer, & Crona(32).
A range of other variables will be assessed to control for cofounding factors associated with the cluster design. These variables include but are not limited to child illness (a standard two-week recall on infectious illnesses including cough, rhinorrhea, fever, and rash), household consumption and assets, and household decision making (Likert scale instrument that captures common domains of decision-making including purchasing decisions; decisions regarding service use (health, education); decisions regarding children’s diet, health and education).
Process evaluation
As shown in Table 6, the process evaluation will examine three key implementation outcomes; fidelity, adoption, and sustainability. The fidelity outcome will capture the degree to which the intervention was implemented as described in the study protocol, adherence over the course of the intervention, and the quality of program delivery (30). Methods for collecting and documenting implementation fidelity include activity/event counts, semi-structured interviews with intervention participants, reports from the field team, and a baseline/endline survey of caregivers and fishers that asses awareness and knowledge transfer associated with the social marketing campaign.
Adoption will focus on better understanding participants intention to try to actualize the information they have received (30). During home visits with caregivers the research team will observe what changes the mother/caregiver has made and their intention to try to act on the messaging in the future. Meetings with fishers will gather similar information as well as asking fishers to report on their use of the modified traps.
The sustainability outcome is intended as an initial assessment of local institutions interest and ability to maintain the intervention once it has been completed. Semi-structured interviews with BMU officials, heads of local health clinics, CHVs, and other relevant local government representatives will be used to assess what they know about the intervention, perceptions of it, and potential for maintaining.
Analysis
Primary and secondary outcomes
Generalized linear regression modeling (GLM), allowing for non-normal distributions, will test the continuous outcomes of HAZ, WAZ, child dietary fish intake, child dietary diversity score, fisheries yield, and fish earnings. As a difference-in-difference analyses, change variables for each outcome will be examined (difference between baseline and endline). For the binomial outcomes of diarrhea morbidity (and other outcomes of stunting and underweight), we will estimate prevalence ratios by the GLM modeling with robust Poisson. If stunting prevalence in this population exceeds the acceptable threshold for use of odds ratios (0.2105), prevalence ratios (PRs) will be used to examine the intervention effect and were considered analogous to relative risk in this longitudinal study. The robust Poisson, with a classic sandwich estimator to correct the inflated variance of standard Poisson, is less affected by outliers.
To test for intervention effectiveness, the two intervention groups will be combined for all hypotheses except the secondary outcome of increased fisher earnings and exploratory hypothesis for differences between social marketing and social marketing + traps intervention groups. Regression models will be adjusted for potential confounding factors including age, sex of the child, corresponding baseline measures, and others found to differ significantly between the trial groups (e.g. maternal education). For fisheries yield, confounding factors will be used to adjust regression models, such as: water temperature, fishing ground area, coral cover, seasonality. The P significance value for Type I error (and one-tailed test) will be P < 0.05 and corresponding 95% confidence interval. Diagnostics for regression model assumptions, structure and observations will be applied, and corrective procedures applied as necessary. If selection bias is widely detected with important differences across intervention and control communities, we will apply propensity score analyses (33). Data analyses will be performed with Stata software (version 16.0; StataCorp, College Station, TX) and R (4.1.2).
Sub-group analysis
We plan to conduct sub-group analyses for both the primary and secondary endpoints based on child age (6–24 mo.; 25–48 mo.; and 49–60 mo.) and baseline anthropometry (HAZ/WAZ<-2; and HAZ/WAZ>-2). The justification for this is based on the evidence showing that these characteristics may influence the response effect. Younger children growing more rapidly may show greater response in HAZ. As well, children stunted at baseline may also show a greater response to the intervention.
Process evaluation
A range of approaches will be used to analyze the data collected as part of the process evaluation. NVivo software will be used to code and analyze the qualitative data from the semi-structured interviews, discussions, home visit notes, and observations. A directed content analysis approach will be used with two rounds of coding and/or identifying key concepts (34). Phase one of the process will be closed coding using a codebook developed from the interview guides. A second round of open coding will be used to clarify any of the new ideas that were identified in phase one. Once open coding has been completed, code mapping will be conducted, and codes will be grouped into hierarchies to organize evidence as themes emerge. Throughout this process, the research team will document reflections on the content of the interviews. This documentation along with the notes of the field research coordinator will be analyzed to capture insights and possible lines of additional inquiry. Counts of actual activities and events will be compared with the project workplan to assess implementation fidelity and coverage. Differences between baseline and endline awareness and knowledge transfer captured in the household/fisher survey will be analyzed using R (4.1.2). An anticipated output of the analysis is a paper that details the implementation process, challenges that were faced, successes, and lessons learned for future replication.