Study Design and Sampling
This study used a two-arm non-randomized repeated cross-sectional design to evaluate the two intervention packages. We surveyed 205 women receiving routine care prior to the implementation of the intervention: 100 in the PNC arm and 105 in the CWC arm. We subsequently surveyed 226 women receiving the intervention package post-intervention: 106 in the PNC arm and 120 in the CWC arm. See Figure 2. This study design was selected to reduce the possibility of contamination between the control and treatment groups; furthermore, as only approximately 3 months elapsed between the collection of treatment and control data, changes in contraceptive uptake due to exogenous factors were minimized.
This study took place at six hospitals in the Northern Region of Ghana. At the time of the study, there were 15 district hospitals across the Northern Region of Ghana. The sample of six
facilities selected across six districts - with a mix of urban, peri-urban and more rural hospitals - aimed to provide a representative sample of care at hospitals across the Northern Region.
District hospitals were selected as the primary sampling unit due to higher anticipated client flow that would ease data collection and maximize the number of clients reached by each trained provider. Facilities were divided between the two intervention packages to ensure a comparable geographic spread. The following hospitals were allocated to the postnatal care package: Bimbilla, Gushegu, and Yendi Hospital. The following hospitals were allocated to the child immunization package: Karaga, Kpandai, and Zabzugu.
Sampling
The sample size for clients was selected to exceed the baseline number of participants
needed to do a regression analysis according to the principles set forth by (40). See Table 1.
The inclusion criteria for clients participating in the study were that they had:
- Delivered a live birth in the last 12 months
- Attended a child immunization or postnatal care at one of the targeted facilities on the day of surveying
Clients were sampled while exiting appointments from the six facilities. The implementation team approached clients, explained the study, and asked if they met the selection criteria. If clients met the criteria, they were offered a stipend of 20 cedis to participate.
Table 1. Sample Sizes
Allocation
|
Clients
|
Baseline
|
Endline
|
Intervention 1: Postnatal care package
|
100
|
106
|
Intervention 2: Child welfare clinic package
|
105
|
120
|
Total
|
205
|
226
|
Timeline of Activities
This study was split into three phases of programming. Phases 1 and 3 were the same for both intervention arms. During Phase 2, three facilities received the postnatal care package and three received the child welfare clinic package.
Phase 1: Formative Research
To begin, the study team engaged facility-level stakeholders to understand the feasibility of implementing the intervention packages at the selected facilities. Previous research has indicated the importance of designing interventions in a participatory manner, including incorporating input from service providers and other stakeholders (18). Speaking to facility directors highlighted the need for an adaptable program with the structure of care differing between facilities. It also emphasized the importance of making the materials self-explanatory to better account for likely staff turnover or rotation around the facilities.
From here, the team conducted baseline data collection through structured questionnaires delivered in person to clients who met the inclusion criteria at the target facilities. A follow-up questionnaire was delivered by mobile phone 14 days after in-person surveying to assess contraceptive uptake.
Phase 2: Implementation of Intervention Packages
Both intervention packages included the following activities:
1. Training for providers on 1:1 family planning counseling
A single one-day training session was held for each intervention package with providers selected from the target facilities. While the project team intended to only invite providers from the intervention units (PNC or CWC), hospital administrators selected providers from multiple departments for attendance. This included staff who provided immediate postpartum services at the maternity ward but were not part of the Reproductive and Child Health team.
The sessions were tailored to the postpartum period. They focused on guidance and practice in a model of counseling designed to be feasible for providers to consistently deliver in a way that would increase the quality of routine postnatal contraceptive counseling. Providers’ knowledge and attitudes were tested after the training to assess its effectiveness and potential barriers to implementation, with questions such as ‘Which methods can be safely used by breastfeeding mothers at one month post-delivery?’.
2. Program champions
One provider was selected from each target facility to act as a ‘Program Champion’. These were selected by the facility director, with their name and contact details passed onto the project team. Program Champions were responsible for ensuring the program was consistently implemented at their facility, and for highlighting any barriers to implementation promptly so that the project team could coordinate with the facility to address these. These aims were achieved in part by collecting and submitting routine data on referral and counseling rates to the project team. They were also responsible for ensuring that all relevant providers - including those unable to attend the in-person training - were given clear guidance on the intervention and how to use the materials.
Each Program Champion had to pass a knowledge test to be accepted into the role. They received a small stipend every two weeks upon submission of short observation, client, and facility data surveys, as well as a weekly WhatsApp check-in.
3. Ongoing monitoring activities through implementation
Previous investigations of postpartum contraceptive counseling have been undermined by significant implementation challenges (39). As such, the project team implemented multiple further monitoring activities in addition to recruiting Program Champions.
The team conducted phone surveys of a small sample (n=54) of clients to assess the quality of implementation at the midpoint of the intervention period. These surveys focused on assessing the frequency with which healthcare staff at the facilities used the counseling materials during the appropriate appointments. Phone numbers for clients were provided by each facility’s Program Champion.
An experimental WhatsApp tool was also developed. This aimed to increase providers’ retention of training knowledge while engaging them in direct monitoring to maximize their adherence to the counseling model. This system allowed the project team to send an automated program of interactive content to every healthcare provider who participated in the training. Program Champions collected the phone numbers of any providers at the target facilities who were not able to attend the in-person training so that they could receive the key messages of the training through this WhatsApp system. For the postnatal care program, we sent a weekly survey of around five questions. For the child welfare clinic program, we sent a fortnightly survey of around 10-15 questions with the provision of a small airtime incentive as compensation for the time this took. Completion of the questionnaires was significant, particularly for those receiving the airtime incentive, suggesting that this is a viable strategy for direct provider engagement.
Phase 3: Evaluation
Endline surveying took place six weeks after the training sessions and initiation of the intervention packages. Client and provider surveys were delivered to assess provisional changes in knowledge, attitudes and contraceptive uptake rate. While a longer assessment period may have been beneficial, we believe that six weeks was more than sufficient time for quality implementation to occur that would allow for a robust indication of each program’s value based on the pre-post assessment model.
Sample size and data collection questions were kept the same at the endline as for the baseline, with the addition of a few other questions to improve the contextual understanding of implementation quality and program value. With permission from the Regional Health Directorate and each facility, the project team collected government facility data capturing the monthly facility records for key metrics. However, some records were missing from the datasets and there were issues with the consistency and reliability of data received. As such, we have excluded this data from our assessment of program results.
Timeline of Activity
See Table 2.
Table 2. Timeline of Activity
August-September 2023
|
Phase 1 - Formative Research
We refined the program design through engagement with facility stakeholders and baseline data collection. We completed baseline data collection by administering structured questionnaires to postpartum women at facilities alongside a questionnaire for facility directors. We then followed up with clients 14 days after the initial questionnaires via mobile phone to assess contraceptive uptake.
|
October - November 2023
|
Phase 2 - Implementation of Intervention Packages
We delivered training sessions in October 2023, including an assessment of providers’ contraceptive knowledge and attitudes towards contraceptive use. We commenced implementation at the facilities immediately post-training, pairing this with ongoing monitoring work to ascertain the quality of implementation.
|
November 2023 - January 2024
|
Phase 3 - Evaluation
We conducted endline data collection six weeks post-training through structured questionnaires with postpartum women at the intervention facilities. We supplemented this with mobile phone surveying 14 days later. We held the questions used for data analysis and the structure of surveying constant between the baseline and endline surveying.
|
Limitations
As data was only collected from mothers on a handful of days, the data represents only a snapshot of the care provided at facilities pre- and post-intervention. As a result, any differences to care provided on days when surveyors were present could have a disproportionate effect on the results. Additionally, data on contraceptive use was self-reported; hence, it may be vulnerable to issues such as social desirability bias. While the sample was sufficiently large to draw overall conclusions, the conclusions for particular subgroups are less robust due to the smaller sample size. Finally, we were unable to use facility data to examine the effect of programming on longer-run trends in contraceptive uptake due to issues with the consistency and reliability of the facility data we received.
Intervention Package
Intervention Arm 1: Postnatal Care (PNC)
This intervention package was implemented at Yendi, Gushegu and Bimbilla hospitals. Counseling materials were provided to every training attendee, with additional copies for relevant providers at each facility who were unable to attend the training day. Providers at the PNC session were given a counseling guide, method cards, and a ‘Method Information Booklet’.
The focus of this intervention was to increase the frequency and quality with which family planning counseling is included in one-to-one counseling sessions. The intervention package had three main aims:
- Include family planning counseling as part of every 1:1 postnatal appointment.
- Use MHI’s Counseling Guide as a framework for this discussion, with the Method Cards and Method Information Booklet used as key resources in this framework. The discussion should take around 20 minutes, depending on the number of questions from the client.
- Offer a method directly, or a referral to the family planning unit, for women who express an interest in taking up a method of birth spacing at the end of the counseling discussion.
A novel counseling guide was designed for the intervention. This was targeted specifically at the postnatal period and designed to integrate into the existing structure of appointments at Ghana Health Service facilities. The counseling guide provided an overall structure for the counseling session and acted as a job aid for remembering the training while delivering counseling. The counseling guide was supplemented with method cards that aimed to make appointments interactive and client-centered, two markers of improved quality of care identified in prior literature (41). These acted as a visual tool for clients to indicate their key preferences and which kinds of methods they were most interested in.
All attendees also received a ‘Method Information Booklet’ with an extensive explanation of family planning methods. This acted as a reference tool for providers to look up more complex or detailed information about different methods, including side effect profiles, effectiveness in preventing pregnancy, risk factors to screen for before method provision, and the mechanism for taking the method. Finally, the referral card acted as a practical reminder to clients who expressed interest in a method that was not available for provision during the routine appointment, either due to stock shortages or the need for insertion by a trained specialist.
Intervention Arm 2: Child Welfare Clinics (CWC)
This intervention package was implemented at Zabzugu, Karaga, and Kpandai hospitals. Counseling materials were provided to every training attendee, with additional copies for relevant providers at each facility who were unable to attend the training day.
At the CWC session, providers were given a group talk flipchart, 1:1 counseling card, and referral cards for directing people to the Family Planning Unit. Similarly, all materials were designed specifically for this intervention to ensure their relevance to postpartum counseling and their ability to integrate into existing systems of care at public health facilities in Ghana.
The child welfare clinic intervention was designed to consist of three key components. These were a group talk, one-to-one messaging, and a referral system. The intended process for delivering these is described below:
- Providers include family planning messaging in every group talk given while women wait for their child to be called up for weighing and immunization, using MHI’s streamlined ‘Birth Spacing Group Talk’ flipchart as a guide.
- Providers offering immunizations have a very short one-to-one family planning discussion with each woman as her child is vaccinated using the ‘Birth Spacing Card’.
- Providers offer women the option of a streamlined referral for family planning at the end of this one-to-one engagement, using a system of referral cards to make it simple for women to receive a method that day should they choose to do so.
The ‘Birth Spacing Group Talk’ flipchart was designed so that the group talk would take no more than 10 minutes and be feasible to implement even at busy CWC sessions. The flipchart leads providers and clients through a discussion of the range of methods available to clients, how to safely take methods and manage their side effects, and the benefits of receiving family planning counseling while at the facility.
The ‘Birth Spacing Card’ was designed for use by providers directly administering immunizations to children after they have been weighed and their health records have been recorded. Providers were asked to counsel every woman whose child they immunized. The card was designed so that the engagement would last 1-2 minutes at a maximum to ensure feasible implementation. This model was chosen to mirror the approach of (21).
A referral card system was paired with the ‘Birth Spacing Card’. All women who expressed interest in discussing family planning further received a referral card to take to the Family Planning Unit. These were designed to be discreet to pass between provider and client to maintain confidentiality. Referral cards acted as a physical reminder to the client to follow up on their family planning interest. They also indicated to providers at the Family Planning Unit of the hospital that the client had already received some family planning guidance and could receive a streamlined version of standard counseling.
Finally, all providers received a ‘Method Information Booklet’ as a reference tool to answer more complex questions about contraceptive method use and provision.
Data Collection
The surveying team obtained written, informed consent to participate from all clients and providers who participated in the study. All data was collected using the SurveyCTO system unless otherwise stated. All surveys and tests took place in private areas of the facilities where clients and providers could not be overheard, or via mobile phone.
Surveying Approach
Clients
The implementation team used the SurveyCTO platform to deliver structured questionnaires to clients at each of the target facilities. Clients were surveyed after they had received care, but before they left that unit of the hospital. At the end of these questionnaires, clients were asked if they would be willing to share their mobile phone number and answer a short follow-up call 14 days later. Follow-up phone surveying was included based on feedback received from local stakeholders during the intervention design. Stakeholders shared that women often take time to consult with their husbands or other family members before beginning a family planning method, and that delayed surveying would capture such uptake.
Questions at baseline and endline day-of surveying focused on assessing the following: demographic characteristics; current contraceptive use and attitudes; quality and structure of family planning counseling as part of routine care; and plans and preferences for contraceptive uptake. Surveys delivered via phone at the 14-day phone follow-up were substantially briefer. These focused on current and intended contraceptive use alongside reasons for non-use.
Due to issues with client flow at some of the intervention facilities, some baseline surveying was delivered over the phone rather than in person. These phone surveys used the same questionnaire structure and approach as the in-person surveying.
Data analysis
We used Pearson’s chi-squared test to evaluate our primary hypothesis: postpartum women in the post-intervention group will have a higher level of current and intended modern contraceptive use than postpartum women in the pre-intervention group across both intervention packages. When samples were small, Fisher’s exact test was used.
Pearson’s chi-squared test was also used to evaluate the knowledge differences between pre- and post-intervention groups across the two arms.
Analyses were completed in R (version 4.3.2).
Ethics approval and consent to participate
The study’s authors received ethical approval from the Navrongo Health Research Centre Institutional Review Board to undertake this research. The project team also engaged the Regional Health Directorate of the Ghana Health Service in the design and delivery of the intervention. The study was conducted in accordance with the ethical standards set forth in the Belmont Report. Participants were informed of their voluntary participation in the study and were free to withhold answers at any time. They were also free to withdraw at any time without any consequences. Their consent was obtained before the commencement of the interviews and any data collection.