Design
The study has two primary objectives:
- Impact Evaluation: Evaluate the effect of the 6-month cash transfer program on viral suppression (<1000 copies/ML) at 12 months after starting ART.
The primary objective of this study is to evaluate the effectiveness of the cash transfer program using 22,500 Tanzanian Shillings (TZS)/month (as determined by Phase I) at improving the proportion of PLHIV retained on ART and with suppressed viral load at 12 months after starting ART. Using a cluster randomized control trial, with our sample size of 32 clinics and 1,984 participants (62 participants per clinic), we will have 80% power to detect a risk difference (RD) of 11 percentage points in viral suppression at 12 months between the participants attending intervention and control clinics.
The secondary outcomes of the impact evaluation are:
- Viral suppression (<1000 copies/ml) at 6 months;
- Retention on ART at 6 and 12 months;
- The proportion virally suppressed of those retained on ART at 6 and 12 months; and
- Appointment attendance, the proportion of scheduled visits that were completed during the 0-6 and 0-12 month periods.
- Implementation Study: Understand implementation successes and challenges through measurement of implementation outcomes, and use lessons learned to inform wider adoption of cash transfer programs for PLHIV.
Although evidence from our previous studies demonstrate preliminary effectiveness of cash transfers on HIV-related outcomes, we do not yet know the optimal strategy for implementing this type of system at a larger scale and outside of a research setting. Thus, in anticipation of the potential adoption of the program by the Ministry of Health or others, a primary objective of this study is to gather information related to successful implementation practices and challenges needing attention before scaling.
To address these aims, we will conduct a Type I hybrid implementation-effectiveness study using a two-arm, cluster randomized controlled trial (Objective #1, “impact evaluation”) with the health facility as the unit of randomization (see Figure 1). To measure implementation outcomes (Objective #2, “implementation study”) following Proctor’s framework (34), quantitative and qualitative interviews will be conducted with clinic staff (pharmacy staff, registration staff, clinicians), clinic management, and patients at participating sites. Results will be used to assess heterogeneity in implementation practices and thus inform optimization for potential scale-up. The study will be conducted at 32 HIV primary care clinics in the following Lake Zone regions in Tanzania: Shinyanga, Mwanza, Kagera, and Geita.
Theoretical Framework
The use of incentives for ART treatment adherence is supported by several theories, including Self Determination Theory, which describes engagement in an activity because of an external reward like a cash transfer (35). In addition, microeconomic theory posits that people acquire more of a less costly good, and less of a more expensive one (36) and that individuals often have high discount rates or “present-biased preferences,” placing disproportionate weight on the present while largely ignoring the future (37,38). An implication is that when a behavior, like attending an HIV care visit, has small immediate costs and large delayed benefits, a small immediate incentive may counteract the present costs and tip the balance towards the positive behavior (37,39). The use of incentives for behavior change is also supported by behavioral economic theory, which incorporates constructs from psychology to account for the predicable irrationalities, heuristics, and biases of human behavior (40). For example, “nudges” or short-term, small incentives can change behavior (41,42) and create new habits (43) – a goal of the short-term cash transfer intervention.
The implementation science portion of the hybrid trial is guided largely by Proctor’s implementation science framework, which explores implementation successes and challenges at multiple levels, including the patient, provider and clinic (34). The study design follows closely the typology of hybrid designs outlined by Curran et al (33) (Type I in our case), for which the primary question is related to whether the intervention will work in real-world clinical settings; and the secondary question relates to the potential barriers and facilitators of widespread adoption of the intervention (Proctor’s framework).
Clinic Recruitment
We will engage Regional Medical Officers (RMOs) in Shinyanga, Geita, Mwanza and Kagera Regions, Tanzania to create a sampling frame of eligible study facilities within each region. Initial eligibility criteria for clinics is as follows:
- Currently use an electronic medical records database;
- Average of at least 65 new ART initiates per quarter in 2019, with no fewer than 35 ART initiates in any single quarter in 2019;
- Within 100km driving distance of a city center (either Bukoba, Mwanza, Geita, Kahama, or Shinyanga cities); and
- A minimum of 15km from another study clinic.
The team will approach and enroll eligible selected sites in a randomly assigned order (1 to 10 within each region) until the target enrollment is reached, with the goal of having 32 sites enroll in the study.
Study Arms
Control Arm
Participants in the control arm will receive the standard of care for PLHIV per the National Guidelines in Tanzania (44), as delivered by the participating health facilities. In addition to the standard of care, the mHealth system developed and utilized in the previous (optimization) trial will be implemented in all study clinics (intervention and control). This system was successfully used in the clinics to enroll study participants, track patient appointment attendance, and disburse cash transfer payments for those eligible using automated mobile money transfers (32). We will adapt this mHealth system for the current study and implement it in all study facilities (intervention and control) for enrolling participants, tracking participant visits, sending appointment reminders, and sending cash transfers via mobile banking (cash transfer group only; consistent with procedures used in our previous studies). This strategy is consistent with the Ministry of Health goal of using mHealth strategies for patient care management in Tanzania, as incorporated into the National Strategy for HIV Care (45).
Intervention Arm
In addition to the mHealth system as described above, participants in the intervention arm will have the opportunity to receive up to 6 consecutive monthly cash transfers of 22,500 TSH (~$10) each, conditional on visit attendance with the HIV care provider. Cash transfers will be given once monthly for up to 6 months, spaced ≥25 days apart (consistent with National Guidelines for monthly or bimonthly visits (44)). This means that the cash transfer is only given when the patient visits the clinic for their routine appointment, regardless of whether the visit is earlier or later than the scheduled appointment (but no earlier than 25 days since the last transfer). Upon the monthly visits when a patient checks in for their appointment (via fingerprint or entry of clinic ID), the cash transfer will be automatically distributed through the mHealth system. Transfer amounts are exclusive of transaction fees (<$1), which will also be included in the transfer. Thus, the intended amount is transferred to the patient upon withdrawal.
If a participant does not have a mobile money account: 1) s/he can sign up and return to the clinic on a different day to link this account to the mHealth system, or 2) s/he may ask a trusted friend or relative to receive the transfer. Mobile money is a secure and convenient way for financial transactions, as mobile money kiosks are ubiquitous in the study regions and mobile phone ownership in Tanzania is high and approaching levels in the U.S. (75% in 2018 and rapidly increasing (46)). For participants who do not have mobile banking, wherever possible we will make referrals to kiosks where they can sign up for the service, if desired. In the most recent study, we found that 88% of participants had access to a mobile phone and 79% had access to mobile banking.
Rationale for the cash amount and duration
Our now-completed study to optimize the intervention found that both cash transfer amounts (10,000 TSH and 22,500 TSH per month) significantly improved 6-month viral suppression versus the standard of care. At 6 months, we found a positive trend between incentive size and HIV viral suppression (OR=1.10 per 2500 TZS, 95% CI: 1.03 to 1.17). Further, we found that both cash amounts significantly improved HIV viral suppression over the comparison group [10,000 TSH: 83% vs. 73%, risk difference (RD)=10.2, 95% CI: 1.6–18.8; 22,500 TSH: 85% vs. 73%, RD=12.1, 95% CI: 3.6–20.6]; there was no significant difference between incentive groups (RD=1.9, 95% CI: -5.8 to 9.7). However, only the larger cash value yielded significant improvements over the standard of care for the secondary outcomes of retention in care (RD=7.1, 95% CI: 0.3 to 13.9) and viral suppression among the subset retained in care (RD=7.8, 95% CI: 0.9 to 14.7). To determine the final cash transfer size for the current study, we followed our pre-registered analysis plan (at AsPredicted), as well as several additional analyses including: a cost analysis, discussions with local stakeholders, including the Regional Medical Officers, and co-investigators, assessment of budgetary trade-offs associated with a smaller cash transfer versus larger study size, and consideration about the benefits and weaknesses of various cash amounts (including power considerations and the ethics of engaging in a statistically under-powered study; for example powering the study for the smaller amount would require twice as many clinics in the study, or the study would be significantly underpowered). In addition, with expansion to additional regions, some with higher average levels of socioeconomic status than the region included in the optimization trial, there was some concern that the smaller transfer would be of lower value and thus not enough to improve adherence. Finally, the larger cash amount is of comparable magnitude to the monthly payments distributed through Tanzania’s social action fund, TASAF. After considering these factors, many of which are context-specific, we determined that the effectiveness evaluation will include a cash transfer amount of 22,500 TSH per month for 6 months.
The intervention is intended to fit within the differentiated model of care in Tanzania, in which patients starting ART are scheduled monthly clinic visits until the first viral load test at 6 months after ART initiation. At that time, “stable” patients (those who have attained viral suppression) are given two/three-month refill appointments and/or the opportunity to send a substitute for ART refills or to obtain refills at community-based locations. However, at 6 months, unstable patients (those without viral suppression) continue monthly visits, with enhanced adherence interventions or change of regimen, depending on clinical, immunological, and virological criteria, until they are determined to have stabilized. Note that we will track participation in enhanced adherence counselling among participants in both arms and present this in our results. Thus, the intervention is intended to support patients during the vulnerable first 6 months of treatment before the 6-month decision point for access to a less intensive clinic schedule.
Randomization and Masking
Once facilities are selected for the study and have agreed to participate, we will randomize 32 facilities to either the SOC or the cash transfer intervention group at UC Berkeley using the cvcrand package (cvrall command) in R statistical software (47). To ensure that the arms are balanced on important covariates, and to mitigate the possibility of ineffective randomization due to the small numbers of clinics in the study, we will use a constrained randomization process (48). This process essentially pre-determines a set of acceptable allocations into intervention and control clusters based on covariates of relevance, and then randomly selects an allocation from the list of acceptable allocations (48). Specifically, based on our experience in phase 1, we will include the following covariates in the constrained randomization process: geographic region (Geita, Kagera, Mwanza or Shinyanga), facility level (hospital, health center or dispensary), driving distance to a major city (km), proximity to a major road (<5km), and average number of ART initiates per quarter. We will stratify on geographic region. The 32 sites will be randomized 100,000 times and we will select the unique schemes as the randomization space. Those iterations with an l2 balance score less than the q = 0.1 cutoff will be retained. Among those remaining iterations where there was little to no imbalance detected, we will check for validity of the constrained randomization (e.g., no deterministic allocation of clusters into arms) and ensure that there are sufficient constrained randomizations from which to randomly select a single randomization scheme.
Facility staff will not be blinded to intervention assignment. However, other clinic staff will not be informed that there are intervention and control clinics in the study, and clinical staff trainings for intervention clinics and control clinics will be conducted separately. In addition, participants will not be told during the consent process that as part of the study there are intervention and control clinics. The rationale for this is to prevent behavioral changes such as patients transferring from control to intervention clinics if they find out that there are some clinics offering cash transfers to new ART clients. Although this is not expected to be a significant problem based on feedback from local and regional health authorities, given the small incentive value and that participating facilities will be at least 15km apart, large numbers of transferring patients could compromise the integrity of the study and will create an undue burden for facility staff at intervention clinics.
Recruitment of Participants
Impact Evaluation: Recruitment of individuals for participation in the impact portion of the study will take place within the enrolled clinics. All patients at study clinics who meet the following inclusion criteria will be offered the opportunity to participate in the study:
- Greater than or equal to 18 years of age
- Living with HIV infection
- Initiated on ART (for the first time) less than or equal to 30 days prior to enrollment in the study
- Have access to a mobile phone (ownership, shared ownership, or access to a trusted person’s phone)
- Do not intend to transfer to a different facility for HIV care within the next 12 months.
Eligible PLHIV at both intervention and standard of care sites will be automatically identified by the mHealth system upon registration in the system at a routine visit. An automatic prompt will direct clinic registration staff (who will manage the process) to the appropriate consents and forms in the mHealth system, including permission to access patient data as part of the study. If the patient consents, s/he will automatically be assigned a study ID. The study will use non-competitive enrollment so that we can achieve approximately equal numbers of study participants per site, with a goal of 62 per site. Sites that reach this goal early will discontinue enrollment.
Implementation Study: Recruitment for participation in the implementation science portion of the study for clinic staff will take place in the intervention clinics once all participants have reached their 6-month post-ART timepoint and the cash transfer period (of 6 months) has ended. We will purposefully select staff from the all study clinics such that our interviews include all levels of staff impacted by the changes in the clinic as related to implementation of the intervention (e.g., nurses, registration staff, physicians, In-Charges, pharmacists). Similarly, patients who have consented to and enrolled in the study will be purposefully sampled to assess their experiences with the cash transfer program and the mHealth system after their completion of cash transfer eligibility at 6 months. Specifically, we will interview patients who: a) received all six cash transfers; b) received three or fewer of the six possible transfers; c) enrolled in mobile money as a result of the study; d) were virally suppressed at 6 months; e) were not virally suppressed at 6 months in addition to ensuring representation of both men and women and a range of ages.
Outcomes and Data Collection
Primary outcome measure (impact evaluation, Objective #1): The primary endpoint is viral suppression at 12 months, defined as the proportion of PLHIV retained in HIV primary care and with suppressed HIV viral load 12 months after starting ART. The primary outcome is expressed as a binary variable, defined as PLHIV who are on ART and with sufficient HIV viral suppression (<1000 copies/ml, WHO’s threshold for virologic failure in low and middle income countries (49)) versus not on ART or viral failure (≥1000 copies/ml). This outcome definition reflects global “treatment as prevention” strategies including the UNAIDS 95-95-95 targets, which aim for at least 95% of PLHIV to be on ART and 95% of those on ART virally suppressed. Patients considered not on ART include those who died, stopped ART and/or disengaged from care, or have not apparently received ARVs for ≥28 days since their last missed pharmacy pick-up [i.e., are lost to follow-up (LTFU)] following PEPFAR Monitoring, Evaluation, and Reporting Indicator Reference Guide Version 2.3 for current ART(50).
Secondary outcome measures (impact evaluation, Objective #1):
- Viral suppression (<1000 copies/ml) at 6 months;
- Retention on ART at 6 and 12 months;
- The proportion virally suppressed of those retained on ART at 6 and 12 months; and
- Appointment attendance, the proportion of scheduled visits that were completed during the 0-6 and 0-12 month periods.
Primary outcome measures (implementation study, Objective #2): Implementation outcomes assessed through in-depth interviews and surveys with patients and clinical staff: Adoption, acceptability, penetration, fidelity, feasibility, appropriateness, sustainability; plus usability (Table 1).
Data Collection: Data collection will include the following:
- Medical record review for the primary outcome, viral suppression, at 6 and 12 months
- Surveys with patients at intervention and control clinics at baseline and 6 and 12 months (n=1,984)
- In-depth interviews with patients in the intervention clinics at 6 months (n=30)
- Surveys with clinical staff at intervention and control clinics at 6 months (n=110)
- In-depth interviews with clinical staff at intervention and control clinics at 6 months (n=40).
We linked each data collection activity for the implementation study to implementation outcomes in the Proctor et al. framework (Table 1). (34) We will analyze data from structured surveys and in-depth interviews to examine the implementation constructs of acceptability, penetration, sustainability, appropriateness, adoption, feasibility, and fidelity. We will use validated surveys to assess the usability of the mHealth system from both the clinic staff and patient perspectives, including the System Usability Scale (51) and the Health Information Technology Usability Evaluation Scale (52).
Participant Tracing – Impact Evaluation: As retention in care is included as part of the definition of the primary outcome of this study (i.e., those not retained on ART are included in the denominator of the primary outcome of viral suppression), no additional retention activities will be implemented other than the routine procedures already in place and led by clinical staff. According to national guidelines, patients who miss a scheduled appointment are tracked in the community by a system of home-based care providers (HBCs); this system will remain in place during the study. In addition, we will closely track implementation of patient tracking as specified in the national guidelines within each study clinic so that we can capture any variation in implementation at the clinic level. Research staff will not be involved in tracing participants at any study facility during the 12-month follow-up of each participant. At endline only (12 months), research assistants will enhance these procedures with additional robust tracing using ‘gold-standard’ tracing methods (at least 3 tracing attempts using multiple methods), procedures to investigate all potentially LTFU patients, confirm ‘silent transfers’ (those who transfer to new facilities without notification of the prior facility) and deaths, and refer patients to health facilities where missing plasma specimens can be collected by health facility staff for viral load quantification.
Statistical Analysis
Power Calculation: The sample size was determined for the impact study to evaluate the effectiveness of the cash transfer program at improving the proportion of PLHIV with suppressed viral load (<1000 copies/ml) at 12 months. We used estimates of viral suppression at 12 months and ICC=0.05, estimated from a previous cluster randomized study of HIV treatment adherence that we conducted among HIV-infected pregnant women in Shinyanga Region, an ICC consistent with previous studies.(53) Using site-adjusted data about viral suppression at 6 months from Phase I (75.2% in the control group), along with estimates of viral suppression decline between 6 and 12 months, we estimate that viral suppression among adults at 12 months in the comparison sites will (conservatively) be 70%. With an ICC of 0.05, 32 facilities, 80% power, and 56 PLHIV per clinic (n=1,792), the minimum detectable effect is 11 percentage points as an absolute reduction in the proportion experiencing viral suppression. In the second trial (optimization) we achieved a 12.6 percentage point difference with the 22,500 TSH cash transfer at 6 months, so we believe this effect size is achievable. In addition, if viral suppression is lower than expected in the comparison arm, and the effect of the intervention remains stable, power will increase. We will inflate the target sample size by 10% to n=1,984 (62 participants per clinic across 32 clinics) to account for unexpected issues or significant differences in the enrollment between clinics.
Data Analysis – Impact Study: We will conduct an intent-to-treat analysis to determine the effect of the intervention on 12-month viral suppression (the primary outcome). We will conduct a cluster-based permutation test on the individual-level outcome data, which accounts for clustering within clinic. The effect estimate of interest is the risk difference of viral suppression among PLHIV attending intervention versus comparison facilities. We will pre-register our analysis plan at AsPredicted.
We will conduct several secondary analyses of the primary outcome, although we are not powered for these analyses. We will examine heterogeneity in the primary analysis by facility and patient characteristics. We will also conduct a treatment-on-the-treated analysis to isolate the impact of incentive delivery (54–56).
Using the same methods as for the primary analysis, we will also assess effects on the following key secondary outcomes:
- Viral suppression (<1000 copies/ml) at 6 months;
- Retention on ART at 6 and 12 months;
- The proportion virally suppressed of those retained on ART at 6 and 12 months; and
- Appointment attendance, the proportion of scheduled visits that were completed during the 0-6 and 0-12 month periods.
We will additionally assess effects on the following survey-based outcomes at 6 and 12 months:
- Food security
- Mental health (anxiety, depression)
- Hopefulness
- IPV
- Self-efficacy
- Participation in the labor force / functional status
- Other indicators of household welfare (e.g., investment in small businesses)
Data Analysis – Implementation study: Following each in-depth interview, the interviewer will memo then debrief with the study team to discuss emergent themes. Debriefings will be held weekly with interviewers and the PI to ensure consistency and quality of data collection. Audio-recordings from IDIs will be verbatim transcribed and translated into English. Data analysis will follow an open-coding approach (57,58) and will be based on research questions, study aims, and Proctor’s implementation constructs. An initial coding framework will include a list of predefined analytical terms relating to Proctor’s constructs; however, data analysis will be iterative, allowing new themes to emerge throughout the analysis process(59). Data will be coded independently by two members of the research team using Dedoose qualitative coding software. Concepts will be grouped into categories, and main themes will be extracted and summarized in an analytic theme matrix.
Implementation outcome data from structured surveys with clinical staff will be analyzed descriptively using both STATA and Dedoose. We will synthesize quantitative and qualitative data to produce a comprehensive set of implementation outcome indicators. We will then use the implementation indicators to assess variation in how the program was implemented across the intervention clinics, for example, exploring levels of penetration and fidelity of the mHealth system, and explore variation in effectiveness using a sensitivity analysis. Note that we are not powered to show statistical differences in viral suppression by variation in implementation outcomes.