Cost-effectiveness of two long-lasting insecticidal nets delivery models in mass campaign in rural Mozambique

doi:10.21203/rs.2.12474/v2

Download PDF

Research note

Cost-effectiveness of two long-lasting insecticidal nets delivery models in mass campaign in rural Mozambique

https://doi.org/10.21203/rs.2.12474/v2

This work is licensed under a CC BY 4.0 License

Journal Publication

published 14 Sep, 2019

Read the published version in BMC Research Notes →

You are reading this older preprint version

Read the latest preprint version →

Objective The aim is to compare the cost-effectiveness of two long-lasting insecticidal nets (LLINs) delivery models (standard vs new) in universal coverage (UC) campaigns in rural Mozambique. Results The total financial cost of delivering LLINs was US$ 231,237.30 and US$ 174,790.14 in the intervention (302,648 LLINs were delivered) and control districts (219,613 LLINs were delivered), respectively. The average cost-effectiveness ratio (ACER) per LLIN delivered and ACER per household (HH) achieving UC was lower in the intervention districts. The incremental cost-effectiveness ratio (ICER) per LLIN and ICER per HH reaching UC were US$ 0.68 and US$ 2.24, respectively. Both incremental net benefit (for delivered LLIN and for HHs reaching UC) were positive (intervention deemed cost-effective). Overall, the newer delivery model was the more cost-effective intervention. However, the long-term sustainability of either delivery models is far from guaranteed in Mozambique’s current economic context.

Health Economics & Outcomes Research

Long-lasting insecticidal nets campaign

Universal health coverage

New and standard delivery model

cost-effectiveness analysis

Malaria

Mozambique.

Using long-lasting insecticidal nets (LLINs) can reduce malaria morbidity and mortality [1-3]. Worldwide funding for malaria control fell by 8% between 2013 and 2014 [4]. Funding for the provision of LLINs can continue to decrease [5] and it is necessary to ensure cost-effective and sustainable LLINs delivery models.

Most of the economic studies do not compare the distribution of LLINs through the same mechanisms or channel. Recently, Ntuku et al. [6] evaluated a fixed delivery strategy and a door-to-door strategy. Their findings show that the fixed delivery strategy achieved a higher LLIN coverage at lower delivery cost compared with the door-to-door strategy.

In 2015, Mozambique piloted a new model of LLIN delivery in campaign [7]. Two rural districts were intervened with a new LLIN delivery model, and two served as the control, maintaining the standard delivery model. Results of this pilot showed that 87.8% (302,648) of planned LLINs were distributed in the intervention districts compared to 77.1% (219,613) in the control districts [7].

The objective of this research is to compare the cost-effectiveness of the two delivery models in mass campaigns in rural Mozambique, and establish the most cost-effective LLIN delivery model.

Setting and location

The study was conducted in four rural districts of Mozambique. Two districts served as intervention (with the new delivery model); and two served as control (with standard delivery model). These districts were selected based on pragmatic criteria described elsewhere [7]. All four districts are rural, with limited access to health services, and low health, social and economic indicators [7, 8].

Study Design

An observational and cross-sectional study with cost-effectiveness analysis component was carried out using secondary data from the pilot study conducted between October and December 2015 [7].

Collection of cost data

The campaign costs were retrospectively collected from the providers’ perspective. The costs considered were related to training of personnel, allowances, LLINs warehouse storage, LLIN transportation vehicles rental, and materials production (pamphlets, coupons, stickers, etc).

These costs were aggregated into four categories: 1) micro-planning; 2) LLIN storage; 3) LLIN transport; 4) mobilization and training at district level, household registration, and LLIN distribution.

Costs were collected in Mozambican Metical (local currency) and United States Dollars (US$). In 2015, the exchange rate was: 1 US$ = 42.00 Meticais. No adjustment for inflation was undertaken since all cost were paid in 2015. No discount rate was applied since the temporal universe of analysis did not exceed one year.

Comparators: the two delivery models

Both delivery models are community-based. One delivery model allocates LLINs based on the assumption of one LLINs for every two persons in a household (intervention districts), and another the number of LLINs is allocated based on assumptions around households members sleeping patterns (control districts). A comprehensive description of the models is reported elsewhere [7, 8].

Measurement of effectiveness

Two endpoints were used to measure the effects of the campaign in the intervention and control districts: i) number of LLINs delivered; ii) households (HHs) achieving universal coverage (UC) target (one LLIN for every two persons). The number of HHs achieving UC was estimated according to the following steps:

Step 1: percentage of HHs achieving UC - [70.8% (95% CI: 67.6–74.0) in the intervention districts, and 59.6% (95% CI: 56.2–63.0) in the control districts] [8];
Step 2: registered HHs multiplied the step 1 results (136,985 HHs were registered in the intervention districts, and 120,246 HHs were registered in the control districts [7]).

Cost-effectiveness analyses

The following cost-effectiveness measures were calculated: i) average cost-effectiveness ratio (ACER) per LLIN delivery; ii) ACER per HH achieving UC; iii) incremental cost-effectiveness ratio (ICER); and iv) incremental net benefit (INB).

The ACER per LLIN delivered and ACER per HH achieving UC was calculated by dividing the total implementation cost by the number of LLINs delivered and number of HHs achieving UC, respectively.
The ICER (which indicates the additional amount of money needed to obtain an extra unit of health gain) was calculated by dividing the difference between the total cost by the difference of effects in the intervention and control districts.
The incremental net benefit (INB) was calculated by valuing additional effect (∆E) in dollars and then subtracting the associated additional cost (∆C): INB = (∆E x λ) - ∆C, where λ is willingness to pay (WTP) for a 1-unit gain of effect [9].

Willingness to pay (WTP) and decision rule on cost-effectiveness

Willingness to pay

Three WTP was adopted:

WTP 1) for LLINs delivered (US$ 1.32 per LLIN - adopted by the Global Fund for Mozambique in-country mass free campaign budget planning [10]);
WTP 2) for LLINs delivered plus LLIN purchases cost (US$ 9.12 per LLIN - US$ 1.32 + US$ 7.8 which was the maximum inter-quartile purchase cost for the period 2005 – 2012 [11]); and
WTP 3) for HHs achieving UC (US$ 3.30 per household). This third WTP was determined by multiplying the average number of HH members (five) [7] by US$ 1.32, and dividing by two (one LLIN for every two persons).

Decision rule

The cost-effectiveness decision rule was based on INB results. Two INB was calculated: INB for delivered LLIN (using WTP 1 and 2) and INB for HHs achieving UC (using WTP 3). A positive INB means that the new intervention extra benefits (∆E x λ) outweighs its extra costs (∆C), i.e., the new intervention is deemed cost-effective. Conversely, when INB is less than 0 (negative INB), the new intervention is not cost-effective [9].

Sensitivity analysis

A one-way deterministic sensitivity analysis was performed on the following parameters and assumptions: i) free warehouses for storing LLINs; ii) transport cost (±50%); and iii) costs of LLINs purchase (-25%, -50%). Base case cost analysis was used to calculate the percentage of deviation in the intervention and control districts. For the first two parameters, the base case was the ACER and ICER per LLIN delivered. For the third parameter, the base case was also ACER and ICER per LLIN delivered but also included the 2014 purchase cost of US$ 3.63 per LLIN for the planned 344,770 LLINs in the intervention and 284,873 LLINs in the control districts.

The US$ 3.63 per LLIN was based on the unit cost for Disease Control Technologies Royal Sentry® rectangular LLINs 190 x 180 x 180 cm of US$ 3.19; procurement fee 1.50%; outbound transport charges 11.94%; transport insurance charges 0.14%; question and answer charges 0.09%; and pre-shipment inspection charges 0.12%.

Financial costs of the LLIN campaign

The total financial cost of the campaign from the providers’ perspective was US$ 231,237.30 in the intervention districts and US$ 174,790.14 in the control districts. Cost activity category 4 and 3 comprised around 43% and 38% in the intervention districts and 50% and 41% in the control districts, respectively. Cost activity category 4 were US$ 0.06/LLIN higher in the control districts. The ACER per LLIN delivered was US$ 0.76 and US$ 0.80 in the intervention and control districts, respectively – Table 1. The ACER for HHs achieving UC was lower in the intervention districts (US$ 2.38 vs US$ 2.43) – Table 2.

Cost-effectiveness and decision rule

The overall ICER to deliver one additional LLIN was US$ 0.68, with a positive INB (intervention deemed cost-effective according to decision rule), i.e., a saving of more than US$ 50,000 per LLIN delivered would result from switching from the standard to new delivery model (with U$S 1.32 as willingness-to-pay) – Table 2. The overall ICER for one households reaching universal coverage was US$ 2.24, with a positive INB, i.e., a saving of more than US$ 26,000 per household reaching universal coverage would result from switching from the standard to new delivery model (with U$S 3.30 as willingness-to-pay) – Table 2.

Sensitivity analysis

After a sensitivity analysis, the ACER per LLIN delivered remained at a lower rate (less sensitive) in the intervention districts rather than in the control districts, i.e., the results of ACER per LLIN delivered remain robust. The cost-effectiveness of the new delivery model also remained sustained for all the parameters tested (positive INB even using WTP 2) – Table 3.

This cost-effectiveness study demonstrates that the new delivery model is the more cost-effective strategy for the universal coverage campaign. The positive incremental net benefit shows that important savings could be achieved from adopting the new delivery model (opportunity-cost).

The ACER per LLIN delivered was lower in the intervention districts. This was mainly driven by the low relative contribution of the micro-planning, LLINs transport, and district-level activities costs. The ACER per HH achieving UC was also lower in the intervention district.

Paintain et al. [12] found higher financial costs for the distribution of LLINs - US$ 1.19 (ranging from US$ 1.08 to US$ 1.41). However, Grabowsky et al. [13] found financial costs of around US$ 0.32, which is considerably lower than what was found in the present study. As for Mueller et al’s. [14] study, they incurred an implementation cost of about US$ 1.46 million to distribute 907,500 LLINs, which would give an ACER of US$ 1.6/LLIN. This ACER is higher than what was found in this study, for either the new or standard delivery model.

From a health-financing point of view, the high overall cost found for these interventions casts doubt on their long-term sustainability in low-income contexts. Mozambique allocated US$ 580.9 million (9% of the National budget) to the health sector in 2015 [15]. For an estimated 25,727,911 inhabitants in 2015 [16], this budget for the health sector corresponds to US$ 22.6 per capita [assuming this as Mozambican State willingness-to-pay (WTP)]. Taking into account the mean cost to distribute one LLIN with the new intervention (US$ 0.76), and that one LLIN would benefit two persons, the financial sustainability of the intervention would be guaranteed if a campaign were taken stand-alone by the Mozambican State and the WTP were only for the malaria programme (ICER < WTP).

However, considering that the Ministry of Health does not focus exclusively on LLIN campaigns, and other health programmes exist and require budgetary allocation, the country would not be in a position to guarantee financial sustainability for LLIN distribution. The Mozambique health sector allocated US$ 4,186,129 to the National Malaria Control Programme in 2014 [4]. Considering that 100% of the Mozambican population is at risk for malaria, this allocation corresponds to US$ 0.16 per capita (WTP), i.e., US$ 0.32 for each two persons (US$ 0.44 less than the ACER per LLIN in the intervention). This WTP clearly demonstrates the current financial un-sustainability of the country in assuming the LLINs campaign. The same conclusion holds even considering free warehouse storage, less 50% transport costs, and 50% reduction of LLINs’ purchase cost.

Bed nets campaign is still more cost-effective than indoor residual spraying (US$ 5.41 per person protected) [17], RTS,S (US$ 39.25 per fully vaccinated child) [18, 19], and treatment (US$ 2.59 per person tested and treated) [20]. This is in line with what Winskill et al. [21] found in their modelling cost-effectiveness study. In conclusion, the new delivery model is worthwhile (INB positive) from a programme provider perspective and current donor economic outlook. However, the long-term sustainability of either delivery models is far from guaranteed in Mozambique’s current economic context.

Limitations

One of the limitations is the adopted WTP. The WTP is often estimated through extensive surveys and is not always available [22]. The rationale for using the three ceiling is not only justifiable, but it is also appropriate to the country context. However, it is suggested that each country should adopt their own value for money ceiling, or make use of net benefit approach with cost-effectiveness acceptability curve if the ceiling is unknown plotting probability of cost-effectiveness against variation of the ceiling. Another limitation is the one-way sensitivity analyses. In the “real-world” more than one parameter varies at a time, and correlation between variation in multiple parameters can overstate uncertainty.

ACER – Average cost-effectiveness ratio;

HH / HHs – Household / Households

ICER – Incremental cost-effectiveness ratio;

INB – Incremental net benefit;

LLIN / LLINs – Long-lasting insecticidal net / Long-lasting insecticidal nets;

OR - Odds Ratio;

SA – Sensitivity Analysis;

UC – Universal Coverage

WTP – Willingness-To-Pay;

Ethics approval

The study was administratively authorized by the Provincial Health Departments of Zambezia (Ref 2270/DPSZ/512/2015) and Manica (09/11/2015), and also received authorization from the National Committee on Bioethics in Health (Ref 112/CNBS/2015).

Consent for publication

Not applicable

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author, upon reasonable request.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

JAHA conceived and designed the protocol, performed data analysis, and wrote the manuscript. BC, ML and CM supported critical manuscript review. MROM supported the protocol design, data analysis, contributed to manuscript writing. All authors read and approved the final manuscript.

Acknowledgements

The authors would like to acknowledge the contributions of World Vision Mozambique and the Foundation for the Community Development for providing the financial records. The corresponding author would like to also acknowledge Prof. Giuliano Russo for encouragement and initiation in the field of health economics.

Funding

The LLIN universal coverage campaign in Mozambique was supported through a financial contribution of Global Fund to Fight AIDS, Tuberculosis, and Malaria. The Funding body did not have any role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Bennett A, Smith SJ, Yambasu S, Jambai A, Alemu W, Kabano A, et al. Household ownership and use of insecticide-treated mosquito nets in Sierra Leone 6 months after a national mass-distribution campaign. PLoS ONE. 2012; 7: e37927.
Walker PGT, Griffin JT, Ferguson NM, and Ghani AC. Estimating the most efficient allocation of interventions to achieve reductions in Plasmodium falciparum malaria burden and transmission in Africa: a modelling study. Lancet Global Health. 2016;4:e474-84.
Winskill P, Walker PGT, Griffin JT, and Ghani AC. Modeling the cost effectiveness of introducing the RTS,S malaria vaccine relative to scaling up other malaria interventions in sub-Saharan Africa. BMJ Global Health 2017; 2 (1) e000090.
WHO Global Malaria Programme. World Malaria Report. Geneva; 2015. Available from: http://www.who.int/malaria/publications/world-malaria-report-2015/en/ [Accessed 20th May 2017].
WHO Global Malaria Programme. World malaria report. Geneva; 2012. Available from: http://www.who.int/malaria/publications/world_malaria_report_2012/report/en/ [Accessed 20th May 2017].
Ntuku HM, Ruckstuhl L, Julo-Réminiac J-E, Umesumbu SE, Bokota A, Tshefu AK, et al. Long-lasting insecticidal net (LLIN) ownership, use and cost of implementation after a mass distribution campaign in Kasaï Occidental Province, Democratic Republic of Congo. Malaria Journal 2017; 16:22.
Arroz J, Mendis C, Pinto L, Candrinho B, Pinto J, and Martins MRO. Implementation strategies to increase access and demand of long-lasting insecticidal nets: a before-and-after study and scale-up process in Mozambique. Malaria Journal 2017; 16:429.
Arroz J, Candrinho B, Mendis C, Varela P, Pinto J, and Martins MRO. Effectiveness of a new long lasting insecticidal nets delivery model in two rural districts of Mozambique: a before–after study. Malaria Journal 2018; 17:66.
Hoch JS; Dewa CS. A Clinician’s Guide to Correct Cost-Effectiveness Analysis: Think Incremental Not Average. The Canadian Journal of Psychiatry 2008; 4 (53): 267-274. Available from: http://journals.sagepub.com/doi/pdf/10.1177/070674370805300408 [Accessed 27th February 2018].
MISAU and WVM. Adenda ao Memorando de Entendimento entre o Ministério da Saúde da República de Moçambique e a Organização Não Governamental Visão Mundial Moçambique. 2017. (Unpublished).
Wafula F, Agweyu A, and Macintyre K. Regional and temporal trends in malaria commodity costs: an analysis of Global Fund data for 79 countries. Malaria Journal 2013, 12:466.
Paintain LS, Awini E, Addei S, Kukula V, Nikoi C, Sarpong D, et al. Evaluation of a universal long-lasting insecticidal net (LLIN) distribution campaign in Ghana: cost effectiveness of distribution and hang-up activities. Malaria Journal 2014, 13:71.
Grabowsky M, Nobiya T, Ahun M, Donna R, Lengor M, Zimmerman D, et al. Distributing insecticide-treated bed nets during measles vaccination: a low-cost means of achieving high and equitable coverage. Bulletin of the World Health Organization 2005, 83:3.
Mueller DH, Wiseman V, Bakusa D, Morgah K, Daré A, and Tchamdja P. Cost-effectiveness analysis of insecticide-treated net distribution as part of the Togo Integrated Child Health Campaign. Malaria Journal 2008, 7:73.
UNICEF. Informe Orçamental 2015: Saúde. Available from: http://budget.unicef.org.mz/informes/2015UNICEF_BB2015_Saude.pdf [Accessed 20th May 2017].
Instituto Nacional de Estatística. III Recenseamento Geral da População e Habitação 2007. Moçambique; 2007. Available from: http://www.ine.gov.mz/estatisticas/estatisticas-demograficas-e-indicadores-sociais/projeccoes-da-populacao [Accessed 20th May 2017].
PMI. President’s Malaria Initiative Africa Indoor Residual Spraying Project. 2012. Available from: http://www.africairs.net/ [Accessed 7th September 2017].
Penny MA, Verity R, Bever CA, Sauboin C, Galactionova K, Flasche S, et al. Public health impact and cost-effectiveness of the RTS,S/AS01 malaria vaccine: a systematic comparison of predictions from four mathematical models. Lancet 2016; 387:367–75.
Galactionova K, Bertram M, Lauer J, and Tediosi F. Costing RTS,S introduction in Burkina Faso, Ghana, Kenya, Senegal, Tanzania, and Uganda: a generalizable approach drawing on publicly available data. Vaccine 2015; 33:6710–18.
Okell LC, Cairns M, Griffin JT, Ferguson NM, Tarning J, Jagoe G, et al. Contrasting benefits of different artemisinin combination therapies as first-line malaria treatments using model-based cost-effectiveness analysis. Nat Commun 2014;5:5606.
Winskill P, Walker PGT, Griffin JT, and Ghani AC. Modeling the cost effectiveness of introducing the RTS,S malaria vaccine relative to scaling up other malaria interventions in sub-Saharan Africa. BMJ Global Health 2017; 2 (1) e000090.
Hounton S and Newlands D. Applying the net-benefit framework for assessing cost-effectiveness of interventions towards universal health coverage. Cost Effectiveness and Resource Allocation 2012, 10:8.

Table 1: Total cost and cost per LLIN delivered (US$) for each category in the intervention and control districts

	Intervention (new delivery model)		Control (Standard delivery model)
LLIN delivered	302,648		219,613
Aggregated and standardized categories	Cost	%	Cost	%
1. Micro-planning	6,184.85	2.7	5,580.84	3.2
ACER per LLIN delivered	0.02		0.03
2. LLIN warehouse storage	6,983.76	3.0	6,880.33	3.9
ACER per LLIN delivered	0.02		0.03
3. LLIN transport	86,908.64	37.6	71,007.48	40.6
ACER per LLIN delivered	0.29		0.32
4. Mobilization, trainings at district level, household registration, and LLIN distribution	99,105.53	42.9	86,736.97	49.6
ACER per LLIN delivered	0.33		0.39
4.1 Coupons and Stickers production	32,054.52	13.9	NA	NA
ACER per LLIN delivered	0.11		NA
4.2 Household registration data analysis	NA	NA	4,584.52	2.6
ACER per LLIN delivered	NA		0.02
Total cost	231,237.30	100.0	174,790.14	100.0
ACER per LLIN delivered	0.76		0.80

NA = Not Applicable. Household registration data analyses were not necessary in the intervention districts; coupons and stickers were not used in the control districts.

Table 2: Comparative cost-effectiveness results in the intervention and control districts

Effects and cost-effectiveness indicators	Intervention (New delivery model)	Control (Standard delivery model)
Delivered LLINs	302,648	219,613
Registered Households	136,985	120,446
HHs achieving UC (%)	70.8	59.6
HHs with UC	96,985	71,786
Total cost (U$S)	231,237.30	174,790.14
ACER for HHs achieving UC (U$S)	2.38	2.43
∆ Cost (U$S)	56,447.16
∆ Effect (LLINs delivered)	83,035
∆ Effect (HHs achieving UC)	25,199
ICER for delivered LLIN (U$S)	0.68
ICER for HHs achieving UC (U$S)	2.24
INB for delivered LLIN (U$S)	+53,159.04
INB for HHs achieving UC (U$S)	+26,709.54

Table 3: Deterministic one-way sensitivity analysis of cost estimates to key assumptions

Parameter tested	Control / Intervention districts	Cost (US$)	ACER _LLIN	% ACER _LLIN deviation	ICER _LLIN	% ICER _LLIN deviation	INB _LLIN
Free warehouse	Control	167,909.81	0.76	-4.43
Free warehouse	Intervention	224,253.54	0.74	-2.50	0.68	-0.18	53,262.46

Transport cost (+50%)	Control	210,293.88	0.96	19.70
Transport cost (+50%)	Intervention	274,691.63	0.91	19.42	0.78	14.09	45,208.45

Transport cost (-50%)	Control	139,286.40	0.63	-20.72
Transport cost (-50%)	Intervention	187,782.98	0.62	-18.36	0.58	-14.08	61,109.62

LLIN Purchase cost + delivery cost	Control	1,214,576.59	5.53	NA
LLIN Purchase cost + delivery cost	Intervention	1,489,647.80	4.92	NA	3.31	NA	482,207.98

Less 25% LLIN Purchase cost + delivery cost	Control	954,629.98	4.35	-21.39
Less 25% LLIN Purchase cost + delivery cost	Intervention	1,175,045.18	3.88	-21.09	2.65	-19.80	536,864.00

Less 50% LLIN Purchase cost + delivery cost	Control	694,683.36	3.16	-42.80
Less 50% LLIN Purchase cost + delivery cost	Intervention	860,442.55	2.84	-42.21	2.00	-39.69	591,520.01

NA – Not applicable because is the new base case with the inclusion of LLIN purchase cost into delivery cost.

Download PDF

Journal Publication

published 14 Sep, 2019

Read the published version in BMC Research Notes →

Editorial decision: Minor revision
01 Sep, 2019
Editor assigned by journal
31 Aug, 2019
Submission checks completed at journal
30 Aug, 2019
Editor invited by journal
30 Aug, 2019

You are reading this older preprint version

Read the latest preprint version →

Cost-effectiveness of two long-lasting insecticidal nets delivery models in mass campaign in rural Mozambique

Status:

Journal Publication

Version 2

Abstract

Introduction

Methods

Results

Discussion

List of Abbreviations

Declarations

References

Tables

Status:

Journal Publication

Version 2