The conditions for the csMBA described here were optimized for reagent efficiency and allowed a detection range greater than 4.4 orders of magnitude for Pf, Pv210 and Pv247 when using positive controls. The csMBA improved lower detection limits 56-fold, 17-fold and 66-fold for Pf, Pv210 and Pv247, respectively, when compared to the csELISA and allowed for simultaneous detection of the three antigens. The process of multiplexing for these analytes allows a single csMBA run to generate the same amount of data as three csELISAs. In addition, the volume of antibody used in the csMBA was decreased by 80% for Pf and 66% for Pv210 and Pv247 and the amount of sample used to test for Pf, Pv210 and Pv247 decreased from 150µl to 50µl over the standard csELISA. The csMBA required approximately 3.5 hours of hands-on preparation compared to approximately 5.5 hours for the csELISA. Analysis steps for the csMBA performed using the Bio-Plex® 200 took approximately 1.75 hours (passive time once analysis was initiated) while absorbance value acquisition for a csELISA plate took less than a minute with the SpectraMax 200. Thus, with the csMBA, instrument availability was the rate-limiting factor. Generally, the speed of MBA analysis varies based on settings within the software and how many beads are in the microplate wells but can be expected to take one to two hours. However, considering that the multiplex reader can analyze four 96-well csMBA assays in a typical workday, and each csMBA procedure simultaneously assays three sporozoite antigens, this is the equivalent of 12 csELISA 96-well plates (due to the single-plex nature of the csELISA). The availability of streamlining processes in the laboratory such as a plate washer, multichannel pipettes or a tissue homogenize, (like the TissueLyser) can enable more high-throughput sample processing. A workflow to prepare and analyze four plates by csMBA might look as follows: four plates are prepared simultaneously on day one and one of those plates is analyzed on the instrument overnight while the remaining three are stored in the refrigerator. On day two (after being washed twice with 200µl of PBS-T, resuspended in 100µl PBS and a briefly shaken at 900 rpm), the remaining three plates can be consecutively analyzed on the instrument while four new plates are simultaneously prepared. At the end of day two, one “day two” plate is run overnight, continuing the workflow cycle. To obtain a comparable amount of data by csELISA, twelve plates would need to be simultaneously prepared and analyzed daily (see Additional file 3).
In addition to its greater efficiency, there is no “time penalty” for adding analytes to a bead-based assay, making this an ideal platform for expanding the targets to be detected. For example, inclusion of bead-bound antibody for the detection of additional parasite antigens could be accomplished without increasing assay preparation or run time. In contrast, with the csELISA, this would require preparation of an additional assay plate, representing 5.5 hours, as well as additional sample depletion. In the context of mosquito analysis, one feasible application of this could be testing for other human Plasmodium spp., pending the development of sensitive and specific monoclonal antibodies, or host bloodmeal analysis, which, if analyzed using csELISA, requires a separate assay plate (and 50µl of sample) for each potential bloodmeal host and would be restricted due to higher required samples volumes.
The cost effectiveness of the csELISA as a laboratory method has made it a popular choice in resource-limited settings, where the malaria burden is often the highest. Initial costs of operationalizing a lab for csELISA can range from US$5-10K and for csMBA from US$20-40K. Using the materials and methods described here, and without factoring in personnel-related costs, the amount (USD) to process a mosquito for a single analyte by csELISA is approximately $0.26 and for Pf, Pv210 and Pv247 by csELISA is approximately $0.52. Comparable costs for csMBA analysis are $0.59 and $0.71, respectively (see Additional file 4). Thus, addition of each analyte represents a $0.13 increase by ELISA and $0.06 increase by MBA, therefore making MBA the more cost-efficient choice as the number of analytes being assayed increases. In the long-term, the time and cost-savings of MBA can offset the increased startup cost. Additional considerations such as decreased processing time and decreased detection limit make csMBA an attractive choice.
Lower limits of detection for the csELISA previously reported during assay development were 125 sporozoites for Pf and Pv210 and 250 sporozoites for Pv247 per mosquito equivalent [2, 4]. In contrast, our lower limits of csELISA detection were found here to be (Pf = 1400 sporozoite, Pv210 = 425 sporozoite and Pv247 = 1650 sporozoite per mosquito equivalent) and could be due to several factors. For example, differences in antibody lots, conjugation efficiency, antibody storage duration or the type of assay plate, due to differences in material, well shape and binding affinities used could all affect assay performance. Repeatability of these findings was not conducted here and thus is a limitation of this study. The csMBA detected fewer than 25 sporozoite per mosquito equivalent, thus representing a significant improvement to detection sensitivity that could help minimize this problem. This improved detection sensitivity means potentially more accurate identification of infective mosquitoes, thus reducing the possibility of false negatives and misleadingly low sporozoite rate estimations. The higher sporozoite rates determined by csMBA versus those by csELISA for mosquitoes collected in Madagascar may be due to increased assay sensitivity, that is, mosquitoes that did not contain enough sporozoite protein to be detected by csELISA but contained enough for detection by csMBA. This could be important for specimens with low levels of sporozoites and specimens where protein may have degraded due to poor storage conditions. For example, for P. falciparum, a range of 100 to 105,984 sporozoites was previously estimated using csELISA in salivary glands dissected from laboratory-infected An. stephensi [25], and 130 to 245,760 and 82 to 77,270 sporozoites were found by microscopic examination of salivary glands dissected from naturally infected An. gambiae and An. funestus, respectively [26]. The average range of the number of P. vivax sporozoites from microscopic examination of salivary glands from batches of female mosquitoes fed on infected blood under laboratory conditions has been reported as 8.17–8,347 [27]. In these examples, mosquitoes with lower sporozoite loads may be missed by the current csELISA but identified as positive using the csMBA. The two by two tables presented (Fig. 3) are difficult to interpret without knowing the infectivity status of each specimen. This can only be determined by dissection and microscopic examination of fresh specimens, which was not possible and thus, is a limitation in this study. In general, salivary gland dissections are difficult to execute as they are time consuming, time sensitive and require trained personnel [1].
The lower limit of detection observed with the csMBA when compared to the csELISA would suggest increased assay sensitivity. Therefore, it would be expected that analysis of specimens by csMBA would yield more cs-positive mosquitoes than the same analysis by csELISA. This was generally observed in this study, however, the Madagascar Pv210 results showed 5 samples positive by csELISA but negative by csMBA (Fig. 3). Without knowing the infectivity status of those mosquitoes, it is not possible to know the cause of this result. A possible explanation is that the csELISA and csMBA analyses were temporally separated for the Madagascar mosquitoes and thus, an unstable cross-reactive protein may have been detected by the csELISA that had degraded by the time csMBA analysis was conducted. Due to limited sample availability, it was not possible to boil homogenate and retest by csELISA. Ability to perform boiled retesting by csELISA may have helped to elucidate this observation and is thus a limitation of this study. A version of the csELISA protocol [16] available at the time of this study recommends initially testing all samples and retesting of positives (without boiling homogenate). This regimen creates potential to assign false positives if a cross-reactive protein is the cause for positive assay signal but also creates ambiguity if a sample tests positive initially but negative after retest. Retesting following boiling of homogenate may help to better explain and understand conflicting initial test and retest results.
It is widely accepted that the csELISA yields false positives, possibly due to detection of sporozoites circulating in hemolymph, detection of cs protein present in oocysts, or cross-reactivity of unknown protein thought to be present in livestock bloodmeals found in the mosquito digestive tract [28–30]. To address this, mosquitoes were bisected using a method shown to minimize unintended inclusion of oocysts, and homogenate was boiled prior to a portion of the retesting to denature any heat-unstable cross-reactive proteins [17]. Bisection, as described, was easier to accomplish for mosquitoes stored in ethanol (Guinea) than for dried specimens (Madagascar), which were brittle and crumbled under scalpel pressure. Mosquito storage conditions prior to analysis can also influence assay results, as protein can break down over time and mold or bacteria can grow if specimens are not properly desiccated. Thus, when possible, cold storage in 70% ethanol may help to improve protein preservation, minimize microbial growth, and enable proper dissection. Methods of storage and quality control measures were not systematically assessed in this study but may provide additional opportunity to further increase csELISA and csMBA sensitivity and specificity. An approach where sporozoite status is determined by microscopy and then those salivary glands are analyzed by csELISA and csMBA would help to determine the true sensitivity and specificity of these laboratory assays, though even these types of studies can yield variable results [1, 5, 31]. Thus, proper bisection before testing specimens, followed by a regimen of boiled retesting of any initial positives is likely to increase confidence in the sensitivity of resulting sporozoite rates.
The assay signal cutoff value often used for immunoassays is the average of the negative controls plus three standard deviations [32], and anything above this cutoff value is considered “positive”. Minimal variation in the negative controls can reduce the cutoff value and potentially result in false positives. In the case of the csELISA, the current protocol prescribes using a cutoff value that is the average of the absorbance values of the negative controls, multiplied by two (without adjusting for background absorbance) [16, 20]. Depending on the contribution of the background, this can lead to artificially high cutoff values and can create the potential for false negatives. In addition, negative control mosquitoes are often obtained from a source independent of the test mosquitoes which introduces variables such as storage conditions and environmental exposures, meaning these types of negative controls are not a true representation of collection negatives. Given these issues, an alternative method for determining positives is to choose a cutoff value that allows confident detection based on lower limits of detection. For example, with the csMBA, an MFI value of 100 (Table 3) would allow as few as 6 sporozoites per mosquito equivalent to be scored as a positive. Increasing this cutoff value would create potential for false negatives and conversely, decreasing it would create potential for false positives. To address this, boiling and retesting homogenate from samples above the cutoff will eliminate false positives that may be caused by heat-unstable cross-reactive proteins and strengthen the validity of the results. Further, to properly assess and compare results across multiple assay plates using an absolute cutoff, the background absorbance or fluorescence contribution specific to each assay plate (determined by assaying “grind buffer only” wells) should be subtracted from each sample reading.
Whether conducting csELISA or csMBA, a set of standardized quality control procedures can be established and conducted before a project begins and with each assay to increase confidence in results. For example, prior to starting a project, a sufficient volume of capture antibody, detection antibody and positive control can be prepared for use with all samples in a study. These preparations should be stored in aliquots to minimize freeze-thaw degradation and for protection from light to prevent photobleaching. A standard curve can then be generated in triplicate, using the prepared recombinant positive controls and antibodies. The standard curve data can be used to ensure a wide range of detection is possible and that the coefficient of variation (CV) between replicates is acceptable. Accuracy can be measured on each sample assay plate by including positive controls and comparing the absorbance-bkgd or MFI-bkgd values to those established with the standard curve. Outlier plates that do not fit the established acceptance criteria can be identified and samples on those plates rerun [33, 34]. While antibody any positive control preparation and storage was controlled in this study, accuracy between csELISA and csMBA sample plates was not compared and thus presents limitations that may make some of the Madagascar and Guinea sample data difficult to interpret.