Comparison of different automated RNA extraction methods
To evaluate the impact of the RNA extraction method on the sensitivity of SARS-CoV-2 detection, we compared five automated extraction methods by using serial dilutions of inactivated cell culture supernatant with SARS-CoV-2 concentrations around the limit of detection. PCR analysis was performed in duplicate by using the E-Gene/KoMa and orf1ab/c-myc duplex PCR assays, which resulted in a total of four PCR replicates for the detection of SARS-CoV-2 RNA in each sample. Table 5 shows the number of positive PCR reactions for each dilution when using the different extraction methods. Detection of SARS-CoV-2 from cell culture supernatant was comparable for all tested extraction automats. Results were confirmed by using two additional, independently generated series of dilutions (data not shown).
Table 5
PCR positivity comparison between five automated RNA extraction methods by using serial diluted cell culture supernatant
Sample | Dilution factor1 | Q-Con | Q-HT | Q-Sym | KFF | MP96 |
1 | -- | 4/4 | 4/4 | 4/4 | 4/4 | 4/4 |
2 | 1:2 | 4/4 | 4/4 | 4/4 | 4/4 | 4/4 |
3 | 1:4 | 4/4 | 4/4 | 4/4 | 4/4 | 2/2* |
4 | 1:10 | 4/4 | 4/4 | 4/4 | 4/4 | 4/4 |
5 | 1:20 | 4/4 | 4/4 | 4/4 | 4/4 | 4/4 |
6 | 1:40 | 4/4 | 4/4 | 3/4 | 4/4 | 4/4 |
7 | 1:100 | 3/4 | 3/4 | 1/4 | 2/4 | 3/4 |
8 | 1:200 | 0/4 | 0/4 | 1/4 | 1/4 | 1/2* |
9 | 1:400 | 0/4 | 1/4 | 1/4 | 0/4 | 1/4 |
10 | 1:1000 | 0/4 | 1/4 | 0/4 | 0/4 | 0/4 |
11 | 1:2000 | 0/4 | 0/4 | 1/4 | 0/4 | 0/4 |
PCR positivity comparison was performed by using serial diluted cell culture supernatant of SARS-CoV-2. The number of positive rRT-PCR replicates is shown for each sample. The SARS-CoV-2 rRT-PCR assay targets two regions of the SARS-CoV-2 genome and was performed in duplicate, yielding a total of four PCR replicates per RNA extract.
Q-Con: QIAcube Connect, Q-HT: QIAcube HT, Q-Sym: QIAsymphony, KFF: King Fisher Flex, MP96: MagNa Pure 96
1 The dilution factor relative to the most highly concentrated sample 1 is given in order to allow a relative comparison of performance around the limit of detection. In the pre-tests, sample 1 had a Ct value of 30 in both the E-Gene and orf1ab rRT-PCR assay.
* RNA analysis not performed in duplicate due to insufficient volume of RNA extract
Figures 1a and 1b show the Ct values obtained for each sample in the E-Gene and orf1ab PCR after extraction by using the different instruments. Extraction using the QIAcube Connect was selected as reference method to quantify the differences in Ct values across instruments. For each instrument and sample, the difference of Ct values to the mean Ct value obtained with the QIAcube Connect was calculated (Figs. 1c and 1d). All automated extraction methods yielded similar Ct values in the SARS-CoV-2 rRT-PCRs. Using the King Fisher Flex and Magna Pure 96 resulted in slightly lower Ct values compared to the QIAcube Connect, which is probably due to the higher concentration factor of RNA extract in relation to the original sample (4x concentrated when using the King Fisher Flex and Magna Pure 96; 2.3x and 1.75x concentrated when using the Qiagen instruments; Table 1). When the Ct values were adjusted for the different ratios of sample volume to RNA volume, the Ct difference of the King Fisher Flex and Magna Pure 96 compared to the QIAcube Connect was largely eliminated, illustrating the equal performance quality of the extraction automats (Figs. 1e and 1f). Using the QIAsymphony instrument resulted in slightly higher Ct values compared to all other tested methods, a fact which we also observed when applying different non-customized off-board and on-board lysis protocols provided by the manufacturer (data not shown).
Ct values for detection of SARS-CoV-2 in serial diluted cell culture supernatant were compared between the five tested automated RNA extraction methods. (a) Ct values for each tested sample obtained with the E-Gene rRT-PCR and (b) orf1ab rRT-PCT. (c) Difference of the Ct value obtained for a sample extracted by the listed automat to the mean Ct value measured for the same sample after extraction by the QIAcube Connect in E-Gene rRT-PCR, (d) orf1ab rRT-PCT, (e) E-Gene rRT-PCR after adjustment for the ratio of sample volume to RNA volume and (f) orf1ab rRT-PCT after adjustment for the ratio of sample volume to RNA volume.
Q-Con: QIAcube Connect, Q-HT: QIAcube HT, Q-Sym: QIAsymphony, KFF: King Fisher Flex, MP96: MagNa Pure 96
The QIAcube Connect, QIAcube HT and QIAsymphony instruments, which at the time could be used for processing infectious samples, were additionally compared by using a panel of 20 SARS-CoV-2-positive patient samples, selected to cover a wide range of viral loads including virus concentrations around the limit of detection. All three compared extraction automats showed a similar performance on the tested patient samples, both with regard to the number of correctly identified samples and the obtained Ct values (Table 6).
Table 6
PCR positivity comparison between selected RNA extraction automats using 20 patient samples
Performance parameter | Q-Con | Q-HT | Q-Sym |
Number of detected samples | 20/20 | 18/20 | 18/20 |
E-Gene and orf1ab detected | 16/20 | 15/20 | 14/20 |
Only E-Gene detected | 3/20 | 0/20 | 3/20 |
Only orf1ab detected | 1/20 | 3/20 | 1/20 |
E-Gene mean Ct value | 30.76 | 28.92 | 30.56 |
E-Gene range of Ct values | 18.46–38.72 | 18.21–40.08 | 19.20–38.20 |
orf1ab mean Ct value | 30.80 | 30.95 | 30.47 |
orf1ab range of Ct values | 19.31–37.42 | 19.10–38.46 | 19.94–37.10 |
PCR positivity was compared between three selected RNA extraction automats for detection of SARS-CoV-2 in 20 patient samples. PCR analysis was performed in duplicate by using the E-Gene/KoMa and orf1ab/c-myc duplex PCR assays.
Q-Con: QIAcube Connect, Q-HT: QIAcube HT, Q-Sym: QIAsymphony
Increasing PCR analysis capacity through a higher level of multiplexing
Our SARS-CoV-2 PCR assay was initially developed as a combination of two duplex PCR reactions detecting E-Gene/KoMa and orf1ab/c-myc (7). In order to be able to increase PCR throughput if needed, we combined the detection of E-Gene, KoMa, orf1ab and c-myc in a quadruplex reaction. As the fluorescence intensity of the orf1ab PCR suffered considerably from the higher degree of multiplexing, we added a second probe to the orf1ab reaction. Notably, this reduces the probability of detection failure due to virus mutations, for which the SARS-CoV-2-specific orf1ab PCR is at a higher risk than the more broadly reactive Sarbeco E-Gene PCR. For further compensation of the expected sensitivity loss in the quadruplex assay compared to the duplex assays, we increased the volume of RNA extract added to the PCR reaction from 5 µl to 10 µl.
Probit analysis for the quadruplex PCR under the described reaction conditions (AgPath-ID PCR kit, BioRad CFX96) revealed a limit of detection of 28.7 genome copies per reaction for the E-Gene assay and 32.0 genome copies per reaction for the orf1ab assay. The limits of detection of the quadruplex PCR assay are therefore about three and five times higher than the previously determined limits of detection for the duplex PCR assays, which are 9.8 and 6.6 genome copies per reaction for the E-Gene/KoMa PCR and the orf1ab/c-myc PCR, respectively (7).
To evaluate the impact of the slightly reduced sensitivity of the quadruplex PCR on the ability to correctly identify positive patient samples, we compared the duplex and quadruplex PCRs by testing 24 patient samples that were previously identified to be SARS-CoV-2 positive with E-Gene Ct values higher than 30. Fresh RNA extracts were prepared from the original samples by using the QIAcube Connect and tested in parallel with the SARS-CoV-2 duplex PCRs and the quadruplex PCR. Both assays returned similar results for the tested samples (Table 7).
Table 7
Comparison of the duplex and quadruplex SARS-CoV-2 PCR assays using 24 weakly positive patient samples
Performance parameter | Duplex assay | Quadruplex assay |
Number of detected samples | 20/24 | 22/24 |
E-Gene and orf1ab detected | 18/24 | 17/24 |
Only E-Gene detected | 0/24 | 4/24 |
Only orf1ab detected | 2/24 | 1/24 |
E-Gene mean Ct value | 34.03 | 33.55 |
E-Gene range of Ct values | 28.94–37.97 | 27.67–38.70 |
orf1ab mean Ct value | 35.37 | 34.02 |
orf1ab range of Ct values | 29.47–43.41 | 28.63–41.58 |
24 weakly positive patient samples were tested by using either the E-Gene/KoMa and orf1ab/cmyc duplex PCR assays or the E-Gene/KoMa/orf1ab/c-myc quadruplex assay.
Sample pooling
In order to prepare for peaks of exceptionally high testing demand, we established a two-level pooling protocol with either two or four samples per pool, which can be flexibly utilized depending on the current needs.
To minimize sensitivity loss caused by the dilution effect of the pooling, we developed a modified version of our SARS-CoV-2 quadruplex PCR assay, in which both E-Gene and orf1ab are detected by using the same fluorescence dye (FAM), which results in a higher fluorescence intensity. We refer to this assay as allFAM quadruplex PCR. While in the regular quadruplex assay an additional probe was included only for the orf1ab reaction, the allFAM quadruplex assay also includes an additional probe for the E-Gene reaction to further enhance fluorescence intensity and thus detection sensitivity. The allFAM quadruplex assay does not allow the distinction between E-Gene and orf1ab signals. However, each sample of a positive pool is subsequently analyzed individually by using the standard PCR assays which detect E-Gene and orf1ab separately. While successful RNA extraction and PCR inhibition can still be controlled for in the sample pools by using an exogenous internal control, confirming adequate sampling for each individual sample via an endogenous internal control is not possible when samples are pooled. Nevertheless, we decided to include the c-myc PCR in the assay for pooled samples in order to obtain at least some information on the human nucleic acid content in the pools.
We tested the performance of our sample pooling approach by utilizing the same 24 weakly positive patient samples that were used to compare the SARS-CoV-2 duplex PCRs with the quadruplex PCR (Table 7). In parallel to the individual testing, all 24 positive patient samples were analyzed in a pool with either one or three negative patient samples. RNA extractions were performed by using the QIAcube Connect, and all RNA extracts were subjected to the duplex PCRs, the standard quadruplex PCR and the allFAM quadruplex PCR. Compared to individual testing, both the duplex and quadruplex assays failed to detect three samples in the two-sample pools and six samples in the four-sample pools (Table 8). In contrast, the allFAM quadruplex assay did not miss any samples in the pooled testing compared to individual testing and even detected two additional samples in the two-sample pools.
Table 8
PCR positivity comparison between individual testing, two-sample pools and four-sample pools
Performance parameter | Duplex PCRs | Quadruplex PCR | allFAM Quadruplex PCR |
Indiv. testing | Pools of 2 | Pools of 4 | Indiv. testing | Pools of 2 | Pools of 4 | Indiv. testing | Pools of 2 | Pools of 4 |
Number of detected samples | 20/24 | 17/24 | 14/24 | 22/24 | 19/24 | 16/24 | 19/24 | 21/24 | 19/24 |
E-Gene and orf1ab detected | 18/24 | 11/24 | 10/24 | 17/24 | 16/24 | 11/24 | n.a. | n.a. | n.a. |
Only E-Gene detected | 0/24 | 2/24 | 2/24 | 4/24 | 2/24 | 5/25 | n.a. | n.a. | n.a. |
Only orf1ab detected | 2/24 | 4/24 | 2/24 | 1/24 | 1/24 | 0/24 | n.a. | n.a. | n.a. |
E-Gene mean Ct value | 34.03 | 35.62 | 35.24 | 33.55 | 34.43 | 34.80 | 32.73* | 35.11* | 35.24* |
E-Gene range of Ct values | 28.94–37.97 | 28.44–41.69 | 29.19–40.04 | 27.67–38.70 | 27.06–39.69 | 27.99–39.26 | 27.81–36.28* | 26.85–42.17* | 27.97–41.69* |
orf1ab mean Ct value | 35.37 | 36.41 | 36.32 | 34.02 | 35.25 | 33.95 | n.a. | n.a. | n.a. |
orf1ab range of Ct values | 29.47–43.41 | 28.86–42.89 | 30.00–41.06 | 28.63–41.58 | 27.75–41.24 | 28.49–37.54 | n.a. | n.a. | n.a. |
24 weakly positive patient samples were extracted individually and in a pool with either one or three negative patient samples. PCR analyses were performed by using the SARS-CoV-2 duplex PCRs, the standard quadruplex PCR and the pooling-specific allFAM quadruplex PCR.
* The Ct values of the allFAM quadruplex PCR refer to the combined signals of the E-Gene and orf1ab assays as they are both detected in the same fluorescence channel in this assay.
n.a.: not applicable
Figure 2 shows the Ct values for each sample, obtained by individual testing, two-sample pooling and four-sample pooling using either the duplex assay (Fig. 2a and 2b), quadruplex assay (Fig. 2c and 2d) or allFAM quadruplex assay (Fig. 2e). Samples that were detected only by individual testing and not in the pools had Ct values of 34 or higher. While the average Ct values obtained from the pools were, as expected, about 1–2 cycles higher than those measured in the individual samples (Table 8), Fig. 2 shows that the difference in Ct values between individual testing and pooled testing varied considerably from sample to sample. In some cases, Ct values were even lower in the pool than in the individual sample.
Comparison of Ct values between individual testing, two-sample pooling and four-sample pooling for detection of SARS-CoV-2 in 24 weakly positive patient samples. Shown are Ct values for each tested sample obtained with (a) the E-Gene PCR of the duplex assay, (b) the orf1ab PCR of the duplex assay, (c) the E-Gene PCR of the quadruplex PCR assay, (d) the orf1ab PCR of the quadruplex PCR assay and (e) the pooling-specific allFAM quadruplex PCR assay which detects E-Gene and orf1ab in the same fluorescence channel.