With the increasing number of mutations in the SARS-CoV-2 emerging VoC, as in B.1.1.529, also known as Omicron, the evaluation of the current RT-qPCR assays used for the detection of SARS-CoV-2 is important for correct diagnosis. Evaluation of these assays in the wet laboratory is limited in this rapidly evolving Omicron outbreak, because of the time constraint and lack of representative strains available for clinical laboratories, as previously noted.30 Therefore, an in silico approach was used to evaluate the sensitivity of current RT-qPCR assays using the whole genome sequencing data of the SARS-CoV-2 Omicron VoC (particularly from the publicly available GISAID database), and employing suitable bioinformatics tools.7,30 We evaluated the sensitivity of 30 RT-qPCR primers and probe sets in this study using SCREENED, which produces alignment statistics and thus, number of false-negative results could be obtained. An overall summary of the results is presented in Table 7.
Table 7. Assays with potentially false negative results based on in silico analysis.
Assay
|
Source/Country
|
BA.1
|
BA.2
|
Both BA.1 and BA.2
|
1
|
Chinese Center for Disease Control and Prevention, China
|
|
|
|
2
|
Charité Hospital, Germany
|
|
|
|
3
|
Pasteur Institute, France
|
|
|
|
4
|
Centers for Disease Control and Prevention, USA
|
|
|
|
5
|
National Institute of Infectious Diseases, Japan
|
|
|
|
6
|
Li Ka Shing Faculty of Medicine, The University of Hong Kong, China
|
|
|
|
7
|
Ministry of Public Health, Thailand
|
|
|
|
8
|
University of Hong Kong/Queen Elizabeth Hospital, China
|
|
|
|
9
|
Lu et al., China
|
|
|
|
10
|
Won et al., Korea
|
|
|
|
11
|
Sigma-Aldrich, USA
|
|
|
|
12
|
Huang et al., China
|
|
|
|
Note: Red indicate risk of false negatives (low sensitivity, <99% for all primers and probes in assay). Green indicate low risk of false negative (high sensitivity, ≥99% for all primers/probes in assay)
The HKUniv RdRp/Hel assay, developed at the University of Hong Kong, showed the worst sensitivity for the reverse primer, due to presence of a substitution at the 3’ end of the primer annealing site, which is present in all the 232 Omicron BA.1 sublineage genomes. The ChinaCDC N assay had second lowest sensitivity, because of the presence of three substitutions at the beginning of the forward primer annealing site. These substitutions were observed in the 5’ end of the assay, which may not prevent the amplification of the genome in vitro but due to the criteria used by SCREENED, this assay produces false negative results in silico and was observed in 229 Omicron BA.1 sublineage genomes. A total of 10 substitutions were observed in the reverse primer annealing site of the Thai N assay (developed by the Ministry of Public Health, Thailand), in 226 BA.1 Omicron sublineage genomes. Therefore, for the BA.1 Omicron sublineage, ChinaCDC N, Thai N, and HKUniv RdRp/Hel assays do not meet the criteria used by SCREENED in our analysis, which is also the criteria elaborated by the EC for evaluation of primers and probe sets.26 For the BA.1 Omicron sublineage, a mismatch in the sixth nucleotide from 3’ end was also observed for USCDC N3 assay forward primer, which was not matching with our SCREENED criteria but could give a false negative result, as a single mismatch in the 3’ end may result in failure or reduced performance of the test. Related to BA.1 sublineage, other primers and probe sets sensitivity was > 99% and this was in agreement with our criteria.
In comparison with previous studies evaluating the sensitivity of the RT-qPCR assays for SARS-CoV-2 genomes from April 2020 to January 2021,7,15 ChinaCDC N assay had the lowest sensitivity, which is in line with our observations in this study with Omicron VoC. Further, we observed a sensitivity of 2.59% for the Thai N assay and 0% for the HKUniv RdRp/Hel assay for the Omicron VoC, while Gand et al.15 for the same assays obtained a sensitivity of 99.73% and 100%, respectively, analyzing other VoC, which points towards important differences between the Omicron VoC and previous SARS-CoV-2 variants. Interestingly, CoremCharite N and Pasteur RdRp IP4 assays showed the best results in our study, as these showed the highest sensitivity (Table 7), less diversity of amplicon among the genomes (Table 7), and no substitutions in the primers and probes annealing site. The Pasteur RdRp IP4 assay was intended to be specific to SARS-CoV-2, however, the specificity of assay CoremCharite N was not communicated.15
For SARS-CoV-2 Omicron BA.2 sublineage, which was restricted to five genomes due to very limited number of genomes available at time of this study, ChinaCDC N, Thai N, HKUniv RdRp/Hel assays displayed the lowest sensitivity. ChinaCDC N and Thai N assays had 3 and 10 mismatches in the forward and reverse primer annealing sites respectively in all five genomes analyzed in this study. The HKUniv RdRp/Hel assay showed a substitution in the 3’ end of the reverse primer for all five genomes. The second lowest sensitivity was observed for SigmAldr S5 and SigmAldr S6 assays with 13 and 12 mismatches,respectively, in the reverse primer annealing site for four genomes of SARS-CoV-2 Omicron BA.2 sublineage. The HKUniv S assay showed a 40% sensitivity with 12 mismatches in the reverse primer annealing site for three SARS-CoV-2 Omicron BA.2 sublineage genomes. Hence, ChinaCDC N, Thai N, HKUniv RdRp/Hel, HKUniv S, SigmAldr S5 and SigmAldr S6 assays do not meet the criteria for an appropriate primers and probe set for detecting BA.2 sublineage of the SARS-CoV-2 Omicron VoC. For SARS-CoV-2 Omicron BA.2 sublineage, other primers and probe sets ) sensitivity was in agreement with the a priori criteria.
It is likely that SARS-CoV-2 Omicron BA.2 sublineage, due to lacking the deletion in S at residues 69-70, is not “identified” as likely Omicron due to no S gene target dropout on some NAAT, which is often a pretext to sequencing, thus leading to underrepresentation of this sublineage in WGS data. However, in our study with the primers and probes employed, the S gene dropout could not be explained clearly for the SARS-CoV-2 Omicron BA.1 results as HKUniv S, Won S, SigmAldr S5 and SigmAldr S6 assays have high sensitivity (Table 7), which implies that these assays could correctly detect most of the studied SARS-CoV-2 Omicron BA.1 genomes included in our analysis. Thus, care should be taken in validating the use of the S gene target dropout for each specific RT-qPCR assay as means for tracking the SARS-CoV-2 Omicron BA.1 sublineage. Interestingly, for SARS-CoV-2 Omicron BA.2 genomes, the S gene dropout could be potentially observed in HKUniv S, Won S, SigmAldr S5 and SigmAldr S6 assays, which we observed to have low sensitivity (Table 6). Conversely, the presence of the N gene dropout for SARS-CoV-2 Omicron BA.1 could potentially be observed for some assays, such as ChinaCDC N and Thai N. The presence of the N gene and/or S gene dropout on RT-qPCR are not likely to occur for the SARS-CoV-2 Delta VoC, and if detected, should alert to a high likelihood of being the Omicron VoC.14 However, the potential for both N and S genes dropout highlights the importance of using an assay with multiple gene targets and the need for additional testing approaches in cases of suspected false negatives.
This preliminary study was limited by a small number of currently available SARS-CoV-2 Omicron VoC genomes, as well as by the rapid genetic diversification of the B.1.1.529, with multiple sublineage, including a newly classified SARS-CoV-2 Omicron BA.3.31 However, our findings demonstrate the urgent need to evaluate NAAT for detection of SARS-CoV-2 Omicron and other potentially similar emerging VoC. We will continue to update our analysis in the weeks ahead. Importantly, the large number of RT-qPCR tests currently being performed employ commercially developed primers and probes, whose sequences are unknown and often not shared due to concerns over intellectual property. However, in these unprecedented times, false negative results can have detrimental consequences, especially early in the SARS-CoV-2 Omicron outbreak, limiting capacity for viral tracing, intervention, and interrupting the transmission chain. Thus, wet laboratory evaluation and validation of commercial assay primer and probes should be urgently performed. We amplify the call by Metzger et al.30 for governmental bodies or neutral institutions to be tasked with in silico evaluation in emergency settings for global spread of a new SARS-CoV-2 VoC to inform clinical research laboratories of potential diagnostic performance issues while protecting intellectual property.