Main findings
With the COBAS assay, urine samples showed good concordance in hrHPV detection compared with cervico-vaginal and cervical samples, while moderate hrHPV concordance was found between samples using the CLART assay. Compared to cervical sampling, urinary hrHPV detection had a sensitivity of 63.9% and a specificity of 96.5% using COBAS; compared with 51.6% and 92.4% for CLART. The invalid hrHPV test rates of urine were 1.8% and 26.9% for the COBAS and CLART assay, respectively. Home-based urine collection was well-accepted and women ranked it as the most preferred future screening procedure.
Strengths and limitations
Main strengths of our study were the use of two clinically validated hrHPV DNA assays, approved for primary hrHPV screening [22, 25, 26] and the fact that the women served as their own controls, limiting potential biases. Additionally, the women collected the urine samples at home without supervision from healthcare professionals, which from an implementation point-of-view is the most appropriate setting to evaluate urine collection before becoming routine.
A limitation of the study is the time interval between samples. Part of the discrepancy in hrHPV concordance between urine and cervical samples may be explained by a hrHPV infection acquired or cleared between sampling [19]. Yet, the questionnaire data enabled us to interpret discordant results, and the time interval between collecting the samples was not an issue when comparing urine samples with cervico-vaginal self-samples.
Since our study was conducted in a referral population diagnosed with ASC-US, the concordance results cannot be generalized directly to a screening population. Furthermore, as we enrolled women who had already attended the screening program, the acceptability of urine collection may differ from women reluctant to participate in routine screening. A generalization of our results to routine screening programs should therefore be done with caution.
Interpretation and comparison with previous studies
Even though first-void urine was used, which has been proven to contain significantly more HPV DNA than the subsequent part [8, 27], we found lower hrHPV positivity in urine samples as compared with corresponding cervical and cervico-vaginal samples for both assays. Thus, the lower hrHPV positivity in urine may be due to specimen type differences rather than the assay itself [15]. Our result corresponds to most comparative studies [9–12, 15, 28, 29], but not all [13, 14, 27].
COBAS showed higher concordance for hrHPV detection (any type) between first-void urine and cervical samples than CLART (κ = 0.66 vs. 0.47). Our concordance using COBAS was higher than reported by Asciutto et al. (κ = 0.58) [9] and Cho et al. (κ = 0.33) [12], but lower than reported by Bernal et al. (κ = 0.76)[14] and Sargent et al. (κ = 0.82) [10]; all using a combination of first-void urine samples and COBAS in referral populations. As our study was the only one with an interval between the urine and cervical sample, some of the differences in concordance may be attributed to this factor. Other reasons for the differences are likely explained by variations in sampling procedure (at home vs. clinic), type of preservative media [27],
(pre-) analytical processing protocols [13], storage conditions [27], the volume of urine collected [27], and study populations (differences in abnormal cytology prevalence). The concordance between urine and cervical samples for hrHPV detection using COBAS remained robust (κ = 0.61), when including the 58 women who had an invalid test result by CLART only in the analysis (data not shown).
A meta-analysis found a pooled sensitivity of 77% and specificity of 88% for hrHPV detection in urine samples compared with cervical samples [8]. In our study, lower sensitivity (63.9% and 51.6% for COBAS and CLART, respectively) but higher specificity (96.5% and 92.4% for COBAS and CLART, respectively) was found between the urine and cervical samples for both assays. Thus, more than 50% of the cervical hrHPV infections were not detected in the urine samples. However, it is possible that adjustment of the COBAS assay cut-off value for positive result could provide performance-related benefits for urine collection, as reported elsewhere [28]. Despite small numbers, CLART showed higher concordance between urine and cervical samples for the detection of HPV16/18 than COBAS (κ = 0.65 vs. 0.34), whereas COBAS performed better than CLART for the detection of hrHPV other types (κ = 0.70 vs. 0.38). In comparison with our previous study which was conducted within the same study population (n = 213), good concordance (κ = 0.70) was found between cervico-vaginal self-sampling and cervical sampling for hrHPV detection using COBAS including acceptable sensitivity (80.9%) and specificity (91.6%)[19]. Additionally, cervico-vaginal self-sampling was well-accepted, but almost 10% of the women expressed concerns about proper sampling. Here, no CIN2 + cases were missed by cervico-vaginal self-sampling [19].
In the present study, overall agreement between urine and cervico-vaginal self-samples for detection of hrHPV (any type) using COBAS (87.3%) was in line with previous data [11].
Neither the COBAS nor the CLART assays are currently CE-marked for urinary testing; yet, urine samples analyzed on CLART resulted far more often in invalid hrHPV test results than on COBAS (26.9% vs. 1.8%). This indicates that the CLART assay may be more severely affected by the presence of PCR inhibitors in urine and the lower amount of cells in urine, both known to reduce assay sensitivity [30, 31].
In comparison, invalid test rates of urine samples have in other studies been reported to range between 0 and 4% using PCR-based HPV DNA assays [9, 10, 12–15, 29]. Whether optimizing the (pre)-analytical processing protocols could lead to better results for the CLART assay warrants further exploration. Indeed, our results support that future research should focus on optimizing the urinary (pre)-analytical procedures to improve accuracy, but also compare accuracy of hrHPV testing in paired urine and cervical samples using different combinations of urine collection methods and hrHPV assays. The ongoing VALUDES study seeks to address this current lack in evidence [32].
For screening purposes, detection of hrHPV in urine would be useful only if it can identify women who have underlying CIN2+, which is a treatable screening endpoint [33]. Accuracy of hrHPV testing with COBAS for CIN2 + detection using urine samples has proven to be significantly lower than compared with cervical and cervico-vaginal sampling [28]. Although our study was not designed to evaluate the clinical accuracy of urine, we did find that up to half of the CIN2 + cases were missed by urine collection.
For use in screening, a high acceptability of the method is of great importance if wanting to reach non-participants through urine collection. Our results were consistent with the literature, showing urine collection to be highly acceptable [10, 13]. Similar to other studies, urine was the most preferred screening method [13, 16, 17]. We did not observe any differences in preferences between age groups. Confidence in correct execution of the urine collection procedure is essential, as insecurity could lead to mistrust of the test results and cause the woman to worry. Despite women in our study performed urine collection at home with no specially designed urine collection device [34], only 3.4% of the women expressed concerns about collecting the urine sample correctly. This is lower than the 20% reported by women performing clinic-based urine collection [10] and even lower than the 10% of women expressing concerns about performing home-based cervico-vaginal self-sampling as reported previously [19].