A rapid screening model for early predicting novel coronavirus pneumonia in Zhejiang Province of China: A Multicenter Study

doi:10.21203/rs.3.rs-22245/v1

Download PDF

Research Article

A rapid screening model for early predicting novel coronavirus pneumonia in Zhejiang Province of China: A Multicenter Study

https://doi.org/10.21203/rs.3.rs-22245/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 16 Feb, 2021

Read the published version in Scientific Reports →

Version 1

posted

You are reading this latest preprint version

Novel coronavirus pneumonia (NCP) has been widely spread in China and several other countries. Early finding of this pneumonia from huge numbers of suspects gives clinicians a big challenge. The aim of the study was to develop a rapid screening model for early predicting NCP in a Zhejiang population, as well as its utility in other areas. A total of 880 participants who were initially suspected of NCP from Jan 17 to Feb 19 were included. Potential predictors were selected via stepwise logistic regression analysis. The model was established based on epidemiological features, clinical manifestations, white blood cell count, and pulmonary imaging changes, with the area under receiver operating characteristic (AUROC) curve of 0.920 (95% confidence interval: 0.902-0.938; AUROC=0.915, and its standard deviation of 0.028, as evaluated in 5-fold cross-validation). At a value of whether the predicted score >4.0, the model could detect NCP with a specificity of 98.3%; at a cut-off value of < -0.5, the model could rule out NCP with a sensitivity of 97.9%. The study demonstrated that the rapid screening model was a helpful and cost-effective tool for early predicting NCP and had great clinical significance given the high activity of NCP.

Infectious Diseases

Novel coronavirus pneumonia

2019 novel coronavirus

clinical characteristics

a rapid screening model

Since December 2019, novel coronavirus pneumonia (NCP) emerged in Wuhan, Hubei, which was well known as the largest transportation hub in China. The pathogen has been proved to be a novel betacoronavirus that is currently named 2019 novel coronavirus (2019-nCoV) [1]. The disease has swept across China rapidly through human-to-human transmission [2-4]. Since Feb 27, 2020, more than 78,000 people were confirmed to be infected and more than 2700 were died in China [5].

As the number of patients soaring, scholars have summarized the clinical characteristics of NCP [6-8]. Symptoms at onset of disease included fever, cough, headache, vomiting, diarrhea and so on. Normal or decreased leukocyte count was common. Radiologic abnormalities like ground-glass opacity and patchy shadowing on chest X-ray or computed tomography (CT) were marked characteristics. Acute respiratory distress syndrome, arrhythmia and shock could also occur in severe cases. Until now, to detect 2019-nCoV by the accurate real-time reverse transcription polymerase chain amplification (RT-PCR) assessment has been regarded as the golden diagnostic standard [9].

Nevertheless, false negative results in initial RT-PCR examination existed in a number of cases [10]. Besides, the time-consuming process, short supply of kits, and difficulty in qualified sampling prevented us from early-stage diagnosis and treatment, as well as prompt isolation of patients. Therefore, it necessitates establishment of a rapid diagnostic model to screen high-risk patients with 2019-nCoV infection.

In this study, we aimed to develop a novel screening scale to determine highly suspected subjects based on epidemiological data, clinical manifestations, laboratory and radiological examinations. It is the first screening model for predicting NCP in Zhejiang Province, China, and can be popularized nationwide and even worldwide.

Clinical characteristics of the study participants

Of the 880 subjects enrolled in the study, 21 subjects were excluded due to missing data, and 859 participants were eligible for evaluation. Of them, 339 were diagnosed as NCP with the positive detection of 2019-nCoV by real-time RT-PCR, while the other 520 participants were ruled out with at least two times negative results by RT-PCR.

The characteristics of participants were exhibited in Table 1. Among these 339 NCP sufferers, 188 (55.46%) were male, and the mean age was 46.88 ± 14.65 years. The age of NCP sufferers was significantly larger than those without NCP (P<0.001). 33.63% of the confirmed patients had a history of travel or residence in Wuhan within 14 days, and 27.43% had contacted patients with fever or respiratory symptoms from Wuhan within 14 days. 35.10% of the confirmed cases were related to cluster outbreaks in families or places of work.

The common symptoms of NCP included fever (47.79%), dry cough (43.95%), sputum (34.81%), fatigue (26.55%) and dyspnea (9.73%). But fever was not a specific symptom because it was also commonly seen in non-NCP individuals (47.50%, P = 1.000). Normal or decreased WBC count happened in 93.81% of NCP patients, and decreased lymphocyte count was seen in 54.28% of patients. The mean WBC count in NCP group was 5.40 ± 2.56 (×109/L), significantly lower than those without NCP (7.36 ± 3.06, ×109/L, P<0.001). Meanwhile, the lymphocyte count was 1.22 ± 0.85 (×109/L), significantly lower than those without NCP (1.71 ± 0.86, ×109/L, P<0.001). No significant difference was found between the two groups in terms of C-reactive protein level (CRP). Most NCP patients (94.39%) had pulmonary radiologic changes like unilateral or bilateral patchy shadowing, ground-glass opacity or pulmonary consolidation on X-ray or CT.

Predictors associated with NCP

We performed both univariate and multivariate logistic regression analyses to assess predictors of NCP (Table 2). In the univariate analysis, age, co-existing diseases, travel or residence history within 14 days in Wuhan, neighboring areas of Wuhan in Hubei Province, and other areas with persistent local transmission, or community with definite cases, contacting patients with fever or respiratory symptoms within 14 days from Wuhan, neighboring areas of Wuhan in Hubei Province, and other areas with persistent local transmission or community with definite cases, relationship with a cluster outbreak, presence of sputum, fatigue, dyspnea, diarrhea or bellyache, muscle soreness, absence of nasal congestion or sore throat, decreased WBC count, lymphocyte count, and neutrophil cell count, and imaging changes in chest X-ray or CT were observed to be associated with higher odds of NCP.

The above characteristics were utilized in the subsequent multivariate analysis, revealing that the following nine characteristics were independent risk factors for NCP: travel or residence history within 14 days in Wuhan (OR = 8.440, 95% CI = 4.204-16.944, P<0.001), contacting patients with fever or respiratory symptoms within 14 days who had a travel or residence history in Wuhan (OR = 2.967, 95% CI = 1.630-5.402, P<0.001), contacting patients from other areas with persistent local transmission or community with definite cases (OR = 4.139, 95% CI = 2.334-7.342, P<0.001), relationship with a cluster outbreak (OR = 25.164, 95% CI = 11.833-53.516, P<0.001), presence of fatigue (OR = 2.710, 95% CI = 1.490-4.930, P = 0.001), dyspnea (OR = 5.276, 95% CI = 2.076-13.410, P<0.001), muscle soreness (OR = 14.187, 95% CI = 1.998-100.730, P = 0.008), decreased WBC count (OR = 0.750, 95% CI = 0.659-0.852, P<0.001), and imaging changes in chest X-ray or CT (OR = 6.291, 95% CI = 4.315-9.171, P<0.001).

Derivation of the model

In this multivariate logistic regression model, the probability of having NCP was 1/(1 + e-(-2.043 + 2.133 (if travelling to or residing in Wuhan) + 1.088 (if contacting patients from Wuhan) + 1.421 (if contacting patients from other areas with persistent local transmission or community with definite cases) + 3.225 (if relating to a cluster outbreak) + 0.997 (if having fatigue) + 1.663 (if having dyspnea) + 2.652 (if feeling muscle soreness) - 0.288 * WBC count + 1.839 * chest imaging score)). Consequently, we utilized the exponents of this formula and established a Zhejiang rapid screening model for predicting NCP as follows:

Model score = 2.133 (if travelling to or residing in Wuhan within 14 days) + 1.088 (if contacting patients with fever or respiratory symptoms from Wuhan within 14 days) + 1.421 (if contacting patients with fever or respiratory symptoms from other areas with persistent local transmission or community with definite cases within 14 days) + 3.225 (if relating to a cluster outbreak) + 0.997 (if having fatigue) + 1.663 (if having dyspnea) + 2.652 (if feeling muscle soreness) - 0.288 * WBC count + 1.839 * pulmonary imaging score (as introduced in the “Method” part).

The AUROC of the formula was 0.920 (95%CI: 0.902-0.938) (Figure 1). To examine whether the model was over fitted, we used 5-fold Cross-Validation of the trained model. It showed that the mean of AUROC was of 0.915 with standard deviation of 0.028. At a value of whether the predicted score >4.0, the model could detect NCP with a specificity of 98.3% (95% CI: 97.7%–98.9%); at a cut-off value of >1.0, the rapid screening model could determine NCP with a sensitivity of 85% (95% CI: 81.2%-88.8%), and a specificity of 82.3% (95% CI: 80.6%-84.0%). At a cut-off value of < -0.5, the model could rule out NCP with a sensitivity of 97.9% (95% CI: 97.1%–98.7%) (Table 3).

Among the 859 subjects, 154 subjects (17.9%) had a model score of >4, and 272 subjects (31.7%) had a model score of <-0.5. Based on the cut-off values, 410 subjects (96.2% of subjects with the model score >4 or <-0.5) were correctly classified.

In this study, we compared the characteristics between the NCP patients and the suspected individuals who were finally ruled out of NCP. Having analyzed the clinical and epidemiological features, we developed a rapid screening model for predicting NCP in a Zhejiang population. The model included four epidemiological features: travel or residence history within 14 days in Wuhan, contacting patients with fever or respiratory symptoms within 14 days from Wuhan, contacting patients from other areas with persistent local transmission or community with definite cases, relationship with a cluster outbreak; and five clinical manifestations: fatigue, dyspnea, muscle soreness, decreased WBC count, and imaging changes in chest X-ray or CT. The diagnostic performance of the established scale was excellent with an AUROC of 0.920.

A model score of < -0.5 demonstrated a very small probability to be infected by 2019-nCoV (with a sensitivity of 97.9%). When the score was higher than 4.0, subjects were more likely to suffer from NCP (with a specificity of 98.3%) and they should be immediately isolated and further tests are highly recommended. At a cut-off value of >1.0, the model could detect NCP with a sensitivity of 85% and a specificity of 82.3%. Due to the nature of a communicable disease, it is essential to avoid missed diagnoses, in particular given its surging outbreak. Clinicians can set the best cut-off value based on actual demands.

Under the circumstance of continuing spread of 2019-nCoV, Zhejiang model established in this study, as the first rapid screening diagnostic model for NCP, is of great significance in this battle. Unlike virus isolation or RT-PCR testing, the screening scale is economical, uncomplicated and fast, which can be used to select potential patients for further RT-PCR examinations.

Nevertheless, there were several limitations in the study. Firstly, the enrolled participants were limited to Zhejiang Province, leading to certain regional limitations in the application of the screening model, in particular the epidemiological characteristics of possible compromise in another area. Secondly, our research was confined to early and rapid screening, without adequate information on disease progression and prognosis. Last but not least, with the development of epidemic situation, weight of certain characteristics, especially epidemiological characteristics, should be modified to increase the scope and accuracy of the diagnostic model.

According to the recent literatures, most patients with NCP are characterized by fever, cough, fatigue, and myalgia in the initial stage [11]. Atypical symptoms include diarrhea, nausea, headache, sore throat and so on. As the illness progressed, a proportion of patients gradually presented with dyspnea, especially in the populations with low immune functions [12]. Complications like acute respiratory distress syndrome (ARDS), arrhythmia and shock, is probably associated with a poor prognosis [7].

The most common laboratory abnormalities observed are leukopenia and lymphocytopenia. Moreover, it is reported that hypoalbuminemia, elevated CRP and lactate dehydrogenase (LDH), and decreased CD8 count can be seen in part of cases [6, 13]. The most frequent imaging manifestation is patchy/punctate ground glass opacities involved in single or multiple pulmonary lobes [14]. Alterations on chest CT can reflect the severity and progress of NCP [15]. However, 2019-nCoV infection can also present with normal pulmonary imaging, particularly in early stage, suggesting the necessity to combine epidemiological information, clinical manifestations and imaging in the screening and diagnosis [16].

At present, RT-PCR remains the confirmation criteria for the diagnosis of 2019-nCoV infection. RT-PCR is a technology combining RNA reverse transcription (RT) with polymerase chain amplification (PCR) of cDNA. It has been widely used in detecting different coronavirus (such as SARS-CoV and MERS-CoV) in laboratory, because of its high specificity and sensitivity. Besides that the RT-PCR test can be time-consuming, a shortage of test kits supply may not meet the needs of a growing infected population. Furthermore, RT-PCR of 2019-nCoV may be false negative due to unstable kits or unstandardized sampling [17]. Xiao et al reported that some patients who met the diagnosis of NCP based on clinical and imaging findings, had negative results for viral RNA [18]. In another study, initial negative RT-PCR results turned positive in repeated testing in a number of patients [10]. With the purpose of timely isolation and early treatment, it is necessary to establish a rapid screening diagnostic model for distinguishing highly suspicious patients with NCP.

Further nationwide even worldwide studies are needed to access the utility of this model, and subject to further adjustment and calibration if necessary. In addition, best cut-off value of this model can be re-set based on actual demands. Actually, the authors are trying to develop a procedure for fast scoring in clinical application based on this model.

In conclusion, the study established a rapid screening model for predicting NCP in a Zhejiang population. This model can be used as a simple, fast, and cost-effective tool for screening NCP with significant clinical value.

Patients

From Jan 17 to Feb 19, 2020, a total of 880 patients who were suspected of 2019-nCoV infection were recruited from hospitals in Hangzhou, Wenzhou, Shaoxing, Taizhou, Ningbo and Jiaxing in Zhejiang Province. The study was approved by the Ethics Committee of Zhejiang Provincial People’s Hospital (2020KY006); in addition, all research was performed in accordance with relevant guidelines [19]. Exempt informed consent was approved by the Ethics Committee of Zhejiang Provincial People’s Hospital because the subjects would not be exposed to any risk in this observational study, and the information of subjects was anonymized at collection and prior to analysis.

Epidemiological history and clinical manifestations were collected in each individual. Age, gender, region, coexisting diseases, body temperature, results of blood routine test and chest X-ray or CT were recorded for all participants. Throat swab, sputum, blood, or stool samples were collected to examine the 2019-nCoV nucleic acid using real-time RT-PCR. If the first-time RT-PCR test revealed negative, samples should be collected after 24 hours for a repeated test.

Eligibility

Patients admitted to the fever clinics who were initially suspected of NCP were included in the study. Suspected or confirmed cases were diagnosed according to the 5th edition of the Chinese recommendations for diagnosis and treatment of pneumonia caused by 2019-nCoV [19].

Suspected cases

NCP should be suspected if subjects conform to any one of the criteria in the epidemiological history and any two of the standards in clinical presentations. If there is no epidemiological history, suspected cases should meet three of the criteria in clinical presentations.

Epidemiological history: (1) Subjects with a travel or residence history in Wuhan or its neighboring areas, or other areas with persistent local transmission, or communities with definite cases within 14 days; (2) Subjects with a history of contacting confirmed cases with 2019-nCoV infections (positive nucleic acid detection) within 14 days; (3) Subjects with a history of contacting patients with fever or respiratory symptoms who have a travel or residence history in Wuhan or its neighboring areas, or in other areas with persistent local transmission, or communities with definite cases within 14 days; (4) Subjects who are associated with a cluster outbreak, which is defined as one definite case with NCP in family or place of work within 14 days, along with other patients with fever or respiratory symptoms.

Clinical presentations: (1) Fever and/or respiratory symptoms; (2) Typical chest imaging features of NCP, such as ground-glass opacity, infiltrating shadows, and pulmonary consolidation. (3) Normal or decreased white blood cell (WBC) count, or decreased lymphocyte count in the early stage of the disease.

Confirmed cases

Suspected cases who accord with any one of the following criteria: (1) Positive 2019-nCoV nucleic acid in throat swab, sputum, blood samples, or stool by using real-time RT-PCR; (2) Genetic sequencing of samples being highly homologous with the known 2019-nCoV.

Establishment of the rapid screening scale

Based on the epidemic situation in Zhejiang Province, we included age, gender, co-existing diseases, the epidemiological parameters, clinical symptoms, body temperature, WBC count, lymphocyte count, neutrophil count, and chest imaging to establish a novel diagnostic model of NCP. The epidemiological features and symptoms were considered as binary variables, and were scored as “1” if “yes”, and “0” if “no”. As to chest radiologic changes, they were simply classified as “normal”, “unilateral local patchy shadowing”, “bilateral multiple ground glass opacity”, “bilateral diffuse ground glass shadowing with pulmonary consolidation”, and “Other imaging alterations such as pulmonary nodule or pleural effusion”, and were scored as “0”, “0.5”, “1”, “2” and “0.3”, respectively.

The samples were classified to NCP, 339 individuals, and non-NCP, 520 individuals, according to their real-time PT-PCR outcomes since the detection of the 2019-nCoV nucleic acid using real-time RT-PCR was considered the golden standard. Consequently, after the derivation of the rapid screening model, the diagnostic performance of the established scale was also verified.

Statistical analysis

All statistical analyses were conducted using SPSS software (version 22.0) for Windows (SPSS, Chicago, IL). Continuous variables were compared using the Student’s t-test, and categorical variables were compared using the chi-squared test. For multiple comparisons, the one-way analysis of variance (ANOVA) was performed. Univariate logistic regression analyses were conducted to assess the factors associated with NCP. The parameters with statistical significance were loaded to a multivariate logistic regression model to further identify independent predictors for NCP.

To identify candidate predictors, we performed a stepwise logistic regression analysis (p-value to enter =0.05 and p-value to remove =0.10). A model based on the results of multiple logistic regression analysis was established to screen NCP; furthermore, 5-fold cross-validation was employed to evaluate the performance of the model. Area under receiver operating characteristic curve (AUROC) with 95% confidence interval (CI) was used to assess the predictive accuracy of the screening model for determining NCP [20]. Optimal cut-off values were set, and the corresponding sensitivities, specificities, positive likelihood ratios, and negative likelihood ratios of the model were calculated. A two-sided p-value cutoff < 0.05 was considered to be statistically significant.

Lu R, Zhao X, Li J, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor LANCET 2020; 395:565-574
Chan JF, Yuan S, Kok KH, et A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster. LANCET 2020; 395:514-523
Li Q, Guan X, Wu P, et al. Early Transmission Dynamics in Wuhan, China, of Novel Coronavirus-Infected The New England journal of medicine 2020
Tuite AR, Fisman Reporting, Epidemic Growth, and Reproduction Numbers for the 2019 Novel Coronavirus (2019-nCoV) Epidemic. ANN INTERN MED 2020
Update on the outbreak of new coronavirus pneumonia as at 24 February 27. http://www.nhc.gov.cn/xcs/yqtb/202002/d5e15557ee534fcbb5aaa9301ea5235f.shtml. (Assessed on February 27th, 2020).
Huang C, Wang Y, Li X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, Lancet (London, England) 2020; 395:497-506
Wang D, Hu B, Hu C, et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus–Infected Pneumonia in Wuhan, JAMA 2020
Chen Z, Fu J, Shu Q, et al. Diagnosis and treatment recommendations for pediatric respiratory infection caused by the 2019 novel coronavirus. WORLD J PEDIATR 2020
Corman V, Landt O, Kaiser M, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. EUROSURVEILLANCE 2020;25
Xie X, Zhong Z, Zhao W, et al. Chest CT for Typical 2019-nCoV Pneumonia: Relationship to Negative RT-PCR RADIOLOGY 2020:200343
Xu XW, Wu XX, Jiang XG, et Clinical findings in a group of patients infected with the 2019 novel coronavirus (SARS-Cov-2) outside of Wuhan, China: retrospective case series. BMJ 2020; 368:m606
Chen N, Zhou M, Dong X, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive LANCET 2020; 395:507-513

Liu Y, Yang Y, Zhang C, et Clinical and biochemical indexes from 2019-nCoV infected patients linked to viral loads and lung injury. SCI CHINA LIFE SCI 2020
Pan Y, Guan H, Zhou S, et Initial CT findings and temporal changes in patients with the novel coronavirus pneumonia (2019-nCoV): a study of 63 patients in Wuhan, China. EUR RADIOL 2020
Pan F, Ye T, Sun P, et al. Time Course of Lung Changes On Chest CT During Recovery From 2019 Novel Coronavirus (COVID-19) Pneumonia. RADIOLOGY 2020:200370
Chung M, Bernheim A, Mei X, et al. CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV). RADIOLOGY 2020:200230
Hao Clinical Features of Atypical 2019 Novel Coronavirus Pneumonia with an initially Negative RT-PCR Assay. J Infect 2020
Xiao SY, Wu Y, Liu H. Evolving status of the 2019 novel coronavirus infection: Proposal of conventional serologic assays for disease diagnosis and infection monitoring. J MED VIROL 2020
China National Health Commission. Diagnosis and treatment of pneumonitis caused by new coronavirus (trial version 5). Beijing: China National Health Commission,2020.http://www.nhc.gov.cn/yzygj/s7653p/202002/d4b895337e19445f8 shtml (accessed Feb 8, 2020).
Swets JA. Measuring the accuracy of diagnostic systems. SCIENCE 1988; 240:1285-1293

Acknowledgments

We thank all the persons fighting in this outbreak.

This work was supported by the grant from the emergency project of key research and development plan in Zhejiang Province, China (2020C03123).

Authors' contributions

Conception and design of the study: Pan HY, Li LJ and Huang HJ. Data collection: Dai YN, Zheng W, Wu QQ, Hui TC, Bao SX, Tong YX, Wu WH, Huang YC, Yin QQ, Wu LJ, Yu LX, Shi JC, Fang N, Shen YF, Xie XS, Ma CL, Yu WJ, Tu WH, Yan R, Wang MS, Chen MJ, Zhang JJ, and Gao HV. Data analysis: Dai YN, Chen GB, Sun NN, and Ju B. Writing of the article: Dai YN, Zheng W and Wu QQ. We thank all the persons fighting in this outbreak.

Competing interests

The authors declare that they have no conflicts of interests, financial or otherwise, related to the publication of this study.

Please see the supplementary files section to view the tables.

Tables.docx

Download PDF

Journal Publication

published 16 Feb, 2021

Read the published version in Scientific Reports →

Version 1

posted

You are reading this latest preprint version

A rapid screening model for early predicting novel coronavirus pneumonia in Zhejiang Province of China: A Multicenter Study

Status:

Journal Publication

Version 1

Abstract

Figures

Introduction

Results

Discussion

Methods

References

Declarations

Tables

Supplementary Files

Status:

Journal Publication

Version 1