Change in country-level COVID-19 case fatality rate is explicable by improved testing; no apparent role of medical care or disease-specific knowledge

doi:10.21203/rs.3.rs-471645/v1

Download PDF

Research Article

Change in country-level COVID-19 case fatality rate is explicable by improved testing; no apparent role of medical care or disease-specific knowledge

https://doi.org/10.21203/rs.3.rs-471645/v1

This work is licensed under a CC BY 4.0 License

Version 1

posted

You are reading this older preprint version

Read the latest preprint version →

Observed case fatality rate (CFR) of COVID-19 has decreased since the beginning of the pandemic. Reasons for this decline include improved knowledge of COVID19 pathogenesis, leading to improved medical care of confirmed cases. However, ascertainment also plays a role: as more low-risk individuals are tested and more mild cases identified, observed CFR will decline. Previously I showed that geography-level CFR was cross-sectionally negatively associated with test density; here I test for similar trends within geography over six months, and check plausibility of various posited causes. Although CFR varied between geographies, its association with testing did not: in 162 geographies, CFR dropped by an average of 18% (median 21; IQR 5–30) for each doubling of test density. Change in CFR within a given geography was not associated either with that geography’s medical spending or with whether the bulk of cases occurred early or late in the pandemic. This shows that medical interventions, including those specific to COVID-19, have only a minimal effect on total CFR. Two major conclusions follow. First, interventions to reduce CFR should be evaluated by comparing groups that received the intervention to those who did not: decline in CFR after an intervention is not evidence of effectiveness. Second, improving clinical care of confirmed COVID-19 cases has only a minimal effect on death rates. To minimize the total death toll of COVID-19, policymakers should prioritize reducing infections.

Infectious Diseases

Epidemiology

Test Density

Medical Spending

Medical Interventions

Infection Reduction

Observed case fatality rate (CFR) of COVID-19 has dropped since the beginning of the pandemic, from 10% to 3% in the US¹ and similarly elsewhere.² Cited reasons for this decline include improved understanding of disease pathogenesis leading to better treatment, as well as the abandonment of ineffective therapies.² However, ascertainment bias almost certainly also plays a role: early in the pandemic, tests were reserved for individuals at high risk of complications and many low-risk cases were missed. Seroprevalence data from early in the pandemic,³ when CFR in the US based on testing approached 10%,¹ suggested that when all cases were included true CFR was usually below 1% and often below 0.50%. Indeed, since asymptomatic or less-symptomatic cases often outnumber those with severe symptoms,⁴ it is likely that observed CFR is inflated by a factor of two or more.

It has already been shown⁵ that CFR of COVID-19 is lower in geographic regions where test density is higher. This association is similar on all continents, even though baseline CFR is higher on some continents than others. However, these cross-sectional data are confounded by geography-level factors such as population age structure, presence of comorbidities, and access to critical care. Thus while it is likely that ascertainment bias plays a role in the observed drop in CFR as test density increases, it is not known how large this effect is.

The current paper investigates the role of test density in driving changes in observed geography-level CFR over a six-month period. As alternative explanations for observed changes in CFR I consider per capita medical spending as an indicator of critical-care access; and timing of the epidemic as an indicator of each geography’s ability to benefit from rapidly-evolving knowledge. This technique eliminates variation in CFR driven by geography-level factors, and thus allows an unbiased estimate of the role of ascertainment in driving observed decreases in COVID-19 lethality.

Study Design and Data Collection

I estimate the slope of the association between change in test density, and change in observed CFR, in resolved cases of COVID-19 between July 3, 2020 and January 5, 2021. I then investigate the role of two factors (timing of the epidemic and medical spending) in driving this change.

COVID-19 data are from every geography for which they were available from a publicly-available real-time counter¹ and in which at least one death had occurred by the earlier timepoint. Timing of the epidemic was expressed as the percent of total cumulative cases at the later timepoint that occurred after the earlier timepoint. Medical spending (USD per capita, 2015) was downloaded from the World Health Organization.⁶

Data Analysis

For each geography I calculate the association between CFR (ratio between total deaths and total resolved cases) and test density per million residents, between the two timepoints.

CFR, test density, total COVID-19 cases, and medical spending were all approximately log-normally distributed and thus were log-transformed for normality in all analyses. Initial checks found four geographies had extreme values for CFR change (Monaco, Central African Republic, and Venezuela at the low end; Uzbekistan at the high end). These were excluded in sensitivity analyses.

Timing of the epidemic (percent of total cases that occurred after July 3) was skewed and thus it was categorized into early, middle, and late based on 10^thand 50^th percentiles.

Models were computed using log-log linear regression weighted by log average number of cases (mean of case count at the two timepoints.) Outputs were then reverse-transformed and expressed as percent change in CFR per doubling of test density.

In countries with complete COVID-19 data (n=162) median CFR was 4.08% (IQR 2.2 – 6.9) on July 3 and 2.04% (1.3 – 3.1) on January 5. Median test density was 23 tests per thousand population (IQR 6.6 – 60) at the earlier timepoint, and 1200 (274 - 5000) at the later timepoint. A median of 88% of total cases occurred after July 3 (IQR 83 - 94%; 10^th percentile, 48%.)

Data on medical spending was available for 142 geographies, which included 99.8% of COVID-19 cases. Median medical spending was $1010 per person per year (IQR 350 – 2200.)

CFR decreased in 136 geographies (84%) (Figure 1) which contained 96% of COVID-19 cases. For each doubling in test density, mean CFR decreased by 18%, with a median (IQR) of 21% (5 – 30)). (Figure 2.) CFR decreased in between 75 and 90% of geographies for the five major continents; it decreased most steeply in Central African Republic (75% per doubling in test density) Monaco (75%) and Venezuela (69%).

Geographies with high medical spending, such as much of Europe, tended to have higher CFR at both timepoints than did geographies with low medical spending, such as much of Africa (Figure 1). However, changes in CFR with test density were similar across the range of medical spending. The slopes of the regression lines for different geographies were nearly parallel on the log-log scale (Figure 1) and there was no visible association between medical spending and rate of change of CFR with test density (Figure 2.)

This null association was supported by statistical models, which found that rate of change in CFR was not associated with either medical spending or timing of the epidemic (both p >0.10), either before or after exclusion of outliers.

Case fatality rate of COVID-19 declined with increasing test density, suggesting ascertainment bias. While CFR itself was consistently higher in some geographies than others, its rate of decline did not vary with factors hypothesized to affect it. This suggests that decline in CFR was almost entirely explicable by improved testing, with no detectable effect of either access to medical care or existence of COVID-19-specific knowledge.

The 18% decrease of CFR with each doubling of test density within the same geography over time was almost the same as that previously observed between geographies at a single timepoint,⁵ further supporting the role of test bias in driving it.

These findings have two major implications. First, research into CFR and its drivers should explicitly consider ascertainment bias. Evaluation of interventions should compare groups that received it to those who did not, rather than interpreting a decline in CFR after an intervention as evidence of effectiveness. Second, improvements in clinical care appear to have only a minor effect on case fatality rate. To minimize the death toll of COVID-19, the priority should be to reduce infection.

Author Contributions

MPS did all the work and takes full responsibility for the paper.

Additional Information

No competing interests. No additional funding.

1 Worldometers.info. COVID-19 Coronavirus Pandemic, <https://www.worldometers.info/coronavirus/> (2020).

2 Ledford, H. in Nature (2020).

3 Ioannidis, J. The infection fatality rate of COVID-19 inferred from seroprevalence data. Bulletin of the World Health Organization, doi:https://www.medrxiv.org/content/10.1101/2020.05.13.20101253v2 (2020).

4 Oran, D. T., EJ. Prevalence of Asymptomatic SARS-CoV-2 Infection: A Narrative Review. Annals of Internal Medicine June 3, M20-3012 (2020).

5 Smith, M. Role of ascertainment bias in determining case fatality rate of COVID-19. J Epidemiol Global Health, doi: https://doi.org/10.2991/jegh.k.210401.001 (2021 ).

6 in Data Explorer (World Health Organization, 2021).

No competing interests reported.

Download PDF

Version 1

posted

You are reading this older preprint version

Read the latest preprint version →

Change in country-level COVID-19 case fatality rate is explicable by improved testing; no apparent role of medical care or disease-specific knowledge

Status:

Version 1

Abstract

Figures

Introduction

Methods

Study Design and Data Collection

Data Analysis

Results

Conclusions

Declarations

Author Contributions

Additional Information

References

Additional Declarations

Status:

Version 1