General characteristics: A total of 62,009 unique orders were included for analysis, including 30,567 from the pre-pandemic, 3,205 from the pandemic, and 28,237 from the post-pandemic period. The median patient age of the overall population was 11.34, IQR: 5.24–15.02; female patients represented 50.8% (31,513/62,009) of the orders. Missed care opportunities significantly increased during the pandemic (n = 1,075/3,205; 33.5%) compared to the pre-pandemic period (n = 5,235/30,567; 17.1%), with a return to the baseline after the end of the shutdown (n = 4,664/28,237; 16.5%) (p < 0.05).
Multivariate analysis
Results of the multivariate analysis for each period are summarized in Table 1.
Pre-pandemic period: On multivariable analysis, during the baseline period, household income categories between $75,000-100,000 [OR: 0.832; CI, 0.749–0.924] and $100,000-200,000 [OR: 0.903; CI, 0.823–0.992] were also associated with lower odds of missed care opportunities. Higher odds were demonstrated for studies ordered for patients living out of the state [OR: 1.658; CI, 1.468–1.873). Likewise, there were higher odds in all age groups (children [OR: 1.218; CI, 1.138–1.304), infants [OR: 1.945; CI, 1.770–2.138], and neonates [OR: 2.094; CI, 1.608–2.728], compared to adolescents (reference group). Compared to CT, several differences between modalities were also found, including higher odds of missed care opportunities for fluoroscopy (OR: 1.675; CI, 1.387–2.023), MRI (OR: 1.991; CI, 1.669–2.374), nuclear medicine studies (OR: 1.505; CI, 1.058–2.142) and Ultrasound (OR: 1.211; CI, 1.020–1.437), and lower for radiographs (OR: 0.547; CI, 0.464–0.646). Orders for neuroimaging studies (OR: 0.548; CI, 0.486–0.618) were associated with lower odds of missed care opportunities.
Pandemic: During the COVID-19 pandemic, the distance between the patient's residence and the examination site (distance [OR: 1.1, CI: 1.01–1.19] and living out of the state [OR: 1.571, CI: 1.150–2.147]), self-identifying as Hispanic (OR:1.492; CI: 1.200-1.854), and having a lower household income ($25,000–50,000 [OR:3.660; CI, 2.736–4.894] and $50,000–75,000 [OR:1.866; CI, 1.427–2.439]) were associated with higher odds of missed care opportunities. Similarly, orders for infants (OR: 1.43, CI: 1.140–1.793) and fluoroscopy (OR: 2.303; CI, 1.428–3.715) had higher odds of missed care opportunities. Neuroimaging studies (OR: 0.544; CI, 0.392–0.754) were associated with lower odds of missed care opportunities.
Post-pandemic: In the post-pandemic period, being Hispanic (OR: 1.148; CI, 1.038–1.269) and living out of the state (OR:1.189, CI: 1.054–1.341), were again associated with higher odds of missed care opportunities. Asian race (OR: 0.835; CI, 0.724–0.962), orders for children (OR:0.787; CI, 0.732–0.847), not having English as a first language (OR: 0.743; CI, 0.662–0.835) and neuroimaging (OR: 0.570; CI 0.501–0.648), were associated with lower odds. Similar trends to those of the pre-pandemic period were seen for the odds of missed care opportunities between modalities.
Table 1
Results of the multivariate analysis
| PRE-PANDEMIC | PANDEMIC | POST-PANDEMIC |
OR | 95% CI | P-Value | OR | 95% CI | P-Value | OR | 95% CI | P-Value |
| Lower | Upper | | | Lower | Upper | | | Lower | Upper | |
Gender (male) | 0.946 | 0.890 | 1.007 | 0.080 | 0.941 | 0.805 | 1.101 | 0.448 | 0.927 | 0.870 | 1.289 | 0.062 |
Age Category* | Adolescents | REFERENCE | REFERENCE | REFERENCE |
Children | 1.218 | 1.138 | 1.304 | 0.000 | 0.988 | 0.831 | 1.173 | 0.887 | 0.787 | 0.732 | 0.847 | 0.000 |
Infants | 1.945 | 1.770 | 2.138 | 0.000 | 1.430 | 1.140 | 1.793 | 0.002 | 0.944 | 0.861 | 1.035 | 0.221 |
Neonates | 2.094 | 1.608 | 2.728 | 0.000 | 1.709 | 0.838 | 3.487 | 0.140 | 0.970 | 0.744 | 1.264 | 0.822 |
Modality | CT | REFERENCE | REFERENCE | REFERENCE |
FL | 1.675 | 1.387 | 2.023 | 0.000 | 2.303 | 1.428 | 3.715 | 0.001 | 2.170 | 1.751 | 2.690 | 0.000 |
MR | 1.991 | 1.669 | 2.374 | 0.000 | 1.336 | 0.857 | 2.082 | 0.200 | 2.036 | 1.667 | 2.488 | 0.000 |
NM | 1.505 | 1.058 | 2.142 | 0.023 | 0.891 | 0.385 | 2.063 | 0.788 | 1.090 | 0.707 | 1.679 | 0.697 |
US | 1.211 | 1.020 | 1.437 | 0.028 | 1.056 | 0.695 | 1.605 | 0.798 | 1.444 | 1.189 | 1.755 | 0.000 |
XR | 0.547 | 0.464 | 0.646 | 0.000 | 0.704 | 0.471 | 1.053 | 0.088 | 0.795 | 0.659 | 0.960 | 0.017 |
Neurological indication | 0.548 | 0.486 | 0.618 | 0.000 | 0.544 | 0.392 | 0.754 | 0.000 | 0.570 | 0.501 | 0.648 | 0.000 |
Anesthesia | 1.033 | 0.870 | 1.227 | 0.708 | 0.829 | 0.540 | 1.272 | 0.391 | 1.026 | 0.863 | 1.220 | 0.773 |
Out of state | 1.658 | 1.468 | 1.873 | 0.000 | 1.571 | 1.150 | 2.147 | 0.005 | 1.189 | 1.054 | 1.341 | 0.005 |
Distance (Km) | 1.000 | 1.000 | 1.000 | 0.108 | 1.100 | 1.001 | 1.190 | 0.000 | 1.000 | 0.999 | 1.000 | 0.073 |
Race | White/ Caucasian | REFERENCE | REFERENCE | REFERENCE |
Asian | 1.000 | 0.872 | 1.146 | 0.995 | 0.736 | 0.505 | 1.074 | 0.112 | 0.835 | 0.724 | 0.962 | 0.013 |
Black | 1.111 | 0.979 | 1.261 | 0.101 | 1.002 | 0.742 | 1.352 | 0.992 | 0.991 | 0.866 | 1.134 | 0.895 |
American Indian/ Native Alaska | 0.903 | 0.821 | 0.993 | 0.035 | 0.943 | 0.770 | 1.156 | 0.574 | 1.019 | 0.926 | 1.121 | 0.698 |
Native Hawaiian | 1.138 | 0.640 | 2.022 | 0.660 | 0.225 | 0.073 | 0.693 | 0.009 | 0.534 | 0.266 | 1.071 | 0.077 |
Other/ Unavailable | 0.549 | 0.161 | 1.871 | 0.338 | 0.000 | 0.000 | | 0.999 | 0.982 | 0.369 | 2.612 | 0.971 |
Hispanic ethnicity | 1.176 | 0.966 | 1.071 | 0.060 | 1.492 | 1.200 | 1.854 | 0.000 | 1.148 | 1.038 | 1.269 | 0.007 |
No English speaker | 1.090 | 0.978 | 1.215 | 0.120 | 1.228 | 0.956 | 1.577 | 0.108 | 0.743 | 0.662 | 0.835 | 0.000 |
Household income category | $25,000 - $50,000 | 0.950 | 0.836 | 1.079 | 0.430 | 3.660 | 2.736 | 4.894 | 0.000 | 1.087 | 0.950 | 1.242 | 0.224 |
$50,000 - $75,000 | 0.984 | 0.888 | 1.091 | 0.761 | 1.866 | 1.427 | 2.439 | 0.000 | 1.059 | 0.952 | 1.179 | 0.290 |
$75,000 - $100,000 | 0.832 | 0.749 | 0.924 | 0.001 | 1.221 | 0.917 | 1.627 | 0.172 | 0.947 | 0.848 | 1.057 | 0.333 |
$100,000 - $200,000 | 0.903 | 0.823 | 0.992 | 0.034 | 0.863 | 0.661 | 1.127 | 0.281 | 0.957 | 0.867 | 1.057 | 0.383 |
$200,000 or more | REFERENCE | REFERENCE | REFERENCE |
* The ages used in the text were defined using World Health Organization (WHO) definitions.
Data Science
CART: The CART allowed us to understand complex relationships between social determinants and missed care opportunities during the pre-pandemic (Fig. 1), pandemic (Fig. 2), and post-pandemic (Fig. 3) periods. For example, during the pre-pandemic period, missed care opportunities were mainly related to exam-specific characteristics (modality and neurological exams) and the patient's age. On the other side, during the COVID-19 pandemic, missed care opportunities were driven by social determinants of health such as household income, the distance between the patient's residence and the examination site, and ethnicity (Hispanic vs. Non-Hispanic). During the post-pandemic period, exam-specific characteristics and patients’ age re-gained relevance, displaying a similar behavior to the baseline (pre-pandemic). Similar to the pre-pandemic period, certain modalities (MR, US, and FL) and non-neurologic studies were associated with a higher rate of missed care opportunities during the recovery period. Nevertheless, contrary to the pre-pandemic period, ethnicity remained as a relevant predictor of the outcome in a specific subset of exam orders. Specifically, MRI, US, and FL studies ordered for neurological indication showed increased rates of missed care opportunities in patients who self-identified as Hispanics (Fig. 4).