Effectiveness of Hospital Emergency Department Regionalization and Categorization Policy on Appropriate Patient Emergency Care Use: A Nationwide Observational Study in Taiwan

Abstract

Background: Emergency department (ED) overcrowding is a health services issue worldwide. Modern health policy emphasizes appropriate health services utilization. However, the relationship between accessibility, capability, and appropriateness of ED use is unknown. Thus, this study aimed to examine the effect of hospital ED regionalization policy and categorization of hospital emergency capability policy (categorization policy) on patient-appropriate ED use.

Methods: Taiwan implemented a nationwide three-tiered hospital ED regionalization and categorization of hospital emergency capability policies in 2007 and 2009, respectively. We conducted a retrospective observational study on the effect of emergency care policy intervention on patient visit. Between 2005 and 2011, the Taiwan National Health Insurance Research Database recorded 1,835,860 ED visits from one million random samples. ED visits were categorized using the Yang-Ming modified New York University-ED algorithm. A time series analysis was performed to examine the change in appropriate ED use rate after policy implementation.

Results: From 2005 to 2011, total ED visits increased by 10.7%. After policy implementation, the average appropriate ED visit rate was 66.9%. The intervention had no significant effect on the trend of appropriate ED visit rate.

Conclusions: Although regionalization and categorization policies did increase emergency care accessibility, it had no significant effect on patient-appropriate ED use. Further research is required to improve data-driven policymaking.

Background

The American Medical Association and American College of Emergency Physicians published guidelines for the categorization and regionalization of hospital-based emergency department (ED) capability to integrate network emergency care and match critically ill patients with the appropriate healthcare facility [1-3]. Kocher et al. (2010) proposed definitions and a conceptual framework for the categorization, designation, and regionalization of emergency care policy evaluation criteria [4]. These theoretical guidelines significantly influence the development of emergency care delivery systems worldwide.

The categorization policy focuses on all emergency care capability and capacity of a hospital, whereas the regionalization policy matches medical resources to patients’ needs to maximize health benefits and outcomes while minimizing the cost and use of resources over a specified geographic area [5]. Empirical data regarding emergency care categorization [5-13] and regionalization [14-21] have demonstrated their effectiveness. However, most studies focus on specific time-sensitive disease entities, age groups, or regional scales. Moreover, data show that categorization, designation, and regionalization policies may improve the transparency of emergency care services by disclosing quality information about the capability levels of prehospital emergency medical services, EDs, and hospital emergency services, but changes in health care-seeking behavior as a result of categorization and regionalization information are unclear [4].

ED overcrowding is a health services research issue [22-26] that may profoundly jeopardize patient safety [27-32]. According to the Asplin ED crowding input-throughput-output conceptual model, patient flow management may drive ED crowding research [33]. This model proposed that ED crowding may be caused by (1) the input dimension represented by inappropriate ED use by patients, and (2) inadequate accessibility and emergency physician capability in emergency care supplied by providers [33].

Aday and Andersen noted that health policy may improve access, thus increasing realized utilization [34]. Contemporary health policy is driven by an emphasis on appropriate health services utilization, avoiding overuse, misuse, or underuse [35]. However, the relationship between accessibility, capability, and appropriateness of ED use remains unknown. Therefore, we hypothesized that regionalization and categorization policies may increase user access, and emergency care quality and capability information disclosure may guide patients when choosing an “appropriate” treatment setting, thereby improving appropriate ED care use rate. Thus, this study aimed to investigate the effect of these policies on patient-appropriate ED use.

Methods

Setting

The Taiwan Ministry of Health and Welfare (MoHW) adopted the categorization, designation, and regionalization international guidelines to establish a national emergency care system, including prehospital emergency medical services (EMS), emergency medical responder-responsive hospital designation, regionalization, and categorization of hospital emergency capability. Taiwan’s ED regionalization and categorization policies were implemented in 2007 and 2009, respectively, with the primary goals of establishing infrastructure and decreasing regional disparity.

Study Design and Timelines

This seven-year retrospective observational study on the effect of hospital emergency care policies on patient-appropriate ED use included all ED visits between January 1, 2005 and December 31, 2011. Each visit date was associated with one event to avoid replicating events (Figure 1). We divided the study period in three: the pre-policy period (October 2005–July 2007), regionalization policy intervention period (August 2007–July 2009), and categorization policy intervention period (August 2009–July 2011).

Regionalization Policy

The regionalization policy focuses on prehospital EMS networking and rescuer-responsive hospital ED designations. Its primary objective was to increase the accessibility of emergency care. To achieve this objective, health authorities first identified responsible hospitals in 61 subregions; subsequently, every subregion had at least one hospital that was designated to respond to acute events.

In July 2007, Taiwan launched the Emergency Medical Services Act Amendment. The revised Emergency Medical Services Act represented a landmark for reorganizing the network of emergency care systems in Taiwan; this act implemented three significant changes: (1) introducing hospital-based ED categorization focused on ED medical capability to provide resuscitation, (2) establishing a medical director system to connect hospital ED physicians with prehospital EMS, and (3) forming six regional emergency operations centers (REOCs). Prehospital regionalization efforts included onsite auditing by the MoHW and the categorization of hospital-based ED using a three-tiered approach to emergency care (severe, moderate, and general). Moderate- and severe-tiered EDs undergo onsite audits by the MoHW, while general-tiered hospitals are overseen by the local health authority.

The hierarchical system of emergency rescuer-responsive hospitals and designated hospital ED must provide transport within 30 minutes for time-sensitive events such as stroke, acute myocardial infarction, major trauma, high-risk pregnancies, and newborns. Six REOCs may dispatch EMS ambulances and rescue personnel from local hospitals to emergency patients and mass casualties. The REOC coordinates with the EMS to provide onsite prehospital triage and care, and dispatches patients to the nearest designated appropriate hospital ED.

Categorization Policy

In 2009, the Taiwan MoHW promulgated the “Standards for the categorization of hospital emergency capability.” According to these standards, the MoHW categorized hospitals into three tiers (severe, moderate, and general) based on their emergency care capability and capacity (including hospital ED, critical time-sensitive-event care teams, and intensive care unit). The primary focus of this policy was the establishment of centers for trauma, cardiac catheterization, stroke, perinatal emergency care conditions, high-risk pregnancies, and pediatric intensive care.

The Joint Commission of Taiwan accredits hospitals every four years, and severe-tiered hospitals are considered the last line for hospital referrals. At the end of 2009, 191 rescuer-responsive hospitals were accredited, including 26 severe-, 76 moderate-, and 89 general-tiered hospitals. This policy ensures the use of timely, continuous, effective, and collaborative multidisciplinary methods with two principal objectives: (1) to provide quality hospital emergency care, and (2) to provide a hospital emergency care capability classification with information regarding whether patients chose the appropriate treatment setting (right care in the right place). This information provides patients with appropriate quality information to increase the appropriate ED use. Therefore, the prehospital EMS, hospital ED, hospital emergency care teams, and intensive care unit critical care capability and capacity were well established and categorized in Taiwan [36].

Estimated Appropriate ED Use

We used a revised version of the Modified Billings/New York University-ED algorithm (NYU-ED algorithm) for emergency care evaluation according to processes and outcome indicators—referred to as the Yang-Ming modified NYU-ED algorithm—to define the appropriateness of ED use (Additional Figure 1) [37]. This algorithm classifies ED visits as emergent vs. nonemergent, and optimal care site as ED vs. primary care. It further divides an ED visit into six categories: (1) “nonemergent” (NE), (2) “emergent, primary care treatable” (EPC), (3) “emergent care needed, preventable/avoidable” (EPA), (4) “emergent care needed, not preventable/avoidable” (ENPA), (5) unclassifiable, and (6) “injury and behavioral health-related diagnosis” [38].

The Modified Billings/NYU-ED algorithm classifies ED use as appropriate when EPA and ENPA summative primary diagnosis probabilities are equal to or greater than 0.50, whereas NE and PCT are classified as inappropriate ED use [39-41].

We reclassified inappropriate and unclassifiable ED visits using explicit procedures (if a patient received any procedure that is not often available in primary care settings, such as computed tomography or magnetic resonance imaging scans), and outcome-based criteria (if a patient is transferred, hospitalized, or dies) to reflect the complexity of a patient’s condition and appropriateness of emergency care usage. Injury and behavioral health ICD-9 codes were excluded as the original Billings/NYU-ED algorithm[38].

Data Access and Covariates

The analytic data were derived from the Taiwan Longitudinal Health Insurance Database 2005 (LHID2005), which is maintained with routinely collected administrative data from the National Health Insurance [42, 43]. The LHID2005 comprises one million randomly sampled participants who were alive in 2005; the database includes all medical records for these individuals from 1995 onward. It also includes hospital and medical professional staff characteristics, subject enrollment, and medical information. This database reflects healthcare facilities’ accessibility and medical care utilization [44, 45]. The collected medical utilization information includes diagnosis procedure, treatment medication, medical cost, date of visit, and deposition [46]. The accuracy of the diagnoses recorded by the LHID2005 for time-sensitive diseases, such as acute ischemic stroke [47, 48], acute myocardial infarction [48], asthma [49] and pneumonia [50], has been validated. Encrypted unique personal identification numbers link all the data, allowing a longitudinal follow-up.

We identified ED visits using the ED visit case type and revenue codes. We used these data to count ED visits. We obtained visit-level data for all ED visits to all hospitals in Taiwan from 2005 to 2011. The covariates included predisposing factors such as sex, age, and occupation; enabling factors such as the beneficiary’s insured salary, urbanization of living area, and emergency care resources classification; and need-driven factors such as comorbidity status. Comorbidity status was defined using the Charlson Comorbidity Index (CCI) score [51].

Statistical Analyses

We compared the two policy periods’ baseline covariates characteristics using χ² tests and t-tests accounting for the LHID2005 administrative data. Because ED use and its covariates are time-dependent and longitudinal, we performed a time series analysis to estimate multilevel changes in appropriate ED use rates after regionalization and categorization policy interventions. Before examining the policy’s effect on appropriate ED visit rates, the Dickey-Fuller test was used to determine the baseline appropriate use rate. The difference in monthly mean probabilities after hospital ED regionalization and categorization was determined using a segmented autoregressive integrated moving average (ARIMA) model with an indicator variable for the regionalization and categorization periods. This model can examine the policy intervention effect while accounting for autocorrelation and time effects. We also evaluated the odds of having an appropriate ED visit during the regionalization and categorization policy stage compared with previous policy stage. All analyses were conducted using SAS 9.4 (SAS Institute, Cary, NC) and Stata MP 14.0 (StataCorp LLC, College Station, TX) software. Statistical significance was determined using a two-tailed significance level of 0.05.

Sensitivity and Bias Analyses

According to a systematic review on ED crowding, the common causes of input factors are nonurgent visits, frequent flyers, and influenza season [52]. During our study period, no specific ED-related policy was promulgated nor was the ED co-payment scheme changed. We evaluated the effects of frequent ED users (≥ 4 visits per year) [53] (Additional Figure 2) and the 2009 influenza season (Additional Figure 3) [54]. Excluding the effects related to these factors, the trend in appropriate ED visit classification showed no substantial changes. A sensitivity analysis was conducted increasing the threshold of EPA and ENPA summation probabilities to ≥ 0.75 (Additional Figure 4). Similar trends in ED visit classification further demonstrated the lack of significant changes.

Results

Emergency Care Access

From 2005 to 2011, the number of ED visits, ED expanse, and ED physicians increased by 10.7%, 29.4%, and 35.1%, respectively. In contrast, the total number of hospitals and EDs decreased by 8.1% and 8.6%, respectively, during the same period (Additional Table 1).

Participant Characteristics

Between 2005 and 2011, 1,931,451 ED visits were identified from one million random sample datasets. Thus, the study sample comprised 1,866,261 events (Figure 1). Of these, 65,190 events on the same date and at the same hospital were excluded to avoid visit replication. When two visits occurred on the same date but at different hospitals (30,401 cases), both visits were considered the same emergency event. A total of 76,460 visits related to injury and behavioral ICD-9 diagnoses were excluded from the modified Billings/NYU-ED algorithm for international comparison. In this study cohort, the crude appropriate ED visit rate was 66.9%. Table 1 presents the numbers and percentages of baseline characteristics of ED visits by policy intervention for observable samples. During the pre-policy period, the mean age of patients was 39.6±26.2 years; after regionalization policy implementation, 44.8±25.3 years; and after categorization policy implementation, 46.2±24.5 years. During the pre-policy period, the mean CCI score of patients was 1.0±1.9; after regionalization policy implementation, 1.2±2.1; and after categorization policy implementation, 1.2±2.1.

Appropriate ED Visit Rate by Baseline Characteristics for Different Policy Interventions

Table 2 presents the overall rate of appropriate ED visits after regionalization policy implementation (64.1% pre-policy period vs. 68.1% regionalization policy stage); no significant changes occurred after the categorization policy was implemented (68.1% vs. 68.5%). Patients with a higher rate of appropriate ED use had the following characteristics: male, aged ≥ 65 years, CCI score > 1, rural region residents, residents of an area with inadequate emergent care resources, weekday ED visit, income level in the third quintile, and occupations such as civil servants, teachers, military personnel, and veterans.

Time Series Analysis of the Policy Intervention Effect

Figure 2 presents the results of the segmented ARIMA analyses examining the relationship between regionalization and categorization policies and appropriate ED use rate. For the rate of appropriate ED visits during the study period, there was no significant change in intercept points (level parameters). Table 2 presents results showing a statistically significant change in the average appropriate ED visit rate as a result of the regionalization policy. The Dickey-Fuller test showed that the data remained stable before and after the implementation of the regionalization (P=0.005) and categorization (P=0.0037) policies. To fit the ARIMA model, we used the autocorrelation function (ACF) and partial autocorrelation function (PACF) to determine whether autoregressive (AR) or moving average processes terms were needed to address any autocorrelation. The plot of the appropriate ED rate by month showed an exponentially declining ACF and spikes in the first and eleventh lags of the PACF. Therefore, we used the AR term in this study. 

We found that comorbidity mediated the association between appropriate ED visit rate and regionalization or categorization policy intervention (Table 3). In contrast, income had an inverse association with appropriate ED use rate. We performed a stratification analysis using the CCI. The population was classified into two groups: one with a CCI score equal to or less than 1 and the other with a CCI score greater than 1 (Additional Table 2). The CCI score subgroup analysis showed that, in both groups, the regionalization policy had a significant negative effect on appropriate ED visit rate (CCI score ≤ 1: trend change -0.27% per month, P=0.024; CCI score > 1: trend change -0.16% per month, P=0.015).

Discussion

In this seven-year policy intervention observational study, ED utilization and expanse increased by 10.7% and 29.4%, respectively. Provider-related ED policies had no significant medium-term effects (two years) on patients’ patterns of appropriate ED use and improved the realized accessibility to EDs.

Previous studies concluded that appropriate ED utilization varies according to insurance status, socioeconomic status, race, and other sociodemographic factors [7]. Nonetheless, need-driven factors were the most important predictors of appropriate ED use [55]. Conversely, common factors for inappropriate ED use include greater trust in the hospital than in the primary care setting [56], greater convenience [57], time saving [58, 59], or lack of primary care access [60]. One Taiwanese nationwide validation study reported that an increase in the availability of ambulatory care physicians or facilities did not decrease non-emergency ED use [61].

From the user’s perspective, non-business hours, including evening and weekend, accounted for 76.2% of whole service period. Moreover, patients tend to seek immediate or ED services for time-sensitive events [62, 63]. Our study determined that provider-side ED policy implementation and quality information disclosure did not increase patients’ appropriate ED use. The lack of effect may be explained as follows: (1) prudent laypersons may have difficulty judging whether their condition is urgent or nonurgent, and where they should go for treatment [63]; and (2) the categorization of hospital emergency capability ensures the comprehensive availability of laboratory services, image studies, and treatment 24 hours a day/365 days a year.

The unintended consequence of hospital emergency care quality disclosure is that the hospital ED becomes the first choice for people seeking treatment for time-sensitive emergency conditions or convenience. The Taiwan MoHW proposed a co-payment of $12 for an ED visit to possibly reduce primary care-treatable ED visits. However, the National Health Insurance medical service payment standards dictate that the co-payments for a medical center ED, regional hospital ED, and local hospital ED visit are $15, $10, and $5, respectively. In comparison, the co-payment for an outpatient clinic visit at a medical center is $12; at a regional hospital, $8; at a local hospital, $2.7; and at a general practitioner office, $1.7. Other factors that must be considered are traffic and waiting time costs in the primary care setting, as well as a minimum wage of $4.50 per hour [64]. Meanwhile, a nationwide emergency policy requires the hospital emergency care system to improve its abilities to meet patients’ needs by improving accessibility through increased convenience (e.g., providing immediate access to an ED anytime) and availability (e.g., providing consultations with an available specialist within 30 minutes). Therefore, a hospital ED offers more significant time savings and cost-effectiveness for patients.

A systematic review reported that financial constraints and case management are two effective approaches to increase ED use appropriateness [65]. Raven et al. (2016) suggested that financial measures may decrease ED visits without increasing appropriateness; conversely, case management may decrease ED visits while increasing appropriateness [65]. We examined the effects of provider-related policy and disclosure of related information on improving patients’ appropriate ED use and found that this policy goal was unmet. We agree with Smulowitz’s suggestion [66] to reshape emergency care and extend medical emergency services to meet patients’ needs, such as offering real-time “face-to-face” telehealth to provide medical recommendations to support patient decision-making, and relieve patient anxiety, implementing an access policy that combines primary and ED care data without time or location limitations [67, 68].

Strengths and Limitations

This study has several strengths: (1) we provided real-world empirical data to explain the relationship between ED policy intervention and patients’ health-seeking behaviors; (2) we analyzed other possible causes of input factor increase (2009 influenza pandemic and frequent ED user effect) to ensure that the effects of policy implementation on appropriate ED use were not caused by other confounders; and (3) to the best of our knowledge, this study is the first nationwide single insurance system example that supports the American Medical Association, American College of Emergency Physicians, and Kocher et al. theoretical models regarding the categorization, designation, and regionalization of emergency care. Thus, our study provides unique information for academic research in emergency care.

Conversely, this study has the following limitations that may impact its generalizability: (1) this retrospective study used a dataset collected for administrative claims purposes according to the conceptualization of appropriate ED visits, which may be defined at the patient, disease, hospital, and social context levels [69-75]. However, we did not have enough information to address these holistic concerns; (2) the LHID2005 administrative dataset is collected for reimbursement purposes, and there is natural attrition due to aging, migration, and death; (3) categorization and designation are essential components in the regionalization of emergency care networks [76]. However, Taiwan emergency care policy and services underwent an established regionalization and categorization sequence, and these paradigm differences deserve further investigation; and (4) in the market-maximized approach, financial and managed care strategies are chosen to drive improvement in appropriate ED use [77]. Contrastingly, Taiwan chose a market-minimized policy to guide appropriate ED use, which may limit the external validity of our study.

Conclusion

Among policies on international emergency care delivery systems, Taiwan’s promotion of regionalization and categorization of emergency care policies has unique characteristics and requires evaluation. The provider-side changes implemented by these policies did improve patient’s accessibility to emergency care. In contrast, emergency care quality disclosure may not increase patients appropriate ED use. Strategies for balancing patients’ needs and appropriate ED use require further investigation.

Abbreviations

ACF, Autocorrelation function

AR, Autoregressive

ARIMA, Autoregressive integrated moving average

CCI, Charlson Comorbidity Index

ED, Emergency department

EMS, Emergency medical services

ENPA, Emergent, not preventable/avoidable

EPA, Emergent, preventable/avoidable

EPC, Emergent, primary care

MoHW, Ministry of Health and Welfare

NE, Nonemergent

PACF, Partial autocorrelation function

REOC, Regional emergency operations center

Declarations

Ethics Approval and Consent to Participate

This study was approved by the Institutional Review Board of National Yang-Ming University (YM107035E). In accordance with regulations of the National Health Research Institutes, patient identification information was anonymized; therefore, informed consent was waived.

Consent for Publication

Not applicable.

Availability of Data and Materials

The data that support the findings of this study are available from the Taiwan National Health Insurance Research Database, but restrictions apply to the availability of these data, which were used under license for the current study and so are not publicly available. Data are however available from the authors upon academic request and with permission of the Taiwan National Health Insurance Administration.

Competing Interests

The authors declare that they have no competing interests.

Funding

The authors declare that they had no funding.

Authors’ Contributions

C-YL and Y-CL made substantial contributions to conception and design of this study. C-YL analysis and interpretation of data, and preparation of the manuscript. Y-CL critical appraisal and rewrite the manuscript to become an academic research paper. All authors have read and approved the manuscript.

Acknowledgments

We acknowledge the Taiwan National Health Insurance Research Database, which was provided by the National Health Insurance Administration and is managed by the National Health Research Institutes.

Authors’ details

¹Department of Neurology, Taipei City Hospital, Taipei, Taiwan

²Institute of Health and Welfare Policy, School of Medicine, National Yang-Ming University, Taipei, Taiwan

³Department of Health Care Management, National Taipei University of Nursing and Health, Taipei, Taiwan

⁴Master Program on Trans-disciplinary Long-Term Care and Management, National Yang-Ming University, Taipei, Taiwan

References

1. American Medical Association, Recommendations of the Conference on the Guidelines for the Categorization of Hospital Emergency Capabilities. 1971: American Medical Association.
2. Mehrotra, A., et al., Important historical efforts at emergency department categorization in the United States and implications for regionalization. Acad Emerg Med, 2010. 17(12): p. e154-60.
3. National Academy of Sciences (US) . National Research Council (US) Committee on Trauma National Research Council (US) Committee on Shock, Accidental Death and Disability: The Neglected Disease of Modern Society. Washington (DC): National Academies Press (US); 1966. Available from: https://www.ncbi.nlm.nih.gov/books/NBK222962/ doi: 10.17226/9978. 1966: National Academies.
4. Kocher, K.E., et al., Categorization, designation, and regionalization of emergency care: definitions, a conceptual framework, and future challenges. Acad Emerg Med, 2010. 17(12): p. 1306-11.
5. Boyd, D.R., et al., Categorization of hospital emergency medical capabilities in Illinois: A statewide experience. IMJ Ill Med J, 1974. 146(1): p. 33-8.
6. Detmer, D.E., et al., Regional categorization and quality of care in major trauma. J Trauma, 1977. 17(8): p. 592-9.
7. Gibson, G., Categorization of hospital emergency capabilities: some empirical methods to evaluate appropriateness of emergency department utilization. J Trauma, 1978. 18(2): p. 94-102.
8. Grumbach, K., et al., Regionalization of cardiac surgery in the United States and Canada: geographic access, choice, and outcomes. Jama, 1995. 274(16): p. 1282-1288.
9. DuBose, J.J., et al., Effect of trauma center designation on outcome in patients with severe traumatic brain injury. Arch Surg, 2008. 143(12): p. 1213-7; discussion 1217.
10. Mechem, C.C., et al., Resuscitation center designation: recommendations for emergency medical services practices. Prehosp Emerg Care, 2010. 14(1): p. 51-61.
11. Nguyen, Y.L., J.M. Kahn, and D.C. Angus, Reorganizing adult critical care delivery: the role of regionalization, telemedicine, and community outreach. Am J Respir Crit Care Med, 2010. 181(11): p. 1164-9.
12. Hunt, M.M., et al., The utility of a "trauma 1 OP" activation at a level 1 pediatric trauma center. J Pediatr Surg, 2017. 52(2): p. 322-326.
13. Windorski, J., et al., Differences in hospital outcomes following traumatic injury for patients experiencing immediate transfer to a level I trauma facility versus resuscitation at a critical access hospital (CAH). Am J Surg, 2018.
14. Lyle, D.M., et al., Regionalization of trauma services in western Sydney: predicted effect on ambulance and hospital utilization rates. Aust N Z J Surg, 1991. 61(8): p. 589-96.
15. Sampalis, J.S., et al., Trauma care regionalization: a process-outcome evaluation. J Trauma, 1999. 46(4): p. 565-79; discussion 579-81.
16. Miyata, H., et al., Toward quality improvement of cardiovascular surgery in Japan: an estimation of regionalization effects from a nationwide survey. Health Policy, 2009. 91(3): p. 246-51.
17. Diaz, J.J., Jr., et al., Does regionalization of acute care surgery decrease mortality? J Trauma, 2011. 71(2): p. 442-6.
18. Glickman, S.W., et al., Assessment of temporal trends in mortality with implementation of a statewide ST-segment elevation myocardial infarction (STEMI) regionalization program. Ann Emerg Med, 2012. 59(4): p. 243-252.e1.
19. Spaite, D.W., et al., Statewide regionalization of postarrest care for out-of-hospital cardiac arrest: association with survival and neurologic outcome. Ann Emerg Med, 2014. 64(5): p. 496-506.e1.
20. Kelly, M.L., et al., Decreased mortality in traumatic brain injury following regionalization across hospital systems. J Trauma Acute Care Surg, 2015. 78(4): p. 715-20.
21. Tung, Y.C. and G.M. Chang, The Relationships Among Regionalization, Processes, and Outcomes for Stroke Care: A Nationwide Population-based Study. Medicine (Baltimore), 2016. 95(15): p. e3327.
22. Velt, K.B., et al., Emergency department overcrowding: a survey among European neurotrauma centres. Emerg Med J, 2018. 35(7): p. 447-448.
23. Boyle, A., et al., Comparison of the International Crowding Measure in Emergency Departments (ICMED) and the National Emergency Department Overcrowding Score (NEDOCS) to measure emergency department crowding: pilot study. Emerg Med J, 2016. 33(5): p. 307-12.
24. Wang, Z., et al., Causes of Emergency Department Overcrowding and Blockage of Access to Critical Services in Beijing: A 2-Year Study. J Emerg Med, 2018. 54(5): p. 665-673.
25. Horwitz, L.I. and E.H. Bradley, Percentage of US emergency department patients seen within the recommended triage time: 1997 to 2006. Arch Intern Med, 2009. 169(20): p. 1857-65.
26. Wallingford, G., Jr., et al., Introduction of a Horizontal and Vertical Split Flow Model of Emergency Department Patients as a Response to Overcrowding. J Emerg Nurs, 2018. 44(4): p. 345-352.
27. Trzeciak, S. and E.P. Rivers, Emergency department overcrowding in the United States: an emerging threat to patient safety and public health. Emergency medicine journal, 2003. 20(5): p. 402-405.
28. Pines, J.M. and J.E. Hollander, Emergency department crowding is associated with poor care for patients with severe pain. Annals of emergency medicine, 2008. 51(1): p. 1-5.
29. Cowan, R.M. and S. Trzeciak, Clinical review: emergency department overcrowding and the potential impact on the critically ill. Critical care, 2004. 9(3): p. 291.
30. Schull, M.J., et al., Emergency department crowding and thrombolysis delays in acute myocardial infarction. Annals of emergency medicine, 2004. 44(6): p. 577-585.
31. Makary, M.A. and M. Daniel, Medical error-the third leading cause of death in the US. BMJ, 2016. 353: p. i2139.
32. Momeni, M., et al., Emergency Overcrowding Impact on the Quality of Care of Patients Presenting with Acute Stroke. Adv J Emerg Med, 2018. 2(1): p. e3.
33. Asplin, B.R., et al., A conceptual model of emergency department crowding. Annals of emergency medicine, 2003A. 42(2): p. 173-180.
34. Aday, L.A. and R. Andersen, A framework for the study of access to medical care. Health services research, 1974. 9(3): p. 208.
35. Payne, S.M., Identifying and managing inappropriate hospital utilization: a policy synthesis. Health Services Research, 1987. 22(5): p. 709-769.
36. Ministry of Health and Welfare, The Statistics and Trends in Health and Welfare 2019. 2020, Ministry of Health and Welfare: Taiwan.
37. Lin, C.-Y. and Y.-C. Lee, Appropriateness of emergency care use: a retrospective observational study based on professional versus patients’ perspectives in Taiwan. BMJ open, 2020. 10(5): p. e033833.
38. Billings, J., N. Parikh, and T. Mijanovich, Emergency department use: the New York story [Internet]. New York (NY): Commonwealth Fund; 2000 Nov [cited 2017 April 15].(Issue Brief No. 434). 2000.
39. Ballard, D.W., et al., Validation of an algorithm for categorizing the severity of hospital emergency department visits. Medical care, 2010. 48(1).
40. Gandhi, S.O. and L. Sabik, Emergency department visit classification using the NYU algorithm. The American journal of managed care, 2014. 20(4): p. 315-320.
41. Wharam, J.F., et al., Emergency department use and subsequent hospitalizations among members of a high-deductible health plan. Jama, 2007. 297(10): p. 1093-1102.
42. Longitudinal Health Insurance Database 2005(LHID2005). Accessed August 20, 2018; Available from: https://nhird.nhri.org.tw/en/Data_Subsets.html.
43. National Health Research Institutes. National Health Insurance Research Database. Accessed August 20, 2018. https://nhird.nhri.org.tw/en/. Accessed August 20, 2018.]; Available from: https://nhird.nhri.org.tw/en/.
44. Yang, Y.T., et al., The relationship between accessibility of healthcare facilities and medical care utilization among the middle-aged and elderly population in Taiwan. Int J Qual Health Care, 2015. 27(3): p. 222-31.
45. Lam, C., et al., Emergency department utilization can indicate early diagnosis of digestive tract cancers: A population-based study in Taiwan. Comput Methods Programs Biomed, 2014. 115(3): p. 103-9.
46. Hsieh, C.-Y., et al., Taiwan’s National Health Insurance Research Database: past and future. Clinical epidemiology, 2019. 11: p. 349.
47. Cheng, C.L., et al., Validation of the National Health Insurance Research Database with ischemic stroke cases in Taiwan. Pharmacoepidemiology and drug safety, 2011. 20(3): p. 236-242.
48. Cheng, C.-L., et al., Validation of acute myocardial infarction cases in the national health insurance research database in Taiwan. Journal of epidemiology, 2014. 24(6): p. 500-507.
49. Su, V.Y.-F., et al., Use of ICS/LABA combinations or LAMA is associated with a lower risk of acute exacerbation in patients with coexistent COPD and asthma. The Journal of Allergy and Clinical Immunology: In Practice, 2018. 6(6): p. 1927-1935. e3.
50. Su, V.Y.-F., et al., Sleep apnea and risk of pneumonia: a nationwide population-based study. Cmaj, 2014. 186(6): p. 415-421.
51. Aday LA & Andersen R, F.G., Health Care in the U.S.: Equitable for Whom? Beverly Hills, CA, Sage Publications, 1980. 1980.
52. Hoot, N.R. and D. Aronsky, Systematic review of emergency department crowding: causes, effects, and solutions. Annals of emergency medicine, 2008. 52(2): p. 126-136. e1.
53. van Tiel, S., et al., Systematic review of frequent users of emergency departments in non-US hospitals: state of the art. Eur J Emerg Med, 2015. 22(5): p. 306-15.
54. Feldman, J., The NYU Classification System for ED Visits: WSHA Technical Concerns. accessed on November, 2017, 2010. 14: p. 2010.
55. Wolinsky, F.D., et al., Emergency department utilization patterns among older adults. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, 2008. 63(2): p. 204-209.
56. Sempere-Selva, T., et al., Inappropriate use of an accident and emergency department: magnitude, associated factors, and reasons—an approach with explicit criteria. Annals of emergency medicine, 2001. 37(6): p. 568-579.
57. Tsai, J.C., Y.W. Liang, and W.S. Pearson, Utilization of emergency department in patients with non-urgent medical problems: patient preference and emergency department convenience. J Formos Med Assoc, 2010. 109(7): p. 533-42.
58. Payne, K., et al., An after hours gp clinic in regional Australia: appropriateness of presentations and impact on local emergency department presentations. BMC Fam Pract, 2017. 18(1): p. 86.
59. Coster, J.E., et al., Why Do People Choose Emergency and Urgent Care Services? A Rapid Review Utilizing a Systematic Literature Search and Narrative Synthesis. Acad Emerg Med, 2017. 24(9): p. 1137-1149.
60. Afilalo, J., et al., Nonurgent emergency department patient characteristics and barriers to primary care. Acad Emerg Med, 2004. 11(12): p. 1302-10.
61. Chan, C.-L., et al., The association between the availability of ambulatory care and non-emergency treatment in emergency medicine departments: a comprehensive and nationwide validation. Health Policy, 2013. 110(2-3): p. 271-279.
62. Gill, J.M. and A.W. Riley, Nonurgent use of hospital emergency departments: urgency from the patient's perspective. Journal of Family Practice, 1996. 42(5): p. 491-497.
63. Chou, S.-C., et al., Analysis of a Commercial Insurance Policy to Deny Coverage for Emergency Department Visits With Nonemergent Diagnoses. JAMA Network Open, 2018. 1(6): p. e183731-e183731.
64. Luque Ramos, A., F. Hoffmann, and O. Spreckelsen, Waiting times in primary care depending on insurance scheme in Germany. BMC Health Serv Res, 2018. 18(1): p. 191.
65. Raven, M.C., et al., The Effectiveness of Emergency Department Visit Reduction Programs: A Systematic Review. Ann Emerg Med, 2016. 68(4): p. 467-483 e15.
66. Smulowitz, P.B., A.B. Friedman, and J.M. Pines, Appropriations for "appropriate" visits: Payment denials for emergency department care. American Journal of Emergency Medicine, 2018.
67. Dale, J., et al., Safety of telephone consultation for “non-serious” emergency ambulance service patients. Quality and Safety in Health Care, 2004. 13(5): p. 363-373.
68. Todd, T.N., Using Data to Inform Appropriateness in Saskatchewan's Health Care System: A Snapshot of Low Acuity Emergency Department Use. 2017, Faculty of Graduate Studies and Research, University of Regina.
69. Hopkins, A., R. Fitzpatrick, and A. Foster, What do we mean by appropriate health care. Quality in Health Care, 1993. 2(1): p. 17-1.
70. David, M., et al., Emergency outpatient services in the city of Berlin: Factors for appropriate use and predictors for hospital admission. European Journal of Emergency Medicine, 2006. 13(6): p. 352-357.
71. Moss, C., et al., Patient experience in the emergency department: inconsistencies in the ethic and duty of care. J Clin Nurs, 2015. 24(1-2): p. 275-88.
72. Jeffery, M.M., et al., Validation of an algorithm to determine the primary care treatability of emergency department visits. BMJ open, 2016. 6(8): p. e011739.
73. Liberati, A., et al., A European project assessing the appropriateness of hospital utilization: background, objectives and preliminary results. International Journal for Quality in Health Care, 1995. 7(3): p. 187-199.
74. Lowe, R.A. and S.B. Abbuhl, Appropriate standards for “appropriateness” research. Annals of Emergency Medicine, 2001. 37(6): p. 629-632.
75. Tsai, J.C., W.Y. Chen, and Y.W. Liang, Nonemergent emergency department visits under the National Health Insurance in Taiwan. Health Policy, 2011. 100(2-3): p. 189-95.
76. Combes, J. and E. Arespacochaga, Appropriate use of medical resources. 2013, American Hospital Association, Physician Leadership Forum: Chicago, IL.
77. Charles E. Begley, D.R.L., Robert O. Morgan, Paul J. Rowan, Rajesh Balkrishnan Evaluating the Healthcare System: Effectiveness, Efficiency, and Equity, Fourth Edition. 2013: Health Administration, Press, Chicago, Illinois.

Tables

Table 1 The baseline characteristic among the emergency department visit patients by policy intervention

Note: The policy of regionalization started on 13 July 2007. Moreover, the policy of categorization began on 13 July 2009. However, using the 31 July 2007 and 31 July 2009 as the cut of point.

Table 2 Appropriate rate by baseline characteristic on different policy intervention

Using the chi-squared test to check the percentage of an emergent visit from all emergency department visit by subgroup; ED: emergency department