Validation of Adult Asthma Case Definitions for Primary Care Sentinel Surveillance

doi:10.21203/rs.3.rs-3120994/v1

Download PDF

Research Article

Validation of Adult Asthma Case Definitions for Primary Care Sentinel Surveillance

https://doi.org/10.21203/rs.3.rs-3120994/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 13 Nov, 2023

Read the published version in Allergy, Asthma & Clinical Immunology →

You are reading this latest preprint version

Background

Most asthma diagnoses and patient care take place in primary care settings. Electronic medical records (EMRs) offer an opportunity to utilize technology to improve asthma diagnosis and care. The purpose of this study was to create and validate separate case definitions for suspected and confirmed asthma in primary care EMRs, to enable surveillance, benchmarking, and quality improvement in primary care settings.

Objective

To develop a case definition for suspected and confirmed asthma for use in a primary care sentinel surveillance system.

Methods

A single chart abstractor conducted a manual audit of 776 randomly selected patient charts from an academic primary care practice EMR in Kingston, Ontario. Following the single chart abstractor classification, a consensus on chart classification as “not asthma”, “suspected asthma”, or “confirmed asthma” was achieved between the abstractor, a family physician, and a respirologist using Canadian Thoracic Society (CTS) criteria. Case definition algorithms based on billing codes, clinical data elements and medications were applied to the site’s Canadian Primary Care Sentinel Surveillance Network (CPCSSN) data for the same charts and compared to abstractor classifications to determine each algorithm’s measurement properties.

Results

The prevalence of suspected and confirmed asthma were 7.3% (n = 54) and 2.4% (n = 18), respectively. None of the proposed case definitions could differentiate between suspected and confirmed asthma. One algorithm consisting of billing, clinical, and medication elements had the highest Youden’s Index for either suspected or confirmed asthma. The algorithm had a sensitivity of 81%, a specificity of 96%, positive predictive value of 71%, negative predictive value of 98%, and a Youden’s Index of 0.77 for combined suspected or confirmed asthma cases.

Conclusion

An EMR case definition for suspected or confirmed adult asthma has been validated for use in CPCSSN. Implementation of this case definition will enable the development of a surveillance electronic tool (eTool) for adult asthma that can foster quality improvement.

Asthma

electronic medical records

quality improvement

knowledge translation

Asthma is diagnosed based on a combination of patient history, physical examination, and objective tests. The Canadian Thoracic Society (CTS) defines asthma as the combination of a compatible clinical history of asthma and reversible airflow obstruction or airway hyperresponsiveness on lung function tests, or alternatively, a specialist diagnosis of asthma.^1,2 Accordingly, although confirmed asthma requires objective testing, a “suspected asthma” case is defined as a compatible clinical history without objective measures of lung function consistent or specialist diagnosis.^1,2 Most asthma diagnoses and care occur in primary care settings.³ Despite available guidelines, less than half of patients diagnosed with asthma have undergone appropriate pulmonary function testing to confirm their diagnosis.⁴ As such, the majority of real-world diagnoses in primary care are more accurately classified as cases of suspected asthma. This failure to use objective testing has led to a high degree of misdiagnosis of asthma.⁵

Electronic medical records (EMRs) offer an opportunity to utilize technology to improve the process of asthma diagnosis. Potential benefits of using electronic tools (eTools) within EMRs include improved quality of care, outcome monitoring, and performance measurement.^6,7 The Canadian Primary Care Sentinel Surveillance Network (CPCSSN) is the first and only pan-Canadian chronic disease surveillance system based on primary care EMR data.⁸ CPCSSN has validated case definitions for 13 chronic conditions, including COPD.⁹ There have also been efforts to create case definitions for adult asthma using EMR data directly by Xi et al. (2015)^10, and using EMR data extracted into the CPCSSN database by Cave et al. (2020).¹¹ The purpose of this study was to create and validate separate case definitions for suspected and confirmed asthma in adults in primary care EMRs, and to determine the ability to distinguish between suspected and confirmed asthma using primary care EMR data.

Study Design

A retrospective chart analysis was conducted at the Queen’s Family Health Team (QFHT) in Kingston, Ontario. The QFHT uses the open-source OSCAR EMR developed by McMaster University that is used across Canada, in the care of over 1 million patients.¹² CPCSSN collects de-identified patient data from source EMRs, including but not limited to demographics, visit dates, reason for encounter, medical conditions, billing history, procedure history, prescribed medications, laboratory results, and patient referrals. This study used coded and processed QFHT data in CPCSSN, stored at the Centre for Advanced Computing at Queen’s University. The random sample in this study was derived from a list of patient charts from CPCSSN data holdings generated by a computer algorithm. Patients that elected to opt-out of research from CPCSSN were removed from the list of patient charts for review.

QFHT patients were notified of the study and given the option to withdraw from the study. The study was approved by the Health Sciences and Affiliated Teaching Hospitals Research Ethics Board (HSERB) at Queen’s University. All data were recorded as non-identifiable information.

Chart Abstraction and Data Collection

The criteria for generation of the patient list were age ≥ 18 years and currently registered at QFHT. Charts were excluded if there was no recorded visit to a physician in the previous 5 years or if a chart was marked as inactive by QFHT. A single chart abstractor conducted a manual audit of the 776 randomly selected patient charts for 776 patients. The sample of 776 patient charts was determined based on a power calculation assuming 8% prevalence of asthma in adults, along with a projected case definition algorithm with 80% sensitivity, 10% precision and 95% CIs. The abstractor collected 96 data points selected a priori by consensus of the lead investigators relevant to asthma diagnosis and management, and classified each chart as “not asthma”, “suspected asthma”, or “confirmed asthma”. The categories of data collected included patient demographics, prescribed medications, asthma symptom history, comorbidities, smoking status, documentation of asthma diagnosis, asthma exacerbation history, pulmonary function tests, and referral notes. Data collected included a lookback time frame of the entire patient’s history, with the exception of medication data, which was separated into expired (>2 years) and current (≤ 2 years). The abstractor used a chart abstraction manual to ensure data entry accuracy and consistency. All data were collected using an online abstraction form created on Qualtrics™ software.

Asthma Classification Definition

The definition of “confirmed asthma” was based on the CTS guideline for asthma diagnosis.^1,2 Confirmed asthma was defined as a compatible clinical history plus pulmonary function tests (PFTs) confirming asthma, and/or a specialist diagnosis. “Suspected asthma” was defined as a compatible clinical history without PFTs consistent with asthma or a specialist diagnosis. All other patient charts were classified as “not asthma.” Following the single chart abstractor classification, each chart classified as suspected or confirmed asthma and 12 charts classified as not asthma which the abstractor thought required additional input for classification, were reviewed by a QFHT family physician and a respirologist to achieve consensus on the final classification. All chart classification reviews were completed on the original OSCAR EMR charts at QFHT.

Case Definition Development

Case definitions were developed and tested on the CPCSSN data holdings for the same charts reviewed and classified by the abstractor and expert physicians in the OSCAR EMR at QFHT. Case definitions tested in this study were developed by members of the study team. They included 3 case definitions for adult asthma previously published in the literature, in addition to new case definitions designed by the research team.^10,11 The proposed case definitions were developed based on all data fields possibly relevant for diagnosis in CPCSSN, including billing information, health condition, encounter diagnosis, and medication data. In total, 21 case definitions were developed and tested through an iterative process. Case definition criteria within the search fields used a combination of: text strings (in encounter diagnosis or health condition fields); International Classification of Disease, Ninth Revision (ICD-9) codes (used by QFHT) in billing diagnosis, encounter diagnosis, or health condition fields); and medication prescription information of the CPCSSN data. The complete list of case definitions and the specific search criteria tested are available in Table 1.

Statistical Analysis

The results of the proposed case definitions were compared to the confirmed asthma classification definition (reference standard). For each proposed case definition, sensitivity (SN), specificity (SP), positive predictive value (PPV), negative predictive value (NPV), and Youden’s Index (YI) [(sensitivity + specificity) – 1] were calculated in the i) confirmed asthma subset, ii) suspected asthma subset, and iii) combined confirmed or suspected asthma subset. Additionally, descriptive statistics were calculated for each of the 96 data points abstracted during the study. Statistical analysis was completed using Microsoft Excel™ and SAS™ software.

Sample Characteristics

A total of 743 patient charts were included in the study's final analysis. Thirty-three charts were excluded (Figure 1).

The characteristics of the sample are detailed in Table 1. The estimated prevalence of suspected or confirmed asthma based on the 743 charts that met inclusion criteria was 9.7% (n=72). Of the 72 charts determined to have suspected or confirmed asthma, 54 (7.4%) were classified as suspected and 18 (2.3%) were classified as confirmed.

In the study sample, 416 of 743 (56.0%) patients’ charts reviewed were female and 327 charts (44.0%) reviewed were male. The mean (± SD) age of patients reviewed was 50.3 (±8.7). Additional patient characteristics are outlined in Supplementary Table 2. In assessing rates of objective measures to confirm asthma diagnosis, spirometry was completed in 114 (15.3%) of charts reviewed. Completion of spirometry with bronchodilator testing was documented in 86 charts (11.6%). Documentation of a methacholine challenge test was completed in 15 charts (2.0%)., and evidence of a specialist diagnosis was present in 22 charts (3.0%).

Case Definition Results

The case definition algorithm determined to have the highest Youden’s Index for the combination of suspected or confirmed asthma was Case Definition 10, which used a combination of text strings and ICD-9 codes from the billing, encounter diagnosis, and health condition within CPCSSN (Table 2). This definition had a SN of 81%, a SP of 96%, PPV of 71%, NPV of 98%, and a Youden’s Index of 0.77. For suspected asthma, the case definition had a SN of 76%, a SP of 94%, PPV of 50%, NPV of 98%, and a Youden’s Index of 0.70. For confirmed asthma, the case definition had a SN of 94%, a SP of 91%, PPV of 21%, NPV of 99%, and a Youden’s Index of 0.85. None of the case definitions assessed in this study met the minimum standard (sensitivity and specificity >70%) to differentiate between suspected and confirmed asthma Complete results are available in Supplemental Tables 3-5.

We validated a case definition for combined suspected or confirmed asthma in primary care. This study's proposed case definitions had similar results for both suspected and confirmed asthma. Case definitions could not discriminate between suspected and confirmed asthma because the use of objective measures to confirm asthma diagnosis was either not completed or not documented. This highlights the importance of confirming and documenting the status of asthma diagnoses in EMRs. Until EMR data elements are adopted that allow for the distinction between suspected and confirmed asthma, one case definition that can be used for combined suspected or confirmed asthma is recommended.

Our proposed case definitions had similar operating characteristics to those reported previously. However, in replicating case definition algorithms from both Xi, et al. (2015)¹⁰ and Cave et al. (2020)¹¹ (Table 1), we found different results across all metrics calculated. For example for Case Definition 1, Xi et al. (2015) report a SN of 78% and SP of 89%, compared to a SN of 35% and SP of 99% in our study. For Case Definition 3, Xi, et al. (2015) reported a SN of 7% and SP of 99%, compared to a SN of 4% and SP of 100% in our study.¹⁰ Case Definitions 1 and 3 were attempts to replicate their algorithms and were considered approximated because the original case definition algorithms used information directly from the source EMR in OSCAR. For Cave et al. (2020), the metrics were similar, with a reported a SN of 83%, SP of 99%, PPV of 74%, NPV of 99%, and a Youden’s Index of 0.82, compared to a SN of 78%, SP of 97%, PPV of 75%, NPV of 98%, and YI of 0.73 in our study.¹¹

This variability can likely be attributed to the variation in the data sources used for case definition analysis and the variation in charting behaviour between clinical sites. Xi et al. (2015) created a cohort with a high proportion of patients with asthma and COPD for analysis. In contrast, we used a population-based sample, thus having a lower asthma prevalence, reducing SP and PPV while improving SN and NPV. In Cave et al.’s (2020) study, the authors used data from the Southern Alberta Primary Care Research Network of CPCSSN (SAPCReN-CPCSSN) to classify cases of asthma. In this study, reviewers used the source EMR for classification, allowing for a complete review of the patient’s entire medical history.

The results of this study highlight the importance of having discrete data elements for asthma diagnostic tests in EMRs, particularly given that there were no searchable data elements that enabled us to differentiate between suspected and confirmed asthma. As such, EMRs should incorporate data elements such as those proposed by the Pan-Canadian Respiratory Initiative for Electronic Health Records (PRESTINE) for providers to be able to document whether asthma is suspected or confirmed, and if confirmed by what method^6,13. This would enable search strategies to differentiate between suspected and confirmed asthma.¹⁴ By adopting these data elements, knowledge translation eTools could provide decision support to healthcare providers on cases of suspected asthma that require objective testing, while simultaneously improving asthma surveillance by ensuring cases of asthma are confirmed asthma¹⁵.

In our study, although we included every medication combination presented in the CTS guidelines for asthma management² (Case Definitions M1-M7), medication data did not improve the operating characteristics of detection algorithms (Table 1). The proposed case definitions that included medication data had a wide sensitivity range, from 0 to 76%. This result differs from previous literature on asthma case definitions, which discuss adding medications as an effective way to improve case definitions.¹⁶ We believe that this may be because many medications are being used for both asthma, COPD, and allergic rhinitis.

The findings of our study fit well within the existing literature on the validation of asthma diagnoses using EMRs. A recent study from Howell et al. (2022)¹⁷ developed a case definition algorithm for asthma using EMR data from a pulmonary specialty clinic. This study’s best-case definition had a SN of 94% and a SP of 85%. These results are slightly higher than the results of our study. In this case, the slightly higher SN and SP can be attributed to using a specialty clinic, which would be more likely to have confirmed cases of asthma, improving specificity, and a higher relative proportion of patients with asthma, improving sensitivity. Another systematic review of literature on the validation of asthma diagnoses in electronic health records by Nissen et al. (2017) described 13 studies on the subject.¹⁶ The authors found that most studies were able to demonstrate a high positive predictive value (PPV > 80%), with a high degree of variation based on methodology used. Our study builds upon the systematic review by using a national database that can utilize the case definition in primary care practices across Canada.

We were able to directly replicate the case definition proposed by Cave et al. (2020), given that it also used CPCSSN data holdings. For case definition 13, Cave et al. (2020) reported a SN of 83% (+ 5%), a SP of 99% (+ 2%), PPV of 74% (-1%), NPV of 99% (-1%), and a Youden’s Index of 0.82 (+ 0.09), which are nearly identical to our results. The discrepancy between the findings can be attributed to the data source used for classifying cases of asthma and the data source used for validating the case definition.

Strengths

Strengths of this study include using the original EMR source data for chart abstraction and classification. By manually reviewing the patient chart, the abstractor and physicians had the entire medical record of a patient available to accurately classify the charts based on all information available. Another strength of this study is the use of CPCSSN data holdings for testing and validating case definitions. CPCSSN data is more granular than health administrative data that has been used for case definitions of asthma in the past, yet more broadly applicable than data from a single EMR.¹⁸ An additional feature of this study is the use of a single abstractor and experts for classification purposes, which ensured consistency in both data collection and final classification of cases throughout the study.

Limitations

Limitations of this study include generalizability and the data source. This exercise was conducted at a single academic clinical site that is a member of CPCSSN. It may be difficult to generalize the findings at this academic primary care practice to community practices, as the case mix may differ, and this particular practice may have unique charting, billing, and data entry patterns. Additionally, this study used information from one EMR, OSCAR. As a result, the case definitions developed in this study may have different results when applied to other EMRs, although the criteria used in the CPCSSN database applies to sites across Canada.

An EMR case definition for confirmed or suspected adult asthma has been validated against original primary care EMR data for use in primary care, including CPCSSN. Implementation of this case definition will enable surveillance and quality improvement of adult asthma care in primary care sites across Canada. Currently, it is not possible to differentiate between suspected and confirmed asthma in primary care EMRs or CPCSSN datasets. As such, adoption of Pan-Canadian standards for EMR elements and algorithms, as proposed by PRESTINE, that identify suspected but unconfirmed asthma and prompt further investigations, is critical to improving the diagnostic accuracy of primary care surveillance and quality improvement systems.

CPCSSN Canadian Primary Care Sentinel Surveillance Network

CTS Canadian Thoracic Society

EMR Electronic medical records

eTool Electronic tools

HSERB Health Sciences and Affiliated Teaching Hospitals Research Ethics Board

ICD-9 International Classification of Disease, Ninth Revision

NPV Negative predictive value

PPV Positive predictive value

PRESTINE Pan-Canadian Respiratory Standards Initiative for Electronic Health Records

QFHT Queen’s University Family Health Team

SN Sensitivity

SP Specificity

YI Youden’s index

Ethics approval

The study was reviewed for ethical compliance by the Queen’s University Health Sciences and Affiliated Teaching Hospitals Research Ethics Board (Reference #6029444).

Consent for publication

Not applicable.

Availability of data and materials

The datasets used during the study are available from the corresponding author upon reasonable request.

Competing interests

Not applicable.

Funding

This study was funded by the Southeastern Ontario Academic Medical Organization Innovation Fund Grant.

Author contributions

MDL conceived the premise of this study. MM, DB, and RM conducted the data analysis. MM wrote the first draft of the manuscript with revisions from MDL and AM. JQ, SG, TT, and GD provided guidance, suggestions, and revisions for this manuscript.

Acknowledgements

Not applicable.

Lougheed, M. D. et al. Canadian Thoracic Society 2012 guideline update: Diagnosis and management of asthma in preschoolers, children and adults. Can Respir J 19, 127–164 (2012).
Yang, C. L. et al. Canadian Thoracic Society 2021 Guideline update: Diagnosis and management of asthma in preschoolers, children and adults. Can. J. Respir. Crit. Care, Sleep Med. 5, 348–361 (2021).
Wu, T. D., Brigham, E. P. & McCormack, M. C. Asthma in the primary care setting. Med. Clin. North Am. 103, 435–444 (2019).
Gershon, A. S., Victor, J. C., Guan, J., Aaron, S. D. & To, T. Pulmonary function testing in the diagnosis of asthma: A population study. Chest 141, 1190–1196 (2012).
Aaron, S. D., Boulet, L. P., Reddel, H. K. & Gershon, A. S. Underdiagnosis and overdiagnosis of asthma. Am. J. Respir. Crit. Care Med. 198, 1012–1020 (2018).
Taite, A., Minard, J., Morra, A. & Lougheed, M. D. Supporting asthma and COPD best practices in Ontario through primary care electronic medical records. Healthc. Q. 23, 67–74 (2020).
To, T. et al. Evidence-based performance indicators of primary care for asthma: A modified RAND Appropriateness Method. Int. J. Qual. Heal. Care 22, 476–485 (2010).
Garies, S., Birtwhistle, R., Drummond, N., Queenan, J. & Williamson, T. Data Resource Profile: National electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Int. J. Epidemiol. 46, 1091–1099 (2017).
Cave, A. et al. Chronic obstructive pulmonary disease as a risk factor in primary care: a Canadian retrospective cohort study. npj Prim. Care Respir. Med. 2021 311 31, 1–4 (2021).
Xi, N. et al. Identifying patients with asthma in primary care electronic medical record systems: Chart analysis-based electronic algorithm validation study. Can. Fam. Physician 61, 474–483 (2015).
Cave, A. J. et al. Validating a case definition for adult asthma in primary care electronic medical records. Prim. Care Respir. Med. 30, 1–4 (2020).
Safadi, H., Chan, D., Dawes, M., Roper, M. & Faraj, S. Open-source health information technology: A case study of electronic medical records. Heal. Policy Technol. 4, 14–28 (2015).
Moloney, M. et al. Integrating User Preferences for Asthma Tools and Clinical Guidelines Into Primary Care Electronic Medical Records: Mixed Methods Study. JMIR Form. Res. 7, (2023).
Lougheed, M. D. et al. Pan-Canadian asthma and COPD standards for electronic health records: A Canadian Thoracic Society Expert Working Group Report. Can. J. Respir. Crit. Care, Sleep Med. 2, 244–250 (2018).
Lougheed, M. D. et al. Pan-Canadian standards for severe asthma in electronic medical records. 5, 391–399 (2021).
Nissen, F. et al. Validation of asthma recording in electronic health records: A systematic review. Clin. Epidemiol. 9, 643–656 (2017).
Howell, D., Rogers, L., Kasarskis, A. & Twyman, K. Comparison and validation of algorithms for asthma diagnosis in an electronic medical record system. Ann. Allergy. Asthma Immunol. 128, 677–681 (2022).
Gershon, A. S., Guan, J., Wang, C. & To, T. Trends in asthma prevalence and incidence in Ontario, Canada, 1996-2005: a population study. Am. J. Epidemiol. 172, 728–736 (2010).

Table 1. Sample Characteristics (n=743)

Characteristic	n	Mean (SD)	Median (Range)
Age, years	743	50.3 (8.7)	48.7 (18-93)
	Subcategory		n (%)
Sex	Male		327 (44)
	Female		416 (56)
Smoking History	Never		345 (46)
	Past		206 (28)
	Current		192 (26)
Comorbidity	Allergic rhinitis		76 (10)
	ACOS		10 (1)
	Bronchiectasis		8 (1)
	Chronic bronchitis		17 (2)
	Congestive heart failure		25 (3)
	COPD		47 (6)
	Cor pulmonale		0 (0)
	Emphysema		11 (2)
	GERD		235 (32)
	Sleep apnea		87 (12)
Medication	Expired n (%)	Current n (%)	Total (Expired + Current) n (%)
SABA	98 (13)	96 (13)	194 (26)
SAMA	3 (0)	3 (0)	6 (1)
SAMA/SABA	0 (0)	0 (0)	0 (0)
ICS	77 (10)	45 (6)	122 (16)
LABA	3 (0)	5 (1)	8 (1)
LAMA	4 (1)	9 (1)	13 (2)
ICS/LABA	10 (1)	27 (4)	37 (5)
LAMA/LABA	0 (0)	3 (0)	3 (0)
ICS/LABA/LAMA	0 (0)	1 (0)	1 (0)
LTRA	1 (0)	0 (0)	1 (0)
Biologics	1 (0)	8 (1)	9 (1)
Systemic steroids	50 (7)	39 (5)	89 (12)
Other	50 (7)	673 (91)	723 (97)
Location		n (%)
Asthma in cumulative patient profile		73 (10)
Asthma in disease registry		38 (5)
Asthma referral notes		39 (5)
Asthma in free text		252 (34)
Asthma elsewhere in patient chart		34 (5)
Other Asthma Documentation Data		n (%)
Asthma synonyms in patient chart		88 (12)
Work-related asthma in patient chart		12 (2)
Family history of asthma in patient chart		25 (3)
Childhood diagnosis of asthma in patient chart		49 (7)
Use of Objective Measures of Lung Function		n (%)
Spirometry performed		114 (15)
Bronchodilator challenge test performed		86 (11)
Methacholine challenge test performed		15 (2)
Exercise challenge test performed		4 (1)
Method of Confirmation of Asthma Diagnosis		n (%)
Specialist diagnosis		3 (0)
Spirometry		13 (1)
Methacholine challenge test		3 (0)
Exercise challenge test		0 (0)
ACOS=Asthma-COPD Overlap Syndrome, COPD= Chronic Obstructive Pulmonary Disease, GERD=Gastroesophageal Reflux Disease ICS=Inhaled corticosteroid, LABA= Long-acting β-agonist, LAMA = Long-acting muscarinic antagonist, LTRA=Leukotriene receptor antagonist, SABA=Short-acting β-agonist, SAMA= Short-acting muscarinic antagonist

Table 2. Case Definition Criteria and Results

Case Definition	Inclusion Criteria (Any One Of)					Exclusion Criteria	SN	SP	PPV	NPV	YI
Case Definition	ICD-9 Billing	Encounter Diagnosis		Health Condition	Medications	Exclusion Criteria	SN	SP	PPV	NPV	YI
1*	1 of: 493						0.35	0.99	0.78	0.93	0.34
2		1 of: “asthma” OR 1 of: 493 (asthma)					0.75	0.97	0.74	0.97	0.72
3*				1 of: “asthma” OR 1 of: 493 (asthma)			0.04	1.00	0.60	0.91	0.04
4	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)					0.81	0.96	0.70	0.98	0.77
5	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)				Billing Any of: 491 (chronic bronchitis), 492 (emphysema), 496 (COPD)	0.81	0.96	0.71	0.98	0.77
6	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)				Encounter Diagnosis Any of: “asthmaquery” “queryasthma” “asthma?” “?asthma”	0.81	0.96	0.70	0.98	0.77
7	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)				Billing Any of: 491 (chronic bronchitis), 492 (emphysema), 496 (COPD) AND/OR Encounter Diagnosis Any of: “asthmaquery” “queryasthma” “asthma?” “?asthma”	0.81	0.96	0.71	0.98	0.77
8	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)			0.81	0.96	0.70	0.98	0.77
9	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)		Billing Any of: 491 (chronic bronchitis), 492 (emphysema), 496 (COPD)	0.81	0.96	0.71	0.98	0.77
10	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)		Encounter Diagnosis Any of: “asthmaquery” “queryasthma” “asthma?” “?asthma”	0.81	0.96	0.70	0.98	0.77
11	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)		Billing Any of: 491 (chronic bronchitis), 492 (emphysema), 496 (COPD) AND/OR Encounter Diagnosis Any of: “asthmaquery” “queryasthma” “asthma?” “?asthma”	0.81	0.96	0.71	0.98	0.77
12	2 of: 493	2 of: “asthma” OR 2 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)			0.78	0.97	0.75	0.98	0.75
13†	2 of: 493	2 of: “asthma” OR 2 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)		Encounter Diagnosis/Health Condition “asthmaquery” “queryasthma” “asthma?” “?asthma”	0.78	0.97	0.75	0.98	0.75
14	1 of: 493	1 of: “asthma” OR 1 of: 493 (asthma)		1 of: “asthma” OR 1 of: 493 (asthma)	Any medication from asthma medication list	Medications LAMA (monotherapy) LABA (monotherapy) LAMA/LABA (monotherapy)	0.85	0.93	0.57	0.98	0.78
Medication Case Definition	Inclusion Criteria (Any One Of)					Exclusion Criteria	SN	SP	PPV	NPV	YI
Medication Case Definition	#1		#2			Exclusion Criteria	SN	SP	PPV	NPV	YI
M-1	SABA		Budesonide/formoterol			Any other respiratory medication on medication list	0.35	0.96	0.47	0.93	0.31
M-2	SABA + ICS		SABA + LTRA			Any other respiratory medication on medication list	0.10	0.98	0.39	0.91	0.08
M-3	ICS					Any other respiratory medication on medication list	0.08	0.98	0.32	0.91	0.06
M-4	SABA + ICS/LABA					Any other respiratory medication on medication list	0.18	0.99	0.93	0.92	0.17
M-5	SABA + (ICS/LABA/LAMA OR ICS/LABA + LAMA OR ICS/LABA + LTRA OR ICS/LABA/LAMA + LTRA)		ICS/LABA/LAMA OR ICS/LABA + LAMA OR ICS/LABA + LTRA OR ICS/LABA/LAMA + LTRA			Any other respiratory medication on medication list	0.08	0.99	0.67	0.91	0.07
M-6	Biologics					Any other respiratory medication on medication list	0	0	0	0	-
M-7	Any medication from asthma medications list					LAMA (monotherapy) LABA (monotherapy) LAMA/LABA (monotherapy)	0.76	0.9	0.45	0.97	0.66
*Adapted from Xi et al. (2015) †Adapted from Cave et al. (2020) LABA= Long-acting β-agonist, LAMA = Long-acting muscarinic antagonist TP=True Positive, FP=False Positive, FN=False Negative, TN=True Negative, SN=Sensitivity, SP=Specificity, PPV=Positive Predictive Value, NPV=Negative Predictive Value, YI=Youden’s Index ICS=Inhaled corticosteroid, LABA= Long-acting β-agonist, LAMA = Long-acting muscarinic antagonist, LTRA=Leukotriene receptor antagonist, SABA=Short-acting β-agonist, SAMA= Short-acting muscarinic antagonist TP=True Positive, FP=False Positive, FN=False Negative, TN=True Negative, SN=Sensitivity, SP=Specificity, PPV=Positive Predictive Value, NPV=Negative Predictive Value, YI=Youden’s Index

AACISupplementalMaterial.docx

Download PDF

Journal Publication

published 13 Nov, 2023

Read the published version in Allergy, Asthma & Clinical Immunology →

Editorial decision: Minor revision
25 Sep, 2023
Reviewers agreed at journal
02 Aug, 2023
Reviewers invited by journal
10 Jul, 2023
Editor assigned by journal
04 Jul, 2023
Submission checks completed at journal
03 Jul, 2023
Editor invited by journal
03 Jul, 2023
First submitted to journal
28 Jun, 2023

You are reading this latest preprint version

Validation of Adult Asthma Case Definitions for Primary Care Sentinel Surveillance

Status:

Journal Publication

Version 1

Abstract

Background

Objective

Methods

Results

Conclusion

Figures

Background

Methods

Study Design

Chart Abstraction and Data Collection

Asthma Classification Definition

Case Definition Development

Statistical Analysis

Results

Sample Characteristics

Case Definition Results

Discussion

Strengths

Limitations

Conclusion

Abbreviations

Declarations

References

Tables

Supplementary Files

Status:

Journal Publication

Version 1