Study team
The Diabetes Research, Education, and Action for Minorities (DREAM) Initiative is led by researchers from New York University (NYU) School of Medicine and is funded by the National Institute of Diabetes and Digestive and Kidney Diseases (National Institutes of Health). Researchers from NYU partnered with Healthfirst (HF), a not-for-profit managed care organization serving more than 35,000 South Asians in NYC. PCPs enrolled into this study are part of HF’s provider network (30) and serve large South Asians communities. The team also partners with the NYC Department of Health and Mental Hygiene Primary Care Information Project (PCIP) (31), a city-wide initiative seeking to improve population health through health information technology and data exchange. Specifically, PCIP supports the adoption and use of EHR among PCPs, working with over 1,500 providers across the city. For this study, PCIP will provide participating PCPs with trainings and on-going technical assistance on the EHR component of the intervention. PCIP will also liaise directly with EHR vendors in the development, deployment, and testing of the pre-diabetes registries. In addition, the team engaged All Medical Care Independent Physician’s Association (AMC IPA), who works with over 100 South Asian physicians in NYC. The AMC IPA will assist with the study’s PCP recruitment, distribution of educational material, and dissemination of study results throughout their physician network. Lastly, the study convened a community advisory board (CAB) comprised of South Asian community-based organizations who provide culturally-tailored expertise in the development and implementation of the CHW intervention, including reviewing and adapting CHW curriculum and participant materials (17, 32).
Ethics and data sharing protocols
Final study protocol and procedures were reviewed and approved by the NYU School of Medicine Institutional Review Board on December 10, 2018. PCPs signed a Memorandum of Understanding (MOU) between the PCP and NYU outlining each party’s responsibilities: 1) Components of the EHR intervention; 2) EHR training requirements; 3) EHR patient data extraction and confidentiality and storage procedures associated with the study; and 4) CHW intervention components. Written informed consent will be obtained from treatment group participants in the CHW arm. A Waiver of Authorization of consent was obtained for EHR extraction of de-identified clinical measures for control participants. This component of the intervention was registered via clinicalTrials.gov by NCT03188094 as of June 15, 2017.
Study design
The study is a two-arm RCT that analyzes the implementation and effectiveness of a multi-component intervention on weight loss promotion tailored for South Asians. The intervention consisted of two components (EHR and CHW) within 20 HF network PCPs in NYC that serve a large proportion of South Asian patients. The 20 sites are roughly divided into three groups, in order for the intervention to be implemented in three successive waves (i.e., staggered) throughout the three years without overlap. Within each PCP site, individuals will be randomized to the CHW intervention or to usual care (control) group. The first year of the study was dedicated to recruitment of PCP sites, planning, and determination of specific components of the EHR and CHW interventions. During Years 2 through 4, two intervention components will simultaneously be implemented within 20 PCP practice sites. For each PCP site, the EHR-CHW intervention is implemented in two rounds of 6-month phases, totaling one year of intervention. In Year 5, the implementation process will be assessed and findings will be used to develop a set of best practices and toolkits for public health and healthcare agencies regarding integrated EHR-CHW strategies to promote weight loss.
Figure 1 illustrates the staggered RCT design. There are three waves across a period of three years, and each PCP practice site has two rounds. Data related to the primary study outcomes are extracted from EHR systems on a bi-annual basis over a period of 18 months (baseline, 6-, 12-, and 18-month time points). The control group will receive usual care from their PCPs throughout study Years 2 to 4. In study Year 5, when all group sessions with treatment participants have ended, the control group participants will be offered the same group sessions as a point of service and not as a part of research.
First component: EHR intervention
Beginning in Study Year 2, the EHR intervention occurs simultaneously with the CHW intervention. Components of the EHR intervention were developed with input from project partners and participating PCP sites. These components are focused on: 1) generating routine patient registry reports that identify patients at risk for DM within each practice; and 2) developing and implementing medical alerts and order sets that are tailored to the South Asian patient population, including alerts to screening for BMI at ≥23 kg/m2. After consideration to the baseline workflow, staff capacity, and logical feasibility conducted through a mixed methods baseline assessment by PCIP, EHR intervention features are implemented at participating sites. Recommendations are then made by PCIP to create a revised practice workflow that ensures the proposed EHR intervention component is practical, realistic, and tailored toward each individual practice.
Patient Registry – Within the EHR, there is a feature that allows providers to query and group patient information based on specific criteria, such as diagnoses of particular health conditions and demographic characteristics (33). These features of the registry allow practices to plan and prioritize patient visits, identify potential care required, and measure overall practice performance. PCIP provides the clinical team with training on the following competencies: 1) understanding the functionality and potential impact of the registry; 2) generating registry reports for follow-up care; 3) identifying patients that have been lost to follow-up; incorporating registries into day-to-day office activities; and 4) monitoring the use, satisfaction, and impact of patient registry use over time. The focus of the project is on encouragement of the routine generation of registry reports in order to more systematically identify patients at-risk for diabetes using HbA1c values between 5.7% and 6.4% at the last clinic visit; this will help providers to prioritize a follow-up visit from these patients.
Alerts – Alerts are built within the EHR in order to remind staff and providers to complete a particular action at the point of care (34). Alerts can be patient-specific or may apply to any patient-satisfying specified criteria. PCIP provides the clinical team with training on how to understand the functionality and the potential impact of alerts, as well as how to utilize alerts for the prevention and management of DM. For our study, alerts are tailored to trigger for patients with an elevated BMI (≥23 kg/m2), in line with recommendations by the ADA for a lowered BMI cutoff point for DM in Asian American adults (35). These alerts prompt PCPs to order an HbA1c test to further investigate DM risk.
Order sets – Order sets are linked to an alert and are standardized sets of evidence-based treatment guidelines (34). In this project, we will create an order set that includes a combination of lab tests and counseling orders that are “pre-set” for patients at-risk for DM. Within the counseling orders, evidence-based, culturally-tailored, in-language educational materials are uploaded for distribution to patients in various South Asian languages (e.g. Hindi, Punjabi, Bengali, and Urdu).
In order to complement these components, participating PCP staff are trained on how to create customizable templates that will increase the efficiency and accuracy of the documentation of vital signs and other pertinent health data, as well as how to utilize automated appointment reminder texts and letters that can be sent to patients electronically (34). PCIP will be providing an initial training to providers and/or staff members that primarily focus on using the registry reports and documentation of screening for BMI at ≥23 kg/m2. PCIP will also review and emphasize the importance of collecting accurate weight measurements at every clinic visit, which will improve the quality of BMI data from the EHR (i.e., primary outcome). PCIP will conduct follow-up technical assistance visits at each site every two months for up to a period of one year after training in order to review initial training material and assist with troubleshooting the registry reports. Simultaneously, practices are encouraged to collaborate with PCIP in order to participate in EHR-based incentive programs, such as Meaningful Use (MU) and National Committee for Quality Assurance (NCQA) Patient-Centered Medical Home (PCMH) recognition (36, 37).
Practice Recruitment Enrollment
Working in concert with PCIP, CAB members, the AMC IPA, and building upon past successful collaborations (38), we have identified independent PCPs in Queens and Brooklyn that are part of the HF network and serve a significant number of South Asian patients (defined as practices with greater than 70% of patients identifying as South Asian). Practices were required to have an operating EHR, specifically eClinicalWorks (eCW) or MDLand, for at least 12 months prior to the time of enrollment (39, 40). These sites were contacted by PCIP or the NYU study team staff by telephone in order to assess their eligibility in terms of their racial/ethnic makeup of patients and interest in the study. If interest was expressed by the representative over the phone, a site visit was scheduled with the study team. During the site visit, an MOU to participate in the intervention was signed by eligible and interested practices. The EHR component of the intervention is launched over a 7-day period following signing of the MOU.
Second component: CHW intervention
Following the launch of the EHR component of the intervention and prior to the launch of the CHW component at each site, NYU and PCIP staff will work in concert with PCP staff to identify the list of patients at-risk for DM and eligible for the CHW intervention through the EHR registry report. Eligibility criteria includes: 1) BMI ≥23 kg/m2; 2) HbA1c levels between 5.7% and 6.4% in the last 12 months; 3) an office visit with their provider in the last 12 months; 4) between the ages of 21 and 74; and 5) not pregnant at the time of screening.
Using the EHR registry, a list of eligible patients is generated at each participating PCP site. The data manager then finalizes this list for randomization, by removing any past study participants, checking for family members using address and telephone numbers, and for some sites, removing individuals that are in a zip code for a different clinic site. Potential family members are randomized, and one individual is kept on the list. The data manager then performs a matched pair randomization within PCP cluster using the R software package ‘matching,’ whereby a single individual is drawn from the list, and a control match is found from the remaining individuals based on age (SD=0.5), gender (exact), and BMI (SD=0.5). If a control match is not found, this individual is placed on the unmatched list. This matching process is repeated until everyone on the list has either been matched or placed on the unmatched list Individuals placed into the treatment group receive a letter from their physician inviting them to participate in the CHW intervention; CHWs follow-up the letter with a telephone call. CHWs have been trained in core competencies, including cardiovascular disease, mental health, motivational interviewing, smoking cession, and other related topics (41).
Study data were collected and managed using REDCap (42, 43) electronic data capture tools hosted at NYU Langone Health. All treatment group individuals were contacted by the CHWs and encouraged to participate in the intervention. Participants complete an in-person or phone-based screening assessing baseline demographics and logistical information, such as preferred language and session availability, as well as confirming study eligibility, including pregnancy status. Treatment participants must sign a consent form in order to participate, which will be administered by the CHW before the first session.
The CHWs deliver a standardized curriculum on DM prevention that has been adapted from the DPP (44, 45). The protocol consists of five monthly 60-minute group health education sessions that provide the tools and strategies necessary to promote weight loss and prevent DM (17). Sessions also includes risk factors that are culturally relevant for South Asian populations (Table 1). All materials are culturally- and linguistically-adapted, and sessions employ adult learning techniques and group-based learning and activities.
Sessions are held in PCP offices and other community spaces, and multiple timeslots of each session are held to accommodate varying schedules. Between sessions, CHWs follow up with participants by phone or in-person through a home or clinic visit; these visits are conducted bi-weekly, and CHWs engage in goal-setting activities related to weight loss or other health issues identified jointly by the patient and the CHW (e.g., physical activity or healthy eating).
Over the total intervention period (4 years), a total of 480 treatment group participants will be enrolled. Matched control group participants will never be contacted by the research team or participate in research activities. De-identified clinical measures will be collected for both treatment and control participants from EHR data for final analysis.
Study Recruitment
Data collection, measures, study outcomes, and analysis
Implementation and sustainability outcomes
The study will employ a mixed methods approach in order to assess challenges, barriers, and facilitators associated with the implementation and adoption process of the integrated EHR-CHW intervention, as well as to determine sustainability and scalability of the model to other payer organizations and health systems serving large immigrant populations. In order to capture data on utilization patterns of the alert and registry tools and integrated EHR-CHW initiatives, system files will be extracted on a quarterly basis that indicate date and time stamps and user logins for each time the tools were used. The frequency of these measures will be described and compared 12 months pre- and post-intervention. In order to assess physician attitudes around national pre-diabetes guidelines and satisfaction with the integrated intervention, baseline and 12-month follow-up surveys will be administered to all participating PCPs after completion of two rounds of the 6-month interventions at each site. These data will be tabulated and summarized descriptively in order to assess changes in attitudes from baseline to 12 months.
In order to explore barriers and facilitators to implementation and intervention adoption, qualitative in-depth interviews will be conducts with PCPs, healthcare payer representatives, and CHWs at baseline and 12-month follow-up. To assess fidelity of the CHW educations sessions, fidelity checklists will be conducted during sessions, and CHWs will keep encounter logs of all interactions with study participants. Interview transcripts and encounter logs will be analyzed for common themes by two independent researchers using both deductive and inductive approaches. First, initial codes will be identified based on the study aims and relevant prior implementation research. The researchers will independently read the transcripts, identifying additional codes based on new themes or subthemes emerging from the data. Second, the researchers will meet with each other and the study research team to compare and discuss codes, resolve discrepancies, and iteratively develop a codebook with code names and meanings. Third, researchers will apply the codebook to the transcripts. Researchers will identify patterns, common themes, and connections among themes throughout the transcripts. Baseline interviews will be used to refine the intervention toolkit and to explore anticipated barriers and facilitators to implementing an integrated EHR-CHW intervention. Post-intervention interview and encounter log data will help to determine key barriers, facilitators, and lessons learned from staff and CHWs regarding the implementation of the intervention in PCP settings for DM prevention in an underserved population.
Lastly, the study will use Medicaid claims data to determine intervention and implementation costs. These costs include: 1) administering the program itself (e.g., phone calls, staff time associated with recruitment and CHW intervention); 2) patient/family time estimated from visits and claims data, and; 3) healthcare utilization by program participants based on utilization data (e.g., hospitalizations, DM-related laboratory tests). Using average resource utilization and costs per patient (in the first 6 and 12 months of follow-up), we will compare resources incurred by the trial arms during the follow-up period at each time point. Our outcome will be the incremental cost per person achieving 5% weight loss. Cost data will be used to inform HF leadership of program costs for consideration of sustainability of CHW models by payer organizations.
Intervention outcomes and analysis
The primary outcome of interest is whether a patient reduces weight by 5% or more over six months of the CHW intervention. We will be comparing patients randomized to a CHW group with control group patients who receive usual care. Since the control group has been created based on pair-wise matching with intervention group participants by age, sex, and BMI, all analyses will adjust for these three covariates. Due to the binary outcome (the patient achieves at least 5% weight-loss or not), we will use logistic regression. To account for nesting in the data structure (patients nested within PCP), we will use a mixed effect generalized linear model with PCP-level random effects. This will address the possibility that the PCPs will have different levels of success in helping their patients (both the control group and intervention group) achieve the 5% threshold. Likewise, CHW’s will likely have varying effects on patient weight loss. However, since there will be seven CHW’s delivering the intervention, we will treat the CHW as a fixed effect in the outcome model. The analysis will be conducted on an intent-to-treat basis; a patient randomized and enrolled to the CHW group will be analyzed as part of that group regardless of whether or not they participate in the program. The analysis will provide point estimates and 95% confidence intervals for the relative odds of achieving weight loss; the confidence interval estimates will reflect both the paired-matching as well as the clustering in the study design.
The secondary outcomes of interest include changes in HbA1c, blood pressure, and BMI at 6 months, and sustained ≥ 5% weight loss at 12 months. For analyses of these secondary outcomes, similar mixed effects regression models (adjusting for matching variables) will be used to estimate the CHW effect. We will use the appropriate mixed effect model depending on whether or not the outcomes are continuous or binary. All analyses will be conducted using R (R Foundation for Statistical Computing, Vienna, Austria).
Power calculation
We conservatively estimate an 8% difference in effect size (i.e., ≥5% weight loss) when comparing intervention and control group participants. Accrual of 960 participants, evenly randomized to intervention or control groups, will provide greater than 80% power to detect this difference, using a 2-sided, 0.05-level test (i.e., 48 participants - 24 intervention and 24 control participants per PCP). These calculations assume a 15% loss to follow-up and the enrollment of 20 PCP sites.