Design and Setting
We will work with our health system and patient partners to pilot the co-designed linguistically and culturally-tailored tele-retinopathy screening intervention for Mandarin-speaking and French-speaking immigrants from China and African-Caribbean countries living with diabetes at a Community Health Centre in Ottawa, Canada. The community health centre houses general primary care practitioners and other health care providers, who provide services including diabetes education program and diabetes chiropody care for individuals living with diabetes. Services are provided in different languages and language interpretation services are available when required. We will use a triangulation mixed methods approach [35] to assess the feasibility, acceptability, and fidelity of the intervention. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) checklist [36] and the CONSORT (Consolidated Standards of Reporting Trials) extension for pilot and feasibility trials [37] was used as a guide for reporting this protocol. The SPIRIT checklist has been included as a supplementary file (Additional file 1).
Participants and Recruitment
Inclusion criteria
For this feasibility pilot, we will include adults with type 1 or type 2 diabetes who are Mandarin-speaking Chinese individuals or French-speaking African-Caribbean individuals with a screening referral from a physician or nurse practitioner and who self-report not having had a dilated eye examination in the last 12 months. We will exclude individuals who do not provide consent to participate in the research and refuse a dilated fundus examination.
Recruitment
Patient recruitment: Patients who attend the screening and meet our inclusion criteria will be invited by the screener to take part in the evaluation. Using a participant information sheet, patients will be informed about the evaluation, and we will obtain informed consent. We anticipate recruiting a total of 50-150 patient participants during the six months pilot assessment including individuals from both population groups. Since this is a feasibility pilot study, there is no power analysis for sample size determination. Part of our objectives is to quantify the attendance to the program itself, and our estimated sample size for patient recruitment aligns with sample sizes observed in other feasibility pilot studies (between 10-300 individuals) [38] and aligns with published recommendations regarding sample size for feasibility studies [39]. The anticipated sample size is also a function of the duration of the evaluation period (6 months) and available appointments for screening, assuming 1-2 patients attending screening each day.
Health care provider recruitment: We will invite each type of health care providers/administrators involved in the retinopathy screening program (screening site administrators, screening site managers, eye screening technicians, ophthalmologists interpreting images, and referrers involved in the delivery of the intervention) to participant in the evaluation. We aim to recruit at least 1 of each type of provider and thus anticipate recruiting about 5-10 health care providers/administrators. We will leverage our health system partners at the community centre to reach out to prospective participants via email.
Retinopathy screening intervention components and processes
The intervention includes components in the care pathway to address the prioritized barriers i.e., language, knowledge of retinopathy, physician barriers regarding communication and support for screening, publicity about the screening, and fitting screening around other activities) to attending retinopathy screening identified in our intervention co-development phase.
Tele-retinopathy screening attendance and procedures
Promotion to population groups: We will identify community health centres and family physicians in Ottawa, that provide services to immigrants from China and African-Caribbean countries and inform them of the screening intervention. Based on our co-development work with health system and patient partners in the intervention development phase [29], potential patients will also be informed of the tele-retinopathy screening via promotion at walk-in clinics, community centres, places of worship, retail locations, and social settings often used by the two population groups. To address barriers around language, knowledge, and promotion about the screening attendance itself, we will use flyers, information sheets, posters, and videos (available in English, Mandarin, and French), which contains information about diabetic retinopathy, its importance, and instructions on how to access the screening intervention. Community champions (patient partners involved in co-developing the intervention and interested in facilitating the intervention promotion within the community groups) will use these materials to support individuals living with diabetes to attend the retinopathy screening intervention.
Referral and Intake: Eligible patients will attend screening via referral from a physician, nursing practitioner, allied health workers (e.g., diabetes educators), or by self-referral. To address physician/health system barriers regarding communication and support for screening, when a patient self-refers for screening, a screening staff will facilitate obtaining physician referral, either from the patient’s primary care provider or from a physician/nursing practitioner affiliated with the screening intervention using a standard template. The template will include a brief introduction to the intervention, sign-off on the screening, as well as a sign-off to allow for the screening staff to book a specialist appointment, if necessary, post screening. Obtaining a referral from patients’ primary care provider is preferred to ensure continuity of care.
Scheduling: The screening staff will schedule patient visits based on patient availability and the schedule and location of the camera. It is anticipated that the tele-retina screening equipment may be moved between different sites to optimize patient access to services for the population groups. Also, the tele-retinopathy screening will be integrated in other diabetes programming such as foot care. This will enable fitting screening around other activities, which is a barrier our intervention aims to tackle.
Screening: An initial phone call will be made to the patient to obtain consent, collect demographic information, and schedule the appointment, followed by in-person screening. When patients arrive for screening, the screener trained in operating the imaging equipment will deliver elements of the intervention (e.g., reassurance of no harm caused to eyes due to screening) using the patient’s preferred language. In the event the screener does not speak the patient’s preferred language (i.e., French or Mandarin), translation support will be provided. The screener will take images of the retina using a portable retina camera (Topcon Maestro2 with colour photos and OCT capabilities). Patients will be provided with linguistically and culturally-tailored resources for evidence-based information about retinopathy (e.g., need for annual screening, risk factors, and information on what happens after screening). This will attend to language and knowledge of retinopathy barriers, as well as physician barriers regarding communication and support for screening.
Grading and access to images: Images will be uploaded to the Ontario Telemedicine Network (OTN)’s secure server, iVision tele-ophthalmology platform [40]. iVision is a robust tele-ophthalmology platform that complies with relevant privacy legislation and integrates ocular imaging, clinical workflows, and reporting into a single-source, cloud-based tele-retinal screening solution, which provides all the features necessary to manage the screening process. The images will then be securely forwarded or “uploaded” to an ophthalmologist/ retina specialist for assessment, diagnosis, and/or treatment recommendations where needed. The retina specialists will grade the images, and a report generated in the OTN system will be accessible to screening staff and forwarded to the referring health care provider. The report will include clear communication of the next steps and recommendations.
Patient follow-up after screening: The screening staff will notify the patient that the results of the screening have been shared with their primary care provider. Where a specialist appointment is needed, either the primary care provider or screening staff (depending on permissions provided on the referral form) will contact the patient to facilitate the next steps. Where further treatment is not required, the screening staff will schedule the next yearly tele-retinopathy screening. Thus, addressing physician barriers regarding communication and support for screening and enabling patient feedback. An outline of the tele-retinopathy screening process is presented in Figure 1.
Screening staff training
All staff involved in screening patients will obtain training provided with the purchase of the imaging equipment regarding operation of the retina screening camera. Additionally, OTN will provide training about the use of the iVision platform and sending and accessing images securely. Furthermore, to ensure that screening personnel are adequately trained on the screening processes and the use of the equipment, they will receive training from our clinical research partners in Ottawa. The research team will train the screening staff in delivering other behaviour change technique components of the intervention such as targeting knowledge barriers.
Pre-feasibility pilot
The screening intervention will first be tested in a pre-feasibility pilot study, whereby our health system and patient partners will test the intervention as designed. This will occur by running through the tele-retinopathy screening process with the intention to troubleshoot any challenges that arise and refine the screening intervention for the feasibility pilot.
Feasibility Pilot
Data collection
Consistent with recommendations for feasibility pilot studies [39,41,42], we will focus data collection on the process, management, resources, and intervention. We will conduct a theory-based process evaluation alongside the delivery of the intervention to assess the feasibility and acceptability of attending the tele-retinopathy screening intervention.
Assessment of intervention acceptability by patients
All eligible patients attending the screening will be invited to complete a post-intervention survey based on the Theoretical Framework of Acceptability (TFA) [30,31] (Additional file 2) about their experience. The survey will assess the acceptability of the intervention by including items related to each domain of the TFA: affective attitude (emotions related to intervention), burden (effort involved), ethicality (consistent with values), intervention coherence (clarity on how the intervention functions), opportunity costs (what they had to provide to take part), perceived effectiveness (whether the intervention is likely to work), and self-efficacy (confidence that they will get screened again). The response format of the survey will include both Likert scales and open-ended statements. The survey will also explore patient-related cost as a result of attending the intervention such as travel and parking costs. Surveys will be available in English, Chinese, and French. Patient participants will complete the survey after screening via Microsoft forms using an iPad device that will be available at the screening. A community health center volunteer will be present to assist patients in completing the survey, if needed. It will take about 15 minutes to complete the survey. Responses in Chinese or French will be translated to English prior to analysis. A mean score above the middle of the scale for each TFA measure, for each group will inform interpretation of the acceptability of the intervention from the perspective of patients.
Assessment of feasibility, acceptability, and fidelity of delivery by health care providers
We will assess the acceptability of the intervention, barriers and enablers experienced, and fidelity of delivery with health care providers involved in delivering the intervention. To evaluate feasibility, we will use conduct interviews using a semi-structured interview topic guide (Additional file 3) informed by the Theoretical Domains Framework (TDF). Interviews will be used to assess barriers and enablers to delivering the intervention for the given role and AACTT [32](Actor, Action, Context, Time, Target)-specified behaviour of each health care provider involved in the implementation of the intervention (e.g., barriers to referring patients from a primary care physician perspective and barriers to delivering intervention from a screener perspective). We will assess feasibility based on the extent to which the barriers experienced were or could be addressed.
The interview guide will also include a brief survey that assessing the acceptability of the intervention informed by the TFA [30] and another survey assessing the fidelity of the intervention delivery informed by the National Institutes of Health (NIH) framework on assessing intervention fidelity [34] (Additional file 3). The response format of the surveys will include both Likert scales and open-ended statements. For acceptability, a median score of mid-point of the scale or above for each TFA measure, will inform our interpretation of whether we think the intervention is acceptable from the perspective of staff involved. We will assess whether the intervention was delivered with fidelity based on a median score of mid-point of the scale or above for each indicator of fidelity reported on: provider training sufficiency, adherence to intervention protocol, and adaptations made. We will combine these self-reports with tracked attendance to training (number of attendees at each training event).
One-on-one interviews will be conducted virtually via Zoom at months one and six of the intervention pilot. Interviews will take approximately one hour and will be audio recorded, transcribed with direct identifiers removed, and then analyzed.
Intervention related data
In addition, during the feasibility pilot study, we will track referrals, including how many patients were referred to the intervention and time between the request for physician referral and referral receipt. We will also track the duration of screening, number of patients attending, dropout rates, time between screening and ophthalmologist interpretation assessment/diagnosis, diagnosis, and follow up treatment recommended. Furthermore, an intake questionnaire administered to patients will collect information on age, insurance coverage, diabetes type, insulin use, age at diagnosis of diabetes, reported HbA1c, existing co-morbidities, last dilated eye examination, other ocular diseases, country of origin, preferred languages, and years since arriving in Canada. These data will allow us to estimate how many Mandarin-speaking and French-speaking individuals living with diabetes from China and African-Caribbean countries in Ottawa attend the tele-retinopathy screening intervention.
Data Analysis
For quantitative data, we will report means and standard deviations for parametric data, medians and inter-quartile ranges for non-parametric data. Demographic characteristics (such as age, gender) will be summarized using frequency tables (n (%)) for categorical variables. The patient survey responses will be descriptively analyzed using IBM SPSS Statistics 25.0, we will run descriptive statistics to report means and standard deviations of responses to each TFA construct, and descriptively report categorical data (e.g., demographic characteristics) in terms of frequencies and percentages, for each group. Any open-ended responses will be analysed qualitatively using directed content analysis based on TFA constructs [30,31]. Descriptive analysis at months 1, 3, and 6 will inform feasible iterations of the intervention based on these data. If mean scores on any TFA construct for either population group are below the mid-point of the scale at months 1 and 3, we will use the findings to suggest potential additional strategies and address concerns in the intervention, but we will continue running the program given that it is an entirely new screening program. If mean scores on any TFA construct are below the mid-point of the scale at month 6 (final feasibility evaluation time point), we will take this to be an indicator that some aspect(s) of the intervention should be further iterated for improved acceptability. If that is the case, we will convene a patient and health system advisory group to decide on whether and how to continue to the program beyond the 6-month feasibility pilot and decide on approaches for optimisation of the program and its delivery.
The feasibility outcomes obtained from the interviews with health care providers will be analyzed using content analysis guided by the TDF [43] using nVivo. Data codes will be generated by labeling one to two lines of text with a descriptive label and then subsequently sorting these into the TDF domains. Data within and across codes will be compared to assess similarities, differences, and interrelations and refined accordingly. Codes representing similar thematic topics will be grouped; these will be defined and documented in a codebook. Interview transcript analysis will involve the following four steps: 1) familiarization, 2) coding participant responses to specific domains, as defined by the TDF, 3) generating sub-themes within each domain, and 4) grouping themes across domains [33,44]. To verify the emerging analysis, a second analyst will review a preliminary set of themes to assess how well the data are represented and the relevance of data within codes, and to the associated TDF constructs. Where differences in interpretation arise, the two analysts will discuss until agreement is reached and amendments will be made to the coding and codebook as necessary. The health care provider survey responses from the interviews will be descriptively analyzed and scale scores calculated, and open-ended responses summarized based on the TFA constructs and NIH framework.
To document and analyze the costs related with the tele-retinopathy intervention, we will obtain the intervention and implementation costs [21] from the community health centre. The intervention cost includes expenses required to purchase and maintain the intervention, salaries for staff, and physician fees. We will use these data along with downstream costs incurred (i.e., patient-related cost, such as travel and parking costs as well as time missed from work), to inform future economic evaluation of the intervention.