Study type, population and setting
This descriptive study included a cohort of ARTc staff invited to participate in case-based e-learning. NACP provides care and treatment services to 1.48 million PLHIV through 620 ARTc which are primarily located in the public health institutions and provide single-window services for HIV-TB care10. National Institute of Tuberculosis and Respiratory Diseases (NITRD), moderated sessions as hub and 115 ARTc from four states (Delhi, Uttar Pradesh, Andhra Pradesh and Tamil Nadu) participated as spokes. The subject matter experts on HIV and TB were drawn both from NACP and NTEP, to provide expert opinion and facilitate case discussion.
Sample size
We purposefully selected two states with a high HIV prevalence (> national average of 0.22%) and two states with low HIV prevalence (< national average) to implement the intervention at all ARTc. Participating staff from each ARTc included medical officer, nurse, counsellor, pharmacist and other cadres (data manager, care coordinator and lab technician).
E-learning intervention
This intervention was anchored on the conceptual framework of building communities of practice, defined as “groups of people who share a common concern/problems/passion, and deepen their knowledge and expertise by interacting on an ongoing basis”.11 We developed curriculum based on the national TB prevention and management guidelines for PLHIV, in consultation with experts from both the programs. We ensured availability of a computer, web camera, speaker with microphone, internet connectivity as per guidelines. We provided an orientation to the spokes on case-based learning through a virtual platform and took feedback on preferred session day/timing to facilitate attendance.
The spokes shared difficult-to-manage cases in a standard format that captured clinical and laboratory details and the key queries about the case management. During the one-hour sessions, a predetermined spoke presented the case, followed by case discussion/didactic and proposed recommendations for case management by the invited subject experts.
Data collection and management
Data was collected to understand– i. feasibility and acceptability of the case-based e-learning; ii. impact on professional satisfaction, self-efficacy (knowledge, skills and competency), technical knowledge retention (short-and long-term) and change in practices among providers.
Feasibility and acceptability of e-learning
Feasibility and acceptability was assessed by using in-session information on date/time, participation, topic and expert. Each session concluded with a poll which captured feedback on four variables–quality, clarity, relevance of content, appropriateness of duration; and overall rating of the session which allowed open-ended comments from participating sites. Feedback using a structured questionnaire was collected from experts who facilitated case-discussions.
Impact of e-learning
Impact was analysed using three parameters–self-efficacy (an individual's belief in his or her capabilities to produce specific performance attainments), knowledge retention, and change in practices and patient outcomes. To assess self-efficacy (knowledge, skills and competencies) and long-term technical knowledge retention, each spoke was subjected to baseline and completion (at the end of 18 months) survey via an electronic structured questionnaire. Short-term technical knowledge retention was assessed through pre-and post-session assessment at the end of each session. We reviewed routine programmatic data to assess practices among participating ARTc.
Data Analysis:
To assess feasibility of e-learning, we calculated percentages for categorical variables using in-session data. We categorised sessions into five domains–diagnosis, treatment, prevention, pharmacological aspects and monitoring. Session participation, participant feedback was disaggregated into 5 domains. Responses from participants and experts on session feedback was collected on five-point scale and responses were re-categorised into three groups–Agreed, Neutral and Disagreed. ‘Agreed’ response rate for each session by feedback variable was calculated. A session was classified to have received as positive feedback if the agreed response rate was ≥ 80% for a specific variable (Table-1). We calculated percentage of positive response for each survey question from experts. We compiled all qualitative response from participants and included those pertaining to quality and relevance of the sessions for analysis. Qualitative responses were recorded in text using double quotations as per standards of presenting qualitative data.
To assess impact of e-learning, responses to ten self-efficacy questions through baseline and completion survey were collected on seven-point Likert scale for each question. Responses were re-categorised into three groups–Agreed, Neutral and Disagreed. Perceived mean scores of baseline and completion surveys were calculated and a paired t-test was used to determine the change in the perceived self-efficacy. For calculating the short-term technical knowledge retention, we used t-test to determine the mean difference in pre-and post-test scores administered during each session. For calculating the long-term knowledge retention, paired t-test was used to determine the mean difference in baseline and completion scores before and after 18 months of the intervention. To estimate improvement in practices, we used chi- square test to measure change in process and patient outcomes–TB screening, TB referral, TB diagnosis, ART initiation and TB preventive treatment (TPT) completion rates over time.