e-Learning with a flipped classroom approach Educational Program
We designed a one-year educational program with four modules addressing dyslipidemia, hypertension, diabetes, and obesity. Each module had an average duration of 3 months, including material designed and produced by several consultants with broad and relevant clinical experience. The complete program will have a duration of 4 years. Each year, new medical students can enroll in the program.
The program included different kinds of educational material, such as:
- Pre-recorded video Lectures: Lectures about the general concepts of each topic. Students were allowed to download the videos at any time. This material was the preamble of later synchronous live-time virtual sessions.
-Bibliographic collection: This was a repertoire of relevant articles for each topic. The articles' collection included an annual update on national and international guidelines for the management of each NCCD. The bibliography was obtained through the retrieval services of the "José Luis Bobadilla Fernández" Library of the School of Public Health of Mexico through the services of ScienceDirect, Ebsco.
- Live-time virtual sessions. These took place once a week. A specialist led the discussion of real clinical cases and answered all questions from the attending students, questions derived from the social service experience.
-Blog Questions to the Expert. In this area, medical students could ask questions not addressed during live sessions, supporting service learning. Experts replied within 72 hours.
- Social Interaction: This is where the students can interact and comment regarding clinical cases and medical information and discuss newly published articles. Medical students work collaboratively with their colleagues (classmates) and share what they have learned.
- Homework: The participants sent the registry of clinical indicators guaranteeing the anonymity of the attended patients. They also sent solutions for clinical cases published online as an exercise for the live session.
- User’s Guide: This section includes general information about the course, evaluation methods, and a calendar of the activities.
- Didactic Planning. Each module contains information and the calendar of the sessions.
- Advertisement: New announcements regarding each module, class, or update.
- Technical support: Help regarding internet connection, availability of materials, and access to sessions.
-Professors: Professors were specialists from NCCDs Clinics in the INCMNSZ, such as Diabetes Clinic, Lipid Clinic, UIEM, Cardiology and Hypertension Department, Obesity Clinic, and CAIPaDi (Centro de Atención Integral al Paciente con Diabetes).
Beneficiary Population. Mexico's Ministry of Health (SSA) invited all students who participated in the program.
Online platform. For implementing this program, the SSA provided a list of rural health centers with free internet access. Later, the call was opened to all states considering that students did not necessarily have to connect from the center health but could connect from their residence or in an internet cafe.
A portal web was developed to report the participants' and user managers' academic profiles and other socio-demographic data. The MOODLE Learning Management System (LMS) was a technological tool supporting free and open-source software. The National Institute of Public Health oversaw the development and adaptations of the web application for the implementation of the program. Through this technological tool, the activities of the students were supervised. The access to content was conditioned through carrying out the diagnostic evaluation. Recorded live sessions, readings, educational videos, surveys, and evaluations were published in LMS - MOODLE.
Evaluation. Our program seeks to ensure that the social service intern has the necessary skills for clinical practice. The evaluation is accomplished in four ways:
1. Assess the quality of care in the attention of NCCD
2. Assess clinical performance and discussion of the real cases in the platform and discuss with the expert within live-time virtual sessions.
3. Assess that the students do the right things and apply the principles of the course to their patients, sending their records in an anonymous format to save the patient's identity.
4. Assess the knowledge of NCCD through pre and post-test.
First, a questionnaire was applied regarding the activities carried out on each patient, such as whether the albumin/creatinine ratio was requested or whether the feet were checked in patients with diabetes. This first questionnaire was applied before starting the course. This evaluation was based on different parameters of quality of care.
In diabetes, the evaluation was based on parameters of the National Committee of Quality Assurance [14], which evaluates if patients had an ophthalmological and renal evaluation, a foot examination, and counseling for smoking cessation. The evaluation of the hypertension module was based on the ICAHi (hypertension care quality index).[15, 16] In the module evaluation, we assessed screening, the indication of self-monitoring, ambulatory blood pressure monitoring, evaluation of complications, the establishment of individualized goals, prescription of lifestyle changes, and registry of most common drugs used. In this case, we also evaluated the correct management of secondary hypertension.
The obesity evaluation was based on the 5A Module[17]. Pre-module questions included information on measurement of weight, height, abdominal circumference, and use of the EOSS scale, patient education on diagnosis and impact on health, treatment options, individualized goal setting, lifestyle changes, drug risk not approved for weight loss, and if follow-up is given for weight change and comorbidities.
Dyslipidemia was evaluated based on the ESC/EAS Guidelines for the Management of Dyslipidemias 2019 [18]. The questionnaire included information about the individualized goal of LDL-c, evaluation of cardiovascular risk in patients with hypertriglyceridemia, and treatment with and without lipid-lowering drugs.
The second way to evaluate is in live-time virtual sessions. In these sessions, the duration is one hour, and real-life clinical cases are presented. The objective is to make an interactive session where the trainees solve the clinical case with the help of the expert. Likewise, doubts on the theme are resolved to consolidate knowledge by putting it into practice in the case discussed. Additionally, practical questions can be resolved on the blog throughout the week. The expert is in charge of answering these questions twice a week.
The third method of evaluation consists of requesting the sending of the patient records to evaluate that the quality evaluation scores are obtained in the attention of each area. ***For diabetes, we evaluated the percentage of patients in control of glycosylated hemoglobin, blood pressure, and LDL cholesterol; we also evaluated the percentage of patients who have had an ophthalmological and renal evaluation, a foot examination, and counseling for smoking cessation. In the post-module evaluation for hypertension, we assessed the percentage of patients achieving blood pressure control, the results of the studies evaluating complications, the criteria for studying a patient with secondary hypertension, and the need for reference to a second-level clinic. In the evaluation post-module for obesity, we also included the change in weight, body mass index, and waist circumference at basal, three, and six months. For the dyslipidemia module, we evaluated indications for screening, tests solicited, and management according to results, time for follow-up, and management of severe hypertriglyceridemia.
A knowledge assessment was also carried out before and after each module. The objective was to have a basal parameter and later to know if the minimum knowledge of each subject was obtained. They could claim a certificate for that module if they obtained a minimum grade of 8/10. Then, if the students finished all four modules with a minimum grade of 8/10, they could obtain a certificate issued by the Mexican Society of Nutrition and Endocrinology (SMNE).
Satisfaction surveys. We assessed the rating of satisfaction with the program at the end of each video conference and the end of each module. The items assessed were:
- learning content and teaching materials
- learning environment (technological support)
- expert performance opinion
Abandonment surveys. We assessed the number of users who finished the training program each year. We evaluated:
- Time dedicated to the program.
- A place where they connected for the session.
- Interaction with experts.
- Course expectations.
- Reasons for abandoning the course.