We developed an interactive session called CL that allows medical students to learn immunology and microbiology content and practice directed-independent learning using collaborative technology (Fig. 1) (31). We previously reported that student performance, measured as mean performance on pre-formative vs post-formative assessment, increased 2.55-fold while students indicated they were slightly satisfied to satisfied with the instructional session using CL instruction (31). Here our aim was to evaluate student perceptions of CL instruction, and to compare to other accepted instructional methods, including TBL, FC and DL.
When comparing questions of student perceptions regarding general satisfaction on a 6-point Likert scale or by ranking, we found that participants were equally satisfied with TBL, DL, and less satisfied with CL and FC (Table 1). In the preclinical years, the students at our institution spend ~ 53% of instruction as DL, 2.5% as TBL, and only 0.1% as FC (data not shown). Taken together, students appear to prefer the teaching style(s) that they are more familiar with (DL and to some extent TBL for our curriculum), similar to what has been previously reported at other institutions (37, 38). It is likely that other aspects of the CL session contributed to the reduced satisfaction by the students (i.e. timing of the session in the curriculum, team expectations, technical difficulties, organization problems, etc.) and that will be the focus of future research.
As expected, students perceived that TBL and FC required more preparation time when compared with CL and DL (Table 1). While TBL and FC require that students prepare before coming to class (21, 22, 27, 39), DL and CL do not require student advanced preparation. The curricular time assigned for CL remained the same as when this material was delivered as a DL instructional method. Students have reported that many classroom styles require prohibitory high advanced preparation in order to be sufficiently effective (21, 23, 36, 40), thus CL has an advantage when compared to TBL and FC, which does not require advanced student preparation.
Students perceived themselves to be equally engaged with TBL, DL and CL instruction, and less engaged with FC (Table 1). TBL is regarded as a highly learner-centered teaching method that, when conducted correctly, improves academic outcomes and learning measures as compared to other lecture-based teaching models such as DL and FC (21). In our curriculum, TBL requires in-person student attendance, and for students to arrive prepared, having studied provided advanced preparation material. With the exception of TBL, mandatory attendance is not common practice in our curriculum and advanced preparation is not required. Thus, student perceptions about engagement may have been compromised. In addition, our students are not exposed to FC commonly in the curriculum, so the rating of engagement as low for this instruction method is not surprising.
In terms of collaboration and teamwork, TBL and CL were rated significantly higher than DL and FC by the students (Table 1). In agreement with Ng, 2020 (39), the intrinsic nature of TBL with the use of teams and students working collaboratively, is similar to the instructional method CL and explains why these are perceived strongly by students. As expected, TBL provided more instructor and peer feedback than DL and FC. Surprisingly, CL was perceived by students to provide higher instructor feedback than TBL, while peer feedback received was perceived to be higher in TBL. Both TBL and CL teaching methods contain higher peer and instructor feedback when compared with DL and FC (Table 2, Table 3). The low mean obtained in the survey relating to feedback across all instructional methods was likely due in part to the high percentage of students who felt they did not receive feedback (DL (80%), FC (82%), TBL (40%) and CL (15%). The low mean for perceived peer feedback is similarly explained by some students reporting that they received no peer feedback. Instructor feedback in CL was provided instantly to all students as they were using the Google document (31), and also later when the material generated by students in class was compared to the material created by the instructor (Fig. 1), while TBL feedback is provided as a group. We speculate that the higher peer feedback rating of TBL is due to its familiarity during the interaction as a group, while in CL the feedback also requires writing the information in a document, which could reduce the personal interaction within the group.
When comparing assessment timing to other instructional methods, CL uses formative assessment before and after each session (Fig. 1, Table 3), while formative/summative assessment of TBL typically takes place at the beginning of iRAT. In general, no formative assessment takes place during FC or DL, as concepts are generally assessed afterwards on formal summative assessments, though this can vary. Higher perceived TBL engagement could therefore be explained as a consequence of the assessment timing; in most TBL sessions the RAT scores are graded and therefore students come prepared for sessions and have a more standardized initial level of knowledge, which may promote better discussion among peers, compared with FC and DL.
Our study has several limitations that should be recognized. The questionnaire that was administered to the students was not a validated survey. In addition, the sample size is small and student perception data were only collected from a single educational institution with one medical education curriculum. While our results cannot be generalizable, the description of this teaching method is publicly available (31) and may be used at educational institutions in order to generate more data on the effectiveness of this teaching strategy in the future.
CL integrates technology and uses the conceptual framework TPACK (24) as a content expert, technology, and pedagogy are integrated in this instructional method. CL also integrates the concepts of generative learning theory (25) as students create a study guide that summarizes and a matrix organizer to complete a given task (also aligns with the highest levels of Bloom’s taxonomy, namely creation, analysis, and synthesis (27)). These are generally not common in foundational courses in medical education (41). Our findings support the notion that CL has unique characteristics (Table 3) that provide formative feedback in order for students to monitor their own learning as required in medical education (Liaison Committee Medical Education Standard 9.7) (42). In our previous publication we found that students demonstrated short-term retention knowledge during CL (31), and future analysis to determine whether CL improves the learning outcomes of medical students, as well as its effectiveness on long term retention when compared with TBL, PBL and DLs is warranted.