2.1. Study Design
This study employed a quasi-experimental design with a non-equivalent control group pre-test–post-test design to examine the effects of flipped learning methods utilising digital literacy on the critical thinking skills and learner autonomy of nursing students.
2.2. Participants
Third-year nursing students enrolled in an adult nursing course at Busan Institute of Science and Technology located in Busan Metropolitan City participated in this study. For this study, ‘nursing students’ are defined as individuals enrolled in a nursing college, nursing department, or nursing program at a four-year university or a four-year restructured college, accredited by the Korean Accreditation Board of Nursing Education in accordance with Article 7 of the Medical Service Act on nurse licensing [22, 23]. Students on a leave of absence or planning to withdraw from the study were excluded.
The sample size for this study was calculated using the G*power 3.1.9.4 program based on a previous study [15]. With an effect size of 0.7, a significance level of .05, and power of 0.8, the required sample size for each group was 23 participants. Considering an attrition rate of > 30%, the study aimed to recruit 30 participants per group for a total of 60 participants. The actual number of participants included in the study was 71, with 36 and 35 in the experimental and control groups, respectively.
2.3. Data Collection Tools
The tools used in this study included questionnaires on the general and learning-related characteristics (including digital literacy) of the participants, and those on critical thinking skills and learner autonomy. Instruments for measuring digital literacy, critical thinking skills, and learner autonomy were used with permission from their respective developers.
2.3.1 General Characteristics and Learning-Related Characteristics
The general characteristics of the participants were assessed using two items: sex and age. Learning-related characteristics included three items—GPA of the previous semester, voluntary selection of the nursing major, and satisfaction with the major—along with 17 items on digital literacy, totalling 21 items. Digital literacy was measured using the Digital Literacy Toward ICT for Learning tool [3], which was translated and standardised into Korean by Kim [24]. This tool comprises domains related to attitudes towards online learning, technical digital literacy skills, cognitive skills, and socioemotional skills. All items were rated on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), with a total score ranging from 17 to 85. Higher scores indicated a more positive attitude towards online learning and higher digital literacy. The original tool’s reliability coefficients (Cronbach’s α) were .86 for online learning attitudes and .89 for digital literacy. The Korean version demonstrated reliability coefficients of .81 for online learning attitudes and .84 for digital literacy. The reliability coefficients for this study were .90 for online learning attitudes and .92 for digital literacy.
2.3.2 Critical Thinking
Critical thinking skills were measured using a tool developed by Kwon et al. [18] to assess the critical thinking disposition of nursing students. This tool includes 35 items across eight domains: creativity, challenge, openness, prudence, objectivity, truth seeking, inquisitiveness, and analytical skills. Each item is rated on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), with a total score ranging from 35 to 175. Higher scores indicate higher critical thinking skills. The Cronbach’s α of the original tool ranged from .56 to .83 for individual factors and was .89 for the scale used in this study. In this study, the reliability coefficients for the individual factors ranged from .60 to .81, and the overall reliability coefficient was .73.
2.3.3 Self-Directed Learning
Learner autonomy was assessed using the SH-Self-Rating Scale of Self-Directed Learning (SH-SRSSDL) developed by Williamson [25] for nursing students; it was translated and standardised for Korean contexts by Jo et al. [26]. This tool comprises 30 items across five domains: awareness, learning strategies, learning activities, evaluation, and interpersonal skills; each item rated on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), with a total score ranging from 30 to 150. Higher scores indicate greater learner autonomy. Williamson’s original tool demonstrated reliability coefficients (Cronbach’s α) of .79 for awareness, .73 for learning strategies, and .71 each for learning activities, evaluation, and interpersonal skills. The Korean version showed reliability coefficients of .90 for awareness, .92 for learning strategies, .93 for learning activities, and .94 each for evaluation and interpersonal skills. In this study, the reliability coefficients were .67 for awareness, .73 for learning strategies, .72 for learning activities, .61 for evaluation, .78 for interpersonal skills, and .88 for the entire scale.
2.4. Education Method and Data Collection
This study applied flipped learning in an adult nursing course for a period of 13 weeks, from September 1 to December 12, 2023 (excluding midterm and final exams). For the flipped learning approach, video content related to weekly topics was provided to the experimental group one week in advance. For this method, students were expected to watch and familiarise themselves with the content before attending class. Quizzes, discussions, and the introduction of new materials based on the pre-watched videos were conducted in the class. The control group received traditional lectures and was provided with the same video content after class completion. The video content, comprising two to three videos per week with a total viewing time of approximately 20 min, was sourced from reputable institutions such as domestic university hospitals and the Korea Disease Control and Prevention Agency to ensure high reliability. To facilitate digital literacy, content was made accessible online through the e-learning site (LMS) of the university, in which the participants were enrolled. To verify the pre-class viewing of the videos, quizzes based on the video content were administered at the beginning of each class, encouraging active participation in pre-learning activities.
2.5. Ethical Consideration
Prior to the study’s commencement, approval was obtained from the Institutional Review Board of the Pusan National University from which the researcher belongs (IRB No. PNU IRB/2023_118_HR). The researcher then sought cooperation from the relevant department to conduct the classes and collect data. The teaching methods were differentiated into flipped learning and traditional lecture formats, while all other course content and assessments remained identical, ensuring no disadvantages to the students, and written informed consent for the study was obtained before the commencement of the classes. No negative consequence based on their choice of teaching method was assured to the participants and they were allowed to choose voluntarily. Additionally, to align with flipped learning characteristics, the content provided to the experimental group before class was made available to the control group after class.
2.6. Data Analysis
Data were analysed using SPSS WIN 27.0. Descriptive statistics, including frequency, percentage, mean, and standard deviation, were used to analyse the general and learning-related characteristics of the participants. Homogeneity tests of the participants’ characteristics and dependent variables between the experimental and control groups were conducted using independent t-tests and chi-squared tests. Pearson’s correlation coefficients were used to analyse the correlations between digital literacy, critical thinking skills, and learner autonomy. The effectiveness of the intervention was compared between the experimental and control groups by using independent t-tests.