Participants:
In total, 134 incoming first-year medical students (MS1) were voluntarily recruited during two consecutive orientations at a local United States medical school from July 2022 through August 2023. Participants engaged in an informative oral presentation led by the investigating team, exploring the advancements and impact of VR in surgical medicine. Subsequently, participants viewed a demonstration video featuring a post-graduate year three (PGY-3) orthopedic surgery resident illustrating the initial steps of surgical screw fixation of a slipped capital femoral epiphysis (SCFE) using the Osso VR system (San Francisco, CA United States). Following this session, each MS1 was briefed on the study's details, including the opportunity to voluntarily replicate the SCFE VR steps demonstrated by the PGY-3, and provided with a digital consent form via Global Research Electronic Data Capture (REDCap). The confidentiality of all 134 MS1s' consents was maintained through de-identification and secure storage, with each consent assigned a unique REDCap "Record ID #" corresponding to the respective MS1's email address. Group emails were sent using these Record ID #s to ensure privacy and uphold the integrity of this double-blind pilot study.
To be eligible for participation, MS1s needed to be enrolled as medical students at the institution conducting the study. The sole exclusion criterion was a self-reported history of adverse reactions to virtual stimulation or seizure/epileptic behavior, although no MS1s met these criteria for exclusion. Participation was entirely voluntary, with no coercion or incentivization involved, and participants were explicitly informed of their right to withdraw from the study at any point, with their data to be promptly deleted in such instances.
Of the 134 MS1s who initially signed up, 51 successfully completed all aspects of the study, encompassing the consent process, pre-interventional questionnaire, Osso VR SCFE procedure simulation, and post-interventional questionnaire. Five duplicate consents and one dropout during the pre-interventional questionnaire accounted for the reduced number of completions. Of the remaining 128 MS1s, 77 chose not to participate in the SCFE VR simulation. Nevertheless, all 51 MS1s who undertook the OSSO VR SCFE steps also completed the subsequent post-interventional questionnaire. Although this represented fewer than half of the initial 128 MS1s who completed the consent and pre-interventional survey, our sample size of 51 subjects aligns with the average number of participants in prior VR studies, which reported an effect size of 0.8015–17. This indicates that our sample adequately accounted for projected attrition resulting from students' schedules and VR availability.
Pre-interventional Questionnaire:
Each consent form included a field for the MS1's school email address, accompanied by an explanation detailing its intended use primarily for instruction dissemination. Additionally, a copy of the PGY-3 VR video was provided, allowing participants to review it as many times as desired prior to data collection, alongside their randomly assigned REDCap Record ID number. Upon submitting digital consent, each MS1 proceeded to complete a 22-question pre-interventional questionnaire, exclusively designed for this study by the research team. This questionnaire encompassed inquiries into basic demographics such as age, gender, hand dominance, and history of engagement in hand-eye coordinated activities, video games, or musical instruments (Figs. 1 and 2), serving to evaluate potential confounding variables.
Participants were allotted a time window ranging from 0 to 60 days to decide whether to participate, aimed at mitigating any perceived coercion. 45 out of 128 subjects consented and completed the pre-interventional survey on the day of the orientation presentation, six did so on the same day during their allocated data collection slot.
Following survey completion, participants received an email within 24 hours from the research team, ensuring anonymity. This email included the identical VR video showcased during the orientation session, facilitating further review if desired, along with the corresponding REDCap Record ID number linked to their consent form. Additionally, a Microsoft Excel Spreadsheet (Redmond, WA United States) was provided, enabling subjects to schedule a 15-minute time slot on one of the designated simulation days using their assigned Record ID number.
SCFE Procedure Simulation:
On the day of data collection, each participant entered a spacious room accompanied by two members of the research team. One member assumed the role of data recorder, while the other provided consistent instructions and verbal cues throughout the simulation, with no role-switching occurring. Prior to commencing the procedure, each participant received a comprehensive explanation of the Osso VR system Unit 080, as introduced by the PGY-3 resident during the orientation session.
The initial prompt informed participants of the opportunity to familiarize themselves with the Osso VR system through a tutorial video. They were encouraged to ask questions and seek assistance from the team members, with no time constraints imposed, although the tutorial typically lasted 1–2 minutes. Following the tutorial, participants received further instructions.
Upon initiating the SCFE pinning simulation, participants were informed of a time frame of approximately 10 minutes to complete the procedure, ample time compared to the demonstration by the PGY-3 resident. Participants were assured that exceeding this time limit would not result in termination of their participation. Participants were granted unlimited retries, verbal hints, and the option to discontinue their participation at any point, with a final prompt encouraging adherence to simulator instructions.
During the simulation, participants initially aimed to maneuver the X-ray fluoroscopy C-arm into optimal positions for both anteroposterior (AP) and lateral views. In this step, the OSSO VR system provided standardized prompts as illustrated in Figs. 3 and 4; these prompts were not counted as “hints,” since they were uniformly provided to all participants, irrespective of their performance on the task. The simulation also provided additional verbal cues to correct any misalignments, which were dependent upon participants’ performance. These cues were counted as “retries” to correctly position the C-arm recorded for analysis.
Following C-arm placement, participants proceeded to grasp the drill and drill bit, performing the subsequent steps of drilling the guide wire into the femoral head at designated points while utilizing X-ray fluoroscopy (Fig. 5). Throughout these steps, participants could request verbal hints from the team members, ensuring procedural accuracy.
Upon achieving satisfactory guide wire placement as per ideal X-ray views, participants finalized the procedure, receiving a performance grade of A, B, C, or did not finish (DNF). Performance grade was comprised of the following recommendations: depth placement in millimeters (shallower/deeper), dimension angle in degrees (posterior/anterior and inferior/superior) to the ideal spot (Fig. 6). Both the grade and recommendations were recorded for data analysis, and team members informed the subject that they could remove the VR headset. The time taken, measured in seconds, was recorded for two activities: first, the time it took the MS1 to drill and place the guide wire into the femur, and second, the total time required for the MS1 to perform the entire VR simulation, which included guide wire placement, C-arm operation, and the placement of the drill bit into the drill.
Participants receiving a DNF grade were given the option to retry within the specified time frame or accept the grade. Retries were recorded regardless of DNF status, including voluntary retries initiated by participants. Completion of the simulation allowed participants to proceed to the post-interventional questionnaire. Overall, recorded markers from the VR SCFE Procedure Simulation included total procedure time, C-arm placement time, guide wire insertion time, performance grade, recommendations, number of retries, and verbal hints, facilitating comprehensive data analysis.
Post-Interventional Questionnaire:
Upon completion of the simulation, the subject removed VR headset and scanned a REDCap QR code on a secure device with their personal smartphone in a separate area of the simulation room. There, they answered eight questions pertaining to their VR experience and performance (Fig. 7). While the subject completed the post-interventional survey, one of the proctoring team members entered the subject’s data output from the simulation into REDCap database. When finished, the subject informed one of the proctoring team members and exited the secure room, concluding his or her participation in the study. This was repeated with each subject.
Data Analysis:
Statistical analysis was performed using the Mann-Whitney-Wilcoxon test, Chi-squared test, and Fischer’s exact tests on the pre-/post-interventional survey responses and the VR SCFE procedure simulation markers. Statistical significance was defined as p < 0.05. Data-collected results are presented as means ± standard deviation with confidence intervals for both surgical interest and non-surgical interest. All statistical analysis was performed using IBM SPSS 28 Statistical Software. No prior power analysis to discover a desired sample size was performed due to similar studies having an n-value of approximately 21–24 subjects15–17. Hindsight power analysis was performed after data was analyzed showing a .80 power equating to approximately 80 subjects.