Table 1: Frequency distribution of learners' satisfaction with virtual learning and its components during the COVID-19 pandemic
Component
|
Type of learners
|
Level of satisfaction with virtual learning
|
Statistical test result
|
Satisfaction
|
Dissatisfaction
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
Expressing expectations and objectives at the beginning of a course
|
Employees
|
(62) 310
|
(38) 105
|
<0/001
|
Students
|
(49) 136
|
(51) 144
|
<0/001
|
Achieving the educational goals
|
Employees
|
(49) 240
|
(51) 260
|
<0/001
|
Students
|
(41) 120
|
(59) 136
|
<0/001
|
Availability of technical facilities and infrastructure
|
Employees
|
(34) 170
|
(66) 330
|
<0/001
|
Students
|
(51) 144
|
(49) 163
|
<0/001
|
Enhancing the speed and effectiveness of virtual learning in education
|
Employees
|
(57) 280
|
(43) 220
|
<0/001
|
Students
|
(51) 144
|
(49) 136
|
<0/001
|
High flexibility
|
Employees
|
(79) 400
|
(21) 100
|
<0/001
|
Students
|
(57) 160
|
(43) 120
|
<0/001
|
Internet speed
|
Employees
|
(21) 100
|
(79) 400
|
<0/001
|
Students
|
(46) 130
|
(54) 150
|
<0/001
|
Possessing electronic skills by learners
|
Employees
|
(64) 320
|
(36) 180
|
<0/001
|
Students
|
(76) 215
|
(24) 130
|
0/026
|
Overall satisfaction with virtual learning
|
Employees
|
(70) 350
|
(30) 150
|
<0/001
|
Students
|
(51) 144
|
(49) 136
|
<0/001
|
Willingness to use virtual learning after the COVID-19 period
|
Employees
|
(83) 420
|
(7) 80
|
0/004
|
Students
|
(54) 150
|
(46) 130
|
<0/001
|
Based on the results shown in Table 1, it was determined that the highest satisfaction among students was related to "possessing electronic learning skills," while among employees, it was related to "high flexibility" and "willingness to use virtual learning after the COVID-19 pandemic." Additionally, the lowest level of satisfaction among students was related to "achieving the educational goals through e-learning," and among employees, it was related to "internet speed in virtual learning." According to the obtained results, it appears that the majority of students and employees have relative satisfaction with virtual learning and its components. Furthermore, using an independent t-test between the gender of students and employees and their satisfaction with virtual learning, a significant correlation was found (p < 0.05), although no correlation was observed between the satisfaction level of employees and students and their previous experiences in using virtual learning (p > 0.05). Based on the t-test, a significant correlation was found between the satisfaction level of learners (students + employees) and all components of virtual or electronic learning (p < 0.001).
In examining the correlation between age and employees satisfaction with virtual learning, a one-way analysis of variance (ANOVA) test was conducted, resulting in a significant correlation (p = 0.03). This finding provided evidence of a meaningful relationship within this group of learners regarding their satisfaction with the training. To further investigate the relationship between employee's satisfaction and age groups, POST HOC test was utilized. As a result, a significant correlation was observed between satisfaction with virtual learning and age groups of 21-30, 31-40, and 40 and above. It was concluded that employee satisfaction increases as age increases.
Furthermore, by employing an analysis of variance, it was determined that there is a significant correlation between student satisfaction with virtual learning and their age (p= 0.002). As age increases, the level of student's satisfaction with electronic learning also increases.
To compare the overall satisfaction of employees and students at Tehran University of Medical Sciences regarding electronic learning, a t-test was performed, revealing a significant difference in the level of satisfaction between these two user groups (p = 0.031). It was evident that employee's satisfaction with virtual learning was higher than that of students.
Table 2: Frequency Distribution of Users Satisfaction with the Navid System based on its Components during the COVID-19 Pandemic
Component
|
Type of learners
|
Satisfaction level with the Navid system and its components
|
Statistical test result
|
Satisfaction with the component
|
Dissatisfaction with the component
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
User-friendliness of the platform's visual design
|
Employees
|
(15) 70
|
(85) 430
|
0/02
|
Students
|
(16) 30
|
(84) 250
|
0/04
|
Easy access to the system
|
Employees
|
(15) 70
|
(85) 430
|
0/005
|
Students
|
(19) 50
|
(81) 230
|
0/006
|
Appropriate volume of provided content
|
Employees
|
(30) 150
|
(70) 350
|
<0/001
|
Students
|
(38) 106
|
(62) 174
|
<0/001
|
Instant access to content
|
Employees
|
(26) 130
|
(74) 370
|
<0/001
|
Students
|
(27) 80
|
(73) 200
|
0/004
|
Easy access to support services
|
Employees
|
(40) 200
|
(60) 300
|
<0/001
|
Students
|
(68) 188
|
(32) 92
|
0/135
|
Appropriate workload
|
Employees
|
(40) 200
|
(60) 300
|
0/001
|
Students
|
(57) 160
|
(43) 120
|
<0/001
|
Appropriate dedicated time for completing assignments
|
Employees
|
(34) 170
|
(66) 330
|
0/001
|
Students
|
(43) 120
|
(57) 160
|
<0/001
|
Effective feedback on assignments
|
Employees
|
(57) 280
|
(43) 220
|
0/22
|
Students
|
(81) 225
|
(19) 55
|
<0/001
|
Variety of content presented
|
Employees
|
(36) 180
|
(64) 320
|
<0/001
|
Students
|
(49) 135
|
(51) 145
|
<0/001
|
Interaction among learners
|
Employees
|
(74) 370
|
(26) 130
|
0/007
|
Students
|
(62) 175
|
(38) 105
|
<0/001
|
Interaction between learners and teachers
|
Employees
|
(66) 330
|
(34) 170
|
0/003
|
Students
|
(54) 150
|
(46) 130
|
<0/001
|
Need for more time
|
Employees
|
(21) 100
|
(79) 400
|
0/07
|
Students
|
(46) 130
|
(54) 150
|
0/001
|
According to Table 2, the highest level of satisfaction among the university students was related to the "effective feedback on assignments," while the lowest level of satisfaction was associated with the "user-friendliness of the platform's appearance." However, university employees expressed the highest level of satisfaction with the "interaction among learners" component and the lowest level with the components of "user-friendliness of the platform's appearance" and "easy access to the system."
Using the t-test at a significance level of P<0.05, a significant difference in satisfaction was found between learners (students and staff) regarding the components of the Navid system, except for "need for more time," "easy access to support services," and "effective feedback on assignments." Additionally, no significant difference in satisfaction levels between employees and students was observed regarding the offline Navid system (p = 0.171). Overall, it seems that the satisfaction level of both students and employees with the offline Navid system is below 50%, indicating a low level of satisfaction among the learners with this system.
To establish a significant correlation between user's satisfaction with the Navid system and factors such as gender, age, and previous experiences with virtual learning, a t-test was conducted. The results did not show a significant correlation between user's satisfaction and learners' satisfaction with the Navid system and their gender or previous experiences (p > 0.05). However, a significant correlation was observed between the age of students and their satisfaction level with the Navid system using a one-way analysis of variance (ANOVA) test (p < 0.01). To determine which specific age groups exhibited this difference, POST HOC test was employed. The analysis revealed that satisfaction with the Navid system increases as students' age increases.
Table 3: Distribution of student satisfaction with the BigBlueButton learning management system and its components during the COVID-19 pandemic
Component
|
level of satisfaction with BigBlueButton and its components
|
Statistical test result
|
Satisfaction with the component
|
Dissatisfaction with the component
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
user-friendliness of the platform's interface
|
(53) 150
|
(47) 130
|
<0/001
|
easy access to the system
|
(60) 170
|
(40) 110
|
0/006
|
appropriate volume of educational content
|
(73) 205
|
(27) 75
|
<0/001
|
instant access to content
|
(53) 150
|
(47) 30
|
0/28
|
access to support services
|
(20) 55
|
(80) 225
|
0/004
|
appropriate time for asking and answering questions
|
(40) 110
|
(60) 170
|
0/001
|
feedback on questions and answers within the system
|
(47) 130
|
(53) 150
|
0/01
|
interaction between the instructor and the student
|
(40) 110
|
(60) 170
|
0/004
|
time flexibility compared to in-person education
|
(47) 130
|
(53) 150
|
0/001
|
internet speed
|
(67) 190
|
(33) 90
|
0/36
|
increased learning due to online nature
|
(53) 150
|
(47) 130
|
0/001
|
Based on Table 3 and considering that only the participating students used the Big Blue Button system in this study, it can be concluded that the highest level of student satisfaction was related to the “appropriate volume of educational content”, while the lowest level of satisfaction was related to "access to support services" of the system.
Furthermore, a significant correlation was observed between student satisfaction and all components of the Big Blue Button system except for "instant access to content" and "internet speed" (p<0.05). There was no significant correlation found between gender, age, previous experiences with the Big Blue Button system, and student satisfaction, as determined by the t-test (p>0.05). Additionally, the use of an ANOVA test revealed that there is no significant difference in satisfaction levels between different age groups and the Big Blue Button System (p>0.05). Moreover, the overall satisfaction rate of students with the mentioned system was less than 50%. In conclusion, it appears that students have low satisfaction with the online Big Blue Button System and its components.
Table 4: Distribution of satisfaction levels among students and employees with Adobe Connect System and its components during the COVID-19 pandemic
Component
|
Type of learners
|
Satisfaction level with the Adobe Connect System and its components
|
Statistical test result
|
Satisfaction with the component
|
Dissatisfaction with the component
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
User-friendliness of the platform's visual design
|
Employees
|
(78) 390
|
(22) 110
|
0/30
|
Students
|
(39) 110
|
(61) 270
|
0/02
|
Easy access to the system
|
Employees
|
(56) 280
|
(44) 220
|
0/09
|
Students
|
(46) 130
|
(54) 250
|
0/001
|
Instant access to content at all times
|
Employees
|
(33) 165
|
(67) 335
|
0/104
|
Students
|
(21) 80
|
(79) 200
|
0/003
|
Easy access to support services
|
Employees
|
(56) 280
|
(44) 220
|
0/02
|
Students
|
(56) 160
|
(44) 220
|
0/01
|
Appropriate timing for presenting questions and answers
|
Employees
|
(67) 340
|
(33) 160
|
0/119
|
Students
|
(39) 110
|
(61) 270
|
<0/001
|
Effective feedback within the system for questions and answers
|
Employees
|
(55) 265
|
(45) 235
|
0/02
|
Students
|
(50) 140
|
(50) 140
|
<0/001
|
Interaction between teachers and learners
|
Employees
|
(44) 220
|
(56) 280
|
0/04
|
Students
|
(50) 140
|
(50) 140
|
<0/001
|
The system time consumming
|
Employees
|
--
|
(100) 500
|
--
|
Students
|
(46) 130
|
(54) 150
|
0/002
|
Internet speed
|
Employees
|
(56) 280
|
(44) 220
|
0/69
|
Students
|
(61) 170
|
(39) 110
|
0/05
|
Increase in learning due to online nature
|
Employees
|
(22) 110
|
(78) 390
|
0/16
|
Students
|
(25) 70
|
(75) 210
|
<0/001
|
Based on the results obtained from Table 4, the highest level of employees satisfaction was related to the "user-friendliness of the platform's appearance," while the lowest level of satisfaction was associated with the "time-consuming nature of the system." Among the participating students in this study, the highest level of satisfaction was derived from the "internet speed," whereas the lowest level of satisfaction was attributed to "Easy access to content at all times.
"A meaningful correlation was observed between the satisfaction levels in the components of "easy access to support services" (P=0/02), "interaction between teachers and learners" (P=0/04), and “effective feedback within the system for questions and answers (P=0/02) in both groups. Although a meaningful correlation was found between the satisfaction levels among students and all the components of the Adobe Connect system (P<0/05), but this was not the case for employees.
Furthermore, no meaningful correlation was found between gender, age, previous learning experiences, and the satisfaction levels of learners with the Adobe Connect system using a t-test (P>0/05).
To identify meaningful differences among users satisfaction levels with the Adobe Connect online system among different age groups, an ANOVA test was employed, but no significant differences were observed in this regard (P<0/05).
Table 5: Frequency Distribution of Students' and Employees Satisfaction with the Skyroom System and its Components during the COVID-19 Pandemic
Component
|
Type of learners
|
Satisfaction level with Skyroom
|
Statistical test result
|
Satisfaction with the component
|
Dissatisfaction with the component
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
User-friendliness of the platform's visual design
|
Employees
|
(64) 350
|
(36) 200
|
<0/001
|
Students
|
(82) 230
|
(18) 50
|
0/007
|
Easy access to the system
|
Employees
|
(55) 300
|
(45) 250
|
0/06
|
Students
|
(93) 260
|
(7) 20
|
0/02
|
Appropriate volume of educational content
|
Employees
|
(58) 320
|
(42) 230
|
<0/001
|
Students
|
(86) 240
|
(14) 40
|
0/008
|
Instant access to content at any time
|
Employees
|
(48) 240
|
(52) 290
|
<0/001
|
Students
|
(57) 16
|
(43) 120
|
<0/001
|
Easy access to support services
|
Employees
|
(48) 160
|
(52) 290
|
<0/001
|
Students
|
(46) 260
|
(54) 150
|
0/04
|
Appropriate timing for submitting questions and receiving answers
|
Employees
|
(64) 350
|
(36) 200
|
<0/001
|
Students
|
(71) 200
|
(29) 80
|
0/001
|
Appropriate feedback within the system for questions and answers
|
Employees
|
(58) 320
|
(42) 230
|
<0/001
|
Students
|
(75) 210
|
(25) 70
|
<0/001
|
Interaction among learners
|
Employees
|
(64) 350
|
(36) 200
|
<0/001
|
Students
|
(68) 190
|
(32) 90
|
<0/001
|
Interaction between teachers and learners
|
Employees
|
(58) 320
|
(42) 230
|
<0/001
|
Students
|
(75) 210
|
(25) 70
|
0/003
|
Time consuming system
|
Employees
|
(64) 350
|
(36) 200
|
0/74
|
Students
|
(75) 210
|
(25) 70
|
0/45
|
Internet speed
|
Employees
|
(58) 320
|
(42) 230
|
0/007
|
Students
|
(68) 190
|
(32) 90
|
0/31
|
Increased learning due to being online
|
Employees
|
(61) 340
|
(39) 210
|
0/005
|
Students
|
(71) 200
|
(29) 80
|
0/003
|
Based on the results obtained from Table 5, the highest level of employees satisfaction was related to the components of "user-friendliness of the platform's visual design," "appropriate timing for submitting questions and answers," "interaction among learners," and "time consuming system." On the other hand, the lowest level of satisfaction was associated with the components of "Instant access to content at any time" and "easy access to support services." Among the students, the highest level of satisfaction with the components was related to "easy access to the system," while the lowest level was associated with "easy access to support services."
By conducting a t-test on a group of students and considering P<0.05, a significant correlation was found between students satisfaction with all components of the SkyRoom System except for "time consuming system" and “internet speed”. Similarly, among the employees, a significant correlation was observed between employees satisfaction and other components of the SkyRoom System, except for " time consuming system " and "easy access to the system," based on the t-test with P<0.05.
To examine the relationship between learners' satisfaction with the SkyRoom System and gender, experience, and previous experiences in virtual training, a t-test was employed. It was determined that among the students, there was no significant difference in satisfaction with the SkyRoom System based on demographic factors, given P>0.05. However, among the employees, a significant difference in satisfaction with the SkyRoom System was observed based on their previous experiences with virtual training (P=0.02). This indicates that users with prior experiences with virtual training through this system are more satisfied compared to those who are using the system for the first time.
By conducting a t-test with P=0.02, a significant difference in satisfaction between the two user groups was observed, with students exhibiting higher satisfaction with the SkyRoom System compared to employees. However, both students and employees expressed relatively high satisfaction with the online SkyRoom system in e-learning.
Table 6: Frequency distribution of satisfaction levels of students and employees with Skype software and its components during the COVID-19 pandemic
Component
|
Educational institution
|
Satisfaction level with the Skype software
|
Statistical test result
|
Satisfaction with the component
|
Dissatisfaction with the component
|
Number (percentage)
|
Number (percentage)
|
Pvalue
|
User-friendliness of the platform's appearance
|
Employees
|
(74) 410
|
(26) 70
|
0/03
|
Students
|
(83) 240
|
(17) 40
|
0/006
|
Easy access to the software
|
Employees
|
(97) 520
|
(3) 60
|
0/85
|
Students
|
(93) 260
|
(7) 20
|
0/20
|
Appropriate volume of educational content
|
Employees
|
(82) 450
|
(18) 100
|
<0/001
|
Students
|
(62) 180
|
(38) 100
|
<0/001
|
Instant access to the content
|
Employees
|
(84) 471
|
(16) 39
|
0/002
|
Students
|
(83) 240
|
(17) 40
|
0/01
|
Appropriate timing for presenting questions and answers
|
Employees
|
(83) 460
|
(17) 90
|
<0/001
|
Students
|
(79) 220
|
(21) 60
|
<0/001
|
Appropriate feedback in the system to questions and answers
|
Employees
|
(66) 370
|
(34) 180
|
<0/001
|
Students
|
(66) 190
|
(34) 90
|
<0/001
|
Interaction among learners
|
Employees
|
(58) 320
|
(42) 230
|
<0/001
|
Students
|
(76) 210
|
(24) 70
|
<0/001
|
Interaction between the instructor and learners
|
Employees
|
(55) 300
|
(45) 250
|
<0/001
|
Students
|
(76) 210
|
(24) 70
|
<0/001
|
Time consuming system
|
Employees
|
(34) 200
|
(66) 350
|
0/1
|
Students
|
(41) 120
|
(59) 160
|
0/07
|
According to Table 6, the highest level of employees satisfaction was related to "easy access to the system," while the lowest satisfaction level was associated with “Time consuming system." Similarly, students expressed higher satisfaction with the component of "easy access to the system" and lower satisfaction with "Time consuming system."
Through conducting t-tests in each group of learners and considering the significance level of P<0/05, a significant relationship was observed between the satisfaction levels of students and employees with all the software components of Skype, except for the components of " Time consuming system " and "easy access to the software."
To determine the relationship between users' satisfaction with the Skype software and their gender, age, and previous experiences with virtual learning, t-tests were used, which indicated that no significant relationship was found with a significance level of P>0/05.
Furthermore, to find a significant relationship between the satisfaction levels of employees and students in different age groups, ANOVA tests were employed, revealing that no significant relationship was observed in any age group (with a significance level of P>0/05).
By conducting a t-test with a significance level of P=0.142, no significant difference in satisfaction levels was observed between these two user groups of Skype.
Table 7: Distribution of satisfaction levels among students and employees based on virtual education, platforms, and software during the COVID-19 pandemic
Type of education, platforms, and software
|
Type of learners
|
Level of satisfaction
|
Stages of satisfaction
|
Statistical test result
|
Satisfaction
|
Dissatisfaction
|
Number
|
Percent
|
Number
|
Percent
|
p-value
|
Virtual education
(Offfline+Online)
|
Employees
|
288
|
52
|
262
|
48
|
Relative dissatisfaction towards deterioration
|
0/031
|
Students
|
150
|
53
|
130
|
47
|
Relative dissatisfaction towards deterioration
|
Asynchronous education (Navid)
|
Employees
|
188
|
67
|
362
|
33
|
Relative satisfaction
|
0/171
|
Students
|
129
|
46
|
151
|
54
|
Low satisfaction
|
Big blue button
|
Employees
|
-
|
-
|
-
|
-
|
-
|
-
|
Students
|
141
|
51
|
139
|
49
|
Relative dissatisfaction towards deterioration
|
Adobe connect
|
Employees
|
259
|
47
|
291
|
53
|
Low satisfaction
|
0/197
|
Students
|
124
|
44
|
156
|
56
|
Low satisfaction
|
Skyroom
|
Employees
|
320
|
58
|
230
|
42
|
Relative satisfaction
|
0/02
|
Students
|
202
|
72
|
78
|
28
|
Relative satisfaction towards improvement
|
Skype
|
Employees
|
389
|
70
|
161
|
30
|
Relative satisfaction towards improvement
|
0/142
|
Students
|
207
|
73
|
73
|
27
|
Relative satisfaction towards improvement
|
Online education
|
Employees
|
327
|
60
|
223
|
40
|
Relative satisfaction
|
0/954
|
Students
|
168
|
60
|
112
|
40
|
Relative satisfaction
|
As observed in the results of Table 7, employees and students of Tehran University of Medical Sciences expressed a relatively lower satisfaction with virtual learning during the COVID-19 pandemic. Although there was a significant difference in satisfaction between these two groups of learners regarding virtual education, with employees who were simultaneously undergoing training courses while working showing higher satisfaction compared to students (p = 0.031). Furthermore, the significant difference in satisfaction between these two groups of learners regarding virtual education was confirmed through the POST-HOC test (p = 0.02).
In addition, selected faculty students expressed a low satisfaction with asynchronous learning (Navid system), while employees showed relative satisfaction with the Navid system. However, no significant difference in satisfaction between these two groups of learners during the COVID-19 pandemic was observed regarding the Navid system as an asynchronous e-learning platform (p = 0.171).
Both groups of learners (students + employees) expressed relative satisfaction with various online learning systems and software during the COVID-19 pandemic at the university, although no significant difference in satisfaction between these two groups was found (p = 0.954).
Among the various online learning systems and software, the highest level of satisfaction reported by both employees and students was related to the Skype System, although no significant difference in satisfaction between these two groups of learners regarding this system was identified (p = 0.142).
The lowest level of satisfaction among learners was associated with the Adobe Connect System for online education. However, no significant difference in satisfaction between students and employees regarding this system was reported (p = 0.197).
Among the components of virtual education, asynchronous training (Navid system) and online training the highest level of user satisfaction was related to system and software flexibility, effective feedback in questions and answers, interaction between teachers and faculty members and learners, provision of support services, and user-friendliness of the platform. The lowest level of satisfaction was associated with internet speed and system downtime.
Among demographic characteristics, the age of learners was a factor that showed a significant relationship with the satisfaction of learners with online education, asynchronous learning (Navid system), and overall electronic education or e-learning. As age increased, learner satisfaction with learning and electronic education also increased (p = 0.002, p = 0.01). However, no significant relationship was observed between learner satisfaction and gender or previous experience with electronic learning systems (p > 0.05).