DOI: https://doi.org/10.21203/rs.2.18687/v2
The process of evaluation is one of the cornerstones of educational management. It is best defined as a periodic process to assess overall academic work [1]. ‘Educational environment’ is a complex term that refers to the social, psychological, and physical locations where students learn [2, 3]. In addition to the infrastructure and university setting, it encompasses the attitude of teachers inside the class and the methods they use to deliver learning materials to students. It also includes the type of curriculum and the methods of teaching used to deliver the curriculum. Collectively, the educational environment can be defined as everything that affects the learning process whether directly or indirectly [4].
It is widely accepted that evaluation of the learning environment in a medical school is one of the major components of medical school program appraisal. It is postulated that learning environment affects the ability of students to learn [3]. Moreover, Lizzio et al. reported an association between the learning environment and development of students’ basic skills, academic achievement and learning satisfaction [5]. Successful intervention at the curriculum level needs constructive periodic feedback from students themselves. Thus, identification of areas of concern that hinder students’ academic performance is of paramount importance for faculty, curriculum planners and institute directors [6]. A sensitive and reliable assessment tool is needed to measure the learning environment in a scientific way, and it should be able to express and represent the data quantitatively.
In 1997, a Dundee University team presented an assessment tool that could measure the environment and the atmosphere for education in a medical school. It was named the ‘Dundee Ready Educational Environment Measure’ (DREEM). This tool was accepted worldwide as a reliable and valid assessment tool to measure the environment of medical schools. This universal consensus may be attributed to its method of development. First, it involved almost 100 medical educators from around the world using Grounded theory and a Delphi procedure. Second, it had been used with over 1000 medical students internationally. Third, it combines quantitative and qualitative methods that consider many different nationalities and cultures, and is not biased towards a specific community [7, 8].
There are few studies conducted in sub-Saharan Africa using the DREEM inventory to measure the educational environment [9–11]. In Sudan, there are 32 public and 42 private medical schools [12]. Only 2 out of the 32 public medical schools have reported DREEM scores for their students [13, 14]. Al-Nahda College is a private college established in Khartoum, Sudan with its first intake of students in 2013. The curriculum used in the college is a modified integrated curriculum. Since its establishment the curriculum of the college has not been reviewed and no feedback has been received from students. Therefore, the current study was conducted to describe student perceptions about the educational environment at the college and to identify areas of strength that need to be maintained, and areas of weaknesses which need improvement for the enhancement of the educational environment as a whole. The results of this study may be used as baseline data for future interventions in the curriculum.
This was an institutional-based cross-sectional study. It was conducted in Al-Nahda College between January and February 2018. The study sample comprised medical students of all academic levels (first to fifth year). Al-Nahda University College uses an integrated curriculum with both longitudinal themes and horizontal integrated block modules. On completion of five academic years, graduates obtain a Bachelor of medicine and Bachelor of surgery (MBBS). In the first three years systems courses emphasize basic sciences with some clinical background. Pure clinical teaching is applied for the final two years. The total number of students in the Medicine and Surgery Program is 874 students. We used the total coverage approach to sampling and tried to collect responses from the majority of students. The study was explained to all students by one of the investigators who had received training on data collection and communication with students over the course of one day. The investigator approached the students to participate in the study in the class after a lecture. Those who agreed to participate were asked to fill in the questionnaire without writing their names. The questionnaire was in English, which was not a problem as the medium of teaching at the college is also English. The investigators added some demographic data that included age, gender, academic level and nationality.
Data were collected using the Dundee Ready Measure for Educational Environment (DREEM) questionnaire, which is composed of 50 questions each scored by 0–4 on a five-point Likert scale (strongly agree = 4; agree = 3; uncertain = 2; disagree = 1; strongly disagree = 0). The scale has nine questions where scoring is reversed (numbers 4, 8, 9, 17, 25,35,39,48 and 50) to take into account negative wording. The maximum score of the overall scale is 200. The interpretation of the overall score is as follows: 0–50 indicates very poor educational environment; 51–100 indicates many problems; 101–150 more positive than negative and 151–200 suggests an excellent educational environment. The scale contains five subclasses as follows:
Students’ perception of learning:
This domain contains 12 questions with a maximum score of 48. The scores are interpreted as follows: 0–12, 13–24, and 25–36 are interpreted as very poor, negative, and a more positive approach, respectively [15].
I. Students’ perception of teachers:
This domain contains 11 questions with a maximum score of 44. The scores are interpreted as follows: 0–11, 12–22, 23–33, and 34–44 are considered as abysmal, in need of some retraining, moving in the right direction, and model teachers, respectively [15].
II. Students’ academic self-perception:
This domain contains eight questions with a maximum score of 32. The scores are interpreted as follows: 0–8, 9–16, 17–24, and 25–32 are interpreted as a feeling of total failure, many negative aspects, feeling more on the positive side, and confident, respectively [15].
III. Students’ perception of atmosphere:
This domain contains 12 questions with a maximum score of 48. The scores are interpreted as follows: 0–12, 13–24, 25–36, and 37–48 were considered as a terrible environment, there are many issues that need to change, a more positive atmosphere, and a good feeling overall, respectively [15].
IV. Students’ social self-perception:
This domain contains seven questions with a maximum score of 28. Scores can be interpreted as follows: 0–7, 8–14, 15–21, and 22–28 were considered as miserable, not a nice place, not too bad, and very good socially, respectively [15]. Further, every item can be considered as an area that needs particular attention, an area that can be improved or a strong area based on scores ≤ 2.0, 2–3 and ≥ 3.5, respectively [15].
Statistical analysis
Data were entered, double-checked and analysed using Statistical Package for Social Sciences (SPSS) (version 24; SPSS Inc. Chicago, IL, USA). The data were expressed as mean (SD) or number (%). Students’ gender, nationality and academic level were used as independent variables. Linear regression analysis took place using the DREEM score as dependent variable and students’ gender, academic level and nationality as independent variables. The mean (SD) of DREEM overall score and subclass score were compared between five academic levels of the students using one-way ANOVA followed by Tukey’s test. The mean (SD) of DREEM overall score and subclass score were compared between males and females, and between clinical (4th and 5th level) and pre-clinical (1st–3rd level) students by using Student’s t-test after checking the variance. P-values ≤ 0.05 were considered statistically significant.
A total of 670 students were successfully approached and 36 refused to participate. The response rate was 94.6%. A total of 634 medical students participated in the study representing all academic levels including pre-clinical (83.9%) and clinical (16.1%) students. Three hundred and sixty-one participants (56.9%) were male. Five nationalities participated in this study, namely: Sudanese, Nigerian, South African, Syrian, and Egyptian students. Sudanese nationality was the most common (71.9%), while Nigerian (18.1%) was the most common nationality for foreign students and Egyptian was the least common (1.3%) (Table 1).
The overall DREEM score in this study was 130, which indicates a more positive educational environment than negative. Likewise, students’ perceptions of teachers, academic self-perception, perception of atmosphere and social self-perception were also positive. However, student perception of learning showed a negative indicator (Table 2).
Females had a significantly higher mean (SD) overall DREEM score than male students [136 (31.5) vs. 129 (35.5); P=0.008]. Also, females scored higher than males in the subclasses regarding student perception of teachers, academic self-perception and social self-perception, [28.8 (7.8) vs. 27.1 (8.5); P=0.024]; [22.2 (5.6) vs. 21.0 (7.2); P=0.017]; [19.8 (4.9) vs. 18.8 (5.4); P=0.019], respectively. Grouped (clinical and pre-clinical) and separated academic levels did not show any significant effects in the perception of the students towards the overall DREEM score or the subclasses (Table 3 and Table 4). None of the detailed items scored less than 2 or more than 3 (Table 5). The linear regression analysis model showed that student gender significantly affects overall DREEM score [7.65± 2.91; P-value= 0.009] (Table 6).
To the best of our knowledge, this is the first DREEM study reported from a private medical school in Sudan. The major finding is that the overall DREEM score of 130/200 indicates a more positive than negative educational environment in the Al-Nahda medical program. This result is in-line with Ahmed et al., and Salih et al., who conducted studies in public national universities in Sudan, namely the University of Al-Gezira and Bahri University where scores of 122/200 and 125.2/200 were obtained, respectively [13, 14]. The positive scores in these studies, as well as our own, point to a well-established infrastructure, an integrated and student-centred curriculum, skilful teachers and a good social-environment. Each of these aspects has been key for Al-Nahda College since its establishment. The result is comparable to other international medical schools like Ziauddin University in Pakistan (117/200), King Abdul Aziz University (102/200), Taibah University (120/200) and Qassim University in Saudi Arabia (112/200) [16–19]. However, the score exceeds that of medical schools at Jazan University (96.5/200), King Saud University in Saudi Arabia (90/200), and Guilan Medical University in Iran (100/200). Scores from these institutes indicate educational environments with many problems [20–22] despite the fact that these three institutes were established in economically powerful countries with ample logistics and resources. Students perceive a negative educational environment, suggesting that economic power is not the only determinant of the educational environment and there are other factors beyond the facilities of the educational environment [20]. The DREEM inventory was used to measure the educational environment as it is widely accepted as a reliable way to compare educational environments in different medical schools around the world. DREEM considers international differences in culture, moral issues and languages. DREEM has strong psychometric properties which enable the tool to be used to evaluate medical schools for international comparison in a valid and reliable way [23].
In the current study, students perceived their teachers positively. However, student perception of learning indicates a negative perception. A positive perception of teachers is an outcome of a faculty continuous development plan implemented by the Educational Development Centre and aimed at enhancing the faculty’s capacities in preparation and delivery of teaching materials, setup of blue-printing, standard settings and student assessment. Moreover, the college follows a specific and rigorous recruitment procedure that ensures selection of staff with the highest academic grades and strong academic teaching experience. This finding is in line with other universities in Sudan and outside of it [13, 24].
Student academic self-perception was positive in our study with a score of 21.5/32. Academic self-perception is defined by Kohli and Dhaliwal as being “related to ability of the students to cope with the academic workload” [25]. Although many studies report low scores and negative perceptions in this domain, indicating a global challenge [26, 27], our result is similar to that reported by other studies from Sudan (21/32) and Malaysia (20.6/32) [11,14]. Well-designed and prepared timetables – with more time allocated to self-directed learning – are a leading cause for this positive perception. However, delivery of many teaching activities in a very restricted time is considered a challenge in medical education. Whether the teaching curriculum is traditional or innovative [26, 27], students often feel overloaded by academic duties and this overwhelming sensation may result in frustration and sometimes depression [28]. Female students had academic self-perception that was significantly more positive than that of their male counterparts. Australian DREEM supports our findings [29].
Student perception of the atmosphere in our study scored 32.7/48 and showed a more positive perception than other DREEM reports from Sudan (26/48) and Saudi Arabia (30.2/48) [11, 16]. Educational atmosphere refers to the teaching class and clinical setup, and teachers’ behaviour during the teaching sessions and clinical rounds. It also includes curriculum design and academic regulation. Some reports indicate that a teacher-centred curriculum focused on lecturing is boring [30, 31]. Here students are subjected to a less motivating environment in contrast to problem-based learning [32]. There were neither gender nor academic ranking differences in the perception of this domain.
In this study, students perceived their social life as more positive (19.2/28) than in many institutes in Sudan (17/28), Pakistan (15.4/28) and Malaysia (16.7/28) [13, 17, 33]. These findings regarding social life in this study are not surprising and may be partially attributed to the out-of-class activities, journeys and open cultural days regularly organized by the students’ deanship. These journeys and open days create a robust social environment and relationships between students and with the academic and administrative staff. Moreover, the student mentoring program is one of the important determinants of the social life which ensures a strong psychological support and feedback system [25]. Although the mentoring program is not well known, an advisory program for students was implemented in the last two years with aims very close to those of a mentoring program. Female students perceived the social life significantly more positively than male students, as was seen at the College of Medicine at Taibah University [19].
Students’ perceptions of learning indicated a negative educational environment. This is a major concern for many international universities [26, 34–36]. To obtain a good learning perception, researchers recommend structured learning for clinical and theoretical teaching. Moreover, more time should be allocated for tutorial sessions, and the adoption of small teaching group techniques and other innovative approaches [37]. Although there was no item that scored below 2 in this subscale, items that scored lowest were: “I am clear about the learning objectives of the course” and “I am encouraged to participate during teaching sessions”. Clarity of learning objectives is a cornerstone of adult learning principles, and participation in discussions reflects students’ cognitive activity [38]. This subscale suggests need for urgent intervention that includes: explaining of the learning objectives to the students for each teaching session or at least for every module. Small group discussions should be held more frequently and with encouragement for each student to participate in the session. This domain should be considered at the time of curriculum appraisal and in all long-term planning.
In this study we observed that females perceive the overall educational environment, their teachers, their academic and social self-perception significantly more positively than male counterparts. There is no clear reason for this, however, it may be attributed to the way of thinking, learning style, concern and interest of the female gender over the male gender [39]. Possibly, gender bias favouring female teaching and assessment is the case here [40]. From another point of view, Makhdoom and his colleagues observed that high academic achievers specifically perceived their teachers far more positively than non-academic achievers. Perhaps female students constitute a high proportion of the higher academic achievers. However, we did not enquire about academic achievement in this study. More than three decades ago Carol Gilligan and Susan Pollak (1988) noted:
The increasing number of women entering the medical profession prompts a rethinking of medical education. Like the canaries taken into mines to reveal the presence of unseen dangers, women medical students in their heightened sensitivity to detachment and isolation often reveal the places in medical training and practice where human connection has become dangerously thin [41].
Perhaps, this high female sensitivity has led to the differences noted in the perception of the majority of the domains.
In this study, students’ ranking (clinical or pre-clinical) failed to show any significant difference in the overall DREEM score or any of the subscale domains. This may be attributed to the motivation and excitation associated with the admission to the school of medicine and a feeling of determination in the pre-clinical phase. Students in the clinical phase may be fully aware of the complexity of the clinical phase and the efforts needed for bedside teaching so they may be more realistic. However, they are still optimistic about their future as they are about to leave student life behind and become a doctor. Findings in the literature are conflicting [13, 39, 42].
This is the first study that documents the educational environment in Al-Nahda College and it has many limitations. First, although the DREEM inventory is well structured, valid and reliable, it is long and students may have become bored when responding to the items, which may then have affected the responses obtained. Second, educational environment is a complicated issue that the predetermined options in DREEM may be too limited to address. Further study is needed to reassess the educational environment in Al-Nahda College after considering all the domains that need intervention and including the variables that are missing in this version, like students’ grade point average (GPA), admission scores and secondary certificate type.
The overall DREEM score indicates that the educational environment was perceived as positive by the medical students. Four subscales were positive: students’ perception of teachers, academic self-perception, perception of atmosphere and social self-perception. The students’ perception of learning was negative. Female students perceived the educational environment significantly more positively than male students. The perception of clinical students did not differ from that perceived by pre-clinical students. Further study is needed to develop the work that has been initiated here.
DREEM Dundee Ready Educational Environment Measurement
GPA Grade point average
IL Illinois
Inc Incorporation
MBBS Bachelor of Medicine and Bachelor of surgery
SASP Students’ academic self-perception
SD Standard deviation
SPA Students’ perception of atmosphere
SPL Students’ perception of learning
SPSS Statistical package for social sciences
SPT Students’ perception of teachers
SSSP Students’ social self-perception
UK United Kingdom
USA United states of America
WFME World Federation for Medical Education
Ethics approvals and consent to participate
The study received ethical clearance from AL-Neelain University Research Ethics committee. All participants provide written informed consent.
Consent for publication
Not applicable
Availability of data and materials
Authors confirm that they are ready to provide the study data and materials upon request.
Competing interests
None to declare.
Funding
Not applicable.
Authors’ contributions
HZH and NMA concepted and designed the study. MYI, RHM and LHA conducted the study. YMA, HZH and NMA shared in the statistical analyses. NMA, HZH and YMA share in drafting the paper. All of the authors drafted and approved this version of the paper.
Acknowledgements
The authors wish to thank all students who participate in this study and the administrative team in Al-Nahda College.
Table 1: Background charecteristics of the study population
Variable |
N (%) Or Mean (SD) |
Age, years |
19.6 (1.5) |
Gender Male Female |
361 (57.0) 273 (43.0) |
Academic level 1st year 2nd year 3rd year 4th year 5th year |
129 (20.3) 260 (41.0) 143 (22.6) 80 (12.6) 22 (3.2) |
Nationality Sudanese Nigerian South African Syrian Egyptian |
456 (71.9) 115 (18.1) 46 (7.3) 9 (1.4) 8 (1.3) |
Table 2: DREEM overall score and subclass score among Al-Nahda Medical Students
Domain |
Number of items |
Maximum score |
Al-Nahda College findings Mean (SD) |
Rating |
DREEM overall |
50 |
200 |
130 (34.2) |
More positive than negative |
Students’ perception
|
12 |
48 |
24 (6.0) |
Negative |
Students’ perception
|
11 |
44 |
28 (8.3) |
Moving in the right direction |
Students’ academic self-perception |
8 |
32 |
21.5 (6.6) |
More positive |
Students’ perception of atmosphere |
12 |
48 |
32.7 (8.3) |
More positive atmosphere |
Students’ social
|
7 |
28 |
19.2 (5.2) |
Not too bad |
Table 3: Determinant of students’ perception according to DREEM overall and sub-class
Variables |
DREEM overall score |
Students’
|
Students’
|
Students’
|
Students’
|
Students’
|
Mean (SD) |
||||||
Gender Male Female
P-value |
129 (35.5) 136 (31.5)
0.008 |
23.7 (6.1) 24.5 (5.8)
0.082 |
27.1 (8.5) 28.8 (7.8)
0.024 |
21.0 (7.2) 22.2 (5.6)
0.017 |
32.5 (8.7) 33.07 (7.7)
0.407 |
18.8 (5.4) 19.8 (4.9)
0.019 |
Academic level Pre-clinical Clinical
P-value |
132.0 (33.3) 132.8 (38.3)
0.946 |
24.0 (6.0) 24.3 (6.1)
0.780 |
27.7 (8.1) 28.2 (9.0)
0.821 |
21.5 (6.5) 21.5 (7.3)
0.922 |
32.6 (8.1) 33.0 (9.3)
0.954 |
19.1 (5.2) 19.5 (5.3)
0.658 |
|
|
|
|
|
|
|
Table 4: DREEM overall score and subclass score among Al-Nahda Medical Students detailed by academic levels
DREEM domain |
1st year n=129
|
2nd year n=260
|
3rd year n=143
|
4th year n= 80
|
5th year n=22
|
P-value* Between groups |
Mean (SD) |
|
|||||
Students’ perception
|
23.7(6.4) |
24.2(5.6) |
24.1 (6.2) |
24.1(6.2) |
24.8(6.0) |
0.910 |
Students’ perception
|
27.5(9.3) |
28.1(6.8) |
28.2(9.3) |
28.1(6.3) |
28.6(9.0) |
0.959 |
Students’ academic self-perception |
20.7(7.6) |
22.2(5.3) |
21.3(7.5) |
21.4(6.2) |
20.9(7.3) |
0.394 |
Students’ perception of atmosphere |
32.5(9.4) |
33.0(6.5) |
33.1(9.6) |
32.8(9.3) |
33.5(9.7) |
0.973 |
Students’ social
|
18.8(5.7) |
19.3(4.8) |
19.4(5.4) |
19.1(4.4) |
20.0(5.22) |
0.822 |
Overall DREEM score |
128.5 (39.5) |
135.9(26.0) |
132.1(38.6) |
132.0(38.3) |
135.6(39.1) |
0.399 |
*ANOVA followed by Tukey’s test.
Table 5: Detailed item scores for educational environment of medical school in Al-Nahda College
Item |
Statement
|
Mean (SD) |
|
Students’ perception of Learning |
|
|
I am encouraged to participate during teaching sessions. |
2.08 (1.59) |
|
The teaching is often stimulating |
3.20 (0.663) |
|
The teaching is students centered |
3.05 (1.169) |
|
The teaching helps to develop my competence |
2.97 (1.138) |
|
The teaching is well focused |
2.56 (1.170) |
|
The teaching time is put to good use |
2.59 (1.104) |
|
The teaching over emphasizes factual learning |
2.89 (1.086) |
|
The teaching helps to develop my confidence |
2.65 (1.041) |
|
I am clear about the learning objectives of the course |
2.19 (1.363) |
|
The teaching encourages me to be an active learner |
2.59 (1.180) |
|
Long term learning is emphasized over short term learning |
2.37 (1.166) |
|
The teaching is too teacher centered |
2.59 (0.981) |
|
Students’ perception of teachers |
|
|
The course teachers are knowledgeable. |
2.27 (1.36) |
|
The teachers are patient with patients/ students’ consultations |
2.93 (0.860) |
|
The teachers ridicule the students |
2.92 (1.065) |
|
The teachers are authoritarian |
2.98 (1.156) |
|
The teachers have good communication skills with patients |
2.47 (1.220) |
|
The teachers are good at providing feedback to students |
2.69 (1.329) |
|
The course teachers provide constructive criticism here |
2.59 (1.269) |
|
The teachers give clear examples |
2.30 (1.372) |
|
The teachers get angry in teaching sessions |
2.10 (1.332) |
|
The teachers are well prepared for their teaching sessions |
2.18 (1.408) |
|
The students irritate the course teachers |
2.65 (1.220) |
|
Students’ academic self-perception |
|
|
Learning strategies which worked for me before, continue to work for me now. |
2.95 (1.120) |
|
I am confident about my passing this year |
2.85 (1.192) |
|
I feel I am being well prepared for my profession |
2.92 (0.875) |
|
Last years work has been a good preparation for this years work |
2.71 (1.369) |
|
I am able to memorize all I need |
2.44 (1.323) |
|
I have learnt a lot about empathy in my profession |
2.66 (1.325) |
|
My problem-solving skills are being well developed here |
2.48 (1.128) |
|
Much of what I have to learn seems relevant to a career in healthcare |
2.65 (1.031) |
|
Students’ perception of atmosphere |
|
|
The atmosphere is relaxed during teaching |
2.95 (0.961) |
|
The school is well timetabled |
2.82 (1.117) |
|
Cheating is a problem in this school |
2.76 (1.194) |
|
The atmosphere is relaxed during lectures/clinical rounds |
2.59 (1.158) |
|
There are opportunities for me to develop interpersonal skills |
2.92 (1.160) |
|
I feel comfortable in teaching sessions socially |
2.72 (1.084) |
|
The atmosphere is relaxed during seminars / tutorials |
2.85 (0.989) |
|
I find the experience disappointing |
3.11 (1.056) |
|
I am able to concentrate well |
2.44 (1.261) |
|
The enjoyment outweighs the stress of the course |
2.65 (1.220) |
|
The atmosphere motivates me as a learner |
2.35 (1.149) |
|
I feel able to ask the questions I want |
2.79 (0.937) |
|
Students’ social-self-perception |
|
|
There is a good support system for students who get stressed. |
2.57 (1.183) |
|
I am too tired to enjoy the course. |
2.53 (1.259) |
|
I am rarely bored on this semester |
2.89 (1.108) |
|
I have good friends on this school |
3.04 (1.065) |
|
My social life is good |
2.60 (0.898) |
|
I seldom feel lonely |
2.92 (1.164) |
|
My accommodation is pleasant |
2.72 (0.959) |
Table 6: Linear regression analysis model to predict affector of overall DREEM score
Variable |
β |
SE |
P-value |
95% CI |
Students’ Gender |
7.65 |
2.91 |
0.009 |
1.94 - 13.37 |
Academic level |
0.65 |
1.33 |
0.622 |
-1.96 - 3.28 |
Nationalities |
2.91 |
1.79 |
0.105 |
-0.61 - 6.43 |