Gender Differences in the Effect of Medical Humanities Program on Medical Students' Empathy: A Prospective Longitudinal Study

Abstract

Objective: Previous studies have suggested that Medical students' empathy declines during medical school, especially during the clinical studies. The aim of this study was to examine. changes in medical students' empathy during their first clinical experience, and to determine the impact of gender and humanities curriculum on empathy changes.  

Methods: In this prospective longitudinal study, 262 4^th year students from three consecutive classes were assessed. Empathy was assessed before and at 4^th-year-end, using the Jefferson Scale of Physician Empathy-Student Version (JSPE-S). The three classes differed in humanities curriculum [limited Medical Humanities (MH_(lim)) vs. extended Medical Humanities (MH_(ext))], and in admission system [Personal Interview (PI) vs. multiple mini interviews (MMI)]. Results: Overall, there was a small but significant decrease in JSPE-S during the fourth year (114.40±11.32 vs. 112.75±14.19, p= 0.034). Among men there was a statistically significant decline in JSPE-S during the fourth year, and the MH_(ext) (but not the MH_(lim)) was associated with the decline (t₍₃₅₎ = 2.38, p = 0.023). Women students showed no decline in empathy during the fourth-year of studies, regardless of type of humanities program. In addition, women who participated in MH_(ext) had a higher JSPE-S scores during the 4^th -year as compared to women who participated in MH_(lim).

Conclusion: Pre-clinical humanities program was associated with a decline in empathy among men medical students during the fourth-year of medical studies. Gender differences in response to medical humanities programs require further study. 

Background

Enhancing physician's empathy towards patients is recognized as an important aim of medical education [1, 2, 3]. Empathy is defined [3] as involving cognitive and emotional domains [4]. 'The cognitive domain of empathy involves the ability to understand another person’s inner experiences and feelings and a capability to view the outside world from the other person’s perspective. The affective domain involves the capacity to enter into or join the experiences and feelings of another person' [5].

Empathic patient-doctor communication can increase patients' trust and satisfaction [6, 7], increase adherence to treatment [7, 8], and also reduce the number of legal claims against primary care physicians [9]. However, most of the studies on empathy changes during medical studies have suggested that empathy declines, rather than increases during studies [1, 10-12]. In a cross-sectional study of empathy among medical students, Chen et al. showed that first-year students had the highest empathy scores whereas the fourth-year students had the lowest scores [10]. Two longitudinal studies showed a decline in empathy during medical studies [1,11]. Interestingly, most of the studies showing a decline in empathy during medical school have suggested that the decline is largest following students' exposure to clinical life during clerkships [1,10-12]. Reviews of studies reporting on empathy at various stages of physician training suggested that empathy declines during medical school and residency [13], however the decline was suggested to be small [14].

Studies have reported on higher empathy scores among women medical students as compared to men [1,11,15- 17]. However, reports on the effect of gender on empathy changes among medical students’ have yielded inconsistent findings. While similar patterns of empathy decline have been reported in men and women in some studies [1,11,15], one study found that empathy declined between the third and the fourth-year of medical studies only in men but not in women [16].

Educational interventions have been suggested to prevent empathy decline during medical studies (18-23). Previous studies have reported on higher empathy in women as compared to men, following such educational interventions [22, 23].

The main aim of the present study was to examine changes in medical students' empathy during the first clinical year in medical school, and to determine whether gender and humanities curriculum moderate potential findings. An additional aim was to contribute to the validity evidence of the Hebrew version of the JSPE-S by examining its relationship with an established measure of empathy.

We hypothesized that students' empathy will decline during their first clinical year of medical studies, and that an extensive 3-year preclinical medical humanities curriculum would prevent this decline.

Methods

The study was approved by the ethical committee of Hadassah Medical School. Informed consent was signed by all participants.

Context- Structure of Medical studies

The Hadassah Hebrew University of Jerusalem Medical School offers a six-year program. The first three years includes basic sciences and preclinical studies. During the first three years of studies, exposure to patients and everyday hospital life is limited and occasional. During the following three years, students attend hospitals or outpatient clinics in small groups on a daily basis. Thus, the first students' significant clinical experience occurs at the fourth-year of studies.

Study cohorts

The study included three consecutive cohorts, differing in humanities curriculum and admission system. The participation in the humanities program in each year was mandatory, thus each class was obligated to participate in the program offered in that year (limited/extended). The three consecutive cohorts included (Figure 1): 
(1) PI/MH_(lim)  cohort: Personal Interview (PI), limited Medical Humanities program (MH_(lim) ) (n=91).

(2) MMI/MH_(lim) cohort: multiple mini interviews (MMI), (MH_(lim) ) (n=86).
(3) MMI/MH_(ext) cohort: MMI, extended Medical Humanities program (MH_ext) (n=85). 

Admission system

In the admission process, candidates to the Hadassah Hebrew University of Jerusalem Medical School are invited to an interview based on their Psychometric entrance test scores (Israeli version of SAT's) and undergraduate academic scores.  The first cohort (PI/MH_(lim)) went through an admission process that included a panel-style personal interview, in which three examiners interviewed each candidate for about 45 minutes. The second and the third cohorts (MMI/MH_(lim) and MMI/MH_(ext)) went through a multiple mini interviews (MMI)-based admission process. The MMI is an OSCE-style exercise, consisting of multiple, focused interviews that , in which candidates have a limited time to discuss an issue with an interviewer, or to demonstrate the capacity to work through a challenging interpersonal situation presented by an actor. The MMI is designed to dominantly focus on ethical and communication issues, and to evaluate traits such as motivation, responsibility, self-awareness and interpersonal skills. It is intended to assess skills that are inadequately assessed by the personal interview. Another advantage of the MMI over the panel-style interview is that multiple interviews may dilute the effect of chance and various biases [24].

Humanities program

The PI/MH_(lim) and the MMI/MH_(lim) cohorts included a pre-clinical humanities curriculum that was limited to the first year of medical school. The third cohort (MMI/MH_(ext)) participated in an extensive and comprehensive three-year pre-clinical curriculum.

The extended pre-clinical humanities program was taught during the first three years of medical school, including the following courses:

During the first year of medical studies the program included the 'Human and Medicine' course on patient- doctor communication, cultural competency in medicine, basic principles of medical ethics, and physician professionalism. In addition, the first year course included early clinical exposure and community medicine. During the second year of medical studies the program included courses such as history of medicine, medicine and literature, physicians and holocaust, narrative medicine. During the third year of studies the program included the following courses: medicine and law, introduction to human sexuality and introduction to breaking bad news [25].

Study population

342 medical students consented to participate in the study. 264 (77%) of these provided full answered questionnaires on the beginning of the 4^th year. Among these, two students had a repetitive filling pattern which wasn’t consistent with the content of the questionnaire and were excluded. Out of the remaining 262 medical students, 35 (13.4%) students did not fill the end of year questionnaires. Thus, 227 students were included in the longitudinal analyses.

Instruments

Interpersonal Reactivity Index (IRI)

The IRI is a validated 28-item self-report measure consisting of four 7-items subscales, each tapping some aspect of the global concept of empathy. The Perspective-Taking scale assesses the tendency of spontaneously adopting the psychological point of view of others; the Fantasy scale taps respondents’ tendencies to identify with feelings and actions of fictitious characters in books, movies and plays. The Empathic Concern scale assesses “other oriented” feelings of sympathy and concern for unfortunate others, and the Personal Distress scale measures “self-oriented” feelings of personal anxiety and unease in tense interpersonal setting [4].

The Hebrew version of the IRI has been widely used in research in Israel [26-28]. In the present study the alpha Cronbach coefficient of internal reliability of the IRI was very good: α = 0.81.

Jefferson Scale of Physician Empathy – Student version (JSPE-S)

The JSPE-S was developed to measure empathy specifically within the context of the physician–patient relationship [5]. It includes 20 Likert scale items which are scored from 1 (strongly disagree) to 7 (strongly agree). The questionnaire was validated in numerous studies and is frequently used in medical education research and has been translated to more than 42 languages [1,3, 29, 30]. The questionnaire encompasses 3 components of empathy; perspective taking (considered the core component of empathy), compassionate care and standing in the patient's shoes [3,5]. The English version of JSPE-S was translated to Hebrew by four physicians who speak English fluently, and was translated back to English by native English speakers who is also fluent in Hebrew ('forward-backward' procedure). Once the preliminary Hebrew version was obtained, the questionnaire was administered to 3 other physicians to achieve a consensus regarding its final version. We examined convergent validity with a similar instrument (the Interpersonal Reactivity Index (IRI), see above). The correlations between the JSPE-S and the IRI total score administered at the beginning of the study was r = 0.31; p < 0.001. The correlations between the JSPE-S and the IRI subscales were r = 0.43; p < 0.01 for Perspective Taking, and r = 0.30; p < 0.05 for Empathic Concern, and no correlation with the Fantasy and Personal Distress subscales. The findings regarding the Hebrew version of the JSPE-S are very similar to the results reported by Hojat [31] in the original English version, who also found that Perspective Taking and Empathic Concern subscales had the greater correlations with JSPE. In addition, the alpha Cronbach coefficient of internal reliability of the JSPE-S was excellent: α = 0.86 for pre-clinical JSPE-S scores, and α = 0.90 at the end of the fourth-year.

Socio demographic questionnaire

Participants were asked to provide information regarding their gender, age, ethnicity, marital status, religiosity, and preferences regarding future residency.

Procedure

The design of the study was longitudinal: investigators distributed questionnaires in two different time points to each cohort during the three study years. The JSPE-S, the IRI and the socio-demographic questionnaire were administered at the beginning of the fourth-year, before attending clerkships. The JSPE-S was distributed to students again at the end of the fourth-year. For all three cohorts the interval between the first and the second questionnaires was 8 months. All questionnaires were filled anonymously. Each participant received a random number, which was written on his/her questionnaire and was used to identify the individual pre-post questionnaires. Students were allowed to return the questionnaires during the following seven days.

Data analyses

One way and two-way ANOVAs and t-tests were used for continuous variables, and χ² tests for demographic categorical variables. For all data analyses, the dependent variable in the present study was level of empathy as assessed by the JSPE-S that was measured twice: at the beginning (preclinical) and at the end of the fourth year. Dependent samples t-tests and ANOVA with repeated measures were used for longitudinal analyses of pre-clinical JSPE-S vs. end of the fourth-year JSPE-S scores. Tukey post-hoc comparison tests were used to examine the differences among the three groups in variables for which one-way ANOVA tests were significant. A two-sided significance level of 0.05 was established for all analyses. Data analysis was performed using Statistical Package for Social Sciences (SPSS) software, Version 26.0 for Windows.

Results

Demographic characteristics

The demographic characteristics of participants are presented in Table 1. There were no differences between the three cohorts in age, marital status or religiosity. Significant differences between cohorts were found in gender and ethnic origin (Table 1).

Table 1: Demographic characteristics of participants in the study 

1. The proportion of women was about one third in the PI/MH_(lim) cohort increasing to more than a half in the MMI/MH_(ext) cohort (χ²₍₂₎=6.99; p = 0.030).

 2. A significant difference in distribution of ethnic origin between cohorts were observed (χ²₍₂₎=9.40; p = 0.009). 

Overall changes in JSPE-S among all subjects during the fourth-year

There were no significant differences in preclinical JSPE-S by gender, marital status, ethnicity, religiosity or residency preferences, and admission system (Table 2).

Table 2: Comparisons between pre-clinical and end of the fourth-year JSPE-S scores according to demographic and baseline characteristics

Among all subjects, there was a small but significant decrease in JSPE-S during the fourth-year of studies (114.40±11.32 vs. 112.75±14.19, t₍₂₂₆₎ = 2.14, p = 0.034, Table 2). Among men from the three cohorts, but not among women, JSPE-S scores declined significantly during the fourth-year (In men: 114.54±11.33 vs 112.13±13.99, t₍₁₂₉₎ = 2.33, p = 0.021, in women: 114.11±11.38 vs 113.78±14.42, t₍₉₅₎ = 0.77, p=0.769,Table 2). Since the decline in JSPE-S was observed in men but not in women, data analysis is presented according to gender (see below).

The effect of MH Program on JSPE-S change:

In order to evaluate the effect of MH program (limited vs extended) and time (beginning and end of year), and their interaction on JSPE-S, repeated measures ANOVA was performed. The analysis included JSPE-S scores as dependent variable, and MH program and time as independent measures. In order to control for admission system, it was added to the initial analysis as a covariate. Since it did not have a significant contribution, we did not include admission system in the final analysis.

Among men there was no effect of MH on JSPE-S scores (F_(1,128) = 0.16, p = 0.691), there was a significant effect of time on JSPE-S (F_(1,128) = 7.26, p = 0.008), and there was no interaction between humanities program and time (F_(1,128) = 1.78, p = 0.185; Table 3, Figure 2 – Panel 2A). However, among men students of the MH_(ext)  cohort we found a significant decline in JSPE-S during the fourth-year of studies (t₍₃₅₎ = 2.38, p = 0.023; Table 3), while no significant decline was observed in the MH(_lim) cohort (t₍₉₃₎ = 1.29, p = 0.200; Table 3).

Table 3: Comparisons between preclinical and end of the fourth-year JSPE-S scores by Medical Humanities program and gender

Humanities program –  MH_(lim) : limited Medical Humanities program, MH_(ext): extended three-year Medical Humanities studies. 

*p<0.05 for difference between MH_(lim) and MH_(ext) in preclinical JSPE-S in women

**p<0.01 for difference between MH_(lim) and MH_(ext) in end of 4^th-year JSPE-S in women

Among women, MH was significantly associated with JSPE-S scores (F_(1,94)=7.46, p = 0.008). However, there was no effect for time (F_(1,94) = 0.10, p = 0.756) and no interaction between MH program and time (F_(1,64) = 0.012, p = 0.914; Table 3, Figure 2 – Panel 2B). These findings indicate that women who participated in MH_(ext)  as compared to MH_(lim) showed higher JSPE-S scores, and that women who participated in either MH_(ext) or MH_(lim)  did not show a decline in JSPE-S (Table 3).

In order to evaluate if the impact of MH_(ext) on JSPE-S was not only statistically significant but also substantial, we calculated Cohen’s d effect sizes: At baseline, differences in empathy scores between women who participated in MH_(ext)  and those who did not were significant (t₍₉₄₎ = 2.89, p = .005), yielding a large effect size: Cohen’s d = .61. At the end of the fourth-year, differences between the two groups of women were still significant (t₍₉₄₎ = 2.15, p = .034), yielding a medium effect size: Cohen’s d = .47.

Discussion

The main findings of this study are that empathy declined among men medical students' during their first extensive clinical experience, and that the decline was associated with pre-clinical humanities program. Among women students, there was no decline in empathy during the fourth-year of studies, regardless of type of humanities program.

In addition, women who participated in the extended humanities program had higher JSPE-S scores during the fourth-year as compared to women who participated the limited program.

In contrast to the finding in women, among men we found a significant decline in empathy during the fourth-year of studies in those who participated in the extended humanities program, but not in those who participated in the limited program.

Our study suggests, according to the large to medium effect sizes observed, that the differences in empathy scores in women who participated in the extended humanities program as compared to the limited program are not only statistically significant but are also likely to be substantial. Further study is required to determine the practical and educational implications of these findings. Such implications may include increased awareness of curriculum planners to potential sources for gender differences in educational interventions aimed to enhance empathy among medical students.

Previous studies [1,10,11,12] have suggested that an overall decline in JSPE-S scores during the third-year of medical studies exists. Our study suggests that an extensive program that included exposure to ethical issues, communication skills, and humanities studies, was associated with a decline in empathy among men students, while among female students a decline was not observed, regardless of medical humanities program.

Previous studies on gender effect on medical students’ empathy yielded inconsistent findings [1,11,15-17]. Our findings suggest that gender differences in empathy may exist, and go along with gender differences previously reported in clinical practice [32, 33]. It is possible that gender-specific impact of educational programs that we and others [22, 23] have observed were underestimated in previous studies because of small samples which did not allow to assess such effects. It is also possible that measuring empathy at a single time point would be less sensitive to detect gender differences in empathy as compared to longitudinal studies.

In our study, the medical school's admission system was not associated with preclinical empathy or empathy changes during the 4^th year of studies. Since our study was performed during the fourth year of studies, any potential difference in students' qualities that could be observed at entering medical school might have been lost after spending three years in medical school. Future longitudinal studies designed to evaluate the effect of admission system on empathy changes during medical studies are required to directly address this question.

Because our study was not randomized it is possible that the observed differences in empathy change between cohorts are the result of baseline difference between cohorts. Although there was no difference between cohorts in gender, average age, marital status, it is possible that other variables that were not captured by sociodemographic measures that were collected contributed to the observed differences.

The decline in empathy during the first clinical year, while students are introduced to the clinical work in the wards, can have several potential explanations. These include de-idealization of students' perception of medicine [34], lack of proper role models [35], and students’ perception that, as compared to the power of technology and the intense clinical experience, empathy may not be a significant tool in the profession of medicine as students had believed it to be before they entered clinical life [36]. Students can easily put aside the importance of interpersonal engagement in patient care when the majority of their studies are based on quantitative scientific outcomes. At the same time, the decline in empathy among medical students may reflect a protective mechanism that can help students to deal with emotionally difficult situations [10].

In our study, medical humanities curriculum was included at the first three years in a six year program, and did not extend to the fourth year of medical school, during which our study was performed. It is possible that the lack of continued medical humanities program during the fourth year contributed to the decline in empathy in men during that year. Additional research is required to investigate this possibility, and to determine why the decline was observed in men but not in women.

Our study has several limitations. The study included a single medical school, which may limit the generalization of the findings. Cultural differences and differences in the average age in which students start medical school, may affect students' previous life experiences and empathy levels. For example, the average starting age for medical school in Israel is higher than in USA [37] or Ethiopia [38]. Such differences might have an impact on our results regarding students’ empathy. In addition, our study was based on a self-reported empathy measurement, the JSPE-S, and not on observed behaviors, that may only partially correlate [39, 40].

We followed students during the 4^th year of studies, and not during all 3 clinical years. This has likely limited our conclusions regarding changes in empathy during medical studies. In addition, the aim of this study was to explore empathy changes that have been previously suggested to occur following the first students' clinical experiences during clerkships. Thus, we evaluated empathy at the beginning and following the fourth year of medical studies in three consecutive classes of medical school. However, since JSPE-S scores at entry to medical school are not available, we cannot exclude the possibility that differences in empathy between cohorts, prior to entrance to medical school, could have contributed to our findings. However, we examined the effect of medical humanities curriculum on empathy in two cohorts of students that were admitted to medical school using the same admission system (MMI), and this could contribute to reduced difference between cohorts in baseline empathy.

Due to the observational design of our study, students' randomization to the medical humanities programs was not possible, and comparisons were made between cohorts. Although randomization is considered a gold standard in clinical studies, it has been recognized that it is difficult to blind learners to their assigned group in educational studies [41]. A clinical research model that has been suggested to be more applicable for educators is the "pragmatic trail" in which interventions are compared in real-world practice [41]. Thus, we measured empathy in a prospective controlled study. We used a longitudinal design with repeated measurements to compare changes in empathy over time in the cohorts studied. In addition, a single humanities program was offered in each year (limited/extended), and students were obligated to participate in it, therefore students' preferences could not affect their participation in the limited/extended programs.

Conclusions

In women, empathy did not decline during the fourth year of medical school, while in men the decline in empathy during the fourth year was associated with medical humanities program.  Our findings regarding gender-specific effects of such educational program require further validation. Such research could examine the impact of educational interventions on men and on women, and may help to design interventions to address potential gender differences in empathy.

Abbreviations

PI: personal interview, MMI: multiple mini interviews, MH_(lim): limited Medical Humanities program, MH_(ext): extended Medical Humanities program.

Declarations

Ethics approval and consent to participate - The study was approved by the ethical committee of Hadassah Medical School. Informed consent was obtained from all participants.

Consent for publication - Not applicable

Availability of data and material - The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Competing interests - The authors declare that they have no competing interests.

Funding -- This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Authors’ contributions: ML, MM designed the study, ML collected the data, LC analyzed the data, all authors interpreted the data and contributed to the writing. All authors read and approved the manuscript. All authors critically revised the manuscript and gave final approval.

Acknowledgments - Not applicable

References

1. M. Hojat, M.J. Vergare, K. Maxwell, G. Brainard, S.K. Herrine, G.A. Isenberg, J. Veloski, J.S. Gonella, The devil is in the third year: A longitudinal study of erosion of empathy in medical school, Acad. Med. 2009;84:1182-91.
2. A.K. Brownell, L. Côté, Senior residents' views on the meaning of professionalism and how they learn about it, Acad. Med. 2001;76:734-7.
3. M. Hojat, J.S. Gonnella, T.J. Nasca, S. Mangione, M. Vergare, M. Magee, Physician empathy: definition, components, measurement, and relationship to gender and specialty, Am. J. Psychiatry. 2002;159:1563-9.
4. M.H. Davis, Measuring individual differences in empathy: Evidence for a multidimensional approach, J. Pers. Soc. Psychol. 1983;44:113-26.
5. M. Hojat, S. Mangione, T.J. Nasca, M.J.M. Cohen, J.S. Gonnella, J.B. Erdmann, J. Veloski, M. Magee, The Jefferson Scale of Physician Empathy: Development and preliminary psychometric data, Educ. Psychol. Meas. 2001;61:349-65.
6. S.W. Mercer, W.J. Reynolds, Empathy and quality of care, Br. J. Gen. Pract. 2002;52 (suppl):S9-S12.
7. S.S. Kim, S. Kaplowitz, M.V. Johnston, The effects of physician empathy on patient satisfaction and compliance, Eval. Health Prof. 2004;25:237-51.
8. E. Vermeire, H. Hearnshaw, P. Van Royen, J. Denekens, Patient adherence to treatment: three decades of research. A comprehensive review, J. Clin. Pharm. Ther. 2001;26:331-42.
9. W. Levinson, D.L. Roter, J.P. Mullooly, V.T. Dull, R.M. Frankel RM, Physician-patient communication: The relationship with malpractice claims among primary care physicians and surgeons, JAMA. 1997;277:553-9.
10. D. Chen, R. Lew, W. Hershman, J. Orlander, A cross-sectional measurement of medical student empathy, J. Gen. Intern. Med. 2007;22:1434-8.
11. B.W. Newton, L. Barber, J. Clardy, E. Cleveland, P. O'Sullivan, Is there hardening of the heart during medical school?, Acad. Med. 2008;83:244-9.
12. M. Hojat, S. Mangione, T.J. Nasca, S. Rattner, J.B. Erdmann, J.S. Gonnella, M. Magee, An empirical study of decline in empathy in medical school, Med. Educ. 2004;38:934-41.
13. M. Neumann, F. Edelhäuser, D. Tauschel, M.R. Fischer, M. Wirtz, C. Woopen, A. Haramati, C. Scheffer, Empathy decline and its reasons: A systematic review of studies with medical students and residents, Acad. Med. 2011;86:996–1009.
14. J. Colliver, M. Conlee, S. Verhulst, L. Dorsey, Reports of the decline of empathy during medical education are greatly exaggerated: A reexamination of the research, Acad. Med. 2010;84:588-93.
15. D. Chen, D. Kirshenbaum, J. Yan, E. Kirshenbaum, R. Aseltine, Characterizing changes in student empathy throughout medical school, Med. Teach. 2012;34:305-11
16. B.W. Newton, M.A. Savidge, L. Barber, E. Cleveland, J. Clardy, G. Beeman, T. Hart, Differences in medical students’ empathy, Acad. Med. 2000;75:1215.
17. M. Hojat, J.S. Gonnella, S. Mangione, T.J. Nasca, J.J. Veloski, J.B. Erdmann, C.A. Callahan, M. Magee, Empathy in medical students as related to academic performance, clinical competence and gender, Med. Educ. 2002;36:522-7.
18. M. Hojat, D. Axelrod, J. Spandorfer, S. Mangione, Enhancing and sustaining empathy in medical students, Med. Teach. 2013;35:996-1001.
19. S. Rosenthal, B. Howard, Y.R. Schlussel, D. Herrigel, B.G. Smolarz, B. Gable, J. Vasquez, H. Grigo, M. Kaufman, Humanism at Heart: Preserving Empathy in Third-Year Medical Students, Acad. Med. 2011;86:350-8.
20. M. Muszkat, A. Ben-Yehuda, S. Moses, Y. Naparstek, Teaching empathy through poetry: a clinically based model, Med. Educ. 2010;44:503.
21. M. Muszkat, O. Barak, G. Lalazar, B. Mazal, R. Schneider, I. Mor-Yosef Levi, M.J. Cohen, L. Canetti, A. Ben Yehuda, Y. Naparstek, The effect of medical students' gender, ethnicity and attitude towards poetry-reading on the evaluation of a required, clinically-integrated poetry-based educational intervention, BMC Med. Educ. 2014;14:188.
22. J. Shapiro, E. Morrison, J. Boker, Teaching empathy to first year medical students: Evaluation of an elective literature and medicine course, Educ. Health. 2004;17:73–84.
23. M. Kommalage, Using videos to introduce clinical material: Effects on empathy, Med. Educ. 2011;45:514–5.
24. K.W. Eva, J. Rosenfeld, H.I. Reiter, G.R. Norman, An admissions OSCE: The multiple mini-interview, Med. Educ. 2004;38:314-26.
25. D. Shaham, L. Kandel, A. Gural. Establishing a Medical Humanities Program in Israel: Challenges and Solutions, The European Legacy. 2011;16: 307-315,DOI: 10.1080/10848770.2011.575594
26. R. Karniol, R. Gabay, Y. Ochion, Y. Harari, Is gender or gender-role orientation a better predictor of empathy in adolescence, Sex Roles. 1998;39:45-59.
27. Y. Gabay, S.G. Shamay-Tsoory, L. Goldfarb, Cognitive and emotional empathy in typical and impaired readers and its relationship to reading competence, J. Clin. Exp. Neuropsychol. 2016;38:1131-43.
28. F. Uzefovsky, I. Shalev, S. Israel, S. Edelman, Y. Raz, D. Mankuta, A. Knafo-Noam, R.P. Ebstein, Oxytocin receptor and vasopressin receptor 1 a genes are respectively associated with emotional and cognitive empathy, Horm. Behav. 2015;67:60-5.
29. M. Di Lillo, A. Cicchetti, A.L. Scalzo, F. Taroni, M. Hojat, The Jefferson Scale of Physician Empathy: Preliminary psychometrics and group comparisons in Italian physicians, Acad. Med. 2009;84:1198-1202.
30. J. Kliszcz, K. Nowicka-Sauer, B. Trzeciak, P. Nowak, A. Sadowska, Empathy in health care providers-validation study of the Polish version of the Jefferson Scale of Empathy, Adv. Med. Sci. 2006;51:219-25.
31. M. Hojat, S. Mangione, G.C. Kane, J.S. Gonnella, Relationships between scores of the Jefferson Scale of Physician Empathy (JSPE) and the Interpersonal Reactivity Index (IRI), Med. Teach. 2005;27:625-628.
32. J.M. Bensing, A. van den Brink-Muinen, D.H. de Bakker, Gender differences in practice style: A Dutch study of general practitioners, Med. Care. 1993;31:219-29.
33. K.D. Bertakis, L.J. Helms, E.J. Callahan, R. Azari, J.A. Robbins, The influence of gender on physician practice style, Med. Care. 1995;33:407–16.
34. J. Kay, Traumatic deidealization and the future of medicine, JAMA. 1990;263:572-3.
35. N.P. Kenny, K.V. Mann, H. MacLeod, Role modeling in physicians' professional formation: Reconsidering an essential but untapped educational strategy, Acad. Med. 2003;78:1203-10.
36. C.H. Griffith, J.F. Wilson, The loss of student idealism in the 3rd-year clinical clerkships, Eval. Health Prof. 2001;24:61-71.
37. E.J. Austin, P. Evans, R. Goldwater, V. Potter, A preliminary study of emotional intelligence, empathy and exam performance in first year medical students, Pers. Individ. Dif. 2005;29:1395-1405.
38. S. Dehning, S. Gasperi, M. Tesfaye, E. Girma, S. Meyer, W. Krahl, M. Riedel, H-J. Möller, N. Müller, M. Siebeck, Empathy without borders? Cross-cultural heart and mind-reading in first-year medical students, Ethiop. J. Health Sci. 2013;23:113-22.
39. Hojat, S. Mangione, T.J. Nasca, J.S. Gonnella, M. Magee, Empathy scores in medical school and ratings of empathetic behavior in residency training 3 years later, J. Soc. Psychol. 2005;145:663-72.
40. J.A. Colliver, M. Willis, R.S. Robbs, D.S. Cohen, M.H. Swartz, Assessment of empathy in a standardized-patient examination, Teach. Learn. Med. 1998;10:8-11.
41. Sullivan GM.Getting off the "gold standard": randomized controlled trials and education research. J Grad Med Educ. 2011 Sep;3(3):285-9. doi: 10.4300/JGME-D-11-00147.1.PMID: 22942950