Cooperation Relationship Analysis
We mapped a cooperative relationship network for countries, institutions, and authors of publications by Cite Space (6.1. R3). The analysis of the distribution of publications (Table 1) identifies the top 10 productive countries, institutions, and authors participating in this study, which can help to analyze the leading research frontier.
Table 1
The top 10 countries, institutions, and authors with the highest number of publications.
| Country | Institution | Author |
Rank | Count | Country | Count | Institution | Location | Count | Author | Institution of Author | Location |
1 | 721 | USA | 36 | University Calif San Francisco | USA | 15 | Yunhe Wang | Peking University | CHINA |
2 | 266 | UK | 33 | University of Toronto | AUSTRALIA | 13 | Lee, Justin S | CDC COVID-19 Response Team | USA |
3 | 204 | GERMANY | 33 | Harvard Medical School | USA | 12 | Xin Zhang | University of Hong Kong | CHINA |
4 | 213 | CHINA | 29 | University of Michigan | USA | 12 | Yanfen Zhang | The Second Affiliated Hospital of Harbin Medical University | CHINA |
5 | 136 | INDIA | 27 | Imperial College London | UK | 12 | Xiaoming Liu | Wuhan University of Science and Technology | CHINA |
6 | 136 | AUSTRALIA | 26 | University of North Carolina | USA | 12 | Kelly M. Harrell | Virginia Commonwealth University School of Medicine | USA |
7 | 130 | CANADA | 25 | University of Sydney | AUSTRALIA | 11 | Royer, Danielle | University of Colorado Anschutz Medical Campus | USA |
8 | 109 | SAUDI ARABIA | 24 | University of Colorado | USA | 10 | Martindale, Jim | University of Virginia | USA |
9 | 66 | PAKISTAN | 22 | University of Stanford | USA | 10 | Harmon, Derek | University of California, San Francisco | USA |
10 | 56 | IRAN | 21 | University of Washington | USA | 10 | Jun Wang | The First Affiliated Hospital of Chongqing Medical University | CHINA |
Co-institutions Analysis
Some institutions with high frequency and centrality have contributed to the promotion of global online learning research. As the main organization for online learning research, universities have done more work than hospitals and research institutions. Figure 2(A) shows a close cooperative relationship among 252 institutions. Given the long-term history of online learning in the USA, seven of the ten most productive organizations belong to the United States, wherein the University of California San Francisco (count = 36) had the most publications. There are eight institutions with centrality greater than 0.1. Boston University (0.13), McGill University (0.13), Brown University (0.12), and Johns Hopkins University (0.10) belong to the United States; Sydney University (0.12) of Australia; Kings College of London of United Kingdom; Peking University (0.12) of China; King Abdulaziz University (0.12) of Saudi Arabia. These institutions (the nodes are linked by red lines) played an important role in establishing close cooperation between their countries.
Co-countries (Areas) Analysis
The cooperative relationship between institutions means the corresponding relationship between countries to some extent, as institutions belong to countries. Figure 2 (A) shows the network map between 119 countries (Areas). The United States has made outstanding contributions in the field of online learning in response to the COVID-19 pandemic, as we can inspire from the two indicators of maximum publications (721) and highest centrality (0.3). The second country is the United Kingdom, with 226 publications and 0.11 centrality. They all have purple outer rings, which represent a very important core position (Table 1). Next is Germany (count = 204, centrality = 0.04). China ranked fourth in terms of publications (213) and in terms of 20nd with centrality (0.03) have made great efforts in online learning research. Although some underdeveloped countries appeared in the list,due to the low centrality,they still need to improve the depth and breadth of research by strengthening their communication and cooperation.
Co-authors Analysis
A total of 241 authors were involved in the current work according to Cite Space analysis, but only 170 authors met the minimum publication thresholds(Ni ≥ 2.90),according to the result of Price’s formula Ni = 0.749 m. Nm refers to the number of papers issued by the most productive author. Figure 2 (B) is the author cooperation relationship map which shows a decentralized partnership of online learning. An obvious close cooperative network is composed of the top list authors. This team contains most publications and most authors (more than 30 researchers, most of them are from universities in the United States). Another obvious author cooperation network exists in China. It is clear that three authors (centrality = 0.13)—Kelly M. Harrell, Wenlu Zhang, and Claudia Krebs—have played an important intermediary role in China and America.
Co-cited References Analysis
Co-cited references of Cite Space refer to the phenomenon that two references are cited by the same document, which made significant contributions to a knowledge evolution process. Figure 3(A) is a map of 2,565 co-cited references among authors of online learning.The top 10 co-cited references (Table 2) were all published before 2020, such as Suzanne Rose[6], Samiullah Dost[7], and Hanad Ahmed[8].Which indicated references prior to 2020 received wide attention after the outbreak of COVID-19. Examples are the second most cited article written by Diane O'Doherty (2018)[9] and the fourth cited article written by Leisi Pei (2019)[10]. It needs to be highlighted that the authors in the co-cited reference list are different from the co-authors list, which indicates that a most productive author may not necessarily signify high quality (nor does the quality of the journal).
Table 2
The top 10 co-cited references of online learning.
Rank | Year | Title | Author | Journal | Co-citation |
1 | 2020 | Medical Student Education in the Time of COVID-19 | Rose S | JAMA-Journal of the American Medical Association | 172 |
2 | 2018 | Barriers and solutions to online learning in medical education - an integrative review | ODoherty D | BMC Medical Education | 98 |
3 | 2020 | Perceptions of medical students towards online teaching during the COVID-19 pandemic: a national cross-sectional survey of 2721 UK medical students | Dost S | BMJ OPEN | 72 |
4 | 2019 | Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis | Pei LS | Medical Education Online | 68 |
5 | 2020 | COVID-19 and medical education | Ahmed H | LANCET Infectious Diseases | 65 |
6 | 2020 | Impact of the COVID-19 pandemic on medical education: Medical students' knowledge, attitudes, and practices regarding electronic learning | Alsoufi A | PLOS ONE | 63 |
7 | 2020 | The psychological impact of the COVID-19 epidemic on college students in China | Cao WJ | Psychiatry Research | 59 |
8 | 2020 | Distance learning in clinical medical education amid COVID-19 pandemic in Jordan: current situation, challenges, and perspectives | Al-Balas M | BMC Medical Education | 58 |
9 | 2020 | The Impact of COVID-19 on Medical Education | Ferrel MN | Cureus Journal of Medical Science | 58 |
10 | 2020 | Strength, weakness, opportunity, threat analysis of the adaptations to anatomical education in the United Kingdom and Republic of Ireland in response to the Covid-19 pandemic | Longhurst GJ | Anatomical Sciences Education | 52 |
The cited reference clustering label can be used to infer the core academic ideas and research frontiers of major academic teams. Figure 3(B) showed that flipped classroom was frequently cited in the 2020 online learning research. Some major references were cited during 2021, including online teaching, surgical education, online learning experience, anatomy education, mental health, dental education, and cognitive load theory. The academic began to pay attention to online learning of postgraduate education at 2022. There is a clear clue that online learning has changed from the initial focus on a certain learning form (flipped curriculum) to the whole stage of medical education, which shows an evolution path of research in the past three years.
Documents on online learning practice
The first theme focused on online learning and education, including online teaching (cluster#0), flipped classroom (cluster#1), and online learning experience (cluster#3). Rose S (2020) and Dost S (2020) published the most valuable references, which provide a solid research foundation for solving the global pandemic. Some authors have paid attention to some underdeveloped countries that lack digital infrastructure and students' e-learning capabilities[11] so as to prevent e-learning from becoming a propeller of the educational gap. Al-Balas M (2020)[12] introduced Jordan's experience; Khalil and Rehana (2020)[13] explored Saudi Arabia's experience.
Documents on learning theory and model
After the outbreak of the epidemic, theories and models related to pedagogy, psychology, and organizational behavior were applied to analyze online learning behavior and motivation (Hadie Rajeh MT, 2021)[14], including self-determination theory, cognitive load theory (cluster#7)[15], and planned behavior theory. Other models, such as structural equation modeling (Almarzouqi A, 2022) and expectation-confirmation model (Cheng YM, 2020), are cited to assess user satisfaction and willingness to continue using online learning[16].
Documents on medical disciplines
Some medical disciplines (cluster#2, cluster #4, cluster #6) are widely concerned with online learning research because they face greater challenges. Longhurst GJ (2020)[17] and Pather N (2020) research anatomy education which is the most concerning subject among all disciplines; Wilcha R-J (2020) and Dedeilia A (2020) committed to surgical education; Amir LR (2020) and Schlenz MA (2020) engaged in dental education. These academic groups are devoted to adapting the traditional, synchronous course to online learning mode. In addition, some advanced technology and tools, such as virtual auscultation[18], augmented reality[19], and simulation, were applied to these disciplines and achieved desirable results.
Documents on mental health
The third theme (Cluster #5) of mental health with 36 nodes, such as depression, stress, and anxiety, was addressed by Cao WJ (2020) and Hodges CB (2021). The COVID-19 pandemic has exposed the need to address mental health issues for the future adoption of e-learning among a massive number of students in medical education. Some strategies have been proposed to address the mental health damage factors to medical students' online learning[20].
Documents on lifelong learning
The final theme (cluster#7) is postgraduate medical education with 14 nodes. Papapanou M (2022) suggests that the quality of postgraduate medical education can be improved through online learning[21]. Researchers have designed a series of online medical courses to meet the learning needs of all stages of medical education. At the beginning of the outbreak, undergraduate medical education focused initially on continuing medical education (namely, continuing professional development) and postgraduate medical education has attracted the attention of academic researchers as well as practitioners.
Keyword Co-occurrence Analysis
The keyword co-occurrence result shows no burst keyword nor keywords with centrality greater than 0.1, which indicates that there is no obvious research center and core hotspot in the online learning field. Instead, there are decentralized themes and tendencies. Most of the high-frequency keywords appeared in the first year of the outbreak, and with increasingly lower frequency and centrality in the following years. However, this does not mean that the academic has lost interest in this field. We are pleased to see that these studies are moving toward a more refined and in-depth direction over time. Table 3 shows the top 10% keywords from 2020 to 2022. There are 198 keywords appearing for the first time in 2020, and these keywords include almost all of the research on online learning to date. 2021 had 154 keywords with lower word frequency and centrality. There were only 53 keywords in 2022.
Table 3
Top high-frequency keywords in online learning from 2020 to 2022.
Year | Count | Centrality | Keywords | Year | Count | Centrality | Keywords |
2020 | 775 | 0.01 | medical education | 2021 | 42 | 0.01 | stress |
605 | 0.03 | medical student | 25 | 0.02 | resident |
175 | 0 | online learning | 23 | 0.02 | challenge |
155 | 0 | covid-19 | 21 | 0.01 | feedback |
145 | 0.01 | impact | 17 | 0.03 | faculty development |
143 | 0.02 | health care | 16 | 0.02 | perspective |
111 | 0 | undergraduate medical education | 15 | 0.02 | validity |
104 | 0 | distance learning | 14 | 0.01 | virtual education |
98 | 0.01 | performance | 13 | 0.01 | student engagement |
98 | 0.05 | skill | 13 | 0.02 | dental student |
95 | 0.04 | perception | 12 | 0.01 | adolescent |
88 | 0.03 | curriculum | 11 | 0.01 | self-efficacy |
86 | 0.02 | anatomy | 11 | 0.01 | nurse |
76 | 0.01 | online education | 11 | 0.02 | disorder |
73 | 0.01 | technology | 11 | 0.02 | integration |
67 | 0.01 | knowledge | 2022 | 7 | 0 | retention |
66 | 0.01 | mental health | 6 | 0 | cardiopulmonary resuscitation |
62 | 0.02 | experience | 6 | 0.1 | structured clinical examination |
61 | 0 | blended learning | 5 | 0 | neurosurgery education |
60 | 0.01 | medical school | 5 | 0 | digital education |
Clusters for research hotspots were identified with the keyword timeline view by Cite Space (6.1.R3). Seven clusters in total were formed, including dental education, virtual reality, mental health, surgical education, self-directed learning, blended learning, and collaborative learning. According to a timeline view (Fig. 4) and the co-occurrence of keywords (Table 3)—combined with the number of chronological documents—the research oriented toward online learning during the COVID-19 pandemic can be roughly divided into three stages.
Rapid development stage
As the largest distance learning practice in the history of human civilization, online learning developed rapidly in 2020, accompanied by the deterioration of COVID-19. The top four keywords should not be analyzed because they are search strategy terms. This period has the most frequent keywords, including health care, impact, perception, etc. These keywords demonstrate the efforts made by the medical education community to ensure the effectiveness of online learning during the lockdown. In order to achieve substantial equivalence, the research in 2020 mainly focuses on the effect and factors of online learning. Some studies have developed appropriate policies and initiatives to promote the effectiveness of e-learning[22].
Flourish stage
The study of online learning flourished in 2021, meanwhile, the COVID-19 pandemic maintained a stable deterioration trend. Compared with 2020, the keyword frequency and centrality decreased significantly. The largest number of publications possessed an increasing keyword and decreasing keyword frequency in this year. However, the reduced frequency indicates that scholars are committed to improving the depth and breadth of research, trying to calm down after a rapid pace in 2020. The high-frequency keywords in 2021 mainly include stress, resident, challenge, feedback, faculty development, perspective, validity, etc. The research direction has also changed from an online learning guarantee to quality improvement. Other studies demonstrate the possibility of changing the learning path from real teaching to virtual online learning during the pandemic[23].
Stable stage
After two years of rapid development, online learning has ushered in a stable stage with more mature theory and more diverse methods. The gradually reduced frequency of keywords, such as retention, cardiopulmonary resuscitation, neurosurgery, and structured clinical examination. It is indicated that the attention to some important topics within the existing research is gradually reduced, replaced by a variety of contextualized situational micro-topics, which is a manifestation of more in-depth research. The new stage focused on topics such as self-regulated learning, advanced technology application, teaching model, etc. Moreover, scholars pay more attention to exploring a hybrid teaching method that combines traditional classroom and online learning and are committed to transforming and retaining online learning results and experiences, even in the post-pandemic era.