Video-Based Interviewing in Medicine: A Scoping Review

doi:10.21203/rs.3.rs-468538/v1

Download PDF

Research

Video-Based Interviewing in Medicine: A Scoping Review

https://doi.org/10.21203/rs.3.rs-468538/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Background: The Coronavirus 2019 pandemic necessitated a rapid uptake of video-based interviewing within the personnel selection process in healthcare. While video-based interviews have been evaluated previously, we identified a gap in the literature on the implementation of video-based interviews, and how they compare to their face-to-face counterparts.

Methods: A scoping review was conducted to consolidate the available literature on the benefits and limitations of video-based interviews, and to understand the perceived barriers associated with transitioning away from face-to-face interviews. A search strategy, developed in concert with an academic health sciences librarian, was run on Ovid Medline, Embase, PsycInfo, and Cochrane Central. The search was performed on March 31, 2020, and updated on February 21, 2021. Studies that implemented and evaluated the impact of video-based interviewing in healthcare were included in our study. Review articles, and editorials were excluded.

Results: Forty-three studies were included in our scoping review, of which 17 were conference abstracts and 26 were peer-reviewed manuscripts. The risk of bias was moderate or high in most studies, with only four studies having a low risk of bias. Both financial costs and opportunity costs associated with the selection process were reported to be improved with video-based interviewing, while the impact on environmental costs was not well explored. Technical limitations, which were not prevalent, were easily managed during the interview process. Overall, video-based interviews were well received by both applicants and interviewers, although most participants still reported a preference for face-to-face interviews.

Conclusions: While video-based interviewing has become necessary during the Coronavirus 2019 era, there are benefits from a financial, opportunistic, and environmental point of view that argue for its continued use even after the pandemic. Despite its successful implementation with minimal technical issues, a preference still remains for face-to-face interviews. Reasons for this preference are not clear from the available literature. Future studies on the role of non-verbal communication during the video-based interview process are important to better understand how video-based interviewing can be optimized.

Registration: This scoping review was registered with Open Science Framework.

Surgery

General Surgery

Anesthesiology & Pain Medicine

Epidemiology

Video-based interviews

Videoconferencing

Personnel selection

Climate change.

Whether applying to medical school, residency programs, fellowships, or for the role of a staff physician, interviews play an important part of the selection process for both applicants and programs. The Coronavirus 2019 (COVID-19) pandemic, and the public health measures that have accompanied it, have necessitated a transition away from face-to-face interviews. This provides an opportunity to scrutinize the benefits and limitations of video-based interviewing as they compare to traditional face-to-face interviews.

Face-to-face interviews come with both financial and opportunity costs that have been reported in previous studies.^{1, 2, 3, 4} Financial costs result from application fees, travel and accommodation for interviews, as well as costs associated with completing elective rotations.^{1, 2, 3} Opportunity costs such as time taken away from clinical service to attend interviews, which applies to applicants and interviewer, should also be considered.^{3, 4}

The environmental costs of face-to-face interviews have not been well-studied in the literature, but a recent emphasis has been placed on the impact of long haul flights associated with traveling for interviews on our carbon footprint.⁵ In line with this, the healthcare sector is regarded as a major contributor to greenhouse gas emissions, urging for a call to action towards climate change as a public health emergency.^{6, 7}

Video-based interviewing presents an opportunity to continue with personnel selection by adhering to COVID-19 restrictions while addressing the aforementioned costs associated with face-to-face interviews. While previous studies have reported on their experience with video-based interviews and provided summaries of the current literature on the topic, a formal structured synthesis of the literature on video-based interviewing within healthcare does not exist.^{8, 9, 10, 11, 12, 13} Given the rapid transition to video-based interviewing, an opportunity was identified to consolidate the current literature on the topic.

Study Aim

The aim of this review was to evaluate the extent of previous research on video-based interviewing as it applies to healthcare contexts. We sought to review the benefits and limitations of video-based interviewing, and identify gaps in our current knowledge on the implementation of video-based interviewing. The research question that guided this scoping review was:

Within selection processes in healthcare, how do video-based interviews compare with face-to-face interviews in terms of costs, implementation, and candidate selection?

Study Design

A scoping review was conducted in anticipation of the heterogeneity of study designs available on this topic. We employed the methodology that has been previously outlined and subsequently refined.^{14, 15} Full details to the conduct of this scoping review can be found in our previously published study protocol.¹⁶ In short, a search strategy developed in conjunction with an academic health sciences librarian was used with the following databases: Ovid Medline, Embase, PsycInfo, and Cochrane Central. The search was run on March 31, 2020 to capture studies from inception to March 30, 2020. The grey literature was searched using Google, and the reference list of all studies selected for inclusion were reviewed for any additional studies that fit our inclusion criteria. Our study was reported according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist, which is provided in Additional File 1.¹⁷ The search strategy can be found in Additional File 2. The search was updated on February 20, 2021.

Inclusion and exclusion criteria that were developed to select studies that were in line with our research question are as follows:

Inclusion criteria:

Involve applicants interviewing via video-based and/or face-to-face interviews AND
Involve applicants applying to medical school, residency, fellowship programs, dentistry, pharmacy, nursing, or other healthcare related fields AND
Any study design that involved the implementation of video-based interviews AND
Any method of data analysis, including quantitative and qualitative studies AND
Assess any outcome of interest including financial costs, environmental impact, or time invested.

Exclusion criteria:

Review articles OR
Editorials or expert opinions that do not describe a particular video-based interview that was implemented OR
Studies that are not published in English or French.

Data Acquisition

The results of our search were initially screened based on title and abstract by two independent reviewers (RS, RH). Cohen’s Kappa statistic was determined following this to ensure inter-rater reliability before proceeding to the next stage of screening. Any discrepant studies by either of these reviewers were included in full text review. After initial screen based on title and abstract, the two reviewers (RS, RH) independently screened the full texts of the selected studies in duplicate. Any discrepancies following this were reviewed by a third independent reviewer (HM) who made the final decision on study inclusion. Reasons for exclusion after full text review were documented.

DistillerSR (Evidence Partners, Ottawa, Canada) was used for the data extraction process. A standardized form was created on this platform and independently tested by two reviewers (RS and RH) on the initial 10 studies that were included. Following this, the data extraction form was modified to capture the range of methodologies and outcomes of the studies that were included in our scoping review. No further changes were made to the data extraction form after this modification and the same standardized form was used on all included studies.

Data Analysis

Given the nature of a scoping review, no formal statistical synthesis of the study data was pursued. Study characteristics including geographic location, study methodology, discipline of authors, purpose of interview, and type of analysis are presented as descriptive data. In line with our aim to identify the benefits and limitations of video-based interviewing, outcomes from each study were also grouped thematically as they applied to financial costs, opportunity costs, environmental costs, technical limitations, impact on the rank list, and body language.

Quality Assessment

Risk of bias assessment of each included article was performed using the Joanna Briggs Institute (JBI) critical appraisal tools by two independent reviewers (RS, RH).¹⁸ Although not a typical component of a scoping review, we sought to provide an assessment of the study quality available in the current literature. Abstracts were not critically appraised as they lacked the methodological detail required to assess for quality and risk of bias. The tools relevant for cohort studies, cross sectional studies, randomized controlled trials, and quasi-experimental studies were used as applicable. Based on the results of the JBI critical appraisal tool, an overall study rating was assigned by the reviewers to describe the risk of bias as either “high”, “moderate”, or “low” risk. All studies that met the inclusion criteria were included in our scoping review, regardless of the results of their quality assessment.

Search Results

A total of 3851 studies were retrieved from our search, after duplicates were removed. Following review of titles and abstracts by two independent reviewers, a total of 76 studies were selected for full text review (Cohen’s kappa = .84). Following independent full text review by two reviewers, a total of 37 studies were selected. These were reviewed by our third reviewer after which 36 articles were included. Reasons for exclusion after full text review included the lack of any video-based interview being implemented (n = 19), letters to the editor (n = 7), did not involve applicants in healthcare fields (n = 3), did not have any measured outcomes (n = 8), or abstracts whose full text were already included (n = 3). The search was updated on February 20, 2021 and 5 additional studies met inclusion criteria. Two additional studies were retrieved from review of the references of the included studies. As such, a total of 43 studies were included in our scoping review.^{19 – 61} A PRISMA flow diagram is provided in Fig. 1 to outline the study selection process.⁶² A summary of the main themes is provided in Table 1, with a more detailed summary provided in Additional File 3.

Study Characteristics

Of the included studies, 17 were conference abstracts and 26 were published manuscripts. Forty-two studies were conducted in the United States while 1 was conducted in Australia.

Twenty-nine studies included medical students applying to residency, 2 studies of students applying to medical/dental school, 2 studies of pharmacy students applying to their respective pharmacy residency, and 10 studies of residents applying to fellowship. Of studies involving medical residency or fellowship applications, disciplines included Urology (n = 1), Anesthesiology (n = 1), General Surgery (n = 1), Pediatric Surgery (n = 1), Gastroenterology (n = 1), Internal Medicine (n = 1), Orthopedic Surgery (n = 2), Obstetrics and Gynecology (n = 2), Family Medicine (n = 2), Complex General Surgical Oncology (n = 3), Female Pelvic Medicine and Reconstructive Surgery (n = 1), Maternal Fetal Medicine (n = 1), Advanced Gastrointestinal Minimally Invasive Surgery (n = 1) and Emergency Medicine (n = 22).

There was a range of study methodology. There were 36 cross sectional studies, 4 cohort studies, 2 quasi-experimental studies, and 1 randomized trial. All studies employed some form of quantitative analysis, while one abstract did not outline what analysis they performed. No studies used qualitative methods.

Virtual panel interview

Eighteen studies reported on their use of panel style virtual interviews. Of these, 6 were adjuncts^{19 – 24} to the face-to-face interview while 12 were replacements.^{25 – 36} Studies used Skype^{19, 21, 24, 25, 26, 27, 28, 30} Facetime¹⁹, Zoom^{31, 32, 34, 35, 36} or a combination of two platforms.^{22, 23, 29} Eleven studies provided additional information outside the virtual interview itself including a video tour of the facility, video tour of the surrounding communities, Google hangout session with current residents, electronic brochures, and resident contact information to ask additional questions if interested.^{19, 26, 28, 29, 30, 31 – 36} The number of interviews varied from a single 15–30 minute video-based interview^{20, 22, 23, 24, 25, 26, 27, 30, 32, 33} to multiple interviews with different faculty members.^{19, 21, 28, 29, 31, 34, 35,36} The number of interviewers also varied from one-on-one interviews^{19, 20, 24, 27, 28, 34, 35} to those with up to five interviewers.^{22, 23, 26, 30, 31, 32, 33} Three studies described having a dedicated individual (e.g. program coordinator, information technology specialist) who facilitated movement of applicants and interviewers between breakout rooms on the video-based platform.^{31, 34, 35} Three studies had an administrative staff responsible for ensuring that applicants had established appropriate audio/visual connections.^{19, 27, 28}

Nine studies reported favourable perceptions from applicants on video-based panel interviews.^{20, 21, 24, 26, 31, 32, 34, 35, 36} Applicants in these studies felt that they were able to demonstrate their strengths and personality through a video-based format,^{26, 32, 35, 36} that it was a fair way to present the program to them²¹, and that the interviews flowed well.³¹ Most applicants found that the video-based interviews met their expectations^{20, 26} and they were satisfied with the process.³⁴

In one study, applicants felt that the video-based interview was less effective in allowing them to represent themselves.²⁸ An additional study highlighted that video-based interviewing prevented the “gut feelings” about a program that are typically felt at the time of a face-to-face interview.³³ Most applicants in one study also found that the inability to see the city or meet the faculty face-to-face was a drawback to video-based interviews.³⁴ Other concerns with video-based interviewing included not being able to understand the program’s culture³⁵ and interact with current residents.²⁹

Few studies explored the interviewers’ perspective on video-based interviewing and found that interviewers were mostly satisfied with the video-based interview process overall.^{26, 31, 34} In one study however, none of the interviewers recommended using video-based interviews as the sole method of interviewing.²¹

In the 12 studies that specifically assessed the role of video-based interviewing as a replacement to the current process, two found that it worked well to replace face-to-face interview^{31, 34} while 10 studies felt that it was a useful adjunct or screening tool, but was not ready to replace face-to-face interviews entirely.^{19, 20, 21, 22, 26, 28, 32, 33, 35, 36}

Overall, the panel based video interview format appeared to be acceptable to applicants and interviewers, although a complete transition away from face-to-face interviews has been met with hesitancy.

Virtual multiple mini interviews

One study reported on their use of video-based multiple mini-interviews (MMIs).³⁷

With their retrospective cohort study comparing applicants to medical and dental school between years that employed face-to-face MMIs with those that employed video-based MMIs, they found that there was no significant difference between interview scores, although there was greater variability in scores in the video-based MMI group.

76% of applicants and 78% of interviewers were satisfied with the video-based MMI process. Similar to the face-to-face counterpart, the video-based MMIs involved seven questions with 2 minute change over time between stations. The interview process was set up and overseen by five administrative staff and two IT staff. This study was the only study that explored the role of a video-based MMI as a replacement to the face-to-face counterpart.

This one study demonstrated that the video based MMI was an acceptable alternative to an in-person process.

One-way video interviewing

One-way video interviewing describes the process by which applicants submit answers to standardized questions in video format to be evaluated as part of the selection process. There were 24 studies that employed this method of video-based interviewing.

Twenty-two of these studies evaluated the Standardized Video Interview (SVI), an online unidirectional interview that was developed by the Association of American Medical Colleges (AAMC) and piloted with the Accreditation Council for Graduate Medical Education (ACGME)-accredited emergency medicine programs. Twelve of these studies were abstracts^{38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49} and 10 were articles.^{50, 51, 52, 53, 54, 55, 56, 57, 58, 59} Applicants submitted an audio/video response to six questions which was subsequently scored from 6 to 30. The goal of the SVI was to provide standardized information about applicant’s Interpersonal and Communication skills, and Professionalism. It was introduced in 2016 as a research project and was administered as an operational pilot in the emergency medicine residency selection during the 2018, 2019, and 2020 Match cycles. Although the SVI was not continued for the 2021 Match cycle, these studies were included in our scoping review to assess the value of unidirectional interviewing.

Overall, there were small correlations between SVI scores and other aspects of the application such as USMLE scores,⁴¹ faculty scores of communication and professionalism,⁵¹ electronic standardized letter of evaluation (eLOE),⁵⁵ patient evaluation of communication skills⁴⁶ and traditional interview scores.^{47, 48} One study questioned the utility of the SVI as there was a lack of a relationship between SVI scores and applicant ranking⁴⁰, while another study found that the SVI score changed the likelihood of a program to invite the applicant for an interview in 7% of cases.⁵⁶ Of studies that explored the applicant perspective, two found that applicants did not feel that the SVI should be part of the application process.^{39, 51}

Apart from the studies that assessed the AAMC’s SVI specifically, two other studies described their use of one way video interviewing or asynchronous video interviews.^{60, 61} Both these studies utilized one way interviewing as an adjunct to face-to-face interviews, rather than a replacement. Applicants submitted a video response to three standardized questions that were scored to determine which applicants would be subsequently invited for a face-to-face interview.

Higher scores on this one-way interview were correlated with higher in-person interview scores.^{60, 61} While one study reported a positive correlation between one way interview score and rank list placement,⁶⁰ the other study reported a nonsignificant positive correlation between the two.⁶¹

Overall, results were ambiguous as to what the SVI was measuring, and the value that should be attributed to it amongst other aspects of the emergency medicine selection process. Nonetheless, one-way interviews may hold some promise as an initial screen but there is no evidence we found to demonstrate that it should replace a bi-directional interview.

Technical Limitations

Eleven of the included studies discussed technical limitations of video-based interviewing.^{19, 20, 21, 22, 23, 28, 29, 30, 34, 36, 37} Three studies discussed issues with connectivity that were resolved by reconnecting or switching to telephone interviews without video.^{22, 23, 28} One study discussed the voice delay associated with using the Skype platform for video-based interviews.²¹ One study explained that while faculty were nervous about potential technical issues with video-based interviews, only one interviewer had a temporary technical connectivity problem.³⁶

No studies reported any major concerns from a technical point of view that limited the use of video-based interviewing.

Financial Cost

Fourteen studies discussed the financial costs associated with the selection process.^{19, 20, 21, 22, 23, 2428, 29, 31, 33, 34, 36, 37, 59} Thirteen of these studies reported a reduction in financial costs for either applicants,^{19, 20, 22, 33, 34, 36} programs/interviewers,^{23, 24, 29} or both.^{21, 28, 31, 37} One study reported that applicants who matched successfully spent significantly more money compared to those that did not match.¹⁹ In another study where applicants were given the option of interview format, 25% of applicants chose a video-based interview due to financial limitations.²⁹ Additionally, the importance of modifying the surgical fellowship recruitment process given increases in student debt had been alluded to by one study.³⁶

Overall, video-based interviewing was seen as a way to improve financial costs for all stakeholders, particularly for applicants in whom financial limitations impact their application process.

Opportunity Costs

Fifteen studies discussed the opportunity costs associated with the selection process.^{19, 20, 21, 22, 23, 26, 27, 29, 31, 33, 34, 36, 37, 58, 61} Eleven these studies reported that video-based interviewing afforded the applicants the ability to expend less time with the interview process,^{19, 20, 21, 22, 23, 26, 28, 33, 34, 36, 37} which would mean less time being taken away from clinical or educational commitments.^{20, 21, 28, 34}

Two studies discussed that video-based interviewing was particularly beneficial for applicants that could not get time off work to attend face-to-face interviews²⁹ and for applicants who would not be able to attend the face-to-face interview due to interview scheduling conflicts.²⁰ One study also highlighted that residency programs themselves would experience fewer disruptions with video-based interviewing since residents could take less time away from clinical duties.³⁶

One study explained that the introduction of the SVI may have increased the time required for applicants to prepare for the interview itself.²⁸ From a program’s perspective, one study reported that the utilization of one-way video interviewing prior to face-to-face interviews delayed the face-to-face interviews by 3 weeks, and increased the burden of work from the program.⁶¹

While one-way video interviewing may come at the cost of increased work for both applicants and interviewers, bidirectional video-based interviewing allows applicants to take less time away from personal or professional commitments and results in fewer disruptions for the programs themselves.

Environmental Cost

None of the 43 studies discussed the environmental impact of interviewing in healthcare as it applies to personnel selection.

Body Language

Three studies discussed the role of body language as it pertained to video-based interviewing.^{21, 23, 33} One study commented on the lack of physical contact such as a hand shake, but explained that this was more of a concern for interviewers.²¹ Another study discussed how the loss of video connection in some interviews prevented the assessment of body language which was part of the evaluation.²³ Finally, one study commented on the lack of subjective details from an interaction that are lost in a video-based format.³³

None of the studies discussed the interpretation of body language and how this plays into applicant selection.

Influence on Rank List

There were 12 studies that assessed either the perceived or objective impact of video-based interviews on the rank list.^{19, 26, 27, 28, 29, 30, 35, 45, 56, 53, 60, 61} Two of these studies reported a positive relationship between video-based interview scores and overall rank list.^{60, 61} Three studies found that there were no differences in acceptance rate and/or rank list position based on whether applicants had a face-to-face or video-based interview.^{27, 28, 29}

Three studies reported from the applicants’ perspective that most applicants were comfortable ranking programs after a video-based interview.^{26, 30} One study reported that only 54% of applicants who had a virtual interview felt that the experience was sufficient to make a ranking decision, compared to 92% of their counterparts who had a face-to-face interview experience.³⁵

From the interviewer perspective of determining the rank list, three studies reported that there was no significant difference of interview type on the ranking of applicants.^{28 – 29}

In terms of the SVI, one study reported the lack of any significant correlation between the SVI scores and rank list position,⁴⁵ while another study reported that the SVI score changed the likelihood of inviting an applicant for a face-to-face interview in 7% of cases, with lower SVI scores more likely to decrease the chance of an interview invite than higher scores were to increase the chance of an interview invite.⁵⁶

Quality Assessment

Quality assessment was completed for the 26 peer-reviewed manuscripts included in our scoping review. Using the JBI critical appraisal tools to evaluate each article, 11 studies were felt to have a high risk of bias, 12 with a moderate risk of bias, and only 3 studies with a low risk of bias. Most studies lacked a valid and reliable tool to evaluate applicant/interviewer perspectives on video-based interviews, did not assess or control for potential confounders, or had poor survey response rates. A summary of our quality assessment is provided in Additional File 4.

Our scoping review summarizes the current literature and highlights major themes about video-based interviewing in healthcare. Overall, both financial costs and opportunity costs associated with the selection process were reported to be improved with video-based interviewing, while the impact on environmental costs has not been well explored in the current literature. Bidirectional video-based interviews were well received by both applicants and interviewers, yet a preference remains for face-to-face interviews. One-way video interviewing may be useful in select settings as a screening tool, but was not found to be a good replacement for bidirectional interviewing.

Important features of video-based interviewing that were described by multiple studies included the use of a video tour of the facility/city, an informal video-based session with current trainees, and having a dedicated administrative person to help applicants and interviews navigate through the video-based platform. While technical limitations were anticipated, there were no major technical issues that limited the use of video-based interviews. The interpretation of body language in a video-based setting was not well explored.

In the context of the social distancing measures necessitated by the COVID-19 pandemic, video-based interviewing has garnered recent interest across multiple disciplines within healthcare which were captured by our broad search strategy. Our search was also updated after its initial run to capture the influx of studies that were published since the start of the COVID-19 pandemic. Previous reviews have not been as structured or encompassing of video-based interviewing in healthcare as our scoping review,^{13, 63} and it has been reported that developments addressing medical school/residency interviews are under reported.⁶³

The results of our review are in line with those from a previous literature review, but also serve to highlight gaps in literature. Joshi and colleagues outlined benefits and drawbacks to video-based interviewing.¹³ Similar benefits were found in our study including the decrease in financial costs and time taken away from clinical or academic duties. While Joshi and colleagues allude to the reduction in carbon footprint with video-based interviews, they also did not find any studies that evaluated this aspect.

An important finding in our review was that despite studies reporting that applicants and/or interviewers felt that the video-based interview worked well, completing transitioning away from face-to-face interviews was not seen as a favourable option. From the results of our review, however, reasons for this are unclear. One of the challenges with assessing the reasons for this hesitancy may be the methodology of the available studies. While using surveys to quantify applicant and interviewer perspectives on video-based interviewing is helpful, it falls short in highlighting the thought processes that guide decision making. It has been suggested that qualitative studies that use an inductive approach to data gathering may be more beneficial in such circumstances to get a better understanding of the reasoning behind our decision making.⁶⁴

Another aspect of video-based interviewing that was not well reported in the included studies is the role of body language and non-verbal communication. While the lack of body language was alluded to in three studies, quantifying the impact of body language on the video-based selection process has inherent challenges and has not been assessed in a healthcare context. In a study by Proost and colleagues from the organizational psychology literature, it was found that applicants are less attracted to organizations that use video-based interviews compared to those that use face-to-face interviews for their selection process.⁶⁵ They explain that this perception may be influenced by the decreased ability to convey and interpret nonverbal cues on a virtual platform. While it has been studied on the organizational psychology literature, the results of our scoping review suggest that non-verbal communication as it applies to video-based interviewing in medicine is an area for future research.

Given the nature of the topic, the challenges associated with survey studies, and the inherent biases involved in the selection process, most studies had a moderate or high risk of bias. Additionally, analysing perceptions around video-based interviewing comes with the challenge of measuring differing viewpoints in a reliable and valid way. We did not come across any validated measurement tool as studies developed and implemented their own surveys. While the goal of our scoping review was not to statistically synthesize data, we appreciate that collating the results of these heterogenous studies has its difficulties. Future research on developing an assessment tool to grade the quality of the interviews may prove helpful in standardizing the evaluation of interview processes.

Our scoping review summarizes the available literature on the use of video-based interviewing in healthcare contexts, and has highlighted important areas for further exploration. Video-based interviewing, while necessary during the COVID-19 era, provides benefits from a financial, opportunistic, and environmental point of view that argue for its continued use even after the pandemic. While video-based interviewing has been reported to be a feasible alternative to face-to-face interviewing, hesitancy remains to completely transition from face-to-face interview for reasons that are difficult to extrapolate from the currently available literature. In addition, the role of non-verbal communication and how this factors into decision making is important to evaluate, as it will help to better understand the complex thought processes that underlie personnel selection in healthcare.

Coronavirus disease 2019 (COVID-19)

Preferred reporting items for systematic reviews and meta-analyses (PRISMA)

PRISMA extension for Scoping Reviews (PRISMA-ScR)

Joanna Briggs Institute (JBI)

Standardized Video Interview (SVI)

Association of American Medical Colleges (AAMC)

Accreditation Council for Graduate Medical Education (ACGME)

Electronic standardized letter of evaluation (eLOE)

Ethics approval and consent to participate

As no intervention or patient recruitment was required for this study, research ethics board approval and consent was waived.

Consent for publication

Not applicable.

Availability of data and materials

To ensure transparency and reproducibility, all data generated or analysed during this study has been included in the published scoping review article and/or its supplementary information files. This includes the search strategy, reasons for study exclusion, and extracted data used in analysis.

Competing interests

The authors declare that they have no competing interests.

Funding

There are no sources of funding to declare.

Authors' contributions

HM, IR and RS conceived the study and developed the research question.

RS, and RH performed data acquisition.

HM, RS and DM drafted the manuscript.

HM, IR, RM, RS, RH, DM reviewed and substantively revised the final manuscript.

Acknowledgements

The authors would like to thank Amanda Hodgson for her help with developing the search strategy for this scoping review.

Polacco, M. A., Lally, J., Walls, A., Harrold, L. R., Malekzadeh, S., & Chen, E. Y. Digging into Debt: The Financial Burden Associated with the Otolaryngology Match. Otolaryngol Head Neck Surg. 2017;156(6):1091–6. https://doi.org/10.1177/0194599816686538
Fogel HA, Liskutin TE, Wu K, Nystrom L, Martin B, Schiff A. The Economic Burden of Residency Interviews on Applicants. Iowa Orthop J. 2018;38:9–15.
Van Dermark JT, Wald DA, Corker JR, Reid DG. Financial Implications of the Emergency Medicine Interview Process. AEM Educ Train. 2017;1(1):60–9. https://doi.org/10.1002/aet2.10011
Watson SL, Hollis RH, Oladeji L, Xu S, Porterfield JR, Ponce BA. The Burden of the Fellowship Interview Process on General Surgery Residents and Programs. J Surg Educ. 2017;74(1):167–72. https://doi.org/10.1016/j.jsurg.2016.06.008
Fung, B., Raiche, I., Lamb, T., Gawad, N., MacNeill, A., & Moloo, H. A chance for reform: the environmental impact of travel for general surgery residency interviews. Canadian Medical Education Journal. 2021. https://doi.org/10.36834/cmej.71022
Solomon, C. G., LaRocque R. C. Climate Change – A Health Emergency. The New England Journal of Medicine. 2019;380(3):209-211. https://www.nejm.org/doi/full/10.1056/NEJMp1817067
Harmer A, Eder B, Gepp S, Leetz A, van de Pas R. WHO should declare climate change a public health emergency. BMJ. 2020;797:m797. http://dx.doi.org/doi:10.1136/bmj.m797
Daram SR, Wu R, Tang S-JJ, S.R. D, R. W, Daram SR, et al. Interview from anywhere: Feasibility and utility of web-based videoconference interviews in the gastroenterology fellowship selection process. Am J Gastroenterol. 2014;109(2):155–9. https://doi.org/10.1038/ajg.2013.278
Edje L, Miller C, Kiefer J, Oram D. Using Skype as an Alternative for Residency Selection Interviews. J Grad Med Educ. 2013;5(3):503–5. https://doi.org/10.4300/jgme-d-12-00152.1
Shah SK, Skipper B, Kalishman S, Timm TC, Smith AY AS, Shah SK, Arora S, Skipper B, Kalishman S, Timm TC, et al. Randomized evaluation of a web based interview process for urology resident selection. J Urol. 2012;187(4):1380–4. https://doi.org/10.1016/j.juro.2011.11.108
Tiller D, O’Mara D, Rothnie I, Dunn S, Lee L, Roberts C, et al. Internet-based multiple mini-interviews for candidate selection for graduate entry programmes. Med Educ. 2013;47(8):801–10. https://doi.org/10.1111/medu.12224
Vadi MG, Malkin MR, Lenart J, Stier GR, Gatling JW, Applegate RL. Comparison of web-based and face-to-face interviews for application to an anesthesiology training program: a pilot study. Int J Med Educ. 2016;7:102–8. https://doi.org/10.5116/ijme.56e5.491a
Joshi, A., Bloom, D. A., Spencer, A., Gaetke-Udager, K., & Cohan, R. H. Video Interviewing: A Review and Recommendations for Implementation in the Era of COVID-19 and Beyond. Academic radiology. 2020;27(9):1316–1322. https://doi.org/10.1016/j.acra.2020.05.020
Arksey H, O’Malley L. Scoping studies: Towards a methodological framework. Int J Soc Res Methodol Theory Pract. 2005;8(1):19–32. https://doi.org/10.1080/1364557032000119616
Levac D, Colquhoun H, O’Brien KK. Scoping studies: Advancing the methodology. Implement Sci. 2010;5(1):1–9. https://doi.org/10.1186/1748-5908-5-69
Selvam, R., Hu, R., Musselman, R., Raiche, I., Moloo, H. Video-based interviewing in medicine: protocol for a scoping review. Syst Rev. 2020;9:219. https://doi.org/10.1186/s13643-020-01484-6
Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMAScR): Checklist and Explanation. Ann Intern Med. 2018;169:467–473. doi: 10.7326/M18-0850.
Joanna Briggs Institute. Checklist for systematic reviews and research syntheses. 2017. http://joannabriggs.org/ebp/critical_appraisal_tools
Chandler, N. M., Litz, C. N., Chang, H. L., Danielson, P. D., N.M., C., C.N., L., & H.L., C. Efficacy of Videoconference Interviews in the Pediatric Surgery Match. Journal of Surgical Education. 2019;76(2):420–426. https://doi.org/http://dx.doi.org/10.1016/j.jsurg.2018.08.010
Daram, S. R., Wu, R., Tang, S.-J. J., S.R., D., R., W., Daram, S. R., … Tang, S.-J. J. Interview from anywhere: Feasibility and utility of web-based videoconference interviews in the gastroenterology fellowship selection process. American Journal of Gastroenterology. 2014;109(2):155–159. https://doi.org/10.1038/ajg.2013.278
Edje, L., Miller, C., Kiefer, J., & Oram, D. Using Skype as an Alternative for Residency Selection Interviews. Journal of Graduate Medical Education. 2013;5(3):503–505. https://doi.org/10.4300/jgme-d-12-00152.1
Staicu, M., Hamby, C., Wychowski, M., Reiss, B. Facetime faceoff: evaluation of video conferencing as a novel pre-interview screen for a PGY-1 pharmacy residency. 2015;E182.
Temple, M., Lagzdins, M. Streamlining the residency interview process using Web-based teleconferencing. American Journal of Health-System Pharmacy. 2014;71:697-701. Doi: 10.2145/ajhp130406
McAteer, R., Sundaram, S., Harkisoon, S., & Miller, J. Videoconference Interviews: A Timely Primary Care Residency Selection Approach. Journal of Graduate Medical Education. 2020;12(6):737–744. https://doi.org/https://dx.doi.org/10.4300/JGME-D-20-00248.1
Chukwumah CV, Shega C, Rosen M, Ponsky Jl. Marks JM. The use of remote Computer audio-video processing to conduct surgical fellowship interviews of Deployed physicians. World Congress of Endoscopic Surgery, National Harbor, MD, April 2010.
Healy, W. L., Bedair, H., & W.L., H. Videoconference Interviews for an Adult Reconstruction Fellowship: Lessons Learned. The Journal of Bone and Joint Surgery. American Volume. 2017;99(21):e114. https://doi.org/https://dx.doi.org/10.2106/JBJS.17.00322
Ballejos, M. P., Oglesbee, S., Hettema, J., Sapien, R. An equivalence study of interview platform: Does videoconference technology impact medical school acceptance rates of different groups?. Advances in Health Sciences Education : Theory and Practice. 2018;23(3):601–610. https://doi.org/http://dx.doi.org/10.1007/s10459-018-9817-2
Shah SK, Arora, S, Skipper B, Kalishman S, Timm TC, Smith AY. Randomized evaluation of a web based interview process for urology resident selection. Journal of Urology. 2012;187(4):1380–1384. https://doi.org/http://dx.doi.org/10.1016/j.juro.2011.11.108
Vadi, M. G., Malkin, M. R., Lenart, J., Stier, G. R., Gatling, J. W., & Applegate, R. L. Comparison of web-based and face-to-face interviews for application to an anesthesiology training program: a pilot study. International Journal of Medical Education. 2016;7:102–108. https://doi.org/10.5116/ijme.56e5.491a
Williams K, Kling JM, Labonte HR, Blair JE. Videoconference Interviewing: Tips for Success. J Grad Med Educ. 2015;7(3):331-333. doi:10.4300/JGME-D-14-00507.1
Molina, G., Mehtsun, W. T., Qadan, M., Hause, K. C., Raut, C. P., & Fairweather, M. Virtual Interviews for the Complex General Surgical Oncology Fellowship: The Dana-Farber/Partners Experience. Annals of Surgical Oncology. 2020;27(9):3103–3106. https://doi.org/https://dx.doi.org/10.1245/s10434-020-08778-y
Sripad, A. Videoconference Interviews for Female Pelvic Medicine and Reconstructive Sugery Fellowship During a Pandemic: The Candidate Experience. Female Pelvic Medicine & Reconstructive Surgery. 2020;S181.
Nutter, A., La Rosa, M., Olson, G. Perception of Candidates and Faculty on Maternal Fetal Medicine Fellowship Videoconference Interviewing. Obstetrics and Gynecology. 2020;S75.
, M., S.R., E., L.M., B., M.M., A., F.M., D., J.C., E., … H., F. Initial Experience with a Virtual Platform for Advanced Gastrointestinal Minimally Invasive Surgery Fellowship Interviews. Journal of the American College of Surgeons. 2020;231(6):670–678. https://doi.org/http://dx.doi.org/10.1016/j.jamcollsurg.2020.08.768
Grova MM, Donohue SJ, Meyers MO, Kim HJ, Ollila DW. Direct Comparison of In-Person Versus Virtual Interviews for Complex General Surgical Oncology Fellowship in the COVID-19 Era. Ann Surg Oncol. 2021;28(4):1908-1915. doi:10.1245/s10434-020-09398-2
Vining CC, Eng OS, Hogg ME, et al. Virtual Surgical Fellowship Recruitment During COVID-19 and Its Implications for Resident/Fellow Recruitment in the Future. Ann Surg Oncol. 2020;27(Suppl 3):911-915. doi:10.1245/s10434-020-08623-2
Tiller D, O'Mara D, Rothnie I, Dunn S, Lee L, Roberts C. Internet-based multiple mini-interviews for candidate selection for graduate entry programmes. Med Educ. 2013;47(8):801-810. doi:10.1111/medu.12224
Winfield-Dial, A., Chhabra, N., Schindlbeck, M., & Bowman, S. Demographic Differences Between High and Low Scorers on the Standardized Video Interview. Western Journal of Emergency Medicine. 2018;S48. https://escholarship.org/uc/item/68c0x4pf
Winfield-Dial, A., Chhabra, N., Schindlbeck, M., & Bowman, S. Applicant Attitudes Towards the Standardized Video Interview - An Interim Analysis. Western Journal of Emergency Medicine. 2018;S4. https://escholarship.org/uc/item/5xp7f587
Humbert, A., Pettit, K., Mugele, J., Turner, J., Morgan, Z., & Palmer, M. Correlation of the Standard Video Interview Score With an Established Application Review Process. Society for Academic Emergency Medicine. 2018;S98.
Naemi, B., Clauser, A., Fair, M. Examining the Relationship Between the AAMC Standardized Video Interview and Step 2 Cs Subscores. Western Journal of Emergency Medicine. 2019;S4.
Hakes, E., Schnapp, B., Ritter, D., Kraut, A., Fallon, S., Brown, K., Westergaard, M. Communication and Professionalism: Comparing Standardized Video Interview Scores to Faculty Gestalt. Society for Academic Emergency Medicine. 2018;S276.
Lewis, J., Hall, M., Joseph, J., Dubosh, N., Ullman, E. Standardized Video Interview Scores Do Not Correlate With Attending Evaluations. Society for Academic Emergency Medicine, 2018;S229.
Willis, J., Surles, T., Silverberg, M., Kendall, S., LoCascio, H., Gernsheimer, J., Schechter, J., Regan, A., Smith, T. Are Standardized Video Interview Scores Predictive of Interview Performance? Western Journal of Emergency Medicine. 2018;S5-S6.
Bowers, K., Comp, G., Kalnow, A., Casey, J., Fraser, W., Lloyd, C., Little, A. Are Standardized Video Interview Scores Predictive of Interview Performance? Western Journal of Emergency Medicine. 2018;S18
Hall, M., Joseph, J., Remotti, E., Lewis, J., Ullman, E., Dubosh, N. Standard Video Interview Score Does Not Correlate With Medical Student Communication Skills. Society for Academic Emergency Medicine. 2018;S229.
McHugh, M., Kulstad, C., Van Dermark, J., Bischof, J. Do Standardized or Traditional Interview Questions Correlate With the Standardized Video Interview? Society for Academic Emergency Medicine. 2019;S216
Shah, K., Chung, A., Bond, M., Ardolic, B., Husain, A., Li, I., Cygan, L., Caputo, W., Shoenberger, J., van Dermark, J.Western Journal of Emergency Medicine. 2018;S23.
Krauss, W., Egan, D., Bond, M., Husain, A., White, M., Taylor, T., et al. Correlation Between Emergency Medicine Residency Applicant’s Standardized Video Interview Scores and United States Medical Licensing Examination Results. Society for Academic Emergency Medicine. 2018;S83
Chung AS, Shah KH, Bond M, Ardolic B, Husain A, Li I, Cygan L, Caputo W, Shoenberger J, van Dermark J, Bronner J, Weizberg M. How Well Does the Standardized Video Interview Score Correlate with Traditional Interview Performance?. The Western Journal of Emergency Medicine. 2019;20(5):726–730. https://doi.org/https://dx.doi.org/10.5811/westjem.2019.7.42731
Deiorio, N. M., Jarou, Z. J., Alker, A., Bird, S. B., Druck, J., Gallahue, F. E., … L., F. (2019). Applicant Reactions to the AAMC Standardized Video Interview During the 2018 Application Cycle. Academic Medicine : Journal of the Association of American Medical Colleges. 2019;94(10):1498–1505. https://doi.org/https://dx.doi.org/10.1097/ACM.0000000000002842
Egan, D. J., Husain, A., Bond, M. C., Caputo, W., Cygan, L., Van Dermark, J., et al. Standardized video interviews do not correlate to United States medical licensing examination step 1 and step 2 scores. The Western Journal of Emergency Medicine. 2019;20(1):87–91. https://doi.org/http://dx.doi.org/10.5811/westjem.2018.11.39730
Gallahue, F. E., Hiller, K. M., Bird, S. B., Calderone Haas, M. R., Deiorio, N. M., Hern, H. G., et al. The AAMC Standardized Video Interview: Reactions and Use by Residency Programs During the 2018 Application Cycle. Academic Medicine : Journal of the Association of American Medical Colleges. 2019;94(10):1506–1512. https://doi.org/https://dx.doi.org/10.1097/ACM.0000000000002714
Hopson, L. R., Dorfsman, M. L., Branzetti, J., Gisondi, M. A., Hart, D., Jordan, J., et al. Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine. AEM Education and Training. 2019;3(3):259–268. https://doi.org/https://dx.doi.org/10.1002/aet2.10346
Hopson, L. R., Regan, L., Bond, M. C., Branzetti, J., Samuels, E. A., Naemi, B., et al. The AAMC Standardized Video Interview and the Electronic Standardized Letter of Evaluation in Emergency Medicine: A Comparison of Performance Characteristics. Academic Medicine : Journal of the Association of American Medical Colleges. 2019;94(10):1513–1521. https://doi.org/http://dx.doi.org/10.1097/ACM.0000000000002889
Husain, A., Li, I., Ardolic, B., Bond, M. C., Shoenberger, J., Shah, K. H., et al. The Standardized Video Interview: How Does It Affect the Likelihood to Invite for a Residency Interview?. AEM Education and Training. 2019;3(3):226–232. https://doi.org/https://dx.doi.org/10.1002/aet2.10331
Hall, MM, Lewis, JJ, Joseph, JW, Ketterer, AR, Rosen, CL, Dubosh, NM. Standardized Video Interview Scores Correlate Poorly with Faculty and Patient Ratings. The Western Journal of Emergency Medicine. 2019;21(1):145–148. https://doi.org/https://dx.doi.org/10.5811/westjem.2019.11.44054
Bird, SB, Hern, G, Blomkalns, A, Deiorio NM, Haywood Y, Hiller KM, et al. Innovation in Residency Selection: The AAMC Standardized Video Interview. Academic Medicine : Journal of the Association of American Medical Colleges. 2019;94(10):1489–1497. https://doi.org/https://dx.doi.org/10.1097/ACM.0000000000002705
Schnapp, B. H., Ritter, D., Kraut, A. S., Fallon, S., Westergaard, M. C. Assessing residency applicants’ communication and professionalism: Standardized video interview scores compared to faculty gestalt. Western Journal of Emergency Medicine. 2019;20(1):132–137. https://doi.org/http://dx.di.org/10.5811/westjem.2018.10.39709
Breitkopf, D. One Way Video Interviewing As A Method to Augment the Residency Application. Obstetrics & Gynecology. 2018;S31.
Breitkopf, DM, Green, IC, Hopkins, MR, Torbenson, VE, Camp, CL, Turner, NS. Use of Asynchronous Video Interviews for Selecting Obstetrics and Gynecology Residents. Obstetrics and Gynecology. 2019;134(4):9S-15S. https://doi.org/https://dx.doi.org/10.1097/AOG.0000000000003432
Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. https://doi.org/10.1371/journal.pmed1000097.
Daniel M, Gordon M, Patricio M, Hider A, Pawlik C, Bhagdev R et al. An update on developments in medical education in response to the COVID-19 pandemic: A BEME scoping review: BEME Guide No. 64. Medical Teacher. 2021;43(3). https://doi.org/10.1080/0142159X.2020.1864310
Kuper, A., Reeves, S., & Levinson, W. An introduction to reading and appraising qualitative research. BMJ. 2008;337(3):a288. https://doi.org/10.1136/bmj.a288
Proost, K., Germeys, F., & Vanderstukken, A. Applicants’ pre-test reactions towards video interviews: the role of expected chances to demonstrate potential and to use nonverbal cues. European Journal of Work and Organizational Psychology. 2021;30(2):265-273. DOI: 10.1080/1359432X.2020.1817975

Due to technical limitations, table 1 is only available as a download in the Supplemental Files section.

Download PDF

Reviewer #3 agreed at journal
10 Nov, 2021
Review #1 received at journal
18 Oct, 2021
Reviews received at journal
18 Oct, 2021
Reviewers invited by journal
18 Oct, 2021
Reviewer #2 agreed at journal
17 Oct, 2021
Reviewer #1 agreed at journal
17 Oct, 2021
Editor assigned by journal
15 Oct, 2021
Editor invited by journal
14 Oct, 2021
Submission checks completed at journal
04 May, 2021
First submitted to journal
26 Apr, 2021

You are reading this latest preprint version

Video-Based Interviewing in Medicine: A Scoping Review

Status:

Version 1

Abstract

Figures

Background

Methods

Results

Discussion

Conclusion

List Of Abbreviations

Declarations

References

Tables

Supplementary Files

Status:

Version 1