Interventions to Mitigate COVID-19 Misinformation: Protocol for a Scoping Review

doi:10.21203/rs.3.rs-416531/v1

Download PDF

Protocol

Interventions to Mitigate COVID-19 Misinformation: Protocol for a Scoping Review

https://doi.org/10.21203/rs.3.rs-416531/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Background: The duration and impact of the COVID-19 pandemic depends in a large part on individual and societal actions which is influenced by the quality and salience of the information to which they are exposed. Unfortunately, COVID-19 misinformation has proliferated. To date, no systematic efforts have been made to evaluate interventions that mitigate COVID-19-related misinformation. We plan to conduct a scoping review that seeks to fill several of the gaps in the current knowledge of interventions that mitigate COVID-19-related misinformation.

Methods: A scoping review focusing on interventions that mitigate COVID-19 misinformation will be conducted. We will search (from January 2020 onwards) MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Africa-Wide Information, Global Health, WHO Global Literature on Coronavirus Disease Database, WHO Global Index Medicus, and Sociological Abstracts. Grey literature will be identified using Disaster Lit, Google Scholar, Open Science Framework, governmental websites and preprint servers (e.g. EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints). Study selection will conform to Joanna Briggs Institute Reviewers’ Manual 2020 Methodology for JBI Scoping Reviews. Only English language, original studies will be considered for inclusion. Two reviewers will independently screen all citations, full-text articles, and abstract data. A narrative summary of findings will be conducted. Data analysis will involve quantitative (e.g. frequencies) and qualitative (e.g. content and thematic analysis) methods.

Discussion: Original research is urgently needed to design interventions to mitigate COVID-19 misinformation. The planned scoping review will help to address this gap.

Systematic Review registrations: Systematic Review Registration: Open Science Framework (osf/io/etw9d).

Health Economics & Outcomes Research

Infectious Diseases

COVID-19

misinformation

health

online

mitigate

The COVID-19 pandemic represents a substantial challenge to global human well- being. The duration and impact of the pandemic depends in a large part on individ- ual and societal actions and, therefore, to the quality and salience of the information to which people are exposed [1]. Unfortunately, COVID-19 misinformation has pro- liferated, especially on social media [2]. Misinformation is defined as information that has the features of being false or clearly unsubstantiated, determined based on expert opinion and evidence [3].

COVID-19 misinformation comes in many forms. For example, unlikely theories about the virus being created as a biological weapon in China. As large-scale vacci- nation has scaled up, COVID-19 vaccine-related misinformation has also appeared, such as false reports about Bill Gates’ plan to equip COVID-19 vaccines with mi- crochips to track and control peoples’ actions [4]. Such misinformation may cause people to turn to ineffective and possibly harmful remedies, overreact (e.g., by hoarding goods) or, more dangerously, underreact (e.g., by engaging in risky be- havior and inadvertently spreading the virus). Misinformation may also delay ac- cess to care, negatively affecting health outcomes [5]. Such information may also worsen existing fear around vaccines and limit their uptake by a population [6], perhaps reducing the population level of indirect protection from the vaccine, or even preventing herd immunity that could eliminate the virus.

The growing danger of COVID-19-related misinformation has spurred efforts to develop and evaluate interventions designed to mitigate the spread of falsehoods and sustain public trust in evidence-based care. Interventions have employed a variety of strategies designed to debunk misinformation, including accuracy reminders [1], curated infographics [7], and misinformation refutation [8]. While such strategies have shown some potential in reducing the impact of COVID-19 misinformation, individuals tend to mitigate misinformation through other means, most commonly web searches [9]. Thus, despite a growing number of studies that attempt to mit- igate COVID-19 misinformation, we are far from knowing when and how to best intervene. In addition, there is a need to capture adverse events related to these types of interventions. Social media interventions also have backfired and increased belief in falsehoods [10].

To date, no systematic efforts have been made to evaluate interventions that miti- gate COVID-19-related misinformation. Past reviews have detailed interventions to mitigate misinformation on social media [11, 12, 13, 14] and the prevalence of misin- formation on social media [15, 16], but have not focused on COVID-19. To provide information that can be used to design effective interventions for COVID-19 mis- information, we plan a scoping review that seeks to compile published evidence in the field to identify gaps in current understanding of experimental evidence regard- ing the mitigation of COVID-19-related misinformation. We will conduct a scoping review rather than use other methods of research synthesis because scoping reviews are appropriate for mapping an area of research [17]. COVID-19 misinformation intervention research outcomes are likely not sufficiently similar to each other to warrant pooling. The review will take a broad view of COVID-19 misinformation, including aspects related to vaccines, COVID-19 origins, and public health mea- sures.

The review protocol has been preregistered within the Open Science Framework database (osf/io/etw9d) will be reported in accordance with the reporting guid- ance provided in the Preferred Reporting Items for Systematic Reviews and Meta- analyses extension for Scoping Reviews (PRISMA-ScR) [18] (see checklist in Addi- tional file 1). Research objectives, inclusion criteria, and methodological techniques will be determined before study commencement using the Joanna Briggs Institute Reviewers’ Manual 2020 Methodology for JBI Scoping Reviews [19]. This process will adhere to the indicated framework: 1) identifying research question; 2) devel- oping comprehensive search strategy; 3) identifying relevant studies; 4) selecting studies; 5) charting data; and 6) collating, summarizing, and reporting results. The study team will develop a search strategy as recommended by the 2020 Methodology for JBI Scoping Reviews.

This scoping review will be conducted by 13 individuals: 12 researchers from sev- eral universities worldwide, from a range of disciplines (e.g. public health, medicine, communication studies, mathematics, nursing, computer science, political science), and an informationist from the Harvey Cushing/John Hay Whitney Medical Li- brary at Yale University. As mentioned above, the objective of the scoping review is to develop a better understanding of the current research landscape around in- terventions to mitigate COVID-19 misinformation by investigating existing studies and gaps in the research. The broad research questions are “what are the benefits and risks of interventions to mitigate COVID-19 misinformation?” and “what are the gaps in the current knowledge base on interventions to mitigate COVID-19 mis- information?” The search strategy will be performed in line with techniques that enhance methodological transparency and improve the reproducibility of the results and evidence synthesis.

Information sources and search strategy

The primary source of literature will be a structured search of electronic databases (from January 2020 onwards): MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science Core Collection, Africa-Wide Information, Global Health, WHO Global Literature on Coronavirus Disease Database, WHO Global Index Medicus, and So- ciological Abstracts. The secondary source of potentially relevant material will be a search of preprint servers (e.g. EuropePMC, PsyArXiv, MedRxiv, JMIR Preprints), Disaster Lit, Google Scholar (e.g. the first five pages will be searched), Open Sci- ence Framework, governmental websites and the COVID-19 social science research tracker [20]. The references of included documents will be hand-searched to identify any additional evidence sources. We will also conduct forward citation chaining. The search strategy will be designed by a research librarian and peer-reviewed by using the Peer Review of Electronic Search Strategies (PRESS) checklist [21]. A draft search strategy for Scopus is provided in Additional file 2. We will use search terms consistent with our main search to find articles for inclusion. The same key- words for the main search will be used to search grey literature each time. All grey literature will be compiled in a folder and reviewed similarly to articles obtained from our database searches. EndNote, a bibliographic software, will be used to store, organize, and manage all references [22].

Eligibility criteria

We will include all intervention studies that mitigate COVID-19 misinformation. Only English language studies will be considered for inclusion. Past work suggests that excluding non-English language records from a review has a minimal effect on results [23, 24].

Inclusion criteria

Published research (peer-reviewed and grey literature where primary data was col- lected such as reports, research letters and briefs) investigating interventions that mitigate COVID-19 misinformation (as long as the authors have denoted the topic of study as misinformation) in all populations, and settings will be eligible for in- clusion.

Only intervention-based studies will be included (e.g. experimental studies, quasi- experimental studies, randomized controlled trials).

There will be no restrictions on the region.

Studies reported only as conference abstracts will also be included, only if we do not have access to the full paper. Conference abstracts are often left out of sys- tematic reviews as they may not contain adequate information to conduct quality assessment or a meta-analysis. Here, we will include conference abstracts as they are often published earlier than full manuscripts [25], which is key to a thorough scoping review on an ongoing phenomenon.

Exclusion criteria

Commentaries, correspondences, case reports, case series, editorials, and opinion pieces will be excluded. Case reports and case series often contain relatively limited evidence [26].

Qualitative studies will be excluded.

Non-intervention studies will be excluded.

Governmental, other agency guidelines and white papers will be excluded. Reviews such as systematic reviews and scoping reviews will be excluded, but we will review the references in these for inclusion, if applicable.

Screening and selection procedure

All reports identified from the searches will be screened by two reviewers indepen- dently. First, titles and abstracts of articles returned from initial searches will be screened based on the eligibility criteria outlined above. Second, full texts will be examined in detail and screened for eligibility. Third, references of all considered articles will be hand-searched to identify any relevant report missed in the search strategy. We will also conduct forward citation chaining. Any disagreements will be resolved by discussion, or if necessary, with a third reviewer. A flow chart show- ing details of studies included and excluded at each stage of the study selection process will be provided. We will contact authors where necessary if the abstracts do not provide sufficient information [25]. Covidence will be used to manage the title/abstract and full-text screening phases [27].

Data extraction

Reviewers will undergo a practice exercises till they have a high level of agreement (> 0.8 kappa) and then independently extract data from studies. Reviewers will abstract the data using a pretested data extraction template. We will use a stan- dardized coding protocol to collect information such as: title of study, authors, date published; study setting; study design; description of methodology; description of study sample; type of intervention; type of misinformation (if any); main findings. Even though a formal risk of bias is not planned for this scoping review, we will note which studies are pre-prints and have not been formally peer-reviewed. We will also note if some studies fail to report appropriate information.

Data synthesis

Outcomes and other information collected regarding selected studies will be synthe- sized using quantitative (e.g. outcomes) and qualitative (e.g. content and thematic analysis) methods, with a narrative summary of findings conducted. Synthesis will be presented in tables, summary data in graphs, and individual data for each study in tables. The broad goal of the synthesis is to identify gaps in research and present recommendations for future research agendas.

There has been limited research that compiles available evidence from various set- tings regarding interventions that mitigate COVID-19 misinformation. Our review will provide an overview of these studies and synthesize available evidence. We will provide an overview of known gaps in the literature, such as how to target corrective information better and to make it more effective, disrupt the formation of linkages between group identities and false claims and reduce the flow of cues reinforcing those claims from elites and the media [28]. There is much anecdotal work around COVID-19 misinformation, with few intervention studies. The planned review will highlight areas of research focus and gaps that require more attention, and capture adverse events related to these types of interventions. Moreover, the COVID-19 context is evolving, especially with large-scale vaccination in the US likely affect- ing misinformation in a rapidly shifting fashion, as well as the scientific evidence around the illness adapting to newer studies being conducted throughout the world. Results will thus provide high-level information to inform, support, and customize the design of interventions to mitigate COVID-19 misinformation. As researchers attempt to minimize COVID-19 misinformation, they need to be aware of scientific evidence to develop interventions to achieve their aim. The planned scoping review seeks to provide this evidence by contributing an evaluation of what is currently known about interventions that mitigate COVID-19 misinformation, with the goal of identifying gaps in research and presenting recommendations for future research foci.

The methodological strength of the planned scoping review is the use of a trans-parent and reproducible procedure for a scoping literature review. We state the data sources, search strategy, and data extraction [29]. Through publishing this research protocol, we strengthen the clarity of the search strategy. The informa- tion from the planned review may provide guidance going forward, as COVID-19 likely transforms itself into a seasonal endemic infection like influenza [30]. Thus, some of the insights in the planned review may be helpful in the coming decade. Any amendments to this protocol will be documented in the final published scoping review with reference to saved searches and analysis.

Results of the review will first be posted to a preprint server so that results can be of benefit more quickly, and then disseminated in a peer-reviewed journal and likely in other media such as: conferences, seminars, symposia. The protocol and final review article will be made open access upon publication. As per PRISMA-ScR guidelines, we will present results in a user-friendly format [31].

Limitations

Our planned review should be read in line with some limitations. Although we plan to search several databases and gray literature sources, we may miss some studies; due to the rapid research pace around the COVID-19 pandemic, it is likely that relevant research, crosscutting across different disciplines, exists in fragmented indexing databases. Not all authors we reach out to may respond and we may thus miss some unpublished work. We may not be able to make policy recommendations due to the lack of quality appraisal of studies [32]. The quickly changing COVID-19 context may be a potential limitation.

PRISMA-ScR: PRISMA Extension for Scoping Reviews

JBI: Joanna Briggs Institute

COVID-19: Coronavirus Disease 2019

Availability of data and materials

The datasets used and analyzed will be made available upon reasonable request.

Ethical Approval and Consent to participate

Not applicable

Consent for publication

All authors approved submission.

Availability of supporting data

Available from authors at reasonable request.

Competing interests

The authors declare that they have no competing interests.

Funding

Study was funded by the Foundation for a Smoke-Free World. The funding body had no role in the design, analysis, or interpretation of the data in the study.

Author’s contributions

NK wrote the first draft. NK, KN, LF, NW, KK, JDT, CTB, QD, SMJ, MDC, JLS, BJN, OP contributed to the manuscript write-up and review.

Pennycook G, McPhetres J, Zhang Y, Rand D. Fighting COVID-19 misinformation on social media: Experimental evidence for a scalable accuracy nudge intervention. PsyArXiv Preprints. 2020;10.
Frenkel S, Alba D, Zhong R. Surge of virus misinformation stumps Facebook and Twitter. The New York 2020;8.
Vraga EK, Bode Correction as a Solution for Health Misinformation on Social Media. 2020;110:S278–S280.
Evanega S, Lynas M, Adams J, Smolenyak K, Insights CG. Coronavirus misinformation: quantifying sources and themes in the COVID-19 ‘infodemic’. JMIR Preprints. 2020;.
Wang Y, McKee M, Torbica A, Stuckler D. Systematic literature review on the spread of health-related misinformation on social media. Social Science & Medicine. 2019;240:112552.
Loomba S, de Figueiredo A, Piatek S, de Graaf K, Larson HJ. Measuring the Impact of Exposure to COVID-19 Vaccine Misinformation on Vaccine Intent in the UK and medRxiv. 2020;.
Agley J, Xiao Y, Thompson EE, Golzarri-Arroyo L. COVID-19 Misinformation Prophylaxis: Protocol for a Randomized Trial of a Brief Informational Intervention. JMIR research protocols. 2020;9(12):e24383.
MacFarlane D, Tay LQ, Hurlstone MJ, Ecker UK. Refuting Spurious COVID-19 Treatment Claims Reduces Demand and Misinformation Sharing. Journal of Applied Research in Memory and Cognition. 2020;.
Geeng C, Francisco T, West J, Roesner F. Social Media COVID-19 Misinformation Interventions Viewed Positively, But Have Limited Impact. arXiv preprint arXiv:201211055. 2020;.
Nyhan B, Reifler J. When corrections fail: The persistence of political misperceptions. Political Behavior. 2010;32(2):303–330.
Walter N, Brooks JJ, Saucier CJ, Suresh S. Evaluating the impact of attempts to correct health misinformation on social media: A meta-analysis. Health Communication. 2020;p. 1–9.
Wood T, Porter E. The elusive backfire effect: Mass attitudes’ steadfast factual adherence. Political Behavior. 2019;41(1):135–163.
Walter N, Murphy ST. How to unring the bell: A meta-analytic approach to correction of misinformation. Communication Monographs. 2018;85(3):423–441.
Chan MpS, Jones CR, Hall Jamieson K, Albarrac´ın Debunking: A meta-analysis of the psychological efficacy of messages countering misinformation. Psychological science. 2017;28(11):1531–1546.
Suarez-Lledo V, Alvarez-Galvez J. Prevalence of Health Misinformation on Social Media: Systematic Journal of medical Internet research. 2021;23(1):e17187.
Porter E, Wood TJ. False alarm: The truth about political mistruths in the Trump Cambridge University Press; 2019.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. International journal of social research methodology. 2005;8(1):19–32.
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Annals of internal medicine. 2018;169(7):467–473.
Peters MD, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evidence Synthesis. 2020;18(10):2119–2126.
Matias J, Leavitt A. COVID-19 social science research tracker. GitHub. https://github. com/natematias/covid-19-social-science-research;
Lefebvre C, Duffy S. Peer reviewing search strategies. HTAi 2018;.
Clarivate Analytics. Endnote X8 for windows. Philadelphia, PA: Clarivate Analytics. 2017;.
Nussbaumer-Streit B, Klerings I, Dobrescu A, Persad E, Stevens A, Garritty C, et al. Excluding non-English publications from evidence-syntheses did not change conclusions: a meta-epidemiological Journal of Clinical Epidemiology. 2020;118:42–54.
Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical International journal of technology assessment in health care. 2012;28(2):138.
Scherer RW, Saldanha How should systematic reviewers handle conference abstracts? A view from the trenches. Systematic reviews. 2019;8(1):264.
Turner RM, Bird SM, Higgins The impact of study size on meta-analyses: examination of underpowered studies in Cochrane reviews. PloS one. 2013;8(3):e59202.
VH Innovation. Covidence systematic review software. Melbourne, Australia. 2017;.
Nyhan B. Facts and myths about misperceptions. Journal of Economic Perspectives. 2020;34(3):220–36.
Silagy CA, Middleton P, Hopewell S. Publishing protocols of systematic reviews: comparing what was done to what was planned. Jama. 2002;287(21):2831–2834.
Murray CJ, Piot The Potential Future of the COVID-19 Pandemic: Will SARS-CoV-2 Become a Recurrent Seasonal Infection? JAMA. 2021;.
Miake-Lye IM, Hempel S, Shanman R, Shekelle PG. What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products. Systematic reviews. 2016;5(1):28.
Bostr¨om AM, Slaughter SE, Chojecki D, Estabrooks CA. What do we know about knowledge translation in the care of older adults? A scoping review. Journal of the American Medical Directors Association. 2012;13(3):210–219.

Download PDF

Reviews received at journal
03 Dec, 2021
Reviewer #1 agreed at journal
02 Dec, 2021
Reviewers invited by journal
20 Aug, 2021
Editor assigned by journal
03 Aug, 2021
Editor invited by journal
02 Aug, 2021
Submission checks completed at journal
17 Apr, 2021
First submitted to journal
12 Apr, 2021

You are reading this latest preprint version

Interventions to Mitigate COVID-19 Misinformation: Protocol for a Scoping Review

Status:

Version 1

Abstract

Background

Methods/design

Information sources and search strategy

Eligibility criteria

Inclusion criteria

Exclusion criteria

Screening and selection procedure

Data extraction

Data synthesis

Discussion

Limitations

Abbreviations

Declarations

Availability of data and materials

Ethical Approval and Consent to participate

Consent for publication

Availability of supporting data

Competing interests

Funding

Author’s contributions

References

Supplementary Files

Status:

Version 1