Participant recruitment
The sample was a self-selected non-probability sample of social media users aged ≥18 years and residing in the U.S. who responded to an anonymous web-based survey administered via Qualtrics (Provo, UT).16 To minimize redundant reporting, participants could only complete the survey once (based on IP address). Eligibility was confirmed through two screening questions (age and residence in the U.S.) at the start of the survey. Survey reporting followed the American Association for Public Opinion Research guidelines.17 The New York University Institutional Review Board reviewed and exempted the study procedures.
Recruitment was facilitated via a social media advertisement campaign through Facebook and its affiliated platforms. Used by 69% of U.S. adults, Facebook was chosen because it is the most popular social media platform among adults ≥65 years.18,19 A growing body of evidence suggests that Facebook is a valid and effective recruitment tool in health research, resulting in lower costs and shorter recruitment periods than other methods.20 The advertisements ran for eleven consecutive days, from March 20-30, 2020.
Survey
The survey questionnaire was developed for this study (See Supplementary File S1 Questionnaire). The survey was informed by the Health Belief Model (HBM), which is a widely used model to explain preventive health behaviors based on knowledge, attitudes, and cues to action.21,22 HBM has been previously utilized to guide surveys for other viral outbreaks, such as H1N1 and Middle East Respiratory Syndrome (MERS),23-27 and for Ebola in the U.S.28,29 The survey was also informed by the World Health Organization (WHO) Tool for behavioral insights on COVID-19.30 The survey included questions on COVID-19 knowledge, risk perceptions, and preventive behaviors, and psychometrically validated mental health scales adapted for this pandemic.
Knowledge of COVID-19 was measured by 13 binary response format (True/False) items, such as “Coronavirus is a contagious disease.” Responses consistent with information provided by the CDC as of March 11, 2020, were summed to create a composite knowledge score
Awareness of COVID-19 Protective Practices was assessed by 10 binary response format (True/False) items, that respondents may have considered preventive of COVID-19 infection, such as “Getting a flu shot.” Items were selected from previous surveys28,31,32 and updated to reflect behaviors relevant to the current pandemic. Responses consistent with CDC recommendations as of March 11, 2020, were summed to create a composite COVID-19 prevention score.
Adoption of COVID-19 Protective Practices was assessed by 12 binary response format (Yes/No) items about specific evidence- and non-evidence-based behaviors that respondents may have considered preventive of COVID-19 infection, such as “Started wearing rubber gloves in public.”
COVID-19-related changes in tobacco and alcohol use were assessed by the question “Since hearing about the Coronavirus outbreak, has your smoking (tobacco products) and alcohol use behaviors changed?” Response options ranged from “Much more” to “Much less” and included “Not applicable.” The variables were re-coded as “more,” “less,” or “no change.”
Anxiety and depression related to COVID-19 were assessed with an adapted version of the 4-item Patient Health Questionnaire (PHQ-4).31,33 The stem question was, “Over the last 7 days, how often have you been bothered by any of the following problems because of the Coronavirus outbreak?” Response options were rated on a 4-point Likert scale ranging from “Not at all” to “Nearly every day.” Total scores ranged from 0-12; with higher scores indicative of greater anxiety and depression symptoms. The score was dichotomized based on the clinical cutoff for possible depression and anxiety (<6 and ≥6).33 The scale demonstrated internal reliability (alpha=0.89).
Impact of Event Scale (IES) and its abbreviated 6-item version (IES-6) are widely validated scales to measure subjective stress.27,34,35 We adapted the IES-6 scale to measure stress associated with the COVID-19 pandemic. An item example was, “I thought about Coronavirus when I didn’t mean to,” with 4 response options ranging from “Not at all” to “Nearly every day.” The mean item response was calculated (possible range from 0 to 3), with higher mean scores indicative of more subjective stress. The sample was dichotomized at the median into high and low stress scores. The scale’s internal consistency was 0.86.
Pessimism was assessed by the question: “I am optimistic that the Coronavirus outbreak will be controlled in the next 3 months.” Response options on the 4-point Likert scale ranged from “Strongly agree” to “Strongly disagree.” The variable was reverse coded and dichotomized into a Pessimism variable (Disagree/Strongly Disagree=0; Strongly Agree/Agree=1).
Demographics assessed included sex, race, age category (by decade), employment status, educational attainment, living with children <18 years of age, state of residence (re-coded by U.S. Census region36), urban/rural residence, and political party affiliation.
Statistical analysis
Given the potential importance of age as a demographic risk factor for mortality among people with COVID-19 infection, the sample was categorized into three age groups: (1) 18-39 years, (2) 40-59 years, and (3) ≥60 years. Descriptive statistics characterized respondents’ demographics and COVID-19-related knowledge, behaviors, substance use, and mental health for the total sample and the three age categories. Pearson’s chi-squared tests for categorical variables, and ANOVA tests for continuous variables, were used to examine differences by age categories. Post hoc pairwise comparisons were also tested. All tests were two-sided with significance level of p<0.05. Logistic regression analyses assessed changes in alcohol consumption and smoking associated with anxiety, depression, and stress, controlling for age and race. All analyses were complete case analyses. Statistical analyses were performed using Stata version 15.1 (StataCorp, College Station, TX).