Study Population
Participants were selected from the Mental Health and Access to Care Survey (MHACS), a survey conducted by Statistics Canada with the broader goal of collecting information about the mental health of Canadians [26]. MHACS is a nationally-representative, cross-sectional survey that was completed over the period March to July 2022. The sampling frame was developed from the 2021 Census and represented all provinces of Canada (excluding territories); however, individuals from minoritized groups were oversampled. Individuals living on reserves and other Indigenous settlements, full-time members of the Canadian Forces, and those in collective dwellings (e.g., institutional residences) were not sampled in MHACS (approximately 3% of the Canadian population meets one of these criteria). Participants were 15 years or older and, of the 39,485 individuals sampled, a response was obtained from 9,861 individuals (response rate of 25%). Non-response adjustment weighting was implemented to reduce bias, and the population was determined to be well-represented when compared with the 2021 Census. Data were stored and accessed at a secure Research Data Centre (RDC) facility at the University of Toronto. Individuals under 18 years of age (n = 452) did not report on early-life adversity and were therefore excluded, leaving an eligible sample for analyses of n = 9,409.
Measures
Pandemic Stress. A total score of pandemic stressors was derived from a set of 14-items asking the respondent, “have you experienced any of the following impacts due to the COVID-19 pandemic?”. Items included stressors relating to finances (e.g., loss of job/income, inability to meet financial obligations or essential needs), service access (e.g., difficulty accessing required health care services), physical health (e.g., diagnosis of COVID-19, hospitalization), and distress/isolation. These items were responded to with a binary response option (i.e., “Yes” [1] or “No” [0]). Items were summed to produce a total score of different stressors experienced, whereby a higher score indicated more stressors (range = 0–14). Acceptable internal consistency was observed across items (α = .76). Due to a possible overlap in the qualities of a subset of these items (i.e., “Feelings of loneliness or isolation”, “Emotional distress”, and “Physical health problems”) with our psychiatric outcomes (e.g., depression symptoms), a sensitivity analysis was conducted which omitted these items and re-summed the overall scale (range = 0–11).
Early-Life Adversity. A modified, 6-item short version of the Childhood Experiences of Violence Questionnaire (CEVQ-SF) was used to assess early-life adversity. Respondents were asked about, “things that may have happened to you before you were 16 in your school, in your neighbourhood, or in your family”, with items related to observing intimate partner violence, direct physical abuse, and direct sexual abuse. Respondents specify how many times the events occurred: “Never”, “1 to 2 times”, “3 to 5 times”, “6 to 10 times”, and “More than 10 times”. Each of these items were dichotomized (“Never” [0] vs. “1 or more” [1]) and a summed scale of early-life adversity was produced (range = 0–6), with higher scores indicating more types of early-life adversity. The CEVQ-SF has been demonstrated to have strong psychometric properties, as well as good internal consistency (α = .85) [27].
Social Support. The 10-item version of the Social Provisions Scale (SPS-10) was used to measure current social supports. The SPS-10 is derived from a larger 24-item scale (SPS-24) and comprises ten items where individuals report “to what extent each statement describes your current relationships with other people” (e.g., people they can depend on, people that provide emotional security, people that provide advice). Items are responded to on a four-point Likert scale ranging from “Strongly agree” to “Strongly disagree”. Items are summed to produce a total social support score (range = 10–40), with higher scores indicating higher levels of perceived social support. The SPS-10 has been demonstrated to have strong psychometric properties, with strong concurrent validity with the SPS-24 and similar predictive power, as well as good internal consistency (α = .88) [28].
Psychiatric Outcomes. The following psychiatric outcomes were assessed in the current study: major depressive episode, bipolar disorder, generalized anxiety disorder, social anxiety disorder, substance use disorder, and suicidality. All psychiatric outcomes (except suicidality) were assessed with an adapted version of the World Mental Health-Composite International Diagnostic Interview (CIDI) [29], based on criteria drawn from the Diagnostics and Statistics Manual, Fourth Edition (DSM-IV). Evaluations of reliability and validity have consistently demonstrated the effectiveness of the CIDI in discerning the presence or absence of psychiatric disorder across various clinical and non-clinical contexts [30]. Suicidality was measured using three items in which the respondent specified whether they had thought about, planned, or attempted suicide. This variable was dichotomized, such that endorsement of any suicidality was treated as “Present suicidality” and endorsing “No” for all three items was treated as “Absent suicidality”. To capture outcomes particular to the pandemic period, all outcomes were based on the previous twelve-month period and were reported as “Present” [1] or “Absent” [0].
Covariates. Multiple covariates were considered, where variables that could confound the association between pandemic stress, early-life adversity, social support, and psychiatric outcomes were controlled. Covariates included sex at birth (“Female” [0] vs. “Male” [1]), age (continuous), household income (we dichotomized the income variable to reflect Canada’s household poverty line, “>=$40k” [0] vs. <$40k), minoritized group (“No” [0] vs. “Yes” [1]), and marital status (dichotomized as “Married/Living common law” [0] vs. “Not married/Not living common law” [1]). Sex was explored as a moderator in the primary analyses.
Statistical Analyses
In order to adjust for unequal selection probabilities due to the complex survey design, the MHACS design effect weights (adjusted for non-response) were incorporated into to all descriptive and inferential modelling. In addition, variance estimates were produced using bootstrap weights (BSW1-BSW1000) to incorporate variability coming from MHACS design. Weighted prevalence estimates were calculated for all psychiatric outcomes, as well as weighted means and frequencies for all predictors and covariates, stratified across subgroups with and without a psychiatric disorder. Unweighted frequency counts are presented, whereas proportions were weighted. Separate two-step logistic regression models were conducted for each psychiatric outcome. The first set of models assessed the main effects of early-life adversity and pandemic stress on psychiatric outcomes (Model 1). The second step then added the interaction between early-life adversity and pandemic stress (Model 2). The second set of models assessed the main effects of social support and pandemic stress on psychiatric outcomes (Model 1). The second step then added the interaction between social support and pandemic stress (Model 2). All models were then replicated with sex as a moderator, with main and interactive effects included (i.e., main effects, two-way interactions, and three-way interactions involving sex). To address the issue of multiple comparisons, we applied a conservative Bonferroni correction (α = 0.05/6 psychiatric outcomes in each model = .0083).
For each outcome of interest, cases were excluded when outcome data was missing (substance use disorder [n = 679 missing]; generalized anxiety disorder [n = 499]; major depression [n = 390]; social anxiety disorder [n = 239]; bipolar disorder [n = 182]; suicidality [n = 102]) but were maintained in other outcome analyses if data was available. Fractional Hotdeck Imputation (FHDI) [31] was used to impute missing data for predictors and covariates, with the highest amount of data missing for social support (n = 715) and early-life adversity (n = 579). FHDI is a robust method for imputation with complex survey designs, where one missing recipient can be imputed with multiple fractional donors (10 donors used in the present study). Each donor contributes a fraction of the original weight of the recipient, whereby the sum of fractional donor weights is equivalent to the single recipient. This analysis then recalculates study survey weights and bootstrapped weights to use in subsequent analyses. Full details of missing data are presented in supplemental material (Table S1). Continuous variables were mean centered in all models to reduce multicollinearity between predictors involved in interactions and to assist in interpreting model intercepts. All analyses were conducted using SAS Systems for Windows (version 9.4) [32]. SAS procedures accommodating complex survey design were used for all imputation, descriptive, and inferential analyses (i.e., PROC SURVEYIMPUTE, PROC SURVEYFREQ, PROC SURVEYMEANS, PROC SURVEY LOGISTIC) [32].