Subjects and Procedures
The present study was part of a wider international project titled: Covid Mental health Survey “Mental health effects of the COVID-19 outbreak – a longitudinal international comparison” (COMET). Detailed information concerning this closed cohort and methodology can be found in the published protocol (OSF | COMET- COVID-19 Mental Health Survey, 2022).
In the present study, only participants replying “Yes” to the following question were included: “Before the start of the COVID-19 pandemic, has a doctor or other healthcare provider ever told you that you have a mental health condition?” (Yes/NO).
Participants were enrolled in 13 different countries: Australia, China, France, Germany, Indonesia, Italy, Netherlands, South Africa, Spain, Sweden, Switzerland, Turkey, and United Kingdom. Recruited online between May and July 2020, participants completed the survey after providing informed consent, and were asked permission to be contacted again for following waves of the questionnaire. Those who agreed to be contacted again received a personal link via email with an invitation to participate in the following four waves. The subsequent waves of the survey took place in September- October 2020, December 2020, March-April 2021 and May-July 2022. Inclusion criteria were an age of 18 or older, and the survey was available in 10 languages (Bahasa Indonesia, Cantonese, Dutch, English, French, Italian, German, Spanish, Swedish and Turkish). The procedure and the aims of the study were reported at the beginning of the questionnaire. The informed consent was obtained online from all participants via a secure web link, and participants were free to withdraw without giving an explanation at any time with no consequences. The COMET study was approved by the Ethical Review Board of the Faculty of Behavioral and Movement Sciences of VU University Amsterdam (VCWE-2020-077), and by the local Ethical Committees of all the involved institutions (see Tarsitani et al., 2022).
All procedures followed were in accordance with the Helsinki Declaration.
Assessment
Information concerning socio-demographic characteristics (gender, age in years, education), economic and housing status (working before and during the pandemic, square meters of living space per person), pandemic-related issues (income reduction during the pandemic, opinion on government regulations and adherence to them, personal COVID-19 infection and of someone close, personal COVID-19 work exposure and of someone close, difficulties in obtaining basic needs due to the pandemic, willingness to vaccinate, conspiracy beliefs on the pandemic) and the presence of chronic somatic disease was collected.
Beyond socio-demographics, the following psychometric tools were administered:
The Patient Health Questionnaire – 9 items (PHQ-9)(Kroenke & Spitzer, 2002) is a 9-item self-report questionnaire to check for depressive symptoms and depressive disorders over the previous two weeks. The overall score ranges from 0 to 27, with items scoring on a 0 to 3 Likert scale. Higher scores indicate more severe levels of depressive symptoms. With a sensitivity of 0.77 (0.71–0.84) and a specificity of 0.94 (0.90–0.97), PHQ-9 demonstrates good psychometric qualities (Kroenke & Spitzer, 2002). Validated or official versions were accessible in Chinese (Yeung et al., 2008), English (Kroenke & Spitzer, 2002), French (Carballeira et al., 2007), German (Löwe et al., 2003), Indonesian (Budikayanti et al., 2019), and Turkish (Konkan et al., 2013). The translated versions that may be downloaded from the PHQ website (www.phqscreeners.com) were used for Italian, Spanish, and Swedish.
The Generalized Anxiety Disorder scale – 7 items (GAD-7) (Spitzer et al., 2006) is a 7-item rating scale with a 0–3 Likert scale for each item and a 0–21 range for the total score. Higher scores reflect greater anxiety symptoms during the last two weeks. The GAD-7 showed good psychometric proprieties (Spitzer et al., 2006). Validated or official versions were accessible in English (Spitzer et al., 2006), French (Micoulaud-Franchi et al., 2016), German (Löwe et al., 2008), Indonesian (Budikayanti et al., 2019), Spanish (Garcia-Campayo et al., 2010), and Turkish (Konkan et al., 2013). The translated versions that may be downloaded from the PHQ website (www.phqscreeners.com) were used for Chinese, Italian, and Swedish.
The PTSD checklist DSM-5–4 items (PCL-5) (Price et al., 2016) is a 4-item scale assessing post- traumatic stress symptoms over the previous week. Items were scored on a 0 to 4 Likert scale. Higher scores indicate higher level of PTSD symptoms. Validated or official versions were accessible in English (Price et al., 2016), French (Ashbaugh et al., 2016), German (Krüger-Gottschalk et al., 2017), Indonesian (Susanty et al., 2021), Swedish (Sveen et al., 2016), and Turkish (Boysan et al., 2017). Through a process of duplicate translation and reconciliation, followed by an independent verification of the similarity between the final versions, the questionnaire was translated into the other languages that were used.
The Oslo Social Support Scale (OSSS-3)(Kocalevent et al., 2018) is a 3-item scale assessing the level of social support with a total score ranging from 3 to 14. By counting the number of people the respondent feels close to, the interest and worry others have for them, and how simple it is to get practical assistance from others, it measures many aspects of social support. English version was available, the questionnaire was translated in the other languages with the methodology described above. Loneliness was investigated through an item added to this scale: “Do you feel lonely?”.
The Padua inventory(Burns et al., 1996) is a 10-item subscale of the Padua Inventory a scale assessing obsessive compulsive symptoms with a 5-point Likert scale. The administered subscale focuses on contamination fear. Validated or official versions were accessible in English (Burns et al., 1996), French (Kaiser et al., 2010), German (Universität Bonn, 2002), Spanish(Mataix-Cols et al., 2002) and Turkish (Yorulmaz et al., 2007); the questionnaire was translated in the other languages with the methodology described above.
The Portrait Values Questionnaire – 11 items (PVQ-11) (Schwartz et al., 2001) is a 11-items scale measuring ten fundamental value orientations (power, achievement, hedonism, stimulation, self-direction, universalism, benevolence, tradition, conformity, security). Participants are asked “How much like you is this person?” for each portrait corresponding to a value and check one of six boxes labelled: very much like me, like me, somewhat like me, a little like me, not like me, and not at all like me at all. The World Values Survey displays the eleven selected items (http://www.worldvaluessurvey.org/wvs.jsp). The scores of the values have been ipsatized as commonly done when analyzing Schwartz values (Rudnev, 2021).
For details on the above-mentioned clinical scales and on how predictor variables were generated, see (Tarsitani et al., 2022) .
Statistical analysis
Among participants who reported pre-pandemic mental health disorder, those who completed at least three out of five surveys were included in the analysis. Scores from GAD-7, PHQ-9, and PCL-5 were used to create a latent score that would give indication of a resilient response as in previous publication (Tarsitani et al., 2022).
A variant of the Mover-Stayer Latent Transition Analysis model (Goodman, 1961) was used. Four categories of participants were identified for each timepoint: Stayers (Group 1), including participants who showed “sustained-resilience” (the only category remaining constant across timepoints), and three Movers categories: “Vulnerable”, “Intermediate”, and “Resilient not belonging to the sustained-resilience class”. Figure 1 is a graphical representation of our model: sustained resilient were forced to remain into the resilient class in each of the five time-points, while movers were free to switch between classes at different timepoints.
Continuous variables were described as mean ± Standard Deviation (SD) in the case of descriptive statistics, or Standard Error of the Mean (SEM) in the case of latent class indicators, whereas absolute frequencies and percentages were reported for categorical variables. Our outcome of interest was belonging to the sustained-resilient group, and it was predicted through a logistic regression model, estimating the odds ratio (OR), and relative 95% confidence intervals (CI). A one-step method procedure was adopted to take uncertainty of individual class allocation into account, i.e.: the class solution and the prediction for class membership were estimated simultaneously. All variables described in the method section were used as possible predictors.
We compared the distribution of variables at baseline of included participants with groups of excluded participants separately: participants with a mental health disorder excluded for insufficient assessments and participants with no mental health disorder. In both cases, we performed the Mann-U-Whitney test for continuous and Chi-square for categorical variables, and the Bonferroni-Hochberg correction was used to take multiplicity of tests into account.
For all hypotheses tested, two-sided p-values were used to evaluate the statistical significance. P-values less than 0.05 were considered significant.
Analyses were performed using MPlus (Muthén & Muthén, 2017) and Stata 17 (StataCorp, 2021).