A Mokken Scale Analysis of the Kessler-6 Screening Measure among Chinese Older Population: Findings from a national survey

doi:10.21203/rs.3.rs-23181/v3

Download PDF

Research article

A Mokken Scale Analysis of the Kessler-6 Screening Measure among Chinese Older Population: Findings from a national survey

https://doi.org/10.21203/rs.3.rs-23181/v3

This work is licensed under a CC BY 4.0 License

Journal Publication

published 22 Sep, 2020

Read the published version in BMC Geriatrics →

You are reading this latest preprint version

Background The aging population increases rapidly across the world. Timely and effective screening of their mental-health problems is important to individuals, families, and the whole society. The Kessler-6 screening measure (K6) is a very popular instrument for non-specific psychological distress. However, few studies have focused on the psychometric properties of this instrument in the older population.

Methods The present study employed Mokken scale analysis to evaluate its dimensionality and structure. This study also used differential item functioning (DIF) to examine whether the same structure existed across sex in a national representative sample of old Chinese people. Data were drawn from a public data set, the 2010 China Family Panel Studies (CFPS2010), and responses from a total of 6450 participants aged 60 years old and above (3136 males and 3314 females) were included in the final analysis.

Results Mokken scale analysis supported the unidimensional structure of the K6. Differential item functioning (DIF) analysis revealed that two of the six items ("Hopeless" and "Everything was an effort") were marked for DIF based on the Chi-square. However, their impacts were negligible in terms of McFadden's pseudo R².

Conclusions The K6 demonstrates adequate psychometric properties in the old Chinese population. The sum of all six items can be used as an indicator of non-specific psychological distress. Differences in the indicator across sex should be considered as a real difference in psychological distress between the female and the male.

Geriatrics & Gerontology

Psychological distress

Mokken scale analysis

dimensionality

Differential item functioning

sex differences

The aging population increases rapidly across the world. Mental-health problems such as depression and anxiety are prevalent in this population. They have both short-term and long-term consequences for individuals, families, and the whole society [1]. According to Report on National Mental Health Development in China (2017-2018), in the past several years, prevalence estimate of depression disorder is ranged from 15% to 39.86%, and the prevalence rate of anxiety disorder is ranged from 11.51% to 22.02% among Chinese older population [2]. Another survey with a large nationally representative sample (the China Health and Retirement Longitudinal Study (CHARLS)) also indicated that about 33.09% of Chinese older adults suffered depression disorders [3]. In consideration of the largest population and fastest aging in China [4], timely and effective screening of psychological distress is vital to help those at risk for early intervention.

The 6-item version of the Kessler Psychological Distress Scale (K6), a very brief instrument, has been developed to screen for non-specific psychological distress [5]. It was initially designed for fast and accurate detection of severe mental illness among the general population. Later, it is also used in some clinical situations [6]. It demonstrates strong psychometric properties in many populations, such as emerging adolescents [7], adults [8], and the elderly [9]. It even outperforms the K10, a long-form with ten items, in screening for DSM-IV mood or anxiety disorder [10]. Due to its excellent performance and high efficiency, it is widely employed in several major global and national surveys, such as the WHO World Mental Health (WMH) Survey, the US National Health Interview Survey [6], the Australian National Survey of Mental Health and Well-Being [10], the Canadian National Population Health Survey [11], the South African Stress and Health study [12]. It is also included in the China Family Panel Studies (Institute of Social Science Survey, Peking University, 2015), a longitudinal survey of Chinese communities, families, and individuals.

However, still some debates exist about the dimensionality of the K6, which is critical in interpreting scores on the scale. The K6 was initially developed as a measure for a unidimensional construct [5]. The one-factor solution (with all items loading on a single factor) is also supported in most of the current studies [6, 8, 11, 13-20]. Nevertheless, this model had a poor fit with the data from a large sample of adolescents in Australia, and a modified single-factor model was proposed instead [21], allowing residual correlations among some items. Moreover, two-factor models were also reported in several studies [6, 7, 22, 23]. Kessler et al. found a two-factor solution in the Indian sample, with an item ("Everything was an effort") loading on the second factor [6]. Lee et al. examined the dimensionality of the K6 among 3014 Hong Kong residents [22]. They found a two-factor model best fit the data, with three items ("Nervous", "Restless or fidgety", and "Everything was an effort") loading on the anxiety factor, another three items ("Hopeless", "Depressed", and "Worthless") loading on the depression factor. Bessaha compared several models of the K6 among a large sample of emerging adults in the US and revealed that a two-factor model and a second-order two-factor model fit the data better than a one-factor model [7]. In their two-factor model, two items ("Nervous" and "Restless or fidgety") loaded on the anxiety factor, while the other four items loaded on the depression factor. Moreover, the anxiety factor and the depression factor loaded on psychological distress in the second-order two-factor model. Easton et al. reported a better fit of Bassaha's two-factor model than the unidimensional model to the responses from Palestinian social workers [23].

Traditionally, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) are used in examining the factor structure of the K6 [11, 21]. Mokken scale analysis (MSA) has demonstrated its unique value in addressing the problem of dimensionality [24-26]. It belongs to the family of nonparametric item response theories. It assumes that all items in a scale are hierarchically ordered along the continuum of a latent construct. It is more flexible than IRT models like the Rasch model and logistic models regarding statistical assumptions and sample size. It is not restrictive with the assumption about the sigmoid-shaped curves of item characteristics [27]. It requires a relatively small sample size to obtain a stable estimation [28]. It is also superior to traditional factorial analysis in evaluating dimensionality and models simultaneously [25]. Traditional factor analysis assumes a linear relation between items and latent construct under Classic Test Theory, and often suffers distortion from item-score distribution. In addition, factor analysis relies mainly on inter-item correlations. It assumes responses on high correlation item-pairs indicate similarities in the latent trait, which might be misleading due to some confusions, such as the similarity of wording [29].

Mokken scale analysis (MSA) evaluates the fit of two models of nonparametric item response theory to data: monotone homogeneity model (MHM) and double monotonicity model (DMM). MHM, the most general Mokken model, has assumptions of unidimensionality, local independence, and monotonicity. Unidimensionality implies that all items on the scale measure the same latent construct. Local independence implies that an individual's response to one item is not influenced by their responses to the other items on the same scale. Monotonicity implies that an individual who has a higher trait level will always obtain a higher score on the items. DMM, a particular case of MHM, has an additional assumption of Invariant Item Ordering (IIO), which assumes nonintersection of item response functions [30]. Mokken scale analysis provides an automated item selection procedure (AISP) to help assess the latent structure of a scale [31, 32]. The total score of all items reveals different levels of the latent construct [25]. The first aim of our study is to employ Mokken scale analysis to evaluate the dimensionality of the K6.

The K6 is often used in the comparison of psychological distress across ages, sex, education, job categories, and nations [6, 11, 20, 33]. Most studies implicitly assume that the K6 measures psychological distress in the same way in different groups. However, the assumption is not always correct and should be justified before comparison [34]. Regarding the findings on the K6, women are higher than men in the mean level and prevalence of psychological distress in both adolescent and adult populations [21]. The differences may be the results of higher vulnerability and more exposure to stress events for women, or the consequences of the way they understand some items [11]. Few studies have examined measurement invariance for the K6 across sex, with the exceptions of Drapeau et al. and Mewton et al. [11, 21]. Drapeau et al. used multi-group confirmatory factor analyses testing sex invariance in different age groups with data from the Canadian National Population Health Survey. They found that though some items might vary over life-course in the sex invariance patterns, the K6 hold measurement invariance across sex in general. Mewton et al. also examined sex invariance in a sample of Australian adolescents under the framework of confirmatory factor analysis. They indicated that the data didn't support the strong invariance model, and further examination of partial invariance models revealed that all items lacked invariance in the item thresholds. Item thresholds are related to response categories. They refer to the points along the latent trait at which transition from one response category to the next occurs, for example, from "None of the time to "A little of the time" [21]. These studies are conducted among people of different ages in western cultures. We are not sure whether the findings could be replicated in eastern cultures, such as China.

Multi-group confirmatory factor analysis is commonly used in examining measurement invariance, but it might not be accurate in figuring out the source of non-invariance. A flexible and robust iterative hybrid logit regression/ item response theory (LR/IRT) framework is recommended to deal with such a problem [35]. The logit regression approach makes comparisons among several models representing the prediction of latent trait and group membership on item performance. In addition, item response theory (IRT) models provide the estimation of latent trait scores. Simulation studies have proven the advantage of this framework in detecting DIF in comparison to other methods. Therefore, the second aim of our study is to employ differential item functioning (DIF) analysis to evaluate measurement invariance of the K6 across sex.

In all, the present study would investigate the dimensionality of the K6 and its measurement invariance across sex with data from China Family Panel Studies in the year 2010. The results would contribute to the understanding of the factor structure of the K6 in eastern cultures and shed some light on the sex difference in psychological distress.

Data and Sample

The study is based on secondary data analysis. The data were drawn from a publicly available dataset, the 2010 China Family Panel Studies (CFPS2010). The CFPS was initiated in 2010, by the Institute of Social Science Survey of Peking University, with financial support from the Chinese government. It is an annual longitudinal survey of Chinese national representative communities, families, and individuals. It collects information related to a variety of topics, such as economic activities, education outcomes, family dynamics and relationships, migration, and health (Institute of Social Science Survey, Peking University, 2015). In the CFPS2010, a subsample of 6598 records from older adults (aged 60 and above) was selected. Due to missing responses to any K6 item, 148 records were discarded. Therefore, responses from a total of 6450 participants (3136 males and 3314 females) were included in the final analysis. Their age ranged from 60 to 110 years old, with a mean of 68.51 years (SD=6.94).

Measures

The K6 is among the most widely used short instruments for screening psychological distress [6]. It comprises six items related to the following feelings during the past four weeks, such as sad, nervous, hopeless, and worthless. Participants indicate their symptoms on a Likert scale ranged from 1 (All of the time) to 5 (None of the time). Following the instruction of the scale, we reversed the rating of the six items on a scale from 0 to 4, and summed their scores as an indicator of psychological distress. The total score ranges from 0 to 24. The higher the scores, the higher levels the psychological distress, such as anxiety and depression. The K6 has been demonstrated good reliability and validity in Chinese populations, with Cronbach's alpha at 0.84, the 32- to 53-day interval test-retest reliability at 0.79 [15]. The Cronbach alpha coefficient is 0. 88 for the female sample, 0.86 for the male sample, and 0.87 for the whole sample in the present study.

Statistical analyses

We performed a Mokken scale analysis to explore the factor structure of the K6 using the R package "Mokken". The package enables us to form unidimensional subscales from all items using an automated item selection algorithm (aisp). The structure of the inventory is indicated by the pattern and scalability of each item (i.e. Hi). We also tested the assumption of local independence and the assumption of monotonicity. We were interested in measurement invariance between males and females, and we employed the "Lordif" package for R to detect differential item functioning (DIF) of items in the K6. Both uniform and non-uniform DIFs were detected with the logistic approach.

Examining factor structure

Assessment of dimensionality. We first evaluated whether the items of the K6 could form a Mokken scale in terms of scalability coefficients. The program calculated the scalability coefficient for all items in a scale (H), the scalability coefficients for each individual item in the scale (H_i), and the scalability coefficients for each item-pair (H_ij). In terms of Sijtsma and van der Ark [30], a scale is insufficient, if H<0.3, weak if 0.3 ≤ H < 0.4, medium if 0.4 ≤ H < 0.5, and strong H≥0.5. In addition, items in a Mokken scale also should have H_ivalues greater than 0.3 and the H_ij values greater than 0. We also explored the issue using the iterative automated item selection procedure (AISP). All six items were evaluated to identify potential Mokken scales. As recommend by Hemker et al. [27], we used an initial lower bound of 0, then increasing incrementally in 0.05 steps until 0.75. The c value is suggested to set at 0.3 in practice, because the solution produced by the AISP is often hard to interpret when c ≥0.35 [30].

Assessment of local independence and monotonicity. Local independence assumes that an individual's response to one item measuring the latent construct is not influenced by their responses to the other items on the same scale. We used the conditional association procedure and calculated two indices W1 and W3 to check local independence. High W1 or W3 reveals that an item pair is likely locally dependent and violates the local independence assumption. Monotonicity implies that an individual who has a higher disposition on the latent trait will always obtain a higher score on the items measuring the latent construct. We plotted the item response function (IRF) for all six items to check monotonicity graphically. We also use the check.monotonicity() function for significance test whether the curve deviates from the monotonicity hypothesis.

Assessment of invariant item ordering. The Monotone Homogeneity Model and the Double Monotonicity Model mainly differ in the assumption of Invariant Item Ordering (IIO), which implies that the ordering of the items in terms of item difficulty is the same at all locations on the latent trait continuum. We attempted to check whether the Monotone Homogeneity Model or the Double Monotonicity Model had a better fit to the data. According to Sijtsma and van der Ark [30], overall IIO is insufficient if the coefficient H^T<0.3, weak if 0.3 ≤ H^T < 0.4, medium if 0.4 ≤ H^T < 0.5, and strong H^T ≥0.5.

Reliability. In addition to Cronbach’s α and Guttman’s lambda-2 λ₂, we also reported the Molenaar-Sijtsma (MS) reliability estimate and the Latent Class Reliability Coefficient (LCRC), which are recommended in the Mokken scale analysis. The former assumes the Double Monotonicity Model hypothesis, while the latter is robust to violation of the assumption. A scale is acceptable if all these indices are greater than 0.7 [27].

Examining measurement invariance

Following the procedure proposed by Choi et al. [36], we conducted differential item functioning (DIF) analysis under the hybrid iterative LR/IRT framework with "Lordif" package in R. Three ordinal logistic models (models 1, 2, and 3) were established for each item involving item performance, latent trait score, group membership, and the interaction between the latter two. Model 1 is a baseline model, including only the latent trait score as the predictor. Model 2 is a uniform DIF model, including the latent trait score and group membership as predictors. Model 3 is a non-uniform DIF model, including latent trait score, group membership, and their interaction as predictors. DIF detection is based on the likelihood ratio (LR) χ² test at the α level of 0.01. A significant difference in the log-likelihood values between Model 2 and Model 1 reveals uniform DIF, while a significant difference between Model 3 and Model 2 indicates non-uniform DIF. DIF magnitude is based on McFadden’s pseudo-R², <0.13 as negligible, 0.13<R²<0.26 as moderate, >0.26 as large [37]. Under the framework, the latent trait score was estimated by default fitting Graded Response Model (GRM).

Additional exploratory factor analysis and confirmatory factor analysis

Moreover, we conducted exploratory factor analyses and confirmatory factor analyses to examine the factor structure of this scale using Mplus 7.4. Due to the ordinal nature of the scale, we used weighted least squares with a correction to means and variances (WLSMV) as the estimation method [29]. For the EFA, eigenvalues greater than one, scree plot, and parallel analysis were employed to determine the number of factors [38]. In addition, the goodness of model fit indices was jointly considered in both EFA and CFA. A good fit is suggested if the comparative fit index (CFI) ≥0.90, the Tucker-Lewis index(TLI) ≥0.9, and the root-mean-square error of approximation (RMSEA) ≤ 0.08 [39].

Descriptive statistics

Responses distribution on five categories for each item in the K6 is presented in Table 1. We can see the symptoms distributed as a positive skewness. The majority of people have no symptoms, while only a few have severe symptoms. According to the cut point of 12/13, the prevalence of psychological distress among the current sample is 5.3%.

PLEASE INSERT TABLE 1 AROUND HERE

Examining factor structure

Assessment of dimensionality

The scalability of the K6 is presented in Table 2. For inter-item pairs, the inter-item scalability coefficients (Hij) range from 0.47 to 0.68. For items, the item scalability coefficients (Hi) ranged from 0.57 to 0.59. For the whole K6 scale, the scalability coefficient was 0.58 (SE=0.009). All the scalability coefficients were significantly greater than the conventional lower-bound value of 0.3. The results suggested the K6 should be considered as a scale of strong strength. The internal consistency of the six items was also excellent (Cronbach's alpha =0.87).

PLEASE INSERT TABLE 2 AROUND HERE

We further explored the dimensionality for all the six items by conducting iterative automated item selection procedure (AISP). The results were presented in Table 3. We followed the recommendation of Hemker et al. (1995), and set an initial value of lower bound c from 0 to 0.75 with increment steps of 0.05. For 0 ≤ c ≤ 0.55, all six items were selected to form one scale. For c=0.6, two scales emerged, including items 1-3 and items 4-6, respectively. For c=0.65, items 1 and 3 were unscalable. For c>0.7, all items were unscalable. The c value is suggested to set at 0.3 in practice, because the solution produced by the AISP is often hard to interpret when c ≥0.35 [30]. Therefore, the results from the AISP confirmed the unidimensionality of the K6.

PLEASE INSERT TABLE 3 AROUND HERE

Assessment of local independence and monotonicity

Moreover, we examined local independence and monotonicity to make sure that the fit between data and the Mokken scale model was adequate. Regarding local independence, there was not any item-pair marked as locally dependent in terms of W1 and W2, two indices calculated in the conditional association procedure [30]. Regarding monotonicity, there was not any item marked as non-monotonical. The visual analysis suggested that all items showed monotonical increases (see Figure 1). In brief, all items met the assumptions of local independence and monotonicity.

PLEASE INSERT FIGURE 1 AROUND HERE

PLEASE INSERT TABLE 4 AROUND HERE

Assessment of invariant item ordering

Graphically comparisons indicated that several IRFs were almost identical, and it was hard to establish an invariant item ordering from visual inspection. A more rigorous method, increasing in transposition [40], was employed to investigate invariant item ordering, and the results suggested that Item 5 and Item 1 showed signs of violating invariant item ordering. Coefficient H^T=0.09, is much less than the conventional criteria 0.3, which means that the item ordering is too inaccurate to be useful. Therefore, the invariant item ordering assumption is not supported. In sum, the Double Monotonicity model didn't fit the data well, while the three assumptions (unidimensionality, local independence, and monotonicity) of the Monotone Homogeneity model were still met. People can be ordered on the latent trait according to their total score on the scale.

Reliability

Table 2 also provides reliability-estimates: coefficients of α =0.87, λ2=0.87, MS=0.87, and LCRC=0.87. All estimates are close to .9, and thus satisfactory. The corrected item-test correlations were adequate for all items, ranged from 0.64 to 0.70.

Sex differences

We also conducted the same analyses for male and female subgroups separately. A similar pattern emerged for the scalability assessment among these two samples. Therefore, the K6 assesses psychological distress in a similar way and with a similar strength both sex.

Examining measurement invariance

Figure 2 illustrates the trait distributions of the male and the female. The male has lower mean scores than the female, but there is still a broad overlap. Table 5 presents the main results of DIF analysis. According to the LR χ²test, Item 4 and Item 5 were marked for uniform DIF, but none was flagged for non-uniform DIF. Further examination of these two items revealed that for the same latent trait score, females were always rated with higher frequencies than males. For both items, the lower-left graph shows the uniform DIF was mainly caused by the fifth category threshold value (3.31vs.2.9, 2.57 vs. 2.45). However, McFadden's pseudo R² statistics (no more than 0.0011) indicated that the magnitude of DIF was very small for each item. Figure 3 represents the impact of all items and DIF items on the whole scale. The left one shows the impact of all six items, indicating a negligible difference across sex, while the right one shows curves for the 2 DIF items, indicating that female score a bit higher when sex group-specific parameter estimates were used.

PLEASE INSERT TABLE 5 AROUND HERE

PLEASE INSERT FIGURE 2 AROUND HERE

PLEASE INSERT FIGURE 3 AROUND HERE

Additional exploratory factor analysis and confirmatory factor analysis

EFA yielded only one component that had an eigenvalue greater than one (eigenvalue λ=4.41), which explained 73.5% of the total variance. Both parallel analysis and scree plot also suggested the one-factor solution. All items had factor loadings greater than 0.8 (See Table 6). However, in terms of the goodness of model fit indices, the one-factor model didn't fit the data well, χ2=1336.664, df =9, CFI=0.972, TLI=0.953, and RMSEA=0.151 (90% CI 0.144, 0.158). A two-factor model ("Depressed", "Nervous", and "Restless or fidgety" on the first factor, while "Hopeless", "Everything was an effort ", and "Worthless "on the second factor) had a better and an acceptable fit to the data, χ2=18.912, df=4, CFI=1.00, TLI=0.999, and RMSEA=0.024 (90% CI 0.014, 0.035).

PLEASE INSERT TABLE 6 AROUND HERE

In CFA, We tested the one-factor model and the two-factor model derived from EFA, as well as three other two-factor models proposed by Kessler et al. [6], Lee et al. [22], and Bessaha [7]. In Kessler et al's model, an item ("Everything was an effort") loads on the second factor, while all other five items load on the first factor. In Lee et al.’s model, three items (Nervous", "Restless or fidgety", and "Everything was an effort") load on the anxiety factor, while the rest three items ("Hopeless", "Depressed", and "Worthless") load on the depression factor. In Bessaha’s model, two items ("Nervous" and "Restless or fidgety") loaded on the anxiety factor, while all the other four items on the depression factor. The model goodness-of-fit indices are displayed in Table 7. Because Kessler et al’s model is not identified in CFA, the estimation is not reliable and not listed in the table. The fit indices suggested that the two-factor model derived from EFA in the present study is the only acceptable model. Both EFA and CFA showed that the two-factor model is the best.

PLEASE INSERT TABLE 7 AROUND HERE

The present study employed a Mokken scale analysis on the K6 to evaluate its dimensionality and structure, and employed DIF analysis to examine whether the same structure existed across sex in a national representative sample of old Chinese people. The results confirmed the unidimensionality of the instrument and justified the sum score of all the six items as an indicator of psychological distress. Our study also supported the measurement invariance of the K6 between male and female populations.

The K6 was developed as a unidimensional measure for psychological distress at the beginning [5]. Later studies reported different factor solutions, one-factor models, and two-factor models, with exploratory factor analysis and confirmatory factor analysis in diverse samples [13, 14, 22, 41]. The incongruent findings may result from differences in populations (e.g., emerging adults and mid-age general population) and statistical methods (e.g., principal axis factor analysis, principal component analysis). Considering the J-shape distribution of item scores in the K6, we employed a new approach, Mokken scale analysis, to address the problem in older people. The approach is more flexible, relying less on item score distributions and sample size [42]. Mokken scale analysis is recommended as a more appropriate method for dimensionality assessment with discrete data [43]. In addition, previous studies mainly focused on the general population, or some specific population, such as adolescents, emerging adults, but few have taped the aging population. Our findings supported the unidimensional solution, which is consistent with the original design of the K6 and most previous studies investigating the factor structure of the K6. It contributes to the understanding of the sum score of all six items of the K6 as the indicator of psychological distress among aging populations.

Measurement invariance is the premise for group comparison [34]. Previous studies indicate that females always have more severe symptoms than males, but only a few studies have examined measurement invariance of the K6 across sex [21]. Drapeau et al. [11] and Mewton et al. [21] examined measurement invariance under the framework of confirmatory factor analysis. We explored measurement invariance under the LR/IRT framework and found two items were marked as with uniform DIF in terms of Chi-square. For Item 4 ("Hopeless"), Drapeau et al. found that women had higher first three thresholds, but lower last thresholds than men. For Item 5 ("Everything was an effort"), they only found sex invariance only in the younger age group and only at cycle 7 of the study. In the India sample, this item was separated as a second factor [6]. Mewton et al. [21] revealed that all six items had higher endorsement rates for females than males. Since the likelihood ratio test is largely influenced by sample size, DIF magnitude is also recommended to consider in detecting items with DIF. In terms of McFadden's pseudo R², the impact of the two items is negligible. Therefore, we agree with Drapeau et al. that the items in the K6 measure distress in males and females at the same degree [11]. The sex difference in the K6 scores is a reflection of the true difference in psychological distress rather than bias in reporting of the K6 items. In general, the psychological distress for females is more severe than that for males.

We also employed exploratory factor analysis and confirmatory factor analysis to explore the dimensionality of the K6. The two-factor model is the only acceptable model in comparison to other models in terms of fit indices. Our solution is somewhat distinctive from findings in other studies, partly due to the different treatment of the data and the analytical methods. Most of the previous studies treated the data as continuous, used principal axis factor analysis for exploratory factor analysis, and maximum likelihood estimator in the CFA. We conducted the analysis based on polychoric correlation with WLSMV estimator, which is more recommended due to the ordinary nature and the non-normal distribution of the data [44]. However, it might be hard to explain the solution itself: Why “Depressed” loads on the same factor with “Anxiety” and “Nervous” rather than “Hopeless” or “Worthless”? Why “Everything was an effort” loads on the same factor with “Hopeless” and “Worthless” rather than “Anxiety” or “nervous”. Factor analysis greatly depends on inter-item correlations, which may result in forming a scale in terms of insignificant factors (e.g., the similarity of wording) rather substantial relationship in the construct [29]. According to traditional indexes to determine factor numbers in EFA (eigenvalues greater than one, scree plot, and parallel analysis), the one-factor solution seemed to be more reasonable. Even in Lee et al. 's study, EFA results also suggested a one-factor solution: only one eigenvalue was greater than 1, and explained 56.4% of the total variance [22]. In fact, the one-factor solution is supported in most studies.

Some limitations should be acknowledged about the study. The present study among the few studies focused on examining the psychometric properties of the K6 among a relatively large and national representative sample of the Chinese older people. We only focused on the general aged population here. People in different age groups endorse the items in a somewhat different way [11, 21]. Therefore, the conclusion might not apply to other age groups. In addition, the epidemiological character of psychological distress may not be the same in different cultures [12]. We should be careful before generalization of the findings to populations in other cultures. Moreover, we only investigated the factor structure and sex invariance of the K6 here. Further studies can extend to other issues, such as screening efficiency in comparison with clinical diagnostic measurements.

We employed a Mokken scale analysis on the K6 to evaluate its dimensionality and structure, and whether the same structure existed across sex in a national representative sample of older Chinese adults. The K6 demonstrates adequate psychometric properties in the old Chinese population. It measures a unidimensional construct and holds measurement invariance across sex. The sum of all six items can be used as an indicator of non-specific psychological distress and to rank people on the latent construct. Differences in the indicator across sex should be considered as a real difference in psychological distress between the female and the male.

K6: The 6-item version of the Kessler Psychological Distress Scale

DIF: Differential item functioning

LR/IRT: Logit regression/ item response theory

EFA: Exploratory factor analysis

CFA: Confirmatory factor analysis

PCA: Principal components analysis

MSA: Mokken scale analysis

MHM: Monotone homogeneity model

DMM: Double monotonicity model

AISP: Automated item selection procedure

Ethical approval and consent to participate

The China Family Panel Studies were approved by the Peking University Biomedical Ethics Review Committee (No. IRB00001052-14010). Our access to the data was granted by the Institute of Social Science Survey of Peking University. All procedures performed in this study were approved by the Ethics Committee of the Department of Psychology, Nanjing University.

Consent for publication

Not Applicable.

Availability of data and material

The raw data is publicly available at

https://osf.io/fq8ct/?view_only=c97f6e3bc77341d2a9bbe33f67a09c60

Competing interests

The authors declare that they have no competing interests.

Funding

This study was supported by the Foundation of Humanities and Social Sciences, Ministry of Education of the PRC (No. 20YJA190004), and Project of Philosophy and Social Sciences from the Education Department, Jiangsu Province (No. 2018SJZDI203). They had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Authors' contributions

LZ conceived and designed the study and wrote the first draft of the manuscript. ZL conducted all the statistical analysis. Both authors revised the manuscript and approved the final submission.

Acknowledgments

We would like to express our thanks to the Institute of Social Science Survey of Peking University for allowing us to use the data.

Wolitzky-Taylor KB, Castriotta N, Lenze EJ, Stanley MA, Craske MG: Anxiety disorders in older adults: a comprehensive review. Depression and Anxiety 2010, 27 (2): 190-211.
Fu X, Zhang K: Report on National Mental Health Development in China (2017-2018). Beijing: Social Sciences Academic Press (China); 2018.
Guo J, Guan L, Fang L, Liu C, Fu M, He H, Wang X: Depression among Chinese older adults: A perspective from Hukou and health inequities. Journal of Affective Disorders 2017, 223:115-120.
WHO: China country assessment report on ageing and health. In. Geneva, Switzerland: Author; 2016.
Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, Walters EE, Zaslavsky AM: Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychological Medicine 2002, 32 (6): 959-976.
Kessler RC, Green JG, Gruber MJ, Sampson NA, Bromet E, Cuitan M, Furukawa TA, Gureje O, Hinkov H, Hu CY et al: Screening for serious mental illness in the general population with the K6 screening scale: results from the WHO World Mental Health (WMH) survey initiative. International Journal of Methods in Psychiatric Research 2010, 19 Suppl 1:4-22.
Bessaha ML: Factor Structure of the Kessler Psychological Distress Scale (K6) Among Emerging Adults. Research on Social Work Practice 2015, 27 (5): 616-624.
Khan A, Chien CW, Burton NW: A new look at the construct validity of the K6 using Rasch analysis. International Journal of Methods in Psychiatric Research 2014, 23(1):1-8.
Tomata Y, Watanabe T, Tanji F, Zhang S, Sugawara Y, Tsuji I: The Impact of Psychological Distress on Incident Functional Disability in Elderly Japanese: The Ohsaki Cohort 2006 Study. International Journal of Environmental Research and Public Health 2018, 15(11):2502.
Furukawa TA, Kessler RC, Slade T, Andrews G: The performance of the K6 and K10 screening scales for psychological distress in the Australian National Survey of Mental Health and Well-Being. Psychological Medicine 2003, 33(2):357-362.
Drapeau A, Beaulieu-Prévost D, Marchand A, Boyer R, Préville M, Kairouz S: A life-course and time perspective on the construct validity of psychological distress in women and men. Measurement invariance of the K6 across gender. BMC Medical Research Methodology 2010, 10(1):68.
Andersen LS, Grimsrud A, Myer L, Williams DR, Stein DJ, Seedat S: The psychometric properties of the K10 and K6 scales in screening for mood and anxiety disorders in the South African Stress and Health study. International Journal of Methods in Psychiatric Research 2011, 20(4):215-223.
Green JG, Gruber MJ, Sampson NA, Zaslavsky AM, Kessler RC: Improving the K6 short scale to predict serious emotional disturbance in adolescents in the USA. International Journal of Methods in Psychiatric Research 2010, 19 Suppl 1:23-35.
Prochaska JJ, Sung HY, Max W, Shi Y, Ong M: Validity study of the K6 scale as a measure of moderate mental distress based on mental health treatment need and utilization. International Journal of Methods in Psychiatric Research 2012, 21(2):88-97.
Kang YK, Guo WJ, Xu H, Chen YH, Li XJ, Tan ZP, Li N, Gesang ZR, Wang YM, Liu CB et al: The 6-item Kessler psychological distress scale to survey serious mental illness among Chinese undergraduates: Psychometric properties and prevalence estimate. Comprehensive Psychiatry 2015, 63:105-112.
Dadfar M, Vahid M, Lester D, Bahrami F: Kessler Psychological Distress Scale (K6): Psychometric testing of the Farsi form in psychiatric outpatients. Advances in Bioresearch 2016, 7:105-108.
Peiper N, Clayton R, Wilson R, Illback R: The performance of the K6 Scale in a large school sample. Psychological Assessment 2015, 27(1):228-238.
Kim G, DeCoster J, Bryant AN, Ford KL: Measurement Equivalence of the K6 Scale: The Effects of Race/Ethnicity and Language. Assessment 2016, 23(6):758-768.
Peiper N, Lee A, Lindsay S, Drashner N, Wing J: The performance of the K6 scale in a large school sample: A follow-up study evaluating measurement invariance on the Idaho Youth Prevention Survey. Psychological Assessment 2016, 28(6):775-779.
Vissoci JRN, Vaca SD, El-Gabri D, de Oliveira LP, Mvungi M, Mmbaga BT, Haglund M, Staton C: Cross-cultural adaptation and psychometric properties of the Kessler Scale of Psychological Distress to a traumatic brain injury population in Swahili and the Tanzanian Setting. Health and Quality of Life Outcomes 2018, 16(1).
Mewton L, Kessler RC, Slade T, Hobbs MJ, Brownhill L, Birrell L, Tonks Z, Teesson M, Newton N, Chapman C et al: The psychometric properties of the Kessler Psychological Distress Scale (K6) in a general population sample of adolescents. Psychological Assessment 2016, 28(10):1232-1242.
Lee S, Tsang A, Ng KL, Ma YL, Guo W, Mak A, Kwok K: Performance of the 6-item Kessler scale for measuring serious mental illness in Hong Kong. Compr Psychiatry 2012, 53(5):584-592.
Easton SD, Safadi NS, Wang Y, Hasson RG: The Kessler psychological distress scale: translation and validation of an Arabic version. Health and Quality of Life Outcomes 2017, 15(1).
Li Z, Zhao X, Sheng A, Wang L: Item response analysis of the Geriatric Anxiety Inventory among the elderly in China: dimensionality and differential item functioning test. BMC Geriatrics 2019, 19(1):313.
Mokken RJ: A Theory and Procedure of Scale Analysis: De Gruyter, Berlin, Germany; 1971.
Mokken RJ, Lewis C: A Nonparametric Approach to the Analysis of Dichotomous Responses. Applied Psychological Measurement 1982, 6(4):417-430.
Myszkowski N: A Mokken Scale Analysis of the Last Series of the Standard Progressive Matrices (SPM-LS). Journal of Intelligence 2020, 8:22.
Watson R, Egberink IJL, Kirke L, Tendeiro JN, Doyle F: What are the minimal sample size requirements for Mokken scaling? An empirical example with the Warwick- Edinburgh Mental Well-Being Scale. Health Psychology and Behavioral Medicine 2018, 6(1):203-213.
Wongpakaran N, Wongpakaran T, Kuntawong P: Evaluating hierarchical items of the geriatric depression scale through factor analysis and item response theory. Heliyon 2019, 5(8):e02300.
Sijtsma K, van der Ark LA: A tutorial on how to do a Mokken scale analysis on your test and questionnaire data. British Journal of Mathematical and Statistical Psychology 2017, 70(1):137-158.
Hemker BT, Sijtsma K, Molenaar IW: Selection of unidimensional scales from a multidimensional item bank in the polytomous Mokken IRT model. Applied Psychological Measurement 1995, 19(4):337-352.
Sijtsma K, Meijer RR, Andries van der Ark L: Mokken scale analysis as time goes by: An update for scaling practitioners. Personality and Individual Differences 2011, 50(1):31-37.
Fushimi M, Saito S, Shimizu T, Kudo Y, Seki M, Murata K: Prevalence of psychological distress, as measured by the Kessler 6 (K6), and related factors in Japanese employees. Community Mental Health Journal 2012, 48(3):328-335.
Milfont TL, Fischer R: Testing measurement invariance across groups: Applications in crosscultural research. International Journal of Psychological Research 2011, 3(1):111-121.
Choi SW, Gibbons LE, Crane PK: lordif: An R Package for Detecting Differential Item Functioning Using Iterative Hybrid Ordinal Logistic Regression/Item Response Theory and Monte Carlo Simulations. Journal of Statistical Software 2011, 39(8):1-30.
Wittchen HU: Screening for serious mental illness: methodological studies of the K6 screening scale. International Journal of Methods in Psychiatric Research 2010, 19(S1):1-3.
Zumbo BD: A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-Type (Ordinal) Item Scores. Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense; 1999.
Li Z, Wang L, Zhang L: Exploratory and confirmatory factor analysis of a short-form of the EMBU among Chinese adolescents. Psychological Reports 2012, 110(1):263-275.
McDonald RP, Ho M-HR: Principles and practice in reporting structural equation analyses. Psychological Methods 2002, 7(1):64-82.
Ligtvoet R, Van der Ark LA, Bergsma WP, Sijtsma K: Polytomous latent scales for the investigation of the ordering of items. Psychometrika 2011, 76(2):200-216.
Zhou C, Chu J, Wang T, Peng Q, He J, Zheng W, Liu D, Wang X, Ma H, Xu L: Reliability and validity of 10-item Kessler scale(K10) Chinese version in evaluation of mental health status of Chinese population. Chinese Journal of Clinical Psychology 2008, 16(6):627-629.
Michielsen HJ, De Vries J, Van Heck GL, De Vijver FJRV, Sijtsma K: Examination of the Dimensionality of Fatigue. European Journal of Psychological Assessment 2004, 20(1):39-48.
Wismeijer AAJ, Sijtsma K, Van Assen MALM, Vingerhoets AJJM: A Comparative Study of the Dimensionality of the Self-Concealment Scale Using Principal Components Analysis and Mokken Scale Analysis. Journal of Personality Assessment 2008, 90(4):323-334.
Muthén B, Kaplan D: A comparison of some methodologies for the factor analysis of non‐normal Likert variables. British Journal of Mathematical and Statistical Psychology 1985, 38(2):171-189.

Download PDF

Journal Publication

published 22 Sep, 2020

Read the published version in BMC Geriatrics →

Submission checks completed at journal
13 Sep, 2020
Editorial decision: Accept
11 Sep, 2020

You are reading this latest preprint version

A Mokken Scale Analysis of the Kessler-6 Screening Measure among Chinese Older Population: Findings from a national survey

Status:

Journal Publication

Version 3

Abstract

Figures

Background

Methods

Results

Discussion

Conclusions

Abbreviations

Declarations

References

Status:

Journal Publication

Version 3