Study 1. Exploratory Factor Analysis and Initial Reliability
The 45 items of the ACN:SDH scale were subjected to principal components analysis (PCA) using SPSS version 18. Prior to performing the PCA, the suitability of the data for factor analysis was assessed. Inspection of the correlation matrix revealed the presence of many coefficients of .3 and above. The Kaiser-Meyer-Olkin value was .920, exceeding the recommended value of .6 17 and Bartlett’s Test of Sphericity18 reached statistical significance, supporting the factorability of the correlation matrix (t (χ2 (990) = 6960.55, p = .000).
Principal components analysis, initially revealed the presence of 9 components with eigenvalues exceeding 1, explaining a total of 69% of the variance. Inspection of the scree plot revealed the presence of 6 components; however, solutions for 4, 5, and 6 factors were each examined using varimax and oblimin rotations of the factor loading matrix. The 6-factor solution explained a total of 61% of the variance, and it was preferred because of: (a) theoretical relevance and (b) eigenvalues on the scree plot leveled off after 6. The varimax solution was used in subsequent analyses because the component transformation matrix had small values (.220) indicating that components are not highly correlated which is the underlying hypothesis of the varimax solution. Lastly, a total of 20 items were eliminated because they either did not contribute to a simple factor structure and failed to meet a minimum criterion of having primary factor loadings of .4 or above, along with no cross-loadings of .3 or above.
Finally, a principal components analysis, using varimax rotation was used on the 25-item ACN:SDH scale constrained and a 6-factor solution was revealed, explaining 61% of the variance. Factor 1 contained 6 items that represented Action Toward Addressing SDOH and accounted for 33.96% of the variance. Factor 2 contained 6 items that represented SDOH Knowledge and accounted for 8.01% of the variance. Factor 3 contained 3 items, that represented Negative Attitude toward Addressing SDOH and accounted for 5.86% of the variance. Factor 4 contained 3 items that represented Systemic Accountability and accounted for 5.35% of the variance. Factor 5 contained 4 items that represented Perception of the cause of SDOH and accounted for 4.04% of the variance. Factor 6 contained 3 items that represented School Preparation and accounted for 4.19% of the variance.
Table 2. Exploratory and Confirmatory Factor Analysis Matrix for the SDH Provider Competency Scale
Note. Bold values indicate the highest factor loading for each item; CFA factor loadings significant at the p<.01 = *.; Reverse-scored item = r.
Reliability analysis
The Cronbach alpha reliability estimate for the 25-item total scale was .809. Item total correlations ranged from r = − .28 to r = .88 with a mean item-total correlation of r = .25. The 6 subscales demonstrated the following satisfactory internal consistency estimates: Factor 1, (a = .844); Factor 2, (a = .923); Factor 3, (a = .741); Factor 4, (a = .793); Factor 5, (a = .867); and Factor 6, (a = .373). The study 1 results showed that the 25-item SDH: ACN has 6 dimensions which is concordant with the theoretical model.
Study 2. Confirmatory Factor Analysis
The purpose of Study 2 was to confirm the dimensionality and evaluate the nomological network of the ACN: SDH. Confirmatory factor analysis was conducted using maximum likelihood estimation as implemented in SPSS 28 AMOS. Table 2 shows the CFA model comparisons; in the first model, all 25 items were allowed to load on a single factor (SDH provider competence). The second model is a first order orthogonal model where all items are loaded on the defined dimensions from the EFA (i.e., the 6 factors) and these dimensions were not correlated. The third model is the same as the second model except the 6 factors were allowed to correlate (i.e., oblique). The fourth model is a second order model in which all items were allowed to load on their defined dimensions and all dimensions loaded on a second order factor of ‘SDH provider competence’. All 4 models showed poor model fit; 3 indicators were identified as having a modification index larger than 20 causing the poor model fit. The items deleted included AP3, AP4, and ATT9. The fifth model is a first order oblique model where all items are loaded on the defined dimensions (i.e., 6 factors); this model showed acceptable model fit. The fit indices for each model are presented in Table 3. MLR was used to estimate model parameters and goodness-of-fit of all the CFA models was examined with: RMSEA ≤ 0.06 (90% CI ≤ 0.06), SRMR ≤ 0.08, CFI ≥ 0.90, and TLI ≥ 0.90. 20– 21Additionally, the chi-square/df ratio ≤ 3 rule was also used. 22
Model 5 first order oblique 6 factor model showed better fit than the other models. Fitting the oblique model indicates that specific domains of provider SDOH competency are not interrelated. The chi square, CFI, RMSEA, and SRMR values indicate good to reasonable fit of model 5 (χ2 = 460.281, df = 194, CFI = .937, RMSEA = .067, SRMR = .0475). The factor loadings for the preferred first order model (i.e., model 5) are presented in Table 3.
Table 3
Fit Indices for Confirmatory Factor Analysis of the ACN: SDH
Model
|
X2
|
df
|
CFI
|
RMSEA (90%CI)
|
SRMR
|
Model 1: One factor model
|
2947.2
|
275
|
.454
|
.17 [.161, .178]
|
.1461
|
Model 2: First-order orthogonal six factor model
|
1071.9
|
260
|
.834
|
.10 [.095, .108]
|
.0864
|
Model 3: First order oblique six factor model
|
1101.8
|
269
|
.830
|
.10 [.095, .108]
|
.0916
|
Model 4: Second order factor model
|
1223.8
|
274
|
.806
|
.10 [.101, .113]
|
.1633
|
Model 5: First-order oblique six factor model (22 items)
|
460.281
|
194
|
.937
|
.067 [.059, .075]
|
.0475
|
Note. ACN:SDH = Social Determinants of Health Provider Competency Scale; CFI = comparative fit index; RMSEA = root mean square error of approximation; 90% CI = 90% Confidence Interval for RMSEA (lower limit, upper limit); SRMR = standardized root mean square residual. |
Reliability analysis
Internal consistency estimates of the ACN: SDH total score and subscale scores for Study 2 were high. The Cronbach alpha reliability estimate for the 22-item total score was .867. Item total correlations ranged from r = − .27 to r = .89 with a mean item-total correlation of r = .23. The 6 subscales demonstrated satisfactory internal consistency estimates, listed in Table 4: Factor 1, (a = .848); Factor 2, (a = .944); Factor 3, (a = .790); Factor 4, (a = .808); Factor 5, (a = .863); and Factor 6, (a = .940). The total 22 item scale demonstrated satisfactory internal consistency. Study 2 results indicate that the 22-item ACN: SDH has 6 dimensions which is concordant with the theoretical model.
Scoring. The ACN: SDH items are scored on a scale from 1 to 5, with items with a ‘r’ being reversed-coded. The mean scores and standard deviations for the total 22 item ACN:SDH scale and subscale scores are presented in Table 4. Lower scores indicate less competency.
Table 4
Descriptive statistics and alpha for 22 item ACN:SDH (Study 2)
|
Mean
|
Min
|
Max
|
SD
|
Cronbach alpha
|
EMCC Correlation
|
Measure
|
ACN:SDH
total scale
|
77.73
|
42.00
|
102.00
|
11.46
|
.867
|
.473**
|
AC
|
18.89
|
6
|
30
|
4.99
|
.848
|
.292**
|
KN
|
25.05
|
6
|
30
|
4.74
|
.944
|
.410**
|
NA
|
12.05
|
3
|
15
|
2.58
|
.790
|
.387**
|
SA
|
7.85
|
2
|
10
|
1.78
|
.808
|
.440**
|
PC
|
4.24
|
2
|
10
|
1.81
|
.940
|
− .264**
|
WK
|
9.63
|
3
|
15
|
2.98
|
.863
|
.237**
|
Note. **=correlation is significant at the 0.01 level (2-tailed); Six subscales = AC, KN, NA, SA, PC, & WK |
Convergent and discriminant validity
Pearson’s correlations between the ACN: SDH and the EMCC scales are summarized in Table 4. The ACN: SDH total and 6 subscale scores showed a low to moderate positive correlation to all subscales that are conceptually similar in content, which shows convergent validity. Discriminant validity is indicated by the inverse relationship between the EMCC and the ACN: SDH Perception subscale’ which is hypothesized to be conceptually different.
Factor Invariance Analysis (FIA)
Confirmatory factor analysis was used to test whether the ACN: SDH questionnaire is equivalent among the healthcare provider groups (i.e., Behavioral/Mental health & Medical health); 4 factor models were estimated (i.e., configural, metric, scalar, and strict) and The Chi-square difference test was conducted to determine metric invariance. In terms of configural invariance, the ACN:SDH scale maintained the same number of dimensions in each group. The factor loadings and the item means were similar between the groups, supporting both metric and scalar invariance. Lastly, a chi-square difference test was conducted, which tests whether the model represents a significantly worse fit to the data than the previous model (assuming configural invariance) and the p-value is .206679, which is not significant, interpreted to mean that the metric invariance model holds.
Subgroup Analysis
Subgroup analysis was conducted using ANOVA. A one-way between group analysis of variance was conducted to explore ‘healthcare provider industry’ on levels of SDH competency, as measured by the ACN: SDH. Participants were divided into 4 groups according to their healthcare provider industry (Group 1: Behavioral/Mental health, n = 152; Group 2: Medical health services, n = 93; Group 3: Educators, n = 39; Group 4: Other, n = 18). There was a statistically significant difference at the p < .01 level in ACN: SDH scores for the 4 groups: F (3, 301) = 6.499, p = .001. The effect size calculated using eta squared, was .06, which is a medium effect size.23 Post-hoc comparisons using Tukey HSD test indicated that the mean score for the Behavioral/Mental health group (M = 80.03, SD = 10.80) was statistically different from that of the Medical Health Services (M = 76.09, SD = 11.49) and Other group (M = 69.11, SD = 14.04). The Education group (M = 76.67, SD = 10.40) did not differ significantly from either group.