Descriptive statistics
In the ACT condition, we assessed 25 comorbid disorders, mostly anxiety disorders and dysthymia. The mean number of comorbid disorders was .57. In the CBT condition we assessed 24 comorbid disorders, also mostly anxiety disorders and dysthymia, with a mean of .63. In both conditions 5 participants had comorbid dysthymia. Personality disorders were not assessed, except for borderline and anti-social personality disorder. In the ACT condition 19 participants and in the CBT condition 17 participants, had been treated for depression before. We found no significant differences between the two conditions, with exception of the waiting time between the pre-treatment assessment and the first treatment session, t (56.77) = -4.15. Participants in the ACT condition (M = 3.70, SD = 2.60) had a shorter waiting time (in weeks) compared to participants in the CBT intervention (M = 7.18, SD = 4.57, p <.001). We therefore entered this variable as a covariate in the main analyses. There were no significant differences between conditions at the pre-treatment assessment (ps = .12 to .97) on any of the other measures. More information can be found in A-Tjak et al. [7].
One year outcome
Depressive symptom scores (QIDS-SR) and scores of quality of life (EUROHIS) are presented in Table 1. Results from post-treatment and 6-month follow-up have already been reported in our previous article [7]. We present them here for the convenience of the reader. The results of multilevel analyses can be found in Table 2. Patients reported large reductions in depressive symptoms from pre-treatment to 12-month follow-up. There were no differences in the rate of change between ACT and CBT from 6-month follow-up to 12-month follow-up, as indicated by a non-significant Cubic Time × Condition interaction. Patients also reported large increases in quality of life from pre-treatment to 12-month follow-up. The Cubic Time × Condition interaction was not significant, indicating no differences between ACT and CBT in the rate of change in quality of life from 6-month follow-up to 12 month follow-up.
Table 1. Corrected mixed-regression based estimated means, standard errors (in parentheses) and within- and between-group effect sizes (Cohen’s d) at 12m follow-up.
Measure
|
Condition
|
Pre
M (SE)
|
Post
M (SE)
|
6m FU
M (SE)
|
12m FU
M (SE)
|
Within-group
d
|
Between-group
d1
|
QIDS-SR
|
ACT
CBT
|
14.96 (0.92)
14.61 (0.99)
|
7.89 (0.88)
6.31 (0.96)
|
7.24 (0.84) 7.15 (0.94)
|
7.52 (0.87)
5.66 (0.94)
|
-1.26*
-1.60*
|
-0.25
|
EUROHIS
|
ACT
CBT
|
20.16 (0.93)
20.79 (1.00)
|
24.95 (0.85)
26.10 (0.94)
|
24.33 (0.79)
26.46 (0.87)
|
25.24 (0.85)
27.38 (0.92)
|
0.91*
1.28*
|
0.48
|
Note. ACT = Acceptance and Commitment Therapy, CBT = Cognitive Behavioral Therapy, EUROHIS = European Health Interview Surveys Quality of Life Scale, QIDS-SR = Quick Inventory for Depressive Symptomatology Self-Rated.
1 Cohen’s d pre- treatment to 1-year follow-up effect size
* p < .001
Table 2. Multilevel regression analyses for ACT and CBT on depressive symptoms (QIDS-SR) and quality of life (EUROHIS).
Measure
|
|
F
|
df
|
b
|
SE
|
p
|
|
|
QIDS-SR
|
|
|
|
|
|
|
|
|
linear time
|
|
53.90
|
84.65
|
-2.02
|
.28
|
<.001
|
|
|
quadratic time
|
|
68.02
|
144.73
|
1.75
|
.21
|
<.001
|
|
|
cubic time
|
|
19.83
|
138.96
|
.35
|
.08
|
<.001
|
|
|
waiting time
|
|
1.47
|
81.35
|
.16
|
.13
|
.23
|
|
|
contrast
|
|
1.70
|
106.98
|
1.49
|
1.14
|
.20
|
|
|
Linear time * Condition
|
|
.02
|
84.56
|
.08
|
.55
|
.88
|
|
|
Quadratic time * Condition
|
|
.18
|
144.59
|
.18
|
.42
|
.67
|
|
|
Cubic time * Condition
|
|
2.67
|
139.03
|
-.26
|
.16
|
.11
|
|
|
|
|
|
|
|
|
|
|
|
EUROHIS
|
|
|
|
|
|
|
|
|
lineair time
|
|
30.35
|
71.10
|
1.40
|
.25
|
<.001
|
|
|
quadratic time
|
|
29.89
|
118.47
|
-1.02
|
.19
|
<.001
|
|
|
cubic time
|
|
12.97
|
111.40
|
-.25
|
.07
|
<.001
|
|
|
waiting_time
|
|
2.54
|
80.72
|
-.21
|
.13
|
.11
|
|
|
contrast
|
|
1.16
|
101.51
|
-1.23
|
1.14
|
.28
|
|
|
Lineair time * Condition
|
|
1.83
|
71.04
|
-.67
|
.51
|
.18
|
|
|
Quadratic time * Condition
|
|
.03
|
118.34
|
.07
|
.37
|
.86
|
|
|
Cubic time * Condition
|
|
.24
|
111.45
|
-.07
|
.14
|
.63
|
|
|
|
|
|
|
|
|
|
|
|
Note. ACT = Acceptance and Commitment Therapy, CBT = Cognitive Behavioral Therapy, EUROHIS = European Health Interview Surveys Quality of Life Scale, QIDS-SR = Quick Inventory for Depressive Symptomatology Self-Rated. Waiting time is the time between pretreatment assessment and first treatment session, in weeks. Condition refers to treatment group (CBT or ACT).
Mediation
Depressive symptoms, dysfunctional attitudes, decentering and experiential avoidance scores at pre-treatment, during treatment and post-treatment are presented in Table 3. Overall model fit information for the models that were fitted are presented in Table 4.
Depressive symptoms. Model fitting procedures for the univariate LGCMs indicated a poor fit for the intercept-only model and a good fit for the linear model. A comparison of the BIC values suggests that the linear change model provided the best fit. This indicates that the assumption of linear change in depressive symptoms over time is preferred over the assumption of no change and curvilinear change. Parameter estimates of the linear change model indicated a significant linear decrease, M = -1.58, p < .001, in depressive symptoms at the group level. The variances of the intercept, 15.79, and the slope, 1.02, were significant, p < .01, showing significant individual differences of the initial depressive symptom scores and the rate of change over time. Using a multigroup approach on the linear model, we tested whether the trajectory in the group receiving ACT differed from the trajectory in the group receiving CBT. Inspection of the BIC values indicated that the fit of the model in which the slope factor means were allowed to be estimated differently in the two groups was inferior to the fit of the model in which the slope factor means were constrained to be equal. This implies that the depressive symptom linear slopes were not significantly different from one another.
Dysfunctional attitudes. Model fitting procedures for the univariate LGCMs indicated a poor fit for the intercept-only model and an acceptable to good fit for the linear and curvilinear model. A comparison of the BIC values indicates that the quadratic change model provided the best fit. This indicates that the assumption of curvilinear change in dysfunctional attitude scores over time is preferred over the assumption of no change and linear change. Parameter estimates of the curvilinear change model indicated a significant linear decline, M = -1.35, p < .001, in dysfunctional attitudes at the group level. The mean of the quadratic slope was -.26, p = .045, suggesting an acceleration in the rate of decrease over time. Variances of the intercept, 286.32, and linear slope, 1.22, were both significant, p < .001, showing significant between-person variance of the initial dysfunctional attitudes scores and the rate of change over time. The variance of the curvilinear slope was nonsignificant, .25, p = .34, suggesting no between-person variability in the reversal of the rate of change. Using a multigroup approach on the curvilinear model, we tested whether the trajectory in the group receiving ACT differed from the trajectory in the group receiving CBT. Inspection of the BIC values indicated that the fit of the model in which the slope factor means were allowed to be estimated differently in the two groups was inferior to the fit of the model in which the slope factor means were constrained to be equal. This implies that the dysfunctional attitudes linear and quadratic slope were not significantly different from one another.
In step 2, the relations among change in dysfunctional attitudes and depressive symptoms were assessed in a parallel process model. Providing support for common developmental trends in dysfunctional attitudes and depressive symptoms, the dysfunctional attitudes slope was significantly associated with the slope in depressive symptoms, as indexed by a regression coefficient of .28, p < .01. In addition, the intercepts of dysfunctional attitudes and depressive symptoms were significantly associated, .09, p = < .01.
In step 3, a latent difference score model was fitted. See Figure 1 for parameter estimates of this model. For each interval, depressive symptom levels at an earlier time point significantly predicted depressive symptom levels at a later time point. Above and beyond these autoregressive effects, each of the dysfunctional attitudes difference score factors significantly predicted symptom levels of depression at the end of the interval. This result indicates that prior change in dysfunctional attitudes was related to subsequent symptom levels of depression for each of the intervals. A multigroup model in which the difference score factors predicting levels of depression were allowed to be estimated differently for ACT and CBT also showed that each of the dysfunctional difference score factors significantly predicted symptom levels of depression at the end of the interval. This model resulted in an inferior fit, relative to a model in which the regression pathways were constrained to be equal across treatment conditions (BIC difference of 1.58 points). Although the fit of both multigroup models was not optimal, this result indicates that, in contrast to what we predicted, the assumption of a non-specific treatment effect of change in dysfunctional attitudes on depressive symptom levels is preferred over the assumption of treatment-specific effects.
[Figure 1 here.] Figure 1: Latent difference score model with dysfunctional attitudes as the mediator and depressive symptoms as outcome.
[legends]Path coefficients (unstandardized) are aggregated across conditions (ACT, CBT) as this model resulted in the best fit. DAS = DAS-17 scores, QIDS = QIDS-SR scores, pre = pre-treatment, s = session number during treatment, post = post-treatment, ∆ = latent difference score.
*** p < .001, **p < .01, *p <.05.
Decentering. Model fitting procedures for the univariate LGCMs indicated a poor fit for the intercept-only model and the linear change model. The quadratic change model had a considerably better fit, indicating that the assumption of curvilinear change in decentering over time is preferred over the assumption of no change and linear change. Parameter estimates of the curvilinear change model indicated a significant linear increase, M = .30, p < .01, in decentering at the group level. The mean of the quadratic slope was .25, p < .001, suggesting an acceleration in the rate of increase over time. Variances of the intercept, 24.91, linear slope, .38, and quadratic slope, .14, were significant, p < .05, showing significant between-person variance of the initial decentering scores, the rate of change over time and the reversal in the rate of change. Using a multigroup approach on the curvilinear model, we tested whether the trajectory in the group receiving ACT differed from the trajectory in the group receiving CBT. Inspection of the BIC values indicated that the fit of the model in which the slope factor means were allowed to be estimated differently in the two groups was inferior to the fit of the model in which the slope factor means were constrained to be equal. This implies that the decentering linear and quadratic slope were not significantly different from one another.
In step 2, the relations among change in decentering and depressive symptoms were assessed in a parallel process model. Providing support for common developmental trends in decentering and depressive symptoms, the decentering slope was significantly associated with the slope in depressive symptoms, as indexed by a regression coefficient of -.71, p < .01. In addition, the intercepts of decentering and depressive symptoms were significantly associated, as indexed by a regression coefficient of -.37, p = < .01.
In step 3, a latent difference score model was fitted. See Figure 2 for parameter estimates of this model. Above and beyond the significant autoregressive effects, the decentering difference score factors for the first and third interval significantly predicted symptom levels of depression at the end of these intervals. Across treatment groups, this result indicates that changes in decentering from pre-treatment to session 6, and from session 6 to 11 were related to subsequent symptom levels of depression, whereas no evidence for such an effect was found for the remaining intervals. However, a multigroup model in which the difference score factors predicting levels of depression were allowed to be estimated differently for ACT and CBT resulted in a slightly superior fit, relative to a model in which the regression pathways were constrained to be equal across treatment groups (BIC difference of 1.84 points). Although the fit of both multigroup models was not optimal, inspection of the pathways for ACT shows that changes in decentering from pre-treatment to session 1, and from session 6 to 11 significantly predicted subsequent symptom levels of depressive symptoms. For CBT, changes in decentering from pre-treatment to session 1, and from session 1 to 6 significantly predicted subsequent symptom levels of depression. Given the mediational effects of decentering in both conditions, the superior fit of the treatment-specific model potentially results from differences in temporality of these effects across conditions. In contrast to what we expected, these results indicate a non-specific treatment effect of change in decentering on symptom levels of depression.
[Figure 2 here.] Figure 2: Latent difference score model with decentering as the mediator and depressive symptoms as outcome.
[legends]Path coefficients (unstandardized) are estimated separately for ACT (italics) and CBT (boldfaced) as this model resulted in a superior fit to a model with equality constraints on the difference score to outcome path coefficients. EQ-D = EQ-D scores, QIDS = QIDS-SR scores, pre = pre-treatment, s = session number during treatment, post = post-treatment, ∆ = latent difference score.
*** p < .001, **p < .01, *p <.05, ns = non-significant.
Experiential avoidance. Model fitting procedures for the univariate LGCMs demonstrated a poor fit for the intercept-only model and a good fit for the linear and curvilinear model. Negative residual variances were obtained in the curvilinear model, suggesting that the assumption of curvilinear growth may not be reasonable for the observed data. This indicates that the assumption of linear change in experiential avoidance scores over time is preferred over the assumption of no change and quadratic change. Parameter estimates of the linear change model indicated a significant linear decrease, M = 1.38, p < .001, in experiential avoidance at the group level. The variance of the intercept was significant, 23.67, p < .001, whereas the variance of the slope was nonsignificant, 1.38, p = .06, indicating significant individual differences of the initial experiential avoidance scores but no individual differences in the rate of change. Using a multigroup approach on the linear model, we tested whether the trajectory in the group receiving ACT differed from the trajectory in the group receiving CBT. Inspection of the BIC values indicated that the fit of the model in which the slope factor means were allowed to be estimated differently in the two groups was inferior to the fit of the model in which the slope factor means were constrained to be equal. This implies that the experiential avoidance linear slopes were not significantly different from one another.
In step 2, the relations among change in experiential avoidance and depressive symptoms were assessed in a parallel process model. Providing support for common developmental trends in experiential avoidance and depressive symptoms, the experiential avoidance slope was significantly associated with the slope in depressive symptoms, as indexed by a regression coefficient of -.92, p < .05. In addition, the intercepts of experiential avoidance and depressive symptoms were significantly associated, as indexed by a regression coefficient of -.31, p = < .001.
In step 3, a latent difference score model was fitted. See Figure 3 for parameter estimates of this model. Above and beyond the significant autoregressive effects, the experiential avoidance difference score factors for the last interval significantly predicted symptom levels of depression at the end of these intervals. Across treatment groups, this result indicates that changes in experiential avoidance from session 16 to post-treatment were related to subsequent symptom levels of depression, whereas no evidence for such an effect was found for the remaining intervals. However, a multigroup model in which the difference score factors predicting levels of depression were allowed to be estimated differently for ACT and CBT resulted in a superior fit, relative to a model in which the regression pathways were constrained to be equal across treatment groups (BIC difference of 13.10 points). Although the fit of both multigroup models was not optimal, inspection of the pathways for ACT shows that changes in experiential avoidance for all of the intervals, except the first and second interval (pre-treatment to session 1, and session 1 to 6), significantly predicted subsequent symptom levels of depressive symptoms. For CBT, changes in experiential avoidance for all of the intervals did not significantly predict subsequent symptom levels of depression. This result is in line with the expectations, and indicates a specific treatment effect of change in experiential avoidance on depressive symptoms levels for ACT.
[Figure 3 here.] Figure 3: Latent difference score model with experiential avoidance as the mediator and depressive symptoms as outcome.
[legends]Path coefficients (unstandardized) are estimated separately for ACT (italics) and CBT (boldfaced) as this model resulted in a superior fit to a model with equality constraints on the difference score to outcome path coefficients. AAQ = AAQ-II scores, QIDS = QIDS-SR scores, pre = pre-treatment, s = session number during treatment, post = post-treatment, ∆ = latent difference score.
*** p < .001, **p < .01, *p <.05, ns = non-significant.
Table 3. Means (SD) of depressive symptoms (QIDS-SR), dysfunctional attitudes (DAS-17), decentering (EQ-D), and experiential avoidance (AAQ-II) from pre-treatment to post-treatment.
|
Condition
|
Pre-
Treatment
(N = 82)
|
Session 1
(N = 77)
|
Session 6
(N = 58)
|
Session 11
(N = 49)
|
Session 16
(N = 30)
|
Post-
Treatment
(N = 67)
|
QIDS-SR
|
ACT
|
14.96
(4.15)
|
15.06
(4.63)
|
11.76
(5.08)
|
11.21
(6.16)
|
8.84
(5.84)
|
8.10
(6.54)
|
|
CBT
|
14.61
(4.55)
|
13.57
(4.71)
|
11.24
(5.32)
|
9.68
(5.66)
|
8.23
(4.92)
|
6.34
(5.28)
|
DAS-17
|
ACT
CBT
|
63.36 (17.80)
60.55 (19.95)
|
62.15 (19.83)
59.67 (22.91)
|
61.03 (17.89)
54.33 (18.94)
|
59.51 (21.54)
55.91 (17.23)
|
52.42 (16.40)
51.01 (16.12)
|
50.03 (17.42)
46.56 (16.91)
|
EQ-D
|
ACT
CBT
|
34.96 (5.41)
34.45 (5.61)
|
33.91 (6.65)
33.89 (6.95)
|
33.06 (6.28)
32.08 (6.97)
|
35.58 (7.40)
33.78 (5.29)
|
37.63 (7.52)
36.04 (7.29)
|
37.58 (7.57)
37.13 (5.28)
|
AAQ-II
|
ACT
CBT
|
23.77 (6.95)
23.71 (7.61)
|
23.36 (7.70)
26.52 (8.92)
|
24.96 (7.80)
27.71 (8.89)
|
27.92 (9.71)
25.71 (8.92)
|
30.20 (10.60)
30.17 (8.86)
|
30.77 (9.57)
30.97 (8.70)
|
Note. AAQ-II = Acceptance and Action Questionnaire-II, ACT = Acceptance and Commitment Therapy, CBT = Cognitive Behavioral Therapy, DAS-17 = Dysfunctional Attitude Scale-revised, EQ-D = Decentering subscale of the Experiences Questionnaire, QIDS-SR = Quick Inventory for Depressive Symptomatology.
Table 4. Goodness-of-fit indices for the univariate latent growth curve models, the parallel
process models and the latent difference score models.
Model
|
X2 (df)
|
RMSEA
|
CFI
|
BIC
|
QIDS-SR
|
|
|
|
|
Intercept-only
|
234.56 (19)***
|
0.37
|
0.16
|
2451.88
|
Linear change
|
17.03 (11)
|
0.08
|
0.98
|
2244.37
|
Curvilinear change
|
14.59 (7)*
|
0.12
|
0.97
|
2246.94
|
Multigroup LGCM ≠a
|
30.01 (24)
|
0.08
|
0.98
|
2241.28
|
Multigroup LGCM =b
|
30.54 (25)
|
0.07
|
0.98
|
2240.56
|
DAS-17
|
|
|
|
|
Intercept-only
|
102.37 (19)***
|
0.23
|
0.72
|
2826.02
|
Linear changec
|
29.01 (16)*
|
0.10
|
0.96
|
2756.41
|
Curvilinear change
|
17.25 (12)
|
0.07
|
0.98
|
2749.66
|
Multigroup LGCM ≠
|
35.27 (27)
|
0.09
|
0.97
|
2741.72
|
Multigroup LGCM =
|
35.31 (29)
|
0.07
|
0.98
|
2739.26
|
Parallel process modeld
|
102.02 (55)***
|
0.10
|
0.93
|
4956.86
|
Latent difference score model
|
55.43 (35)*
|
0.08
|
0.97
|
4935.32
|
Latent difference score model
multigroup ≠e
|
236.53 (70)***
|
0.24
|
0.79
|
4946.48
|
Latent difference score model
multigroup =f
|
241.21 (75)***
|
0.23
|
0.79
|
4944.90
|
EQ_D
|
|
|
|
|
Intercept-only
|
109.26 (19)***
|
0.24
|
0.59
|
2556.74
|
Linear change
|
45.46 (11)***
|
0.20
|
0.84
|
2502.95
|
Curvilinear changeg
|
18.11 (9)*
|
0.11
|
0.96
|
2478.11
|
Multigroup LGCM ≠
|
60.20 (24)***
|
0.19
|
0.86
|
2480.85
|
Multigroup LGCM =
|
60.30 (26)***
|
0.18
|
0.86
|
2478.44
|
Parallel process model
|
80.23 (50)***
|
0.09
|
0.95
|
4667.48
|
Latent difference score model
|
78.39 (35)***
|
0.12
|
0.92
|
4684.43
|
Latent difference score model
multigroup ≠
|
178.44 (70)***
|
0.19
|
0.83
|
4665.22
|
Latent difference score model
multigroup =
|
186.54 (75)***
|
0.19
|
0.83
|
4667.06
|
AAQ-II
|
|
|
|
|
Intercept-only
|
91.46 (19)***
|
0.22
|
0.63
|
2799.96
|
Linear change
|
12.08 (11)
|
0.04
|
0.99
|
2730.59
|
Curvilinear change
|
7.52 (7)
|
0.03
|
0.99
|
2731.05
|
Multigroup LGCM ≠
|
42.77 (24)*
|
0.14
|
0.92
|
2724.58
|
Multigroup LGCM =
|
42.78 (25)*
|
0.13
|
0.92
|
2723.33
|
Parallel process modelh
|
67.66 (54)
|
0.06
|
0.98
|
4892.43
|
Latent difference score model
|
93.65 (35)***
|
0.14
|
0.90
|
4942.23
|
Latent difference score model
multigroup ≠
|
172.53 (70)***
|
0.19
|
0.84
|
4917.40
|
Latent difference score model
multigroup =
|
191.90 (75)***
|
0.20
|
0.81
|
4930.50
|
Note. QIDS-SR = Quick Inventory for Depressive Symptomatology Self-Rated; DAS-17 = Dysfunctional Attitude Scale-revised; EQ-D = Decentering subscale of the Experiences Questionnaire; AAQ-II = Acceptance and Action Questionnaire-II; RMSEA = root mean square error of approximation; CFI = Comparative Fit Index; BIC = Bayesian Information Criterion; LGCM = latent growth curve model. * = p < .05, ** = p < .01, *** = p < .001.
aIn this model a multigroup approach was applied to the best fitting univariate LGCM while freely estimating the slope factor means.
bIn this model a multigroup approach was applied to the best fitting univariate LGCM while an equality constraint was imposed on the slope factor means.
ccorrelated measurement residuals among adjacent time points were not included for these linear and
curvilinear models as this provided a superior fit.
dthe curvilinear slope in DAS-17 scores was removed from this model, as a negative residual variance was
obtained for this parameter.
eIn this model a multigroup approach was applied to the latent difference score model while freely estimating the regression pathway linking the latent difference score of the mediator to QIDS-SR scores at the end of the interval.
fIn this model a multigroup approach was applied to the latent difference score model while an equality constraint was imposed on the regression pathway linking the latent difference score of the mediator to QIDS-SR scores at the end of the interval.
gthe correlation between pre-treatment and session 1 scores was negative in this model and was constrained to 0.
h the curvilinear slope in AAQ-II scores was removed from this model, as a negative residual variance was obtained for this parameter.