Participants and procedure
Inclusion criteria for this study were: (1) DSM – 5 diagnosis of BPD assessed with SCID-P-5, a structured clinical interview (19); (2) age above 18 years; (3) the primary caregiver to a child preferably under the age of six (at least primary school age) at the start of the treatment; whereby the acute welfare of the child was not endangered; (4) able to comprehend and speak Dutch at a level sufficient to complete self-report instruments, the assignments, the group training and individual sessions; and (5) willing and able to commit to attending a 2-hour group once a week for 12 weeks and 45 minutes individual session every other week. Exclusion criteria were: (1) lifetime psychosis or bipolar disorder type I; (2) insufficient cognitive capacity to comprehend the topics being discussed; screened by the SCIL (screener for intelligence and learning difficulties) with a cut-off score of 19 (20); (3) significant substance abuse that would have an impact on group functioning; as per clinical judgement following discussion with the research team; (4) start of new medication within 3 months before the start of this study. Participants were not excluded due to concurrent treatment (pharmacological or non-pharmacological). Pharmacological treatment should have been kept stable at least 2 months prior to entering this study.
Following the medical ethical approval of the VU Medical Centre in Amsterdam, mothers with BPD were actively informed about this research project by their clinician. When they were interested in the parenting training and the study, they were referred to the coordinating researcher, a mental health psychologist trained to be a specialist, who provided extensive information about the parenting training and the study and was responsible for the informed consent and assessments. The clinician decided whether it was indicated for the mother to participate in the parenting training at that very moment. During this screening appointment all inclusion and exclusion criteria were checked.
The sample consisted of ten mothers (mean age = 35.9, SD = 4.65). Eight mothers were from Dutch, and two from Turkish descent. The age of the focus child was between 3 and 8 years old (M = 4.6, SD = 1.71). Nine mothers had a child under 6 years old and one with a child of 8 years old. She did not meet one of the inclusion criteria (age of child under 6 years), but the burden of parenting was so high that we decided she could join the group and the study. Three mothers had one child, five mothers had two children and two mothers had three children. In nine cases, the biological father or a father figure was involved to some extent in parenting. One mother reported that the father was not involved in the childrearing (he visited once a week for an hour). Five of the ten mothers considered the involvement limited (e.g., only during the weekends).
Six of the ten mothers met criteria for one or more comorbid disorders. Three of ten met criteria for depression, four of ten met criteria for posttraumatic stress disorder, two of ten met criteria for an additional personality disorder. Seven of the ten mothers had been taking medication (i.e., antidepressants, antipsychotics in small dosage, and benzodiazepines) but did not change the dosage in the three months prior to the start of this study. Of the ten mothers, two of them received additional treatment during the baseline or intervention phase. One mother received schema focused therapy and the other received pedagogical support at home during the baseline and intervention phase.
Study design
A multiple baseline single-case experimental design with a baseline phase (A-phase) and an intervention phase (B-phase) was used in this study to evaluate the effectiveness of parenting skill training. A multiple baseline design is considered an experimental single-case designs and allows testing whether changes in parenting behaviour and parental stress are the result of the intervention and not of time, and whether the change is meaningful (21,22). Because a multiple baseline design requires few participants and because the participants act as their own controls, multiple baseline designs are viewed as a practical and ethically responsible choice in hard to treat and research populations. This is especially the case in parents with BPD who are considered a group with high drop-out rates from large-group research studies (23,24). A minimum of N=4 is suggested for this design (25). Based upon sample sizes in a similar study (26), and the possibility of drop-out, a sample of N=10 seems sufficient. In 1995, the Task Force of the Society of Clinical Psychology (27), a division of the American Psychological Association, classified interventions tested in nine replicated single-case studies as ‘well-established’ interventions.
In our study, the A-phase is the baseline period during which participants did not receive parenting training (T0-T1). Participants were randomised to one of the two baseline lengths (3 and 5 weeks), based on their residence and location registration. Subsequently, the training phase B started during which the mothers received DBT parenting skills training in a group (T1-T3). Timing of assessments was as follows. Extensive assessments (full questionnaires APQ and NOSI-K, described below) were administered before (T0) and after the baseline period (T1), at mid-treatment (T2) and after the training phase at post (T3) and follow-up (T4) assessment. During the two phases (T0-T3) frequent short (biweekly) idiosyncratic assessments of parenting behaviours and parental stress were conducted. In addition, at the end of every group session the participants filled in a very brief, four-question questionnaire to assess group atmosphere at both locations.
Assessment
Extensive assessments at T0-T4
The Dutch version of the Alabama Parenting Questionnaire (APQ; (28)) was used to measure parenting behaviour. The questionnaire consists of 42 items on parenting practices, divided in five categories/scales: positive involvement with children (1), supervision and monitoring (2), use of positive discipline techniques (3), consistency in the use of discipline (4) and use of corporal punishment (5) (28). The questions were filled in on a five-point rating scale (1= never, 2=almost, 3=sometimes, 4=often, and 5=always). 7 items do not belong to one of the subscales. It takes about 10 minutes to fill in the questionnaire. Research shows that the APQ has good psychometric properties (29). Internal consistency reliability alphas for the involvement scale (.80) and the positive parenting (.80) scales were strongest. Poor supervision/monitoring (.67) and inconsistent discipline (.67) had marginally acceptable reliabilities. The corporal punishment (.46) did not yield an acceptable reliability. The criterion validity is rated as good (30).
The Dutch Parental Stress Index-child report (Nijmeegse Ouderlijke Stress Index Kinderen; NOSI-K; (31,32)) was used to measure parental stress. The NOSI-K is the Dutch version of the Parenting Stress Index (PSI (33)). The NOSI-K is a self-report questionnaire consisting of 25-items, about experiences related to child and parent characteristics and situations related to upbringing. The questions were filled in on a six-point rating scale (1=totally disagree, 2=disagree, 3=slightly disagree, 4=slightly agree, 5=agree, and 6=totally agree) which yield together a sum score ranging from 25-150. It takes about 5 minutes to fill in the questionnaire. The PSI has acceptable internal reliability (.83), and test-retest reliability (.81) and content, concurrent and construct validity (32,34). Research showed that the NOSI-K has a good reliability (Cronbach’s alpha .92-.95), the criterion validity is rated as good (35).
Idiosyncratic Assessment (IA)
The IA was a personalised questionnaire of a maximum of 15 items, chosen by the mothers, out of the full APQ and NOSI-K questionnaires. Mothers choose items that represented the top parenting problems they experienced, as indicated during the screening appointment with the research coordinator. The idea was to select the items representing problems that the mother had the most difficulties with and wanted to change the most in her parenting behaviour or parenting stress.
Group atmosphere
Group Session Rating Scale (GSRS) is a brief four-item visual analogue scale to measure group therapy alliance (36). The participants score the session, after each session on a visual bipolar analogue scale, a line of ten centimetres. The four items include the relationship, goals and topics, approach of the session and overall cohesion. The four items yield together a sum score ranging from 0-40, with a mean score of 10. Cut-off score indicating a good alliance is set to a mean score of 8.5 per subscale for clinical populations (37). It takes about 2 minutes to fill in the questionnaire. The GSRS is adapted from the SRS (Session Rating Scale), the preliminary evidence was found that the four items of the GSRS can be thought of as a measure of global alliance within group therapy, which has adequate reliability (both alpha estimates and test-retest correlations) (38).
DBT parenting training
The DBT based parenting training evaluated in this study is the Dutch version of the training for mothers with BPD developed by Renneberg and Rosenbach (16). The content of the training is based on the concept of DBT and is outlined in Table 1. All sessions were described in detail in the original training manual by Renneberg and Rosenbach. Each session is divided into two parts, the first part focuses on the discussion of participants’ homework, and in the second part a new topic is introduced. Every session has the same structure: each session starts with a short mindfulness practice, subsequently homework assignments of the previous session are discussed to facilitate learning and implementation of newly learned behaviours into daily life. After a break, the new subject is introduced followed by a specific exercise (e.g., role-play). In each session a short summary about the topic and homework assignments in print were provided. In addition to the group intervention, mothers had an individual coaching session every other week. During the individual sessions, mothers shared daily cards as well as sensitive topics concerning motherhood, that were too difficult to share in the group (16).
Two female trainers (a clinical psychologist and psychiatric nurse or psychologist) experienced in working with patients with BPD and trained in DBT facilitated and instructed the group training. The group was conducted by two trainers every session. There were different trainers per location. All four trainers had children of their own, which is an important prerequisite according to the training developers. They had monthly peer-to-peer learning sessions in which they discussed their difficulties as a trainer during the program. Individual coaches were trained prior to this research program. They were either psychologists or psychiatric nurses and were trained in DBT. Participants saw the same professional every individual session.
Table 1. [MM1] Theme and content of the 12 sessions of the DBT parenting training
Session
|
Theme
|
Content
|
1
|
Psycho education
|
To comprehend the impact of maternal borderline symptomatology on child development.
|
2
|
Mindfulness
|
To point out the importance of mindfulness in the interaction with children to better perceive and understand the needs of the children and to gain a greater control over own dysfunctional behaviour impulses.
|
3
|
Children’s basic needs
|
To understand children’s needs as well as to assess their own competences to satisfy these needs.
|
4
|
Stress and stress management
|
To develop and maintain stress strategies to better cope with individual stressors.
|
5
|
Stress and stress management
|
Idem.
|
6
|
Structure and flexibility
|
To clarify the importance of rules and rituals and to better differentiate between fixed rules and flexible structures.
|
7
|
Dealing with conflicts
|
To promote a non-violent and solution-oriented management of mother-child conflicts. To develop new ideas and ways to cope with conflicts.
|
8
|
Dealing with emotions
|
To comprehend their children’s emotions and needs. To better understand and handle intense emotions.
|
9
|
The body
|
To enhance the understanding of physical functions and reactions as well as to enhance the empathy for children’s needs for body care.
|
10
|
Basic assumptions about parenting
|
To identify and modify basic assumptions about parenting into realistic views.
|
11
|
Self-care
|
Developing strategies to enable better maternal self-care.
|
12
|
Summary
|
Summarizes the content of the training and outlines the individual changes in the participants’ perception and parental behaviour.
|
Data-analysis
To investigate changes in parenting behaviours and parental stress across phases, we conducted the following analyses. First, the total scores on the full questionnaires assessing these two variables were calculated, and the Reliable Change Index (RCI;(39)) was determined between extensive assessment points (T0-T1; T1-T3; T1-T4). Following Jacobson and Truax, an RCI > 1.96 or < −1.96 (z-scores) indicates clinically reliable change (39).
Second, the Nonoverlap of All Pairs (NAP; (40)) method was used with idiosyncratic assessments to investigate the probability that a random measurement in one phase (i.e., baseline) is different from a random measurement in another phase (i.e., treatment). NAP values were calculated using Shiny SCDA ((41,42). For defining a rule when a NAP value indicates that the change between the baseline and treatment is meaningfully different, we used the following criteria: NAP 50% is chance level, >50% is indicative of an effect in the expected direction (40). NAP values lower than 65% are labelled as weak effect, values between 66-92 as medium effect, and values above 93% are characterised as large effect.
Finally, and to support quantitative data-analysis, the data was presented visually, using graphs. Total scores of the rated group atmosphere are presented.