Aim
The aim of this study is to investigate the effectiveness of chiropractic spinal manipulation versus sham manipulation in children aged 7-14 with recurrent headaches.
Trial design
This was a two-arm, single-blind, superiority randomized controlled trial. The protocol of the study has been published elsewhere [25].
Participants
Between November 2015 and August 2019, we recruited participants for this trial through the Danish School Information Network, local newspapers, television, social media and radio. The children had to be 7-14 years old, to have experienced at least one episode of headache per week for the previous 6 months and to have at least one musculoskeletal dysfunction in the spine, pelvis and/or temporomandibular joint, identified by the investigating chiropractor. Exclusion criteria were examination findings requiring immediate referral, contraindications to spinal manipulation, previous treatment for headache within the last 3 months and failure to report pre-randomisation baseline data.
Setting
The study took place at two clinics in Northern Denmark: one chiropractic clinic and one paediatric specialty practice. Screenings and treatments were administered in both clinics by the same investigating chiropractor with 34 years of experience in private practice.
Pre-randomisation data collection
Before screening, eligible children and their parents answered three questions each Sunday for 4 weeks via a text message on their cell phone (Short Message System, SMS). The questions regarded number of days with a headache, intensity of headaches and number of pills taken for headache during the previous week. In addition, a pre-treatment questionnaire including the characteristics of the child’s headache problem, lifestyle, previous trauma, previous treatment, family history of headache and general health was completed and returned by mail. Details have been reported in the protocol [25].
Screening
After a four-week pre-treatment period, verifying at least four episodes of headache, a screening for inclusion/exclusion was done by the investigating chiropractor. This included standard neurologic and orthopaedic examination, as well as examination for biomechanical dysfunctions in the spine, pelvis and temporomandibular joints.
Randomisation
Upon receipt of the signed consent form, participating children were randomised with 1:1 allocation using random block size with the software nQuery Advisor [26] by the data manager at the Nordic Institute for Chiropractic and Clinical Biomechanics. Group assignment was noted in opaque envelopes and sent to the project clinics.
After completing the four-week pre-treatment period and confirmed as eligible for inclusion at the screening visit, all participants and their parents received oral and written advice believed to be beneficial to headache patients in general, regarding regular sleep, diet and exercise (7). After this the randomisation envelope was opened by the investigating chiropractor and the trial period of 4 months began.
Intervention
At all the visits, the participants’ parents were present during a short interview where information about side effects and trauma experienced since the previous visit was collected by the chiropractor. The parents would then leave the room, and after examining the child, either the chiropractic spinal manipulation or the sham manipulation was administered.
The chiropractic spinal manipulation treatment was directed at specific, individually identified dysfunctions of one or more joints in the spine, pelvis and/or temporomandibular joints. A high-velocity, low-amplitude thrust, resulting in an audible cavitation, was given to improve the function of the joint. The treatment has been described in detail in the study protocol [25]. All treatments were modified to fit the age and size of the child as well as individual spinal characteristics. To reflect daily clinical practice, the number and frequency of treatments, as well as the joints treated, were based on the chiropractor’s individual evaluation at each visit throughout the 4 months treatment period.
The sham manipulation treatment followed a previously validated protocol, developed by Chaibi et al [27]. Placement of the child was similar to the placement in the chiropractic spinal manipulation group, but low-amplitude, low-velocity gentle pushes in a broad non-specific contact away from the spinal column were given with no resulting cavitation. In addition to the protocol previously established by Chaibi et al, a de-activated activator (www.activator.com) [28] on the chiropractor’s own arm would produce a click-noise in connection with the cervical treatment to resemble the sound of the audible joint cavitation in the chiropractic spinal manipulation group. The children in this group should receive approximately eight visits with increasing intervals during the 4 months participation period to resemble a common course of care in a chiropractic practice. The ideal schedule was 2 visits the first week, 1 visit/week the following two weeks, 1 visit every other week for four weeks and finally the last two visits four weeks apart, but it could be modified to the parents’ convenience.
Post-intervention treatment
Children in the chiropractic spinal manipulation treatment group who reported little or no effect, or a worsening of their headache after treatment were offered a consultation with the paediatrician. Children in the sham manipulation group who reported little or no effect, or a worsening of headache after the trial period were offered free chiropractic care, similar to the care delivered in the spinal manipulation group. After the four-month post-trial treatment period, parents received a final text message, identical to the one they received after participating in the trial regarding the effect of the treatment.
Outcomes
Throughout the study period, the parents together with their participating children answered the same weekly text messages as they had during the pre-randomisation period:
- “How many days has <child’s name> had a headache this week? Choose a number between 0 and 7“.
- “How will you rate the pain on a scale from 0-10, where 0 is no pain and 10 is the worst pain you can imagine?”
- “How many pills for headache has < child’s name> taken this week? 0: none, 1: 1-4, 2: more than 4 pills.”
The parents sent the answers using the reply function, and the answers were automatically registered and stored in a database. At the end of the 4 months of treatment, all participating families received a final text message including three questions to be answered in collaboration between parents and child:
- “How satisfied is <child’s name> with participation in this trial on a scale from 0-10, where 0 is the worst and 10 is the best you can imagine?”
- “How has the headache changed since <child’s name> started the treatment at the chiropractor? 1. almost gone/disappeared; 2. much better; 3. slightly better; 4. same; 5. a little worse; 6. much worse; 7. worse than ever.”
- “In this trial there have been two groups. Do you think that <child’s name< was in group 1, who had standard chiropractic treatment or in group 2, that DID NOT have standard chiropractic treatment (please answer 1 or 2)?”
To estimate the effect of the intervention, we considered the average values during the pre-treatment period and the final 4 weeks of the study period (Weeks 14-17) for the three variables based on the weekly SMS questions. The final outcomes were then given by the change scores, i.e. the difference between these average values. A fourth outcome was the global perceived effect (GPE) based on the SMS (question #2) after 4 months.
Sample size
A sample size calculation was conducted when the data collection was completed for 50 children in each treatment group [29]. This was based on weekly headache days, and details were reported in the study protocol [25]. A sample size of 100 children in each group was indicated to detect a difference of 20% in mean change score between groups with a power of 80% and a significance level of 5%. Calculations were performed in nQuery Advisor [26]. Allowing for a 20% drop-out rate, the aim for inclusion was 240 children. However, as drop out was very rare, inclusion was terminated after 199 children.
Blinding
Blinding the chiropractor was obviously not possible. Allocation was concealed from the participants and their parents and blinding was further attempted by including a sham manipulation, closely resembling the active treatment, including the clicking sound. At the end of the treatment period, participating children and their parents received a text message asking which group they believed the child had participated in.
Initial outcome analysis
Due to a lack of experience with the four potential outcomes in a population of children suffering from headache and with an SMS-based data collection based on responses from children and their parents, we did not know whether they were measured in a reliable manner and whether they would show a population variation suitable to be used as an outcome in an RCT. For example, we could not exclude that there would be little variation in some of the intended outcomes across children, or that we observed associations with baseline variables which were lower than expected and/or difficult to explain. Such insights were needed to make an informed prioritisation of the outcome variables. Therefore, we conducted an interim outcome data analysis to avoid potential misjudgments [30, 31].
That interim analysis was performed blinded to intervention status to provide information about the distribution of the four outcome variables in our population and guide the final prioritisation of outcome measures. The results of this analysis were discussed among the authors and the resulting decision report was approved by all authors before analyses of effects were initiated. The statistical report and the final decision report can be found in the Additional File 1.
The following main conclusions were drawn in the report. Since some participants did not follow the instructions to cluster the number of medications in their SMS responses and report the actual number, data on medication use could only be analysed in a reliable manner by identifying the presence/absence of use each week. Consequently, the corresponding primary outcome variable was now the change in the proportion of weeks with medication use. As many children did not report any intake of medication in the pre-treatment phase, the statistical report also suggested a sensitivity analysis, which only included children with at least 2 weeks with medication in the pre-treatment phase.
The vast majority of participants reported a pain intensity of 0 in the weeks with no days of headache, in line with our expectation. However, it turned out that this led to a high variation in pain intensity over time for many children. Hence, the definition of the four-week pain scores was changed for intensity to take only weeks with at least one day of headache into account. Rather than illustrating the average intensity, this reflects the intensity of the headaches when present. In addition, two further intensity definitions were suggested to be included in the sensitivity analyses: the original definition and the average over the last available 4 weeks with headache, but maximally going back 7 weeks from the end of the treatment period. Lastly, the statistical report suggested the inclusion of an analysis of lower percentiles of the change scores, instead of means, as a sensitivity analysis to cover the scenario of only a few children benefiting from the intervention.
Based on the above, ‘number of days with headache’ and ‘pain intensity’ were chosen as equally important outcomes of highest priority, followed by GPE and then medication. The significance level for the first two outcomes was fixed to 0.025 to take multiplicity into account within the planned fixed sequence strategy.
Statistical analyses
All analyses were performed and presented to all authors for interpretation blinded for intervention status and two alternative conclusions were formulated before the concealment was broken. Baseline characteristics are reported as frequencies in each treatment arm for binary and categorical variables, and as means for continuous variables. To illustrate the spread of the data, means are supplemented with 10th and 90th percentiles. With respect to previous examinations, previous treatments and reasons for school absence due to illness, the frequencies for the most common category are reported.
The distribution of the primary outcomes in each treatment group is illustrated by dot plots. Intervention effects are assessed by the difference in mean values between the two intervention groups. They are supplemented by t-test-based 95% confidence intervals, p-values and Cohen´s d (standardized mean difference between groups) as a measure of effect size. In addition, we present adjusted p-values based on a linear regression model with one covariate in addition to treatment. That covariate was the baseline level for each of the change scores, and the number of days with headache at baseline for GPE. According to the protocol, an adjustment for additional baseline characteristics was planned in case they showed a correlation of at least 0.3 with the outcome variable. However, no such characteristic was identified. The multiplicity implied by considering four primary outcomes was taken into account by applying a fixed sequence strategy according to the prioritisation resulting from the initial outcome data analyses. Significance levels of 0.025 for the first two primary outcomes and 0.05 for the two remaining were used and applied to the adjusted p-values.
For the three change scores, a responder analysis was conducted, reporting the proportion in each group with 20, 25, 50 and 75% improvement compared with baseline. The number needed to treat (NNT) to reach a 20% improvement is also reported. In order to decide whether to refer the child to a paediatrician after the follow-up period, GPE was dichotomised into ‘improved’ or ‘same or worse’ [25]. The same dichotomisation was used to calculate NNT and this also allowed calculation of an odds ratio.
Side effects and satisfaction with care are analysed as secondary outomes (the latter not mentioned in the study protocol). In addition, course of treatment and the parents’ guess about treatment group are reported by group. Results for the pre-specified secondary outcomes, headache status and GPE after 8 and 12 months, will be presented in a subsequent manuscript.
Aligned with the protocol, sensitivity analyses were performed with missing values imputed based on multiple imputation (described in detail in Additional File 2). In addition, the sensitivity analyses according to the initial outcome data analysis report were performed.
The study is reported according to the CONSORT guidelines [32] and a CONSORT check list is included as Additional File 3.
STATA v.16.0 (StataCorp, College Station, Tx, USA) was used for all analyses.
Ethics
All parents were required to give written informed consent allowing their child to participate in this study and they were informed orally and in writing that participation in the trial was voluntary and that parents could withdraw their child from the trial at any time with no negative consequences for the child. All participants were treated according to the Declaration of Helsinki [33].
The project was approved by the Regional Committee on Health Research Ethics for The North Denmark Region (#N-20150025) and data were handled according to the General Data Protection Regulations [34]. The trial was registered with ClinicalTrials.gov (Identifier: NCT02684916) [35].