Participants
Children with UCP were recruited from across Queensland, Australia from January 2012 to June 2013.7 Potential study participants were identified through a population-based research database of more than 1300 children with CP at the Queensland Cerebral Palsy and Rehabilitation Research Centre, the Queensland Paediatric Rehabilitation Service and the Cerebral Palsy Register. The recruitment process targeted both publicly funded services and private practitioners with the expectation that the sample would be representative of children with UCP.
Children were eligible to be included if they: 1) had a confirmed diagnosis of UCP; and 2) had reduced upper limb function due to predominant spasticity rather than dystonia; and 3) were aged 5 to 16 years; and 4) had sufficient co-operation and cognitive understanding to participate in the therapy activities. Children were ineligible if they: 1) had fixed contracture or severe muscle spasticity in the designated muscle groups; or 2) had previously undergone upper limb surgery; or 3) had received intramuscular Botulinum toxin A injections within six weeks before baseline assessments.
Full ethical approval for the study [20] was obtained from the Medical Ethics Committee of The University of Queensland (2011000553), The Royal Children’s Hospital Brisbane (HREC/11/QRCH/37) and The Cerebral Palsy League Ethics Committee (CPL-2012-004). Trial registration was obtained with the Australian and New Zealand Clinical Trials Registry (ACTRN12609000912280). Before entering the trial, informed, written consent was obtained from all parents or guardians and assent from children (if 12 years of age or older). Full details of the study methods are reported in the published study protocol [20]. No subgroup analyses were predefined in the trial protocol.
Design
The present economic evaluation was embedded in an open-label parallel randomized controlled trial which compared the effectiveness of an intensive block group model of upper limb therapy delivered using a day camp model (hybrid-CIMT) [20] to an equal dose of a distributed model of individualized occupational therapy provided in the community (SC). The economic evaluation was performed from a societal perspective over a 13-week time horizon which was consistent with the trial period, including all costs (direct or indirect) and effects of each therapy. Due to a short follow-up period, no discount rate was applied to costs or effect measures.
Following baseline assessments, children were randomized within matched pairs to either hybrid-CIMT or standard occupational therapy care (SC). To maximize the homogeneity of the sample and minimize group differences at baseline, children were matched according to age (12-month bands), sex, and Manual Ability Classification System (MACS) level I-II [21–22]. The MACS is a simple five-level, ordinal grading system, created to classify the fine motor ability of children with CP in the range of 4–18 years, meeting international criteria. It describes what a child can do in their daily life, e.g., grasp and handle objects using their hands (performance), and not what children can do at their best (capacity). The MACS is recognized as having high psychometric properties [23].
Therapy allocation was recorded on folded paper inside a concealed envelope. The randomization process was then achieved by allocating a number “1” or “2” to each member of the pair and the envelope was opened by non-study personnel. Study personnel was informed of group allocation.
Sample size
An appropriate sample size determination for this study was based on having sufficient power to compare the functional effects of hybrid-CIMT and SC therapies at 13 weeks. Based on data from a previous study [24], a mean difference of 7 units (10% of the control group mean at baseline on the Melbourne Assessment of Unilateral Upper Limb Function (MUUL) was postulated as the minimum difference likely to have clinical implications. We assumed a standard deviation of 30. With an alpha of 0.05 and a power of 0.80, it was calculated that a sample size of 25 subjects in each group (n = 50) was required.
Intervention and standard care
Participants received either hybrid-CIMT or a SC rehabilitation approach. While both groups received a dosage of 45 hours upper limb training, they differed by 1) delivery method (group versus individualized); 2) intensity (high intensity over 2 weeks versus low intensity over 12 weeks); and 3) environment (community-based camp versus community centre/rehabilitation unit or home).
For the hybrid-CIMT group, participation was by attendance at one of two camps. The first camp was held in January 2012, while the second camp was held in mid-2012. Therapy consisted of intensive direct upper limb training spread over two weeks using a novel circus theme to enhance children’s motivation for engagement and participation. Children in this group attended a community facility, ‘Flipside Circus’ in Brisbane, Australia, for six hours a day coordinated by a team consisting of occupational therapists and physiotherapists. In the first week, the intense tasks were given to the children to utilize their impaired arm through the constraint of their unimpaired arm with an individually made glove. The glove was constructed from breathable fabric with a volar plastic insert to prevent grasp and was removed for no more than 15 minutes per day. In the second week, the glove was removed, and adopting the strategy used by Gordon et al. [25], encouraged the use of both hands to implement bimanual tasks. All tasks were analyzed and selected to target specific movement components required for goal achievement and were novel, fun and motivating, and fostered self-generating voluntary repetition of bimanual tasks.
Children in the SC group received individualized occupational therapy (focused on improving upper limb function) of equal dosage to those in the hybrid-CIMT group. This dosage consisted of six weekly sessions of 1.5 hours of individual direct therapy in a hospital or community setting combined with other therapy in their own homes. As part of the latter component, families were provided with a 36-hour home program to practice goal areas from the commencement of the individual therapy sessions (30 minutes daily for six days/week for 12 weeks).
Cost measures
The economic evaluation aimed to determine and compare the total costs associated with either hybrid-CIMT or SC and relate these costs to effects. Firstly, relevant categories of resource utilization were identified; they being: 1) Direct medical costs; 2) Direct non-medical costs; and 3) Indirect costs Secondly, the volume of each category for each child was measured, and resource costs measured these volumes. Direct medical costs consisted of 1) Healthcare staff salaries; and 2) Flipside Circus registration fees; the latter being particular to the hybrid-CIMT group. Direct non-medical costs consisted of 1) Flipside Circus consumables (e.g. restraint gloves); and 2) Accommodation and Travel costs. The latter relates to the reimbursement of costs incurred by families of children participating in the trial. Indirect costs consisted of 1) Flipside Circus catering, and 2) Productivity costs; the latter being costs associated with primary caregivers’ days off work. Self-reported data on primary caregivers’ missed employment days were prospectively collected throughout the trial via phone calls. Productivity costs were then retrospectively assigned to any missed employment days by applying Australian median earnings data stratified by age, sex and level of highest educational qualification [26]. An estimate of the monthly productivity cost per participant was derived based on participants’ last contact date. While all costs emanating from SC were individualized, costs that occurred from hybrid-CIMT consisted of both individual and aggregate data. All costs were valued in 2020 Australian dollars (AUD).
Effectiveness measures
The primary caregiver completed the Cerebral Palsy Quality of Life Child Questionnaire (CPQoL-Child) to assess the child’s QoL from parents’ perspectives [24]. The questionnaire contains 66 items across seven domains: 1) Access to services, 2) Emotional well-being, 3) Family health, 4) Feelings about functioning, 5) Participation and physical health, 6) Pain and impact of disability, and 7) Social well-being and acceptance. Access to services refers to access to community services or facilities, such as service provisions or accessibility, that support parents and children with CP. Emotional well-being refers to being happy, enjoying/being satisfied with achievements, and having a good emotional state. Family health refers to parents and primary caregivers’ physical and emotional well-being and includes parental happiness. Feelings about functioning refer to communicating with other people in the family and community and performing daily living activities such as feeding, dressing, and toileting. Participation and physical health refer to involvement in school activities, sports and community activities; the possession of adequate motor skills; the capacity to use aids/equipment; and bodily health and wellness. Pain and impact of disability refer to physical pain or discomfort and pain related to therapy. Social well-being and acceptance refer to interactions with peers, family members and other people in the community. Social participation is a component of this domain and refers to social connectedness and relationships, the capacity for involvement in social activities, and social acceptance.
Each question on this form is worded in a way such as “How do you think your child feels about…” and requires an answer from 1 to 9 where 1 = Very unhappy, 3 = Unhappy, 5 = Neither happy nor unhappy, 7 = Happy, and 9 = Very happy. The scoring procedure included two steps. First, raw scores for each item were transformed to a scale with a possible range of 0–100 points. Afterwards, the domain scores were calculated by averaging the scores of all items. Except for the domain of Pain, higher scores indicate better QoL. The CPQoL-Child has excellent psychometric properties [27] and high test–retest reliability ranging from 0.76 to 0.89 across all seven domains [28]. Furthermore, as QoL is defined as ‘well-being across broad domains’, scores are reported by domain rather than an aggregated score [29].
Statistical analysis
The analyses reported here were all planned a priori. There were no interim analyses or stopping rules. The primary analysis was intention-to-treat, with children analyzed in their randomized group, irrespective of whether they completed the trial. We used multiple imputation with chained equations (MICE) approach to compensate for data missingness to create ten imputed data sets and combined these results with Rubin’s rules [30]. As multiple imputation has consistently been shown to be a valid approach in handing missing data, only estimates obtained by multiple imputation are reported [31]. All imputed data were assumed missing at random. Baseline characteristics of participants are reported as counts (percentages) and compared by use of Fisher’s exact test. Due to non-normality, therapy costs per child are reported as medians (interquartile ranges (IQRs)) and compared using the Mann-Whitney U test. A difference-in-difference analysis was used to test the change in each CPQoL-Child domain within the hybrid-CIMT group, by accounting for any trend not attributable to the intervention by controlling for the measured change in the SC group. These changes between baseline and 13-week follow-up were assessed using the paired t-test with Satterthwaite’s correction for unequal variances.
To assess hybrid-CIMIT cost-effectiveness, incremental cost-effectiveness ratios (ICERs) were calculated. ICERs were calculated for each CPQoL-Child domain by dividing the difference in the mean costs (between the two therapies) by the differences in the mean domain scores. Excepting the Pain domain, domain ICERs were interpreted as the incremental cost per unit of additional domain score [32]. For Pain, it is the converse, as a lower QoL score indicates less pain. The non-parametric bootstrap resampling method with 10,000 iterations was used to quantify uncertainty in estimating differences between COMBiT and SC groups for mean costs, mean effects, and ICERs by way of 95% uncertainty intervals (UIs).. Cost-effectiveness acceptability curves were produced to determine the relative likelihood that hybrid-CIMIT was cost-effective at varying willingness to pay thresholds.
All tests of significance were two-sided, and a P-value of less than 0.05 was considered significant. Analyses were conducted using version 17.0 of the STATA software package (StataCorp, College Station, Texas).