This paper presents a rigorous assessment of BCTs that underpin interventions to reduce restrictive practices in adult mental health inpatient settings. Unlike previous reviews this study was broad in scope, not limited to a single restrictive practice or type of intervention. It is the first to comprehensively describe content in terms of BCTs and explore evidence of effectiveness.
The study demonstrated that it is feasible to apply the BCT taxonomy to a set of interventions that vary widely regarding conceptualisation, development, evaluation and reporting although the paucity of randomised designs hampered assessment of intervention effectiveness. Although these limitations in the literature prevented the identification of BCTs that show promise in terms of effectiveness, the review did identify a narrow range of BCTs used across all interventions.
There is little previous research with which to compare the results of the current study. Previous research modified the taxonomy definitions to enable a better fit, a process also required in the current study.[52] Presseau et al.[52] reported some similar findings in interventions for staff delivering diabetes care, identifying fewer BCTs (21 BCTs in 11 clusters) but were reviewing a smaller number of studies. The BCTs identified most frequently in Pressau et al.[52] differed from those reported here, which is not unexpected as the two studies concerned very different interventions.
Most of the 43 identified BCTs could be applied directly to the interventions, but some were complicated by featuring in a number of scenarios, e.g., ‘Restructuring the social environment’. These difficulties were addressed by introducing additional sub-coding, in essence tailoring the method for the context. Therefore, in addition to generating new insights into interventions, the review adds to knowledge around the systematic application of the taxonomy with complex data.
Targeting behaviour of staff vs behaviour of service users
One of the challenges of using the BCT taxonomy was ascertaining whose behaviour (e.g., staff or service user) was the target of the intervention. Within the interventions there were many instances detected where a BCT could be considered to target service user behaviour, but also had the potential to change staff behaviour. One example was the introduction of a sensory room: whilst aiming to change service user behaviour by facilitating self-care to reduce distress, it also changed staff behaviour by providing an additional resource to use to support people and hence facilitate de-escalatory behaviour. This was usually coded as ‘Restructuring the physical environment’ either to reduce conflict antecedents, or to promote de-escalatory behaviour, if conflict should arise. A further complexity is illustrated by the BCT ‘Action planning’. This often included individualised care planning to change a service user’s behaviour if they became distressed; yet may also triggered staff behaviour change towards the service user facilitating an informed response, which in turn can successfully avoid the use of restrictive practices. It is important to acknowledge the various influences of interventions on the behaviour of staff, service users and visitors in the therapeutic milieu.
Detail retention vs clarity of description
The BCT that lacked specificity in this study was also one of the most frequently used. ‘Restructuring the social environment’ captured a broad range of changes implemented by interventions, from a strategic level to everyday interactions between staff and service users. The decision to retain this detail through the creation of sub-categories (e.g., access to staff; management support) addressed the difficulty to some degree for the present study, but added additional layers of complexity that may hinder comparisons between the BCTs coded in this study. The tension between achieving clarity while retaining detail for BCT coding reflects tensions in the literature as a whole, since bespoke interventions confuse attempts to standardise descriptions. Some of this information could be seen as contextual rather than relating to a specific BCT: for instance, it is unclear whether a new type of staff meeting is a behaviour change technique in itself; or whether the BCT is only what happens during the meeting, e.g., problem solving and practical social support. This may be a grey area that was specific to this data and not easily addressed through the use of subcategories. Presseau et al.,[52] also found this code to require more specificity when coding system-level interventions, and recommended the addition of what is ‘restructured’, preferably within an explicit programme theory.
Behaviour’ vs ‘outcomes of behaviour
The study identified a lack of process or implementation data across the studies. In the context of the review the target outcome of the behaviour was an absence of something happening, i.e. fewer restraints. The target behaviour was successful de-escalation, which is itself not an absence of carrying out restrictive practice but a proactive attempt to avoid it by using other strategies. While it was clear for this study that the desired ‘behaviour’ was that which sought to reduce the use of restrictive practice, this was almost never measured or even accounted for amongst the interventions. The focus was always on the outcomes of behaviour, i.e. the number of restraints. This meant that feedback about the ‘behaviour’ could rarely be identified, as the focus was on feedback on ‘outcomes of behaviour’ and fails to capture successful de-escalation. This study shows how BCTs can be usefully deployed by future research to unpick these issues.
BCT Dosage
The frequency of BCT use was summarised in terms of whether they were present or not within an intervention, and not how many times evidence of their use was detected. As such, this does not reflect the ‘dose’ of each BCT. It is possible to report this cumulatively using NVivo software, but this would not be meaningful across a large number of interventions. The lack of explicit use of theory in intervention design and of accompanying detail about fidelity to the intervention further challenges dose identification.
Arguably, these examples illustrate theoretical weaknesses in the intervention literature and reinforce that without a theoretical model, it is difficult to understand what assumption interventions are based on, how they are supposed to have an effect and how effective they were. Using BCTs appears to be a helpful way of identifying where these shortcomings are pertinent. It is recommended that developers of future interventions make more explicit use of theory by using established reporting frameworks[53].
Limitations
The search strategy combined traditional systematic search techniques for retrieving research and grey literature, with a scanning approach to identify alternative sources of material. This had the advantage of enabling the retrieval of diverse records that reported intervention content and was useful for mapping the number and range of interventions; however, the diverse quality of reporting in some records presented a challenge for the meaningful assimilation of findings. For example, lack of detailed description of interventions hampered the detection of BCTs.
Implications for policy and practice
Service providers require high-quality evidence regarding the effectiveness of interventions to reduce restrictive practices. At present, these findings suggest that individual providers are developing and delivering ad-hoc untested interventions, or inconsistently implementing known interventions, without attention to how interventions will bring about change to staff behaviour. Evaluations of such interventions often report positive findings that imply that they are effective but the trustworthiness of such claims is undermined by poor reporting of intervention content, measurement of fidelity, little use of theory and testing using the least robust methodologies. Without reliable evidence, service providers may be using scarce resources to implement ineffective interventions.
Research recommendations
Existing evaluations reveal little about which procedures of an intervention are effective with commonly occurring procedures and BCTs identified across interventions. Without rigorous theory-driven testing of individual intervention procedures and components, it remains unclear which might be effective and whether that effect applies to which restrictive practices. The evaluations identified in this review used a variety of outcome measures reported in different ways, e.g., incidents per service user, or per day. This heterogeneity makes it difficult to compare studies and meta-analyse outcome data. Additionally, one gap that remains is the underuse of service user-reported outcome measures. Development of such outcome measures could add a useful dimension that may shed further light on intervention effectiveness. Future interventions should test individual procedures (and their constituent components) in isolation and be thoroughly described.