Design
Pragmatic parallel cluster-randomized controlled clinical trial with a follow-up of 18 months. The unit of randomization is the FP, and the unit of analysis is the patient. The cost-utility study will be carried out from the perspective of the Spanish National Health System with a time horizon of two years.
CONSERVE-SPIRIT has been used for reporting trial protocol instead of SPIRIT since MULTIPAP Plus had been suspended because of COVID-19 from March 2020 to May 2021 and methodologic modifications were made (Supplementary file 1: CONSERVE-SPIRIT checklist; Supplementary file 2: SPIRIT Trial Modifications in Extenuating Circumstance). This situation has been notified and updated in the trial registry.
Scope of study
The scope of study is primary care within the Spanish National Health System. The Spanish National Health System provides first contact, comprehensive, continuous, coordinated care (which is free at the point of care) to define a population served by primary care centers. Patients have named family physicians who are responsible for delivering and coordinating their care.
Study population
The study population includes patients between 65 and 74 years with multimorbidity and polypharmacy attending in primary care health centres in three autonomous communities Aragón, Madrid, and Andalusia.
FPs inclusion criteria:
-
Stable work situation, without intention to leave the position during the study.
-
Agree to participate and sign the informed consent form
Patient selection criteria:
Inclusion criteria:
-
Age: 65–74 years
-
Multimorbidity: ≥3 chronic diseases
-
Polypharmacy: ≥5 drugs prescribed for at least three months prior to inclusion in the study
-
Having visited/contacted their family physician at least once in the last year
-
Able to follow the requirements of the study
-
Agree to participate and sign the informed consent form
Exclusion criteria:
-
Institutionalized patients
-
Life expectancy of less than 12 months based on their doctor
-
Physical or mental illness that in the opinion of their doctor does not allow them to follow the study requirements.
Sample size: It was calculated under the hypothesis that the intervention would result in a difference of at least six percentage points in the combined variable (hospitalizations and/or all-cause mortality) between the study groups. According to previous studies, in the age range of 65 to 75 years, the criterion incidence of the estimated primary outcome variable was 16% [23, 34]. Considering a power of 80%, an alpha error of 5% and assuming simple random sampling, the required sample size would be 984 patients (492 patients per group).
The appropriate sample size for this type of design depends on the average size of the cluster and the degree of correlation between the individuals in the cluster. Consequently, it is necessary to adjust the sample size calculated according to the design effect (DE). An average group size of eight patients per FP and an intraclass correlation coefficient of 0.02 [35] produces the following (DE = 1 + (5–1) × 0.02 = 1.08), giving a sample size, corrected for design effect, of 1063 patients. Assuming a loss rate of 8%, the final sample size required is 1148 patients (574 per group).
Recruitment: MULTIPAP Plus has a group of 120 FPs who previously participated in the MULTIPAP project, voluntary participation has been proposed to this group and another FPs working in PC health centres in Aragón, Madrid, and Andalusia. Strategies to improve protocol adherence of FP will be considered (e.g. individual follow-up of protocol’s achievements and recognition via e-mail, offer to participate as co-authors in scientific papers, certified training sessions).
Patients will be selected by random sampling from the list of patients who meet the inclusion criteria. Subsequently, each FP will invite the listed patients, when the patient agrees to participate, the FP will inform them in detail about the study and confirm the inclusion/exclusion criteria and obtain the patient’s written informed consent. If they do not agree to participate, data on the patient’s age, sex, and reason for nonparticipation will be collected (see Fig. 1. Flowchart).
The selection of professionals was carried out in the third quarter of 2019. The recruitment of patients began in November 2019 and was suspended in March 2020. Considering the epidemiological situation in Spain, and the reorganization of health services including primary care, it was not possible to restart the study until May 2021. In that month, the situation of the family physicians was reviewed, and the commitment was updated, as well as the situation of the patients recruited between November 2019 and February 2020.
Randomization: The unit of randomization is the FP, and the unit of analysis is the patient. The randomization of FPs will be achieved using the treatment assignment module of Epidat® 4.1; the proposed intervention will be considered the treatment, and usual care will be considered the control. To guarantee an equal number of FPs in each group (intervention and control), the option “balanced groups” will be selected. Once all participating FPs have selected their patients and have collected the corresponding initial data, the Research Unit, Primary Care Management of Madrid, will randomize them centrally. Subsequently, each FP will receive the information of the study group to which they have been assigned, at which time all the patients they have recruited will be included in that group.
Intervention
This is a complex intervention that includes the training of FPs and Physician-patient interview based on the Ariadne principles; the effectiveness of the intervention has been studied in the MULTIPAP RCT[23, 36, 37]. The training includes activities related to basic concepts of multimorbidity, the appropriateness of prescriptions, adherence to treatment, the ARIADNE principles and shared doctor-patient decision-making. All participating physicians will receive this training with the objective of incorporating patient-centred interviews into their routine clinical practice. This would allow the effect of the training to be isolated from the use of a DSS.
Intervention group: several key elements of the intervention must be highlighted:
1. Clinical data will be reviewed and registered by FPs in the electronic case report forms (eCRF) after recruitment in baseline visit.
2. Because of the natural separation between actual electronic health records and electronic case report forms developed for the research project, final tool has been integrated into a dedicated eCRF system using a webservice WS4 version 1.2 of the CheckTheMeds® tool with the specific inputs reviewed by the FPs. This avoid barriers for FPs and the need for reintroducing double information to a separate system. Simple and detailed review of treatment plans has been incorporated. Simple review webservice outputs have been agreed after a Delphi technique with relevant stakeholders (primary care pharmacist, hospital pharmacist, family physicians and researchers).
3. The web-based, user-initiated DSS provide FPs with drug-therapy information that is relevant to participating patients with polypharmacy on demand. After verifying the clinical data included in the eCRF (multimorbidity and polypharmacy corrected for patient-specific factors such as sex, renal function, age and frailty), this DSS provides health professionals with clinical scenarios to optimize treatment plans for patients, the number of STOPP/START and Beers criteria, drug interactions classified based on their potential severity (traffic light system) and adjustment of the medications to other relevant clinical variables.
4. FPs will be able to add and modify patient data in eCRF and able to review again treatment plans as many times as needed with up-to-date relevant information (new drugs, new diagnoses, change if laboratory findings about kidney function, etc).
5. A specific training tool with video-recorded examples for clinical scenarios with treatment plans review appearing on first access to the tool and available for revising when needed as part of the formative intervention.
This intervention was developed in accordance with the recommendations and the taxonomy proposed by the Cochrane Effective Practice and Organization of Care Group (EPOC). The intervention is described in detail in Fig. 2, following the approach proposed by Perera et al. and the Template for Intervention Description and Replication (TIDieR) (Supplementary File 3) [38].
Control group
The patients in the control group will receive the usual clinical care based on the provision of advice and information and will be subjected to the examinations recommended in the guideline corresponding to each of the chronic diseases presented by the patient. Physicians will receive the same initial training programme as professionals in the intervention group.
Blinding
Due to the type of intervention, neither FPs and their patients nor the MULTIPAP Plus study team was blinded to the treatment allocation.
Variables
FPs will provide their data before the start of the study. Patient data will be collected by the recruiting FP, who will also be responsible for patient follow-up. All information will be recorded in a case report form designed for the study. Each FP will access the form from their personal computer through the project website using a personal identification code. Four visits were defined for patient data collection: baseline (T0), 6 months (T1), 12 months (T2) and 18 months (T3) (see Table 1).
Table 1
|
T0 (baseline)
|
|
T1
(6 m*)
|
T2
(12 m*)
|
T3
(18 m*)
|
Responsible entity
|
Confirm inclusion/exclusion criteria
|
X
|
|
|
|
|
FP
|
Written informed consent
|
X
|
|
|
|
|
FP
|
Sociodemographic variables
|
X
|
|
|
|
|
FP
|
Morbidity variables and drug treatment plan
|
X
|
|
X
|
X
|
X
|
FP
|
Randomization of FP´s
|
|
X
|
|
|
|
RU
|
FP intervention (intervention group)
|
|
X
|
|
|
|
RT
|
Patient intervention (intervention group)
|
|
|
X
|
X
|
X
|
FP
|
Mortality
|
|
|
|
X
|
X
|
RT/FP
|
Hospitalizations
|
|
|
|
X
|
X
|
RT/FP
|
Functionality (WHODAS), falls, hip fractures
|
|
|
X
|
X
|
X
|
FP
|
Use of health services
|
|
|
X
|
X
|
X
|
RT
|
Quality of life
|
X
|
|
|
X
|
X
|
FP
|
Usability, adhesion, satisfaction
|
|
|
X
|
|
X
|
TG
|
Costs
|
|
|
|
|
X
|
RT
|
T = Time FP: Family physician; RU: Research Unit; IG: Intervention Group; RT: Research Team; TG: Technical Group. m* = months from randomization |
Primary outcome variable: The primary outcome is a composite endpoint of hospital admission or death during the observation period measured as a binary outcome. Primary outcome measures are recorded by the FPs when they occur or at follow-up visits.Secondary outcome variables:
- all cause mortality, non-elective hospital admission (number of episodes and duration)
- Related to the use of medication: Potentially inappropriate prescription will be evaluated in accordance with the BEER criteria [39] and the STOPP-START criteria [40]; Medication safety will be measured as the incidence of adverse reactions and potentially dangerous interactions, classified based on the taxonomy proposed by Otero-López [41] as well as the incidence of adverse reactions; and Adherence to treatment will be measured Medication adherence was measured with the Morisky Medication Adherence score [42].
- Use of health services will be measured using records of unplanned and/or preventable hospitalizations as well as the use of emergency services and PC (FP and nurse).
- Quality of life will be measured using the EQ-5D-5L questionnaire [43, 44]. The differences in utility index between the intervention group and the control group at 18 months of follow-up will be used to determine the QALYs gained due to the intervention. The scores or utilities derived from the latest version of this tool, the EQ-5D-5L, have been proposed to provide information on economic evaluations of technologies.
- Disability will be measured using the WHODAS questionnaire [45] and number of fractures.
- For cost-utility, the National Health Service perspective will be adopted, with a time horizon of two years and a discount rate of 3%. The costs incurred will be the time dedicated to training required by the training programmes, the cost of the teaching staff, the time dedicated to doctor-patient interviews and the rights to use of the tool (DSS). All costs derived from the intervention will be charged through an opportunity cost proxy: average salary by professional category. As "avoided costs" of the intervention, we will consider the price of the drugs discontinued (measured using the retail price) and the cost of the adverse reactions avoided. The EQ-5D-5L questionnaire will be used to estimate the utilities in both groups (intervention and control). The QALYs obtained with the intervention will be calculated and compared with the difference between the costs incurred and avoided.
- DSS usability will be measured from user analysis perspective and usability testing [46] to the direct users (FPs): a) User analysis: this analyses user behaviour while interacting with a website. It is going to be realised non-obtrusively in the background by recording mouse movements and click behaviour to identify to what extent functions and website areas are accessed when reviewing treatments (Hotjar Tool); b) Usability using an ad hoc design with the Spanish-validated System Usability Scale (SUS) [47] and Computer Software Usability Questionnaire [48], DSS acceptability will be measured using records of actions performed with the CheckTheMeds® algorithm (number of changes) and a review of time invested per professional, and DSS satisfaction will be measured using an ad hoc questionnaire.
Explanatory and adjustment variables
a) Patient variables (first level)
- Sociodemographic: age, sex, nationality, region of residence, marital status, socioeconomic status (monthly salary expressed as multiples of minimum wage), family composition (number of people living in the household), indicators of subjective urban vulnerability, based on those collected by the National Health Survey to explore participants’ neighbourhood (noise level, odours, poor-quality drinking water, unclean streets, air pollution, lack of green areas, feral animals and crime), social support (Duke-UNC-11 Questionnaire adapted to Spanish [49]), profession and social class [50].
- Morbidity: number and description of chronic diseases based on the International Classification of Diseases in Primary Care (ICPC) as per O’Halloran list[51].
- Pharmacotherapeutic treatment plan: number and type of drugs prescribed, active ingredient and dose of each drug.
b) FP variables (second level)
- Sociodemographic: age and sex.
- Professional performance: years of professional experience, resident mentor (yes/no), and average workload measured as average daily consultations per FP during the year prior to the start of the study.
For the Data Monitoring Committee proposal, we have taken into account the distinguishing characteristics of pragmatic clinical trials [52, 53]. This committee includes clinicians, biostatisticians, ethical experts and, given the patient-centred outcomes focus of our trials [54, 55], a patient representative is incorporated to provide patient's perspective. This will allow to review relative benefits, burdens, and potential harms of the interventions and will provide insight into the optimal ways for results sharing [56, 57] to participants and relevant patient group.
Statistical analysis
All analyses will be carried out according to the intention-to-treat principle, with a statistical significance at p < 0.05.
Description of the baseline characteristics means and standard deviations for the quantitative variables and absolute and relative frequencies for the qualitative variables, with their corresponding 95% confidence intervals (95% CIs). Likewise, the characteristics of those patients who leave the study will be described, including the reason for loss during follow-up.
Basal comparisons between groups will be performed using statistical tests for independent samples (Student’s t-test or chi-squared test). Tests for related samples (ANOVA for repeated measures) will be used to analyse changes within groups and between visits.
Analysis of main effectiveness: the difference in percentages in the composite endpoint of hospital admission or death to 18 months with its corresponding 95% IC .Multilevel analysis will be adjusted considering the combined final variable as the dependent variable; the baseline variables of the patient (first level), the professional (second level) and the intervention group as independent fixed effect variables; and the clustering by physician as a random factor. We will use multiple imputation by chain equations including baseline, 6-month, and 12-month data as available, intervention group, stratification and minimisation variables, and other covariates that were informative of missingness. A sensitivity analysis will be conducted to assess whether conclusions may change if assumptions about missing data change.
Analysis of secondary effectiveness: the same analysis will be performed for 12 months. Missing data for professionals and/or patients will be replaced with the most recent reference or available data. For the remaining secondary effectiveness analyses, the difference in means or proportions will be calculated based on the characteristics of the variables (T3-T0) and (T2-T0) between groups using the appropriate statistical tests and an explanatory model will be adjusted using the same methodology applied to the main outcome variable.
Estimated quality-adjusted life years (QALYs) gained at the population level, with corresponding 95% CI, as determined using parametric methods and bootstrap techniques. Given the 2-year time horizon, a discount rate of 3% will be applied.
Calculation of the cost-utility ratio: A cost-utility ratio will be estimated by dividing the total costs by the sum of the potential gains expressed in QALYs. A multivariate sensitivity analysis will be performed by varying the value of the costs with the appropriate distributions within the range of uncertainty. The benefits (QALYs) will also vary with the most suitable distribution in the 95% CIs of the estimates. It will also be included in the sensitivity analysis.
User analysis and usability testing analysis: descriptive statistics will be use to analyse CSUQ an SUS scores according to the formal way of analysis to compare between participant groups (FPs) to take into account gender and age differences [58] in usability. No repeated-measurements neither pre-post test will be analysed.