Trial design
This is a nationwide stepped-wedge cluster randomized trial in all centers of the Dutch Pancreatic Cancer Group. The research team will implement the algorithm for early detection and minimally invasive management of pancreatic fistula to change professional behavior in each hospital and therefore stepped-wedge cluster randomization at center level will be performed. This trial was designed in accordance to the CONSORT guidelines for stepped-wedge cluster randomized trials[13] and the SPIRIT guidelines for clinical trials (figure 1)[14].
The stepped-wedge cluster randomized trial is a form of cross-over design with unidirectional cross-over (from control to intervention phase) at different time points for each cluster (figure 2). Each cluster will contain one center. Randomization will determine the order in which each center will undergo the transition.[15,16] In the first timeframe, all centers will deliver current practice (i.e. control). In the second timeframe, the center in the first cluster will start with algorithm-based best practice (i.e. intervention), while all other centers will still deliver current practice. In the third timeframe, the second cluster will implement the algorithm. Following this fashion, we proceed until all centers have stepped over to the algorithm. In the last timeframe all centers will deliver treatment according to the algorithm. Each cluster will contain one center, therefore, the number of sequences is equal to the number of participating centers and will be 17. To ensure adequate implementation of the algorithm, a wash-in period was designed in which clinicians in the center will be intensively trained by the research team on the algorithm. To avoid contamination of centers still in current practice phase, local clinicians will only have access to the algorithm after cross-over to care according to the algorithm.
Participants
Pancreatic surgery is centralized in The Netherlands in centers performing at least 20 pancreatoduodenectomies annually. All centers performing pancreatic surgery in The Netherlands are participating in this trial. All patients undergoing all types of pancreatic resection in these centers are identified and will be recruited in this trial. There are no exclusion criteria for centers or patients (i.e. nationwide complete enumeration).
Data will be extracted from the prospective Dutch Pancreatic Cancer Audit. Additional data on clinical outcomes will be extracted prospectively through continuous systematic evaluation of patient charts using predefined case record form. Data is stored on a central secured data capturing tool (i.e. Castor EDC) containing programmed checks for outliners. Entered data will be checked by a senior researcher. Local principal investigators are responsible for data collection. They can delegate this to the study personnel if resources are not available at the center.
Withdrawal and replacement of centers
For the design of this trial it is essential that all participating centers participate for the entire duration of the study, to prevent an unequal distribution of patients across the two study arms (i.e. before and after implementation). If a center stops performing pancreatic surgery during the study the randomization order will be maintained. All patients treated in this center will still be included in the final analysis, according to intention-to-treat analysis. As all centers performing pancreatic surgery in the Netherlands participate in this trial, centers will not be replaced after withdrawal.
Intervention
This trial evaluates a nationwide cluster level intervention in which all clinicians involved in the postoperative care for patients undergoing pancreatic resection are educated on the new algorithm for early detection and minimally invasive management of postoperative pancreatic fistula. Currently, guidelines on how to diagnose and manage postoperative pancreatic fistula are lacking. This is concerning since complication management appears to be the most important factor in decreasing mortality after pancreatic resection. The algorithm is based on findings in Dutch observational cohort studies, comprehensive systematic literature analyses, an inventory of current guidelines on postoperative care and expert opinion. The impact of the proposed algorithm was evaluated in a retrospective multicenter cohort and consensus upon this algorithm was reached in several plenary meetings with one pancreatic surgeon from all each centers of the Dutch Pancreatic Cancer Group. The final algorithm was reviewed by the advisory committee of respected international experts from centers performing a high volume of pancreatic resections before implementation in this trial. As a result, we have created a best practice algorithm based on national and international consensus. A complete overview of the design and details on the content of the algorithm are provided in APPENDIX 1.
A schematic overview of the multilevel algorithm is provided in Figure 3. It is based on daily standardized evaluation of all patients undergoing pancreatic resection from postoperative day 3 to discharge up to a maximum of 14 days. The algorithm will provide daily advice on three decision moments: indication for abdominal computed tomography (CT) scan (Figure 4); indication for (invasive) intervention (i.e. minimally invasive percutaneous drainage and/or antibiotic treatment) based on evaluation of the abdominal CT scan (Figure 5) and indication for removal of abdominal drain(s) (Figure 6). The algorithm includes clinical data from physical examination and biochemical tests (i.e. systemic inflammatory response syndrome [SIRS], C-Reactive protein [CRP], white blood cell count [WBC], drain production including amylase content and a daily consult from a pancreatic surgeon). At predefined, evidence based cut-off points (Figure 4), an abdominal contrast-enhanced CT scan and possibly subsequent minimally invasive intervention should be performed or antibiotic treatment should be started (Figure 5). Each CT scan will be evaluated according to predefined criteria (Figure 5) to assess whether there is suspicion of a pancreatic fistula and whether there is an indication for minimally invasive percutaneous catheter drainage. In case of no clinical improvement within 48 hours after last CT scan, a new CT scan should be performed to assess the indication and possibility of (additional invasive) intervention. The indication to remove abdominal drains will be evaluated daily starting on postoperative day 3 for as long as there are abdominal drains in place (Figure 6). The interpretation of the algorithm, the rationale behind the different proposed cut-off points and the proposed management of bleeding or hepaticojejunostomy leakage is provided in APPENDIX 2. Since we propose an intervention of structured use of diagnostic and invasive interventions already used in daily practice, no additional harms for patients are introduced in this study.
To facilitate clinical use of this complex algorithm, it was incorporated in a smartphone application. This application is available for download to all clinicians participating in the trial and will provide the multilevel advice based on the daily entered clinical and biochemical parameters. The application will not contain information that can be traced back to an individual patient. All data will be stored on a secured central database.
Since clinical decision-making for invasive intervention in these patients is challenging, an expert panel is available to assess the indication and feasibility of percutaneous drainage in the management of pancreatic fistula. This online panel, consisting of dedicated abdominal radiologists, interventional radiologists and pancreatic surgeons is available 24 hours a day, 7 days a week. The advice will be reported back to the clinician within 12 hours after consultation or when at least 3 experts provide their advice on next step in the management of these patients. The organization of this expert panel will be similar to the Dutch Pancreatitis Study Group expert panel[17].
Outcomes
All outcomes are assessed up to 90 days after index pancreatic resection or, if admission exceeds 90 days, to hospital discharge. All relevant definitions are provided in Table 1. The primary endpoint is a composite of the following three major complications occurring after study intervention:
- New-onset postoperative bleeding requiring invasive intervention
- New-onset organ failure (i.e. pulmonary, circulatory or renal)
- Death
The rationale for this primary endpoint is that the proposed algorithm for early detection and step-up management of pancreatic fistula can possibly prevent clinical deterioration. The most clinically severe complications associated with pancreatic fistula are combined in this endpoint[8]. Members of an adjudication committee will individually asses the primary endpoint while blinded for the assigned treatment arm; disagreements will be resolved by consensus discussions with allocation concealment.
Secondary endpoints include individual components of the composite endpoint and an adapted version of the primary endpoint in which only complications are included that were deemed to directly related to a pancreatic fistula by the blinded adjudication committee. Other secondary endpoints are: Comprehensive Complication Index (CCI)[18] based on complications grade 3 or higher according to Clavien-Dindo classification[19], postoperative pancreatic fistula[20], gastroenterostomy leakage, postoperative bile-leakage[21], delayed gastric emptying[22], chyle leakage[23], new-onset acute pancreatitis[24], number and timing of abdominal CT scans, number, timing and type of invasive (re-)interventions, admission to the Intensive Care Unit (ICU), length of ICU stay, length of hospital stay, readmission rate, number of patients receiving adjuvant chemotherapy at 90 day follow-up, duration of postoperative pancreatic fistula (time to removal last abdominal drain or completion pancreatectomy), success of implementation (i.e. based on number and timing of abdominal CT scans and proportion of patients days in whom the algorithm was not followed). Daily data on incidence and duration of SIRS, sepsis and organ failure (according to definitions in Table 1 and according to Sequential Organ Failure Assessment (SOFA) and Multiple Organ Dysfunction Score (MODS)) were also collected.[25–27] In addition, we aim to evaluate the impact on quality of life, total direct and indirect costs and budget impact (see below).
Sample size calculation
The PORSCH trial is a superiority trial. The effect of the intervention will be measured using the incidence of the primary endpoint (i.e. postpancreatectomy bleeding, new-onset organ failure or death), which is expected to become lower after implementation of the algorithm. In this study, we aim to improve outcomes of all patients undergoing pancreatectomy. However, to determine the superiority of the algorithm in a homogenous sample of patients, the sample size calculation was based on the cohort of patients undergoing pancreatoduodenectomy.
For sample size calculation we evaluated three Dutch datasets: the mandatory Dutch Pancreatic Cancer Audit (n=1686), data from the study on management of pancreatic fistula (n=309 patients[9]) and the validation study performed in preparation for this trial (n=174). All outcome data used for sample size calculation are presented in Table 2. The composite primary endpoint occurred in 13.8% of patients in the Dutch cancer audit (2014-2015), in 44% of patients with severe pancreatic fistula after pancreatoduodenectomy[9] and 17% in our own validation database (2016). For sample size calculation we used the lowest incidence we found in these three datasets (i.e. 13.8% from the audit data).
The expected reduction in composite primary endpoint was evaluated in two datasets. A relative reduction of 53% was observed in the study on management of pancreatic fistula (i.e. 34% after primary catheter drainage vs. 73% after primary relaparotomy). Using the Dutch Pancreatic Cancer Audit data, centers were divided into four quartiles based on the incidence of the primary endpoint after pancreatoduodenectomy. The worst scoring quartile, containing 292 patients from 4 centers, showed an incidence of 21%. The best scoring quartile, containing 331 pancreatoduodenectomy patients from 5 centers, showed an incidence of the composite primary endpoint of 8% (i.e. relative reduction 62%). Based on these outcomes, a relative reduction of 50% in the primary endpoint was used for the sample size of the PORSCH trial. This was the minimal reduction deemed clinically relevant by the members of the trial steering committee and stakeholders from the Dutch Pancreatic Cancer Group.
The required sample size was calculated using the formula for stepped wedge designs using an expected incidence of 13.8%, a relative reduction of 50%, a two-sided alpha of 0.05 and a power of 0.80[28]. The intra-cluster correlation (ICC) was estimated from the Dutch Pancreatic Cancer Audit at 0.009 (95% CI 0.006-0.049). As the within-period and between-period ICC were the same, the cluster autocorrelation was set at 1[29]. Table 3 provides the required sample size for different numbers of participating sites (i.e. clusters). This number dictates the inclusion time in this study design, which was based on the total number of pancreatoduodenectomies performed in the last 2 years according to the Dutch Pancreatic Cancer Audit. As each cluster will contain one of the 17 participating centers, the number of sequences is equal to the number of clusters. Based on the annual number of pancreatoduodenectomies performed in The Netherlands in 2014 and 2015, the planned study duration is 92 weeks to include the required sample size of 1186 pancreatoduodenectomies with complete enumeration (i.e. 5,1 weeks per step for 18 time periods). The total duration of the trial will be 96 weeks, including a 4-week wash-in period.
As we include patients undergoing all types of pancreatic resection in this trial, the total number of patients registered in this trial is expected to be 25% more than the required sample size. We will perform the primary analyses in patients undergoing pancreatoduodenectomy and subsequently in all patients undergoing any type of pancreatic resection.
Interim analysis
An interim analysis will be performed to evaluate the inclusion rate. At 50% of the planned time for inclusion, the total number of inclusions will be evaluated. If less than 47.5% of the sample size is reached at that time, the duration of steps in the design for the remaining part of the study will be prolonged such that power of 80% is maintained. If the sample size is adjusted at interim analysis, the adjusted dates for crossover will dictate the allocation of patients to routine practice or best practice for the analysis.
Safety reporting
No experimental interventions are introduced in this trial. Therefore, no additional safety or health risk are introduced for patients within this trial as compared to regular care and therefore no specific safety monitoring is performed.
Randomization, blinding and treatment allocation
Randomization is performed after obtaining consent for participation in this trial from the principal investigator and after approval from local (medical ethical) committees of every participating center was obtained. Centers are randomized by an independent statistician using R statistics software to determine the timing of cross-over from current practice to the algorithm[30]. Stratification at randomization is applied for center volume (>45 vs. ≤45 pancreatic resections a year, median value based on data from the Dutch Pancreatic Cancer Audit 2014-2015).
Local principal investigators are informed about the allocated time of crossover of their center, but are blinded to the randomization sequence for all other centers. Blinding of treatment strategy for clinicians or study personnel is not feasible due to the study design. Primary outcomes will be assessed by individual members of an adjudication committee blinded for intervention (i.e. whether this patient was treated before or after implementation of the algorithm). Patients will be coded by a numeric randomization key, only the principal investigators have access to this key.
Statistical analysis
For statistical analysis, outcomes of all patients undergoing pancreatic resection before implementation of the algorithm (i.e. current practice) will be compared to outcomes of all patients undergoing pancreatic resection after implementation of the algorithm (i.e. best practice). Date of pancreatic resection will determine the study phase in which a patient will be analyzed. Primary analysis will be intention-to-treat according to the planned date of cross-over to care according to the algorithm. Data from patients in the-wash in period will be excluded from the primary analysis. Secondary analyses include a per-protocol in which we will compare patients actually receiving care according to the algorithm (i.e. all resections after first implementation presentation at a center, including patients undergoing pancreatic resection in the wash-in period) to patients undergoing pancreatic resection before cross-over. When appropriate, 95% confidence intervals will be calculated. In all analyses a two-sided alpha of 0.05 will be used to denote statistical significance.
Missing baseline data will be imputed using multiple imputation techniques. The primary analysis will be performed using the multiple imputed data. A complete case analysis will be performed to check for inconsistencies. Baseline data will be analyzed and reported using standard descriptive statistics. Chi-square or Fisher’s exact test are used to compare categorical variables as appropriate. Parametric continuous variables are presented as mean with standard deviation (SD) and are compared using the Student’s T-test. Non-parametric continuous variables are presented as median with interquartile range (IQR) and are compared using the Mann-Whitney-U test.
The primary endpoint (i.e. composite of postpancreatectomy bleeding, new-onset organ failure and death) is a binary variable that will be analyzed using mixed-effects logistic regression analysis. Secondary endpoints will be analyzed using crude and adjusted mixed-effects logistic regression analysis (for binary outcomes) or mixed-effects linear regression analysis (for continuous outcomes). Crude analysis will include a random intercept and random slope on the level of the hospital to adjust for the design, and no other covariates. Adjusted analysis will additionally include the following covariates: calendar time and time since cross-over as a continuous variable, predictors for postoperative pancreatic fistula (i.e. soft pancreatic texture, small diameter pancreatic duct, increasing blood loss during pancreatic resection and underlying disease not being pancreatitis or pancreatic adenocarcinoma[31]) and predictors for the primary endpoint (i.e. male gender, increasing age, American Society of Anesthesiologists (ASA) classification >2, index pancreatic resection pancreatoduodenectomy; based on multivariable logistic regression analysis as presented in Table 4). Relevant model assumptions (such as distribution of residuals) will be checked for all models; if deviations from the analysis plan are required this will be described. Crude and adjusted odds ratios with 95% confidence interval and p-value will be reported.
Length of hospital stay will be calculated from the date of the index pancreatic resection and will be analyzed using mixed-effects cox proportional hazards regression, using discharge alive as the outcome event. Patients dying during the index hospitalization will be censored at the day of death. Length of ICU stay and time to resolution of pancreatic fistula (i.e. time to removal of last abdominal drain or completion pancreatectomy) will be analyzed using a zero-inflated negative binominal regression model.
Subgroup and sensitivity analyses
Analyses will be performed both on the group of patients undergoing pancreatoduodenectomy and on the entire group of all patients undergoing pancreatic resection. Additional subgroup analyses will be performed based on adherence to the study protocol (i.e. proportion of patient days the algorithm is followed), hospital volume (>45 vs. ≤45 pancreatic resections a year), pathology (malignant disease), in patients with postoperative pancreatic fistula and in patients with a high risk of pancreatic fistula[32].
A sensitivity analysis will be performed to evaluate the impact on outcomes related to postoperative pancreatic fistula. To this aim, the adjudication will be asked if an outcome was related to postoperative pancreatic fistula and if this outcome could have been prevented by adherence to the algorithm. Two separate analyses will be performed on the Comprehensive Complication Index: one analysis including all complications and one adjusted analysis, in which interventions imposed by the algorithm (e.g. minimal invasive catheter drainage and use of antibiotic management for abdominal sepsis) will not be included in the calculation. A sensitivity analysis will be performed to evaluate the success of implementation. Centers will be divided into equally sized clusters based on the percentage of additional abdominal CT scans per patient after implementation, as compared with before implementation. Separate analysis will be performed for each group.
Economic evaluation
A cost-effectiveness analysis will be performed to compare the health effects and costs of treatment according to the algorithm, as compared with current practice. Preventing major complications is likely to be cost saving, for example by preventing admission to the intensive care unit and decreasing length of hospital stay. However, additional costs may also be introduced by increasing the need for diagnostic resources (e.g., biochemical tests and CT scans) and possibly also minimally invasive interventions. Therefore, it is important to assess whether these costs will be counterbalanced by future health effects and cost savings.
For calculation of cost-effectiveness on a healthcare perspective, volume of health care consumption will be measured during the trial using an adapted version of the Medical Consumption Questionnaire (iMCQ). This questionnaire will measure healthcare utilization for both in-hospital and out of hospital medical expenses, including but not limited to: medication, invasive interventions, days in the hospital, outpatient visits after discharge, visits to the general practitioner. Unit costs will be derived from tariffs as described in the “Zorginstituut Nederland Kostenhandleiding”[33]. Medication costs will be derived from the “Zorginstituut Nederland Medicijnkosten” and, if dosages are missing in the iMCQ, standard dosages will be derived from the “Zorginstituut Nederland Farmacotherapeutisch Kompas”. For calculation of cost-effectiveness on societal perspective, productivity Consumption Questionnaire (iPCQ) will be used to derive losses in productivity. Travel costs per individual will be calculated using average travel distances and standard tariffs from the “Zorginstituut Nederland Kostenhandleiding” in combination with the number of visits in the iMCQ. Health-related quality of life will be measured using the EQ5D-5L at baseline and 90 days after pancreatic resection (i.e., end of follow-up)[34]. Relevant outcomes will be extracted from case record forms and electronic health records at the end of follow-up. The quality of life scores related to these outcomes will be derived from scientific literature for calculation on cost-effectiveness. Quality-adjusted life years (QALYs) will be calculated by multiplying the duration of time spent in a health state by the corresponding quality of life score, hence combining life years and quality of life.
Trial-based cost-effectiveness analysis (CEA) will be performed using the empirical data comparing current practice to best practice up to 90 days after index pancreatic resection[35]. Missing data in either health effects or costs will be imputed using multiple imputation. An additional model-based CEA will be performed to extrapolate the trial results beyond the trial duration[36–38], because the short-term effects from implementation of the algorithm – if present – are likely to affect long term outcomes as well. Besides influence on the primary outcome, implementation of best practice might also influence risk of pancreatic insufficiency and possibly survival as patients are in a better clinical condition to receive adjuvant chemotherapy. Using mathematical modelling, short term evidence from the PORSCH trial will be translated to more generic outcomes, such as survival and health status. Finally, using the mathematical model and additional evidence from literature, a cost-effectiveness analysis will be performed calculating the long-term additional costs and QALYs when implementing the algorithm for a lifetime horizon.
For both the trial-based and model-based CEA an incremental cost effectiveness ratio (ICER) will be calculated by dividing the difference in costs between usual care and the intervention by the difference in QALYs between usual care and intervention. Sensitivity analysis will be performed on parameters which are expected to have the largest uncertainty. Bootstrapping and probabilistic sensitivity analysis will be performed in the trial-based and model-based CEA, respectively, to determine the uncertainty surrounding incremental health effects and costs. Results from these uncertainty analyses will be used to create (incremental) cost-effectiveness planes to graphically represent these results[38]. Cost-effectiveness acceptability curves will be calculated to demonstrate the probability that the intervention strategy will be cost-effective compared to current practice when using a range of cost-effectiveness thresholds (i.e. the amount society is willing to pay for an additional QALY).