Included studies and treatment groups
During the initial literature search, we identified a total of 3405 records from databases and 68 additional online records from conference proceedings. After removing 1030 duplicated records and 1217 non-pertinent articles based on title,1226 studied underwent abstract screening. 58 studies were considered eligible for full-text filtering and 20 studies finally were collected in the network meta-analysis. The majority of included RCTs (19/20) are in phase 3(Table 1). 8 trials were published in 2022 (16-23), 3 in 2021(24-26), 4 in 2020(27-30), 2 in 2018(31, 32), 1 in 2014(33), 1 in 2011(34). Besides, 8 trials recruited patients with esophageal squamous cell carcinoma, 6 trials recruited patients with gastroesophageal junction cancer and gastric cancer, 2 trials recruited patients with esophageal cell carcinoma and gastroesophageal junction cancer, 2 trials recruited patients with esophageal cell carcinoma, gastroesophageal junction cancer and gastric cancer. 1 trial recruited patients with esophageal squamouscell carcinoma or adenocarcinoma. The baseline characteristics of participants were well-balanced between intervention and control arms in all RCTs. The median age ranged from 59 to 67 years.
Participants included in these RCTs were distributed all over the world. Most of the patients were male. The detailed characteristics of included RCTs were summarized in Table 1.
According to the treatment intervention, xxxx participants were grouped into the following 12 treatment categories: chemotherapy (Chemo), nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin (Nivo_S1Oxal), pembrolizumab with paclitaxel (Pem_Pac), Sintilimab with paclitaxeland and cisplatin (Sin_PacCisp), Toripalimab with paclitaxel and cisplatin (Tori_PacCisp), Pembrolizumab with capecitabine and cisplatin (Pem_CapCisp), nivolumab with 5-fluorouracil and cisplatin (Nivo_5FCisp), immune checkpoint inhibitors monotherapy (Immu), Placebo (Control), Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin (Nivo_FOLFOX), Camrelizumab with paclitaxel and cisplatin (Cam_PacCisp), Pembrolizumab with 5-fluorouracil and cisplatin (Pem_5FCisp).
Efficacy outcomes of OS
As the efficacy outcomes of OS, we gathered 12 treatment regimens with 10919 patients as 12 nodes in network meta-analysis (Figure 2A). Firstly, immunotherapis were more likely to get better OS benefit than chemotherapy. Immune monotherapies yield superior OS benefit than chemotherapy (HR = 0.89, 95% CI: 0.83–0.95). Regarding immunotherapy combined chemotherapy (IO), except for Nivo_5FCisp (HR = 0.8, 95% CI: 0.49–1.32), Nivo_S1Oxal (HR = 0.9, 95% CI: 0.75–1.08), Tori_PacCisp (HR = 0.91, 95% CI: 0.77–1.07), the other IO all had a significant OS benefit compared with Chemo. Secondy, Pem_5FCisp was considered to give significant benefits on comparision with Pem_Pac (HR = 0.58, 95% CI: 0.34–0.97), Tori_PacCisp (HR = 0.63, 95% CI: 0.45–0.86), Nivo_S1Oxal (HR = 0.63, 95% CI: 0.45–0.88), Immu (HR = 0.64, 95% CI: 0.48–0.85), Pem_CapCisp (HR = 0.68, 95% CI: 0.5–0.93). The same phenomenon was also found in Sin_PacCisp compared with these groups. Thirdly, with the same immune checkpoint inhibitor, perhaps Pem_5FCisp is better than Pem_CapCisp (HR = 0.68, 95% CI: 0.5–0.93). While with the same chemotherapy, there is a trend of Sin_PacCisp better than Cam_PacCisp than Tori_PacCisp. Forthly, all the treatment regimens have significant OS benefit than control arm. Futhermore, the ranking of OS benefits for each treatment was discerned as Pem_5FCisp>Sin_PacCisp>Cam_PacCisp>Nivo_FOLFOX>Nivo_5FCisp>Pem_CapCisp>Immu>Nivo_S1Oxal >Tori_PacCisp >Pem_Pac>Chem>Control(Figure 3A).
Efficacy outcomes of PFS
As the efficacy outcomes of PFS, we gathered 12 treatment regimens with 10701 patients as 12 nodes in network meta-analysis (Figure 2B). Firstly, chemotherapy and all IO regimens had sigificant PFS benefit than immune monotherapy. All treatment regimens were better than control. Secondly, except for Nivo_5FCisp (HR = 0.84, 95% CI: 0.68–1.04), the other IO regimens had significant PFS benefits than Chemo. Thirdly, compared with Nivo_5FCisp, Pem_5FCisp (HR = 0.77, 95% CI: 0.61–0.97), Tori_PacCisp (HR = 0.69, 95% CI: 0.5–0.94), Cam_PacCisp (HR = 0.66, 95% CI: 0.5–0.89), Sin_PacCisp (HR = 0.66, 95% CI: 0.5–0.88), Pem_Pac (HR = 0.58, 95% CI: 0.35–0.97) were considered to give significant benefits on PFS. Forthly, with the same chemotherapy, there is a trend of Sin_PacCisp is better than Cam_PacCisp than Tori_PacCisp. Futhermore, the ranking of PFS benefits for each treatment was discerned as Pem_Pac>Sin_PacCisp>Cam_PacCisp>Tori_PacCisp>Pem_5FCisp>Nivo_S1Oxal>Nivo_FOLFOX>Pem_CapCisp>Nivo_5FCisp>Chem>Immu>Control (Figure 3A).
Efficacy outcomes of ORR
As the efficacy outcomes of ORR, we gathered 11 treatment regimens with 9222 patients as 11 nodes in network meta-analysis (Figure 2C). Although there are no significantly statistical differences among these different treatment regimens, Nivo_5FCisp might be considered as the best treatment with regard to the ORR, following Sin_PacCisp>Tori_PacCisp>Pem_5FCisp>Cam_PacCisp>Nivo_S1Oxal>Immu>Chem>Pem_Pac>Nivo_FOLFOX>Pem_CapCisp (Figure 3B).
Safety outcoms of AEs
Considering that clinicians were more concerned about serious AEs (which were defined as grade 3-5). We gathered 12 treatment regimens with 10368 patients as 12 nodes in network meta-analysis (Figure 2D). The treatment of ranking No.1 represented the highest incidence of AEs.The results showed that the incidence of grade 3-5 AEs in each treatment group was similar, with no significantly statistical difference (Figure 3B).
Nivo_S1Oxal: nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin; Pem_Pac: pembrolizumab with paclitaxel; Sin_PacCisp: Sintilimab with paclitaxeland and cisplatin; Tori_PacCisp: Toripalimab with paclitaxel and cisplatin. Pem_CapCisp: Pembrolizumab with capecitabine and cisplatin; Nivo_5FCisp: nivolumab with 5-fluorouracil and cisplatin; Immu: immune checkpoint inhibitors monotherapy; Nivo_FOLFOX: Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin; Cam_PacCisp: Camrelizumab with paclitaxel and cisplatin; Pem_5FCisp: Pembrolizumab with 5-fluorouracil and cisplatin; Control: Placebo; Chemo: chemotherapy.
Nivo_S1Oxal: nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin; Pem_Pac: pembrolizumab with paclitaxel; Sin_PacCisp: Sintilimab with paclitaxeland and cisplatin; Tori_PacCisp: Toripalimab with paclitaxel and cisplatin. Pem_CapCisp: Pembrolizumab with capecitabine and cisplatin; Nivo_5FCisp: nivolumab with 5-fluorouracil and cisplatin; Immu: immune checkpoint inhibitors monotherapy; Nivo_FOLFOX: Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin; Cam_PacCisp: Camrelizumab with paclitaxel and cisplatin; Pem_5FCisp: Pembrolizumab with 5-fluorouracil and cisplatin; Control: Placebo; Chemo: chemotherapy.
Rankings
The consistency of the ranking results with the direct and indirect pooled results obtained using HRs and ORs suggests that the framework is stable and reliable (Figure 4). Pem_5FCisp was most likely to rank first for OS (cumulative probability of 66.4%), Pem_Pac was most likely to rank first for PFS (57.8%), Nivo_5FCisp was most likely to rank first for ORR (19.7%), and Pem_CapCisp was most likely to lead highest incidence of grade 3-5 AEs (22.4%, Table s1-s4). In case of Sin_PacCisp, an effective balance between three efficacy outcomes and safety was achieved, the treatment ranked second for OS (48.3%), PFS (29.5%), ORR (18.4%), and sixth for grade 3-5 AEs (7.2%, Table s1-s4). The other one was Cam_PacCisp also appeared an effective and safety balance, with ranked third for OS, third for PFS, fifth for ORR and ninth for grade 3-5 AEs.
Nivo_S1Oxal: nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin; Pem_Pac: pembrolizumab with paclitaxel; Sin_PacCisp: Sintilimab with paclitaxeland and cisplatin; Tori_PacCisp: Toripalimab with paclitaxel and cisplatin. Pem_CapCisp: Pembrolizumab with capecitabine and cisplatin; Nivo_5FCisp: nivolumab with 5-fluorouracil and cisplatin; Immu: immune checkpoint inhibitors monotherapy; Nivo_FOLFOX: Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin; Cam_PacCisp: Camrelizumab with paclitaxel and cisplatin; Pem_5FCisp: Pembrolizumab with 5-fluorouracil and cisplatin; Control: Placebo; Chemo: chemotherapy; OS: overall survival; PFS: progression-free survival; ORR: objective response rate; AE: adverse event.
Two-dimensional analysis
Then we made a two-dimensional outcome analysis graph with OS on the x-axis and the SUCRA value for the incidence of grade 3-5 AEs on the y-axis. The graph showed that higher values on the x-axis and lower values on the y-axis indicated the best drug performance, with the most significant improvement in OS and the lowest incidence of grade 3-5 AEs. This two-dimensional graph provides additional evidence supporting the conclusion drawn from the ranking plot described earlier. As shown in the gragh, Pem_5FCisp, Sin_PacCisp and Cam_PacCisp demonstrated excellent balance between OS and grade 3-5 AEs (Figure 5)
Nivo_S1Oxal: nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin; Pem_Pac: pembrolizumab with paclitaxel; Sin_PacCisp: Sintilimab with paclitaxeland and cisplatin; Tori_PacCisp: Toripalimab with paclitaxel and cisplatin. Pem_CapCisp: Pembrolizumab with capecitabine and cisplatin; Nivo_5FCisp: nivolumab with 5-fluorouracil and cisplatin; Immu: immune checkpoint inhibitors monotherapy; Nivo_FOLFOX: Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin; Cam_PacCisp: Camrelizumab with paclitaxel and cisplatin; Pem_5FCisp: Pembrolizumab with 5-fluorouracil and cisplatin; Control: Placebo; Chemo: chemotherapy; OS: overall survival; PFS: progression-free survival; ORR: objective response rate; AE: adverse event.
Subgroup analysis of PD_L1 expression level
Then, we estimated the clinical outcomes of OS with different PD-L1 expression levels in the subgroup analysis. The participants were divided into the following six subgroups according to the levels of PD-L1 expression: less than 1%, greater than or equal to 1%, less than 5%, greater than or equal to 5%, less than 10%, greater than or equal to 10%. The optimal treatment regimen differed across the six subgroups.
For patients with PD-L1 less than 1%, 5 immune treatment regimens were included in the subgroup analysis. Nivo_FOLFOX (HR=0.78, 95% CI: 0.70-0.87) were significantly superior to chemotherapy. As patients with PD-L1 greater than or equal to 1%, 7 immune treatment regimens were included in the subgroup analysis. Cam_PacCisp (HR=0.59, 95% CI: 0.43-0.80), Tori_PacCisp (HR=0.61, 95% CI: 0.44-0.87), Nivo_5FCisp (HR=0.69, 95% CI: 0.56-0.84) were significantly superior to chemotherapy (Figure 6A).
For patients with PD-L1 less than 5%, 2 immune treatment regimens were included in the subgroup analysis. Nivo_FOLFOX (HR=0.74, 95% CI: 0.66-0.84) were significantly superior to chemotherapy. As patients with PD-L1 greater than or equal to 5%, also 2 immune treatment regimens were included in the subgroup analysis. Nivo_5FCisp (HR=0.69, 95% CI: 0.55-0.87) were significantly superior to chemotherapy (Figure 6B).
For patients with PD-L1 less than 10%, 4 immune treatment regimens were included in the subgroup analysis. Tori_PacCisp (HR=0.61, 95% CI: 0.40-0.93) were significantly superior to chemotherapy. As patients with PD-L1 greater than or equal to 10%, also 6 immune treatment regimens were included in the subgroup analysis. Pem_5FCisp (HR=0.62, 95% CI: 0.49-0.78), Sin_PacCisp (HR=0.63, 95% CI: 0.51-0.78), Nivo_FOLFOX (HR=0.66, 95% CI: 0.56-0.77), Nivo_5FCisp (HR=0.63, 95% CI: 0.47-0.84), Pem_CapCisp (HR=0.69, 95% CI: 0.49-0.97) were significantly superior to chemotherapy (Figure 6C).
Nivo_S1Oxal: nivolumab with tegafur–gimeracil–oteracil potassium plus oxaliplatin; Pem_Pac: pembrolizumab with paclitaxel; Sin_PacCisp: Sintilimab with paclitaxeland and cisplatin; Tori_PacCisp: Toripalimab with paclitaxel and cisplatin. Pem_CapCisp: Pembrolizumab with capecitabine and cisplatin; Nivo_5FCisp: nivolumab with 5-fluorouracil and cisplatin; Immu: immune checkpoint inhibitors monotherapy; Nivo_FOLFOX: Nivolumab with leucovorin and 5-fluorouracil and oxaliplatin; Cam_PacCisp: Camrelizumab with paclitaxel and cisplatin; Pem_5FCisp: Pembrolizumab with 5-fluorouracil and cisplatin; Control: Placebo; Chemo: chemotherapy; OS: overall survival; PFS: progression-free survival; ORR: objective response rate; AE: adverse event.
Stability, eplicability, heterogeneity and inconsistency
The trajectory plot showed that the MCMC chains were stable with good overlap when the number of iterations exceeded 5000. The density plot revealed that the Bandwidth approached 0 and stabilized when the number of iterations reached 20000, indicating that the model had converged well (Figure S1-S4). The convergence plot indicated that the model had reached a satisfactory state (Figure S5-S8). These results represent the stability and replicability of the inferential iterations for each Markov Chain Monte Carlo chain. The methodological heterogeneity including different cancer histology, treatment line, various ICIs and chemotherapy regimens caused the high heterogeneities among each group (Figure S9-S12).