Eligible Studies and Quality Assessment
A literature search identified 349 potentially relevant articles. After screening titles and abstracts, a total of 211 articles of review, irrelevant topics, case report, conference and other were excluded after gradually eliminating overlap. Then reading the full text, 25 articles out of 39 studies were excluded because they were not fully published in English (n = 1), it was impossible to extract enough data to construct a 2 × 2 contingency table (n = 6), and further exclusion of studies not in the area of interest (n = 18). Finally, 14 literatures on the diagnostic performance of 18F-FDG or 18F-NaF PET/CT in breast cancer BM were included for the current meta-analysis. The identification and selection process for studies is shown in Fig. 1.
A total of 14 articles [15, 22–34], consisting of 8 18F-FDG PET/CT studies, 5 18F-NaF PET/CT studies, and 1 study of both 18F-FDG PET/CT and 18F-NaF PET/CT met the inclusion criteria and included 847 patients. The study sample size ranged from 20 to 150 patients with mean age ranging from 43.8–60 years old. All 14 articles were published between 2010 and 2019, including 8 prospective studies and 6 retrospective studies. Among the included studies, 4 included breast cancer patients who had previously received treatment, 3 were newly recruited breast cancer patients clinically suspected of having BM, and 8 included treated and newly recruited patients. The baseline characteristics of each study are presented in Table 1, and the parameters of PET/CT used in each enrolled study are presented in Table S1. The quality assessment of each study was assessed using the QUADAS-2 tool, and the result revealed that all 14 included studies met at least 5 of the 7 reference criteria (ie, 4 items in the risk of bias, patient selection, index test, reference standard, flow and timing and 3 items in application concerns, patient selection, index test, reference standard) and was therefore considered satisfactory [35]. For patient selection, 5 studies [22, 24, 25, 29, 32] were considered to be high-risk because they only used imaging and follow-up results as reference standards. Moreover, one of the studies had only a follow-up of two months [24], which was also considered high-risk. Risk of bias for flow and time of most studies were unclear because they did not report the time interval between the index and the reference standard trial. The results of the QUADAS-2 assessment are shown in Table S2.
Table 1
Clinical Characteristics and Diagnostic Results of the Detection of Bone Metastases Reported in Each Eligible Study.
First author | Country | year | No.patients | No. lessions | Study design | Clinical setting | Mean age (range) | Patient-Based Analysis | Lesion-Based Analysis |
prospective | Multicenter | Consecutive | TP | FP | FN | TN | TP | FP | FN | TN |
18F-FDG PET/CT |
Koizumi M [30] | Japan | 2019 | 120 | - | No | No | Yes | New + treated | - | 34 | 8 | 1 | 77 | - | - | - | - |
Caglar M [26] | Turkey | 2016 | 150 | - | No | No | Yes | New + treated | 52(27–85) | 84 | 1 | 1 | 64 | - | - | - | - |
Hahn S [22] | Germany | 2011 | 28 | 129 | No | No | Yes | New + treated | 57.5(35–78) | 7 | 0 | 1 | 20 | 67 | 5 | 3 | 54 |
Damle NA[15] | India | 2013 | 72 | - | Yes | No | Yes | Treated | 52(30–77) | 25 | 1 | 9 | 37 | - | - | - | - |
Al-Muqbel KM[25] | Jordan | 2017 | 35 | - | No | No | Yes | Treated | 48.1 | 25 | 0 | 9 | 1 | - | - | - | - |
Botsikas D[34] | Switzerland | 2019 | 80 | 175 | Yes | No | Yes | New + treated | 48 | 6 | 0 | 3 | 71 | 18 | 0 | 8 | 149 |
Rager O[24] | Switzerland | 2018 | 25 | 109 | No | Yes | Yes | New | 55(38–82) | 10 | 0 | 2 | 13 | 43 | 0 | 48 | 18 |
Heusner TA[28] | Germany | 2010 | 20 | - | Yes | No | Yes | New + treated | 54.5(25.4–78.2) | 7 | 0 | 0 | 13 | - | - | - | - |
Teke F[32] | Turkey | 2015 | - | 496 | No | No | - | New | 44.5(28–81) | - | - | - | - | 141 | 2 | 10 | 343 |
18F-NaF PET/CT |
Yoon SH[33] | Korea | 2013 | 119 | - | Yes | No | - | New + treated | 55.6 | 49 | 36 | 3 | 31 | - | - | - | - |
Broos WAM[23] | Netherlands | 2018 | 118 | - | Yes | No | - | New + treated | 64 | 50 | 6 | 2 | 60 | - | - | - | - |
Damle NA[15] | India | 2013 | 72 | - | Yes | No | Yes | Treated | 52 | 34 | 11 | 0 | 27 | - | - | - | - |
Passah A[29] | India | 2017 | - | 199 | Yes | No | - | New | 43.8 | - | - | - | - | 178 | 0 | 0 | 21 |
Abikhzer G[31] | UK | 2016 | 41 | 284 | Yes | No | - | New + treated | 58 (30–75) | 21 | 3 | 0 | 17 | 73 | 6 | 7 | 198 |
Piccardo A [27] | Italy | 2011 | 39 | 662 | Yes | - | - | Treated | 60 | 27 | 0 | 0 | 12 | 491 | 11 | 51 | 109 |
Diagnostic accuracy
A total of 9 studies using 18F-FDG PET/CT method had a sensitivity of 0.47 [95%CI: 0.37–0.58] to 1.0[95%CI:0.59-1.00] for the identification of breast cancer BM, and a specificity was 0.92 [95%CI:0.81–0.97] to 1.0 [95%CI:0.98 -1.00]. The pooled sensitivity and specificity of 18F-FDG PET/CT in the identification of BM from breast cancer were 0.88 [95% CI:0.76–0.94] and 0.99 [95% CI: 0.97-1.00], respectively, as shown in Fig. 2. Both Cochran’s Q test and Higgins I2 test showed significant heterogeneity in sensitivity (Q = 168.81, p ≤ 0.01; I2 = 93.48) and specificity (Q = 44.38, p ≤ 0.01; I2 = 75.21). A total of 6 studies included 18F-NaF PET/CT in the detection of breast cancer BM, of which sensitivity and specificity ranged from 0.91 (95% CI: 0.83–0.96) to 1.00 (95% CI: 0.83–0.96), and 0.46 (95% CI: 0.34–0.59) to 1.00 (95% CI: 0.74-1.00), respectively. The pooled sensitivity and specificity were 0.98 (95% CI: 0.92–1.00) and 0.91 (95% CI: 0.76–0.97), respectively, as shown in Fig. 3. In addition, Cochran’s test and Higgins I2 test also showed heterogeneity in sensitivity and specificity between studies, (Q = 70.87, p ≤ 0.01; I2 = 90.12) and (Q = 228.86, p ≤ 0.01; I2 = 96.94). The pooled PLR and NLR for 18F-FDG PET/CT were 129.2 (95% CI: 27.1-616.4) and 0.13 (95% CI: 0.06–0.25), respectively. On 18F-NaF PET/CT, the pooled PLR and NLR were 10.9 (95% CI: 3.8–31.5) and 0.02 (95% CI: 0.01–0.1), respectively. The pooled DOR value of 18F-FDG PET/CT for the diagnosis of breast cancer BM was 1028 (95% CI: 244–4330), and the pooled DOR value of 18F-NaF PET/CT was 489 (95% CI: 65-3654), as shown in Table 2. Analyses were performed by the dersimonan-laird method (random-effects model) with 95% CIs to calculate weighted mean pooled sensitivity, specificity, PLR, NLR and DOR (CIs). Variability was assessed graphically by plotting metrics with 95% CIs separately in each study in the forest plot. Values of pooled PLR greater than 10 and DOR greater than 100 indicate that a positive result for a given test helps to confirm the presence of BM, while pooled NLR values less than 0.1 indicate that a negative result helps to exclude BM [36]. Combined with our data, a positive result from the FDG assay helps to confirm the presence of BM and a negative result from the NaF assay helps to rule out BM. There was no significant difference in the DOR between 18F-FDG PET/CT and 18F-NaF PET/CT. The area under the SROC curve for both 18F-FDG PET/CT and 18F-NaF PET/CT was 0.99 (95%CI: 0.98 − 0.1.00), as shown in Fig. 4.
Table 2
Summary of diagnostic performance characteristics of 18F-FDG and 18F-NaF PET/CT in breast cancer bone metastases
Parameter | 18F-FDG PET/CT | 18F-NaF PET/CT |
Estimate | 95% CI | Estimate | 95% CI |
Sensitivity | 0.88 | 0.76, 0.94 | 0.98 | 0.92, 1.00 |
Specificity | 0.99 | 0.97, 1.00 | 0.91 | 0.76, 0.97 |
Positive Likelihood Ratio | 129.2 | 27.1, 616.4 | 10.9 | 3.8, 31.5 |
Negative Likelihood Ratio | 0.13 | 0.06, 0.25 | 0.02 | 0.01, 0.1 |
Diagnostic Odds Ratio | 1028 | 244, 4330 | 489 | 65, 3654 |
AUC | 0.99 | 0.98, 1.00 | 0.99 | 0.98, 1.00 |
Notes:18F-FDG = Fluorine-18 labeled deoxyglucose; 18F-NaF = Fluorine-18 labeled sodium fluoride ; PET = Positron emission computer; CT = Computed tomography; CI = confidence interval; AUC = area under curve. |
Publication bias
A funnel plot for publication bias for 18F-FDG PET/CT and 18F-NaF PET/CT by Deeks et al. is shown in Fig. 5. The p value of slope coefficient for 18F-FDG PET/CT is less than 0.05 (p = 0.02), suggesting publication bias. The p value of slope coefficient for 18F-NaF PET/CT was 0.37, indicating a low possibility of study publication bias (p > 0.05).
Exploration of heterogeneity
The results of meta-regression analysis are shown in Table 3. A total of 8 studies reported patient-based results of the diagnostic performance of 18F-FDG PET/CT for breast cancer BM with a sensitivity of 0.89 (95% CI: 0.80–0.99) and a specificity of 0.99 (95% CI: 0.98-1.00), and 4 studies including 1038 lesions were lesion-based with a sensitivity of 0.84 (95% CI: 0.67-1.00) and specificity of 1.00 (95% CI: 0.98-1.00). In 7 studies with patients’ mean age > 50 years old, sensitivity was 0.88 (95% CI: 0.78–0.99), and specificity was 0.98 (95% CI: 0.96-1.00), respectively. Four studies with patients’ mean age less than 50 years old had sensitivity of 0.80 (95% CI: 0.60–0.99) and specificity of 1.00 (95% CI: 0.99-1.00). Neither the patient or the patient nor the mean age of the patients were responsible for the heterogeneity between studies, with a p value greater than 0.05. The study design, sample size, scan minimum slice thickness, attenuation correction, and machine source company are the sources of heterogeneity in the diagnostic performance of 18F- FDG-PET/CT in breast cancer BM, with a p value less than 0.05.
Table 3
Meta-regression analysis results of 18F-FDG PET/CT on bone metastases of breast cancer
Parameter | Category | No. of studies | Sensitivity | p value | Specificity | p value |
18F-FDG PET/CT |
Based | patient | 8 | 0.89[0.80–0.99] | 0.88 | 0.99[0.98-1.00] | 0.21 |
| lesions | 4 | 0.84[0.67- 1.00] | | 1.00[0.98-1.00] | |
Design | Prospective | 4 | 0.78[0.55- 1.00] | 0.13 | 1.00[0.99-1.00] | 0.00 |
| Retrospective | 8 | 0.91[0.83–0.98] | | 0.99[0.97-1.00] | |
Mean age | ≥ 50 | 7 | 0.88[0.78–0.99] | 0.73 | 0.98[0.96-1.00] | 0.38 |
| < 50 | 4 | 0.80[0.60–0.99] | | 1.00[0.99–1.00 | |
Sample | > 50 | 4 | 0.91[0.81- 1.00] | 0.65 | 0.98[0.95-1.00] | 0.00 |
| ≤ 50 | 4 | 0.87[0.71- 1.00] | | 1.00[1.00–1.00] | |
Vendor | GE | 4 | 0.92[0.81-1.00] | 0.82 | 1.00[0.99-1.00] | 0.07 |
| Siemens | 6 | 0.89[0.77-1.00] | | 1.00[0.99-1.00] | |
AC | yes | 7 | 0.89[0.78-1.00] | 0.85 | 1.00[0.98-1.00] | 0.02 |
| no | 5 | 0.86[0.72-1.00] | | 0.99[0.98-1.00] | |
Slice thickness | ≥ 4 mm | 4 | 0.90[0.76-1.00] | 0.55 | 0.99[0.95-1.00] | 0.08 |
| < 4 mm | 4 | 0.83[0.64-1.00] | | 0.99[0.95-1.00] | |
Notes:18F-FDG = Fluorine-18 labeled deoxyglucose; PET = Positron emission computer; CT = Computed tomography; CI = confidence interval; AC = attenuation correction. |