CCS-MAR algorithm design
CCS-MAR is a sinogram inpainting-based MAR algorithm which combines image processing strategies with the NMAR method [31] to replace artifact corrupted areas in CT scans. The NMAR method requires a CT scan which is clustered according to tissue types as input. The clustering approach utilized in this work was inspired by the studies conducted by Wu et al. [52] and Luzhbin and Wu [53]. These studies utilized the k-means clustering algorithm [54], which is an unsupervised iterative method being used for classification tasks, for the creation of clustered CT scans. As the performance of the NMAR method depends on the quality of the clustered CT scan, the creation of the clustered scan without metal artifacts is crucial. Therefore, the key step of the CCS-MAR algorithm is the creation of an artifact-free clustered CT scan from the CTart scan.
The CCS-MAR algorithm was implemented using MatLab (version 9.7, The MathWorks Inc, Natick, MA, USA), and its workflow is shown in Fig. 1. It is a fully automatic algorithm which does not require any manual contouring of artifact-corrupted areas. The input of the algorithm is the planning CTart scan, which will be referred to as ‘original’ scan in the rest of this section. In the first step of the algorithm’s workflow, HU value thresholds of 2000 HU and − 950 HU are used to identify and segment the metal component (see arrow ‘a’ in Fig. 1) and air region, respectively. A fixed threshold value of 2000 HU has been chosen for the metal segmentation based on previous studies published in literature [55, 56]. It has been verified that slight changes (range 2000–2500 HU) in the threshold value did not affect the performance of CCS-MAR. In order to create an initial clustered scan, the k-means clustering algorithm is applied to the original scan after the metal and air segmentation (see arrow ‘b’ in Fig. 1). As the original scan is acquired of the thoracic region, this scan primarily consists of soft tissue, bone, and lung tissue. By considering these tissue types, a total of three clusters are chosen during the k-means clustering. Indeed, a number of clusters below three can result in a clustered image with a lack of details and that would result in a wrongly corrected CT scan, whilst more cluster numbers modelled the artifact as one of the tissue clusters in the clustered scan. After the k-means clustering, the segmented air region from the first step is added to the clustered scan. Subsequently, the original scan, the metal component, and the clustered scan are forward projected to generate their respective sinograms (see arrows ‘c’ in Fig. 1).
The metal sinogram is then modified through the application of both dilation with a disk structuring element [57] and smoothing through Gaussian filtering. Since the exact HU value of the metal component in the transducer is unknown, dilation is applied to inflate the metal data to minimize the dependency on the 2000 HU value threshold. The smoothing is applied to remove statistical photon noise which may cause streak artifacts during the reconstruction of CT scans.
In the next step of the algorithm, the NMAR method is applied to the created sinograms. As a result, the original sinogram is divided by the clustered sinogram (see black arrow ‘d’ in Fig. 1) and a normalized sinogram is created. Then, the dilated and smoothed metal sinogram is used as a mask to identify the metal region in the normalized sinogram for the linear interpolation (see arrow ‘e’ in Fig. 1). Subsequently, the interpolated normalized sinogram is multiplied by the clustered sinogram (see black arrows ‘f’ in Fig. 1) resulting in a corrected sinogram. Filtered back projection is finally used to reconstruct the first corrected CT scan from the corrected sinogram (see black arrow ‘g’ in Fig. 1).
Even though most of the artifacts are reduced in the first corrected scan, typically the intense dark streaks which are in the region close to the transducer remain unchanged. Also, the HU value of this region becomes lower than the HU value of the corresponding region on the original scan, because the intense dark streaks are modelled as lung tissue in the clustered scan. Therefore, further correction is necessary. For this purpose, the pixel-wise absolute difference between the original scan and the first corrected scan is calculated. An empirically chosen threshold value of 200 HU is used to identify the pixels which are in the region with the dark streaks. Subsequently, those pixels are identified on the first corrected scan, and they are replaced with a 0 HU value. A value of the threshold in the range of 150 HU to 200 HU is suitable for the HU value replacement. Indeed, it was found that the threshold value below 150 HU will replace the HU values of pixels which do not have metal artifacts on the first corrected scan. This contributes to the generation of an inaccurate second clustered scan. On the other hand, a value above 200 HU will not contribute to the artifact-free combined clustered scan. The region with intense dark streaks may cause a wrong classification during k-means clustering. Thus, spatial relationships [52] are incorporated with k-means clustering, calculated as:
$${C}_{i}={arg}\left\{{max}\left(\left|P\cap {C}_{j}\right|\right)\right\}, j=1, \dots k$$
1
where \(P\) denotes a set of pixels covered by a 3×3 mask centred around pixel \(i\), and \(|.|\) is the number of members in the set after the k-means clustering. \({C}_{j}\)and \(k\) are the \(j\)th cluster and the total number of clusters, respectively. During this procedure, pixel \(i\) is reassigned to the cluster \({C}_{i}\) that has the maximum number of members within the mask. With this method, the clustered scan with spatial relationships is created (see arrow ‘h’ in Fig. 1) and then the air region which was segmented in the first step is added. For the mask size, the minimum size of 3×3 produced the best result for incorporating spatial relationships. On the other hand, the mask with a larger size smeared the clustered scan, which would then produce the second corrected scan with induced secondary artifacts. Even though incorporating spatial relationships allows to reduce the inaccuracies in clustering, especially in the artifact regions, it may also induce errors in pixel reassignment in the artifact-free regions. For this reason, during the initial k-means clustering, the spatial relationships are not incorporated.
In the end, the clustered scans which are created with and without incorporating the spatial relationship are combined (see arrow ‘i’ in Fig. 1) to generate the artifact-free combined clustered scan. During the combination, the absolute difference between those scans is calculated and the difference is added to the initial clustered scan to reduce the intense dark streaks in the region close to the US transducer. Afterwards, the combined clustered scan is forward projected to generate the combined clustered sinogram (see arrow ‘j’ in Fig. 1). Utilizing the combined clustered sinogram, the original sinogram, and the smoothed metal sinogram, the second corrected scan is reconstructed using filtered back projection after the NMAR method (see dotted black arrows ‘d, e, f and g’ in Fig. 1). The dilation of the metal sinogram may cause over interpolation or blurring especially in the region which is adjacent to the US transducer in the second corrected scan. In order to balance this effect, during the creation of second corrected scan, only smoothing and no dilation is applied to the metal sinogram. The corrected scan is an average of the first and second corrected scans (see arrow ‘k’, in Fig. 1). To preserve the noise texture, the result from the application of a high-pass filter on the original scan is added to the corrected scan for the creation of the final corrected scan (CTcor scan) (see arrow ‘l’, in Fig. 1).
CT scan data collection for performance evaluation
To evaluate the performance of the proposed algorithm, several experiments have been performed which are summarized in Table 1. In total, three types of adult anthropomorphic phantoms were used: a Model ART-211 male phantom (ART, Radiology Support Devices, Long Beach, CA, USA), an ATOM® male phantom (CIRS, Model-701, Norfolk, VA, USA), and a CT torso phantom (CT Torso, Model CTU-41, Kyoto Kagaku Ltd, Japan). The phantoms were positioned on the CT table in a head-first position (Fig. 2) and scanned first without, and then with US transducers in place. As can be seen in Table 1, three different CT scanners from Philips and Siemens were used for CT scanning.
The size of an US transducer influences the amount and the appearance of metal artifacts on CT scans [26]. To investigate this effect, a total of three US transducers with various sizes were used: (1) single-plane phased array: Telemed P5-1S15-A6 from Telemed (UAB, Vilnius, Lithuania); (2) bi-plane phased array: Terason XY mini from Teratech Corporation (Burlington, MA, USA); and (3) linear volumetric array: Philips VL13-5 from Philips Healthcare (Andover, MA, USA). To fix the US transducer on the phantoms, custom-built transducer holders (consisting of 3D printed plastic parts and elastic straps) which were developed in collaboration with Usono (Eindhoven, the Netherlands) were used.
For each phantom, first a CT scan was acquired without the transducer on the phantom, which resulted in a reference artifact-free CT scan (CTref). Then, without changing the position of the phantom, an US transducer was placed into the transducer holder and a CT scan with the US transducer-induced metal artifacts (CTart) was acquired. The transducers were placed in a position considered to be suitable for imaging the heart. For all CT scans, a CT thorax protocol was utilized, and the scanning parameters are given in Table 1.
The commercial MAR algorithms iMAR and O-MAR were applied during the CT scan reconstruction on the scanner, as these algorithms are available on Siemens and Philips scanners, respectively. iMAR was not applied to the Siemens PET-CT scans, because it was not available on this particular scanner. In addition to the application of these commercial MAR algorithms, MDT and CCS-MAR algorithms were also applied to all CTart scans.
Table 1
Details of utilized CT scanners, clinical site, scan types (SECT, single energy CT; DECT, dual-energy CT), anthropomorphic phantoms, US transducers and CT scanning parameters
CT Scanner (Model) | Siemens CT (SOMATOM Definition AS) | Philips CT (Brilliance Big Bore) | Siemens PET-CT (Biograph 128) |
Clinical site | Kantonnspital Aarau, Aarau, Switzerland | Geneva University Hospital, Geneva, Switzerland | Herston Imaging Research Facility (HIRF), Brisbane, Australia |
Scan type | SECT and DECT | SECT | SECT |
Phantom | ART | ATOM® | CT torso |
US transducer | Single-plane phased array, Bi-plane phased array | Single-plane phased array, Bi-plane phased array | Linear volume array |
Tube current | 120 kVp (SECT) 80 kVp/140 kVp (DECT) | 120 kVp | 120 kVp |
Field of view (FOV) | 500 mm | 600 mm | 500 mm |
Slice thickness | 1 mm | 1 mm | 2 mm |
Scan dimension | 512 × 512 | 512 × 512 | 512 × 512 |
Pitch factor | 1 | 1 | 1 |
Reconstruction kernel | body (Br38f) | sharp (C) | body (B31f) |