Calibration of DRSM microscope. The rapid volumetric DRSM microscope was calibrated using a fluorescent thin film and fluorescent beads as samples. In both cases, the samples were driven by a programmable motorized three-axis stage (HEP4AXIM/B ProScan, Prior Scientific, UK). The maximum field of view of the proposed system design was around 343×343 µm2 based on the chosen objective lens (W Plan-Apochromat 20X/1.0, Carl Zeiss, Germany) and TAG lens (TAG Lens 2.0, TAG Optics Inc., USA) with a resonant frequency of 456 kHz. Figure 1(a) shows the captured intensity profile of the fluorescent thin film when driven axially by the stage. It is seen that the axial scanning range when driving the TAG lens at 456 kHz is around 120 µm. Consequently, the ability of the proposed DRSM microscope to achieve a large image region of 343×343×120 µm3 is confirmed. The spatial resolution of the proposed microscope was evaluated using a single 200-nm fluorescent bead (F-8888, Thermo Fisher Scientific, USA) fixed in agarose gel. In the optical design of the microscope, the TAG lens was conjugated with the back aperture of the objective. Moreover, the effective aperture of the TAG lens was around 1.8 mm with 20 diopters at the resonant frequency of 456 kHz. To achieve the axial scanning range of 120 µm described above, the laser beam emerging from the TAG lens was only expanded by around 3.33 times by the relay lens systems (see Fig. 5). The resulting coverage of the back aperture of the 20X objective (with a diameter of 12.4 mm) was found to be just 48% (i.e., 1.8×3.33/12.4). Therefore, the lateral and axial resolutions of the DRSM microscope were theoretically degraded by up to 1/0.48 and 1/0.482 times, respectively. To calibrate the spatial resolution of the microscope, the spatial sampling periods were set to 0.16 µm and 0.4 µm for the x-y plane and z-axis direction, respectively. Figure 1(b) shows that the resulting spatial resolutions were 1.02 µm and 1.18 µm in the x-axis and y-axis directions (i.e., the lateral resolution), respectively. In addition, the spatial resolution in the z-axis direction (i.e., the axial resolution) was 10.72 µm, as shown in Fig. 1(c).
When the objective was increased to 40X, the laser beam filled nearly the entire back aperture (i.e., around 5.94 mm) of the objective (W Plan-Apochromat 40X/1.0, Carl Zeiss, Germany). The axial resolution was thus improved from 10.72 µm to 2.78 µm, which was close to the theoretical value for the 40X objective. However, the axial scanning range was significantly reduced from 120 µm (Fig. 1(a)) to just 31.3 µm. Thus, an alternative approach was attempted in which the TAG lens was simply operated at a lower resonant frequency of 143 kHz with 1.5 diopters. The effective aperture of the TAG lens then became 5.5 mm, and the laser beam, with a size of 18.3 mm (i.e., 5.5×3.33), completely covered the back aperture of the 20X objective. However, the axial scanning range was reduced yet further to 9 µm. Hence, a trade-off was found to exist between the axial resolution and the axial scanning range. Notably, the frame rate was unchanged despite the use of a lower TAG resonant frequency. However, the x-axis image region contained only 17 TAG resonant scanning lines. Thus, compared with the original operating mode of 456 kHz with 57 TAG resonant scanning lines, the x-axis scanning resolution was degraded by more than 3 times.
The aim of the DRSM microscope proposed in this study was to realize a long axial scanning range under a concise dual-resonant scanning setup with only a single pass through the TAG lens.21 Hence, the results presented above indicate that a trade-off must be made among the axial scanning range, the axial spatial resolution, and the x-axis scanning resolution.22
High-speed imaging performance and restriction. Figures 2(a)-2(h) show x-y cross-sectional images captured of a 10-µm fluorescent bead (F-8836, Thermo Fisher Scientific, USA) with an x-y plane image region of 80×80 µm2. Figures 2(a)-2(d) present the images captured with x-y image sizes of 512×512, 256×256, 128×128 and 64×64 pixels, respectively, corresponding to pixel ratios of 0.08, 0.24, 0.68 and 0.94, for a constant volumetric imaging rate of 30 vps. Figures 2(a) and 2(b) contain a large number of missing pixels, and hence it is difficult to pinpoint the center of the bead precisely. Furthermore, even though Figs. 2(c) and 2(d) have larger pixel ratios, the lateral scanning resolutions are reduced by 4 and 8 times compared to that of Fig. 2(a), respectively. Accordingly, an attempt was made to improve the imaging performance by accumulating multiple volumetric images. Figures 2(e)-2(h) show the results obtained when accumulating 2, 3, 5, and 10 x-y cross-sectional images with a size of 256×256 pixels in the x-y plane (i.e., effective volumetric imaging rates of 15, 10, 6, and 3 vps, respectively) and pixel ratios of 0.42, 0.55, 0.7, and 0.84. The image quality of Figs. 2(e)-2(h) is greatly improved compared to that of Figs. 2(a)-2(d). However, the image accumulation approach is infeasible for 3D dynamic observations due to the corresponding reduction of the volumetric imaging rate.
The bioimaging performance of the DRSM microscope was further evaluated using the mushroom body (MB) structure of a drosophila brain. The brain sample had a thickness of around 100 µm, and thus its entire volume was observed by the DRSM microscope with an image region size of 343×343×120 µm3 and a volumetric imaging rate of 30 vps. Figures 3(a)-3(c) present the x-y cross-sectional images of the brain obtained with 256×256×80 voxels at depth layers of -30 µm, 0 µm, and 30 µm, respectively. Figures 3(d)-3(f) show the corresponding results obtained when accumulating 100 volumetric images at each plane, respectively. Based on the x-y image size of 256×256 pixels in Figs. 3(a)-3(c), the pixel ratio is just 0.24 in every case. However, the intensity distributions of the two series of volumetric images show a broadly similar morphology. Video 1 shows the corresponding volumetric images of the MB structure without (i.e., original) and with 100-volumetric-image accumulation, respectively.
To maintain a rapid volumetric rate with a large image volume and large image size, the number of missing voxels must be significantly reduced. Furthermore, the problem of Lissajous patterning residuals caused by dual-resonant scanning must also be overcome. Previous studies have suggested that both effects can be addressed via image inpainting and denoising using conventional or deep learning approaches.23,24
Dynamic imaging performance. The DRSM microscope was found to require 0.032 s to acquire each volumetric image (i.e., the volumetric imaging rate was higher than 30 vps). The dynamic 3D imaging performance of the microscope was evaluated by observing the simple harmonic motion of the 10-µm fluorescent bead in real time as it underwent periodic displacement along the z-axis at various frequencies. In performing the imaging trials, the bead immobilized in agarose gel was placed on a piezoelectric stage and driven at five different temporal frequencies of 1, 5, 10, 15, and 20 Hz, respectively. For each driving frequency, the microscope captured volumetric images of the bead continuously for a period of around 3 s at a volumetric imaging rate of 30.6 vps with an image region size of 80×80×120 µm3 and 256×256×80 voxels. Compared with the 343×343 µm2 image region in the x-y plane, the 80×80 µm2 smaller image region with the same 256×256-pixel size was then used to lessen around 4×4-time spatial sampling period (i.e., 80/256 vs. 343/256) of the volumetric images to enable the peak intensity positions corresponding to the centers of the fluorescent bead at different time instances to be more reliably determined.
Figure 4(a) shows the displacements of the fluorescent bead under the five driving frequencies. For each frequency, the vibrational frequency of the bead was estimated from the displacement signal via fast Fourier transform. The normalized temporal spectra of the bead displacements are shown in Fig. 4(b). It is seen that the 20 Hz vibration displacement is aliased to 10.6 Hz (i.e., 30.6–20 Hz). However, for frequencies lower than 15.3 Hz (i.e., one half of the volumetric imaging rate (30.6 vps)), the DRSM microscope accurately tracks the bead displacement as the piezoelectric stage oscillates. In other words, the dynamic imaging performance of the DRSM microscope is confirmed.
The practical feasibility of the DRSM microscope was further evaluated by observing the high-speed movement of the 10-µm fluorescent bead for an image region of 343×80×120 µm3 and a size of 256×256×80 voxels for a volumetric imaging rate of 30 vps and 256×64×80 voxels for an imaging rate of 120 vps. In both cases, the bead was moved over a distance of 200 µm in the left to right x-axis direction at a speed of 6,000 µm/s. Figures 4(c) and 4(d) present the 30-vps volumetric images of the fluorescent bead at 6 different time instances (0, 0.032, 0.064, 0.096, 0.128, and 0.160 seconds) in the x-z and x-y views, respectively. In the x-z view, the morphology of the bead is enlarged as a result of the bead motion in the x-axis direction and the axial resolution of 10.72 µm. By contrast, in the x-y view, the morphology of the fluorescent bead is obliquely elongated due to the x-axis moving direction and y-axis GM scanning direction. The results presented in Figs. 4(c) and 4(d) show that the stage has a slow speed initially, a faster speed in the middle of the displacement range (as shown by a larger bead elongation), and a slower speed toward the end of the displacement range (200 µm). To eliminate the morphology enlargement and elongation effects in the x-axis direction, the volumetric imaging rate was boosted to 120 vps. The higher imaging rate eliminated the morphology enlargement and elongation, but resulted in only a sparsely-sampled volume. However, this drawback can be overcome by using either conventional or deep learning inpainting and denoising approaches.23,24 Video 2 shows volumetric video sequences of the 10-µm fluorescent bead at imaging rates of 30 vps and 120 vps, respectively. The results confirm that a high volumetric imaging rate is necessary for fast moving particles.