Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Enhanced resolution 3D digital cytology and pathology with dual-view inverted selective plane illumination microscopy

Open Access Open Access

Abstract

The current gold-standard histopathology for tissue analysis is destructive, time consuming, and limited to 2D slices. Light sheet microscopy has emerged as a powerful tool for 3D imaging of tissue biospecimens with its fast speed and low photo-damage, but usually with worse axial resolution and complicated configuration for sample imaging. Here, we utilized inverted selective plane illumination microscopy for easy sample mounting and imaging, and dual-view imaging and deconvolution to overcome the anisotropic resolution. We have rendered 3D images of fresh cytology cell blocks and millimeter- to centimeter-sized fixed tissue samples with high resolution in both lateral and axial directions. More accurate cellular quantification, higher image sharpness, and more image details have been achieved with the dual-view method compared with single-view imaging.

© 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

For decades, histopathology has provided the reference standard for cancer diagnosis, prognosis prediction, and treatment decisions. In most cases, a biopsy or surgery is performed to extract cells or tissues for observation and analysis under a microscope. Usually, tissue biopsies are formalin-fixed and paraffin-embedded (FFPE), sectioned into thin slices, stained with dyes, and mounted on glass slides for examination by pathologists. This process has been the gold standard for tissue diagnosis for over a century. However, it is time-consuming, laborious, and destructive of tissue. Moreover, because of the preparation of the tissue and cellular material as thin sections or smears placed onto glass slides, the images are limited to 2D slices, which do not faithfully represent the true 3D architecture of the cellular or tissue material, and thus the original environment of the tumor.

The native 3D microarchitecture of tumors has been increasingly explored over the last two decades for better understanding of tumor structure. Many of these past studies have focused on prostate cancer, due to the specific importance of microarchitecture in its diagnosis and grading. For example, 3D prostate adenocarcinoma was first showed by A.H. Boag et al. [1] in 2001. They cut serial sections from archived paraffin-embedded prostate specimens of varying Gleason patterns (GPs) and Gleason scores (GSs) which were immuno-stained using DAB as the chromogen, digitized with a brightfield microscope, and reconstructed into a 3D volume. They found that instead of the separate glands seen in 2D, a complex array of interconnecting tubules was formed in GP 3, and a glandular fusion in GP 4. This was an excellent early attempt to analyze 3D prostate structures. However, because of the limited digital image resolution and computing resources at that time, resolving adjacent cells and precise edges of glands was a challenge. A similar study was performed by Tolkach et al. in 2018 [2], and important 3D architectural features were found to distinguish patterns GP 3 and GP 4, which is critical for prostate cancer treatment and prognosis. Although both studies have demonstrated that 3D imaging and reconstruction can be more informative than traditional 2D histology, the serial physical slicing approach used is laborious and sensitive to tissue deformations between consecutive slices. In 2016, Royen et al. [3] combined tissue clearing and confocal fluorescence microscopy to investigate the clinical and biological prostate cancer (PCa) features in the actual 3D context from intact tissue, and showed that the glandular system in GP 3 and GP 4 are highly interconnected. In 2017, Glaser et al. [4] used a variant of light sheet fluorescence microscopy (LSFM) to image an optically cleared prostate biopsy, and found that by showing pathologists serial optical sections derived from the 3D volume of prostate images, tangential sectioning artifacts can be distinguished from poorly formed glands, and inter-observer agreement of GS can be improved. Based on these findings, it is becoming increasingly evident that the 3D structure of tumors is important for cancer diagnosis, grading, and overall understanding of tumor microarchitecture, and thus could be a vital new addition for patients.

In addition to confocal [3,5,6] and LSFM mentioned above, multiple other imaging methods have also been utilized for non-destructive imaging of tissues, including optical coherence tomography (OCT) [7], microscopy with UV surface excitation (MUSE) [8,9], structured illumination microscopy (SIM) [10], and nonlinear microscopy [11,12]. While these methods may have significant cost, complexity, and speed advantages for 2D imaging compared to LSFM, for 3D tissue imaging they are limited by varying combinations of low resolution, low penetration depth, or a relatively slow imaging speed. In addition, all of the above-mentioned methods suffer from anisotropic resolution, which could distort 3D tissue architecture renderings and thus hinder new work to analyze and quantify 3D tissue microarchitecture. Therefore, there is a clear need for a non-destructive imaging tool that can accurately represent the 3D structures of the tissue or cellular architecture, with subcellular resolution in any arbitrary direction in the image volume, and with image contrast similar to traditional histopathology.

In this work, we use dual-view inverted selective plane illumination microscopy (diSPIM), one variant of LFSM, for its unique capabilities of imaging large samples with high resolution, low photo-damage [13,14] and isotropic resolution [15]. Optical sectioning ability is obtained by scanning a laser beam to create a light sheet into the sample, and the illuminated area is captured by another orthogonal de-coupled imaging path in a wide-field manner. Together, they provide non-destructive, fast 3D imaging with high contrast and resolution, providing a potentially useful tool for clinical applications. In most cases, LSFM is applied to small, translucent model organisms for study of embryogenesis [13,16,17], neuroscience [18], or optically cleared tissues, such as mouse brain [19,20] or small tissue blocks [6], entailing complicated sample preparation methods or imaging configurations. Similar to the open-top light-sheet microscope (OTLS) [4,21] or light sheet theta microscopy (LSTM) [22], the design of diSPIM enables high-speed centimeter-size sample imaging with easy sample mounting. In OTLS, the objectives are placed below the sample holder in a lens immersion medium, and one of several customized imaging plates between the objective lens and sample is selected to provide a precise match of refractive index between the sample, the imaging plate, and the objective lens immersion medium [23]. In contrast, in the diSPIM architecture the multi-immersion objectives are immersed in the same bath of immersion medium along with the sample, with no additional interfaces introduced between the objective lenses and the sample. Currently, both OTLS and LSTM are designed for single-view imaging. In contrast, a specific feature of the diSPIM design [24,25] is that the illumination and detection paths can switch roles and capture orthogonal images of the sample by turn, contributing to more isotropic resolution in 3D by fusing and deconvolving the two views. Though multi-view deconvolution has been used before to obtain isotropic resolution, it was either applied to small and transparent samples (micrometer size) [15,23,26–28]; large, but sparsely labeled structures [29]; required beads embedded as registration fiduciaries [20]; or required complicated imaging configuration and sample preparation for sample rotation and multi-view acquisition [30]. Here, with no need of rotating samples, we applied dual-view imaging and deconvolution for large (millimeter to centimeter size) 3D virtual histology of conventionally prepared densely-labeled samples to achieve more isotropic resolution, specifically DRAQ5 and eosin (D&E) stained cytology and tissue biopsy samples [31]. Nuclear signals from the DRAQ5 channel were used for dual-view registration, with no need to embed extra beads into the samples. We first tested our dual-view imaging and deconvolution on a phantom of 500 nm fluorescent beads. Then, a cell sample stained with D&E was used to validate the dual-view dual-color imaging and data processing, for the benefits of its relatively smaller size and less scattering property than tissue specimens, and for its potential relevance in 3D cytopathology. Finally, we applied the methods to an optically-cleared prostate biopsy, to evaluate its potential for accurate 3D virtual histology.

2. Methods

2.1 Phantom preparation

Five (5) μL of 1:200 diluted 500 nm sub-diffraction YG (yellow-green) fluorescent beads (Fluoresbrite, Polysciences) were added to 1 g of 3% gelatin solution. Several drops of the mixed solution were placed onto a cover slide. After curing at 4°C for 5 minutes, the cover slide was mounted into a custom imaging chamber filled with water and imaged. 10X water objectives (Nikon, 0.3 NA) were used for this sample.

2.2 Cells and tissue acquisitions and preparation

Buccal cells were obtained by gently rubbing and rotating a cotton swab along the inside of the cheek of a human volunteer for 5 seconds. After removing from the cheek, the swab was immersed in phosphate-buffered saline (PBS) solution immediately and gently agitated. Several cheek swabs were made to collect more cells. The cell suspension was then centrifuged at 180 × g for 5 minutes. After discarding the supernatant, the cells were stained with a 1:100 w/v solution of eosin Y (Sigma-Aldrich) in 80% ethanol for 1 minute and centrifuged again at 180 × g for 5 minutes. The process was repeated with a 1:100 v/v dilution of 5 mM DRAQ5 (Biostatus, Ltd) in PBS for 1 minute before the cells were resuspended in a 3% gelatin block. Finally, the gelatin block was immersed in PBS and imaged with the 10X 0.3 NA water objectives.

A frozen human prostate biopsy was collected from the Louisiana Cancer Research Consortium Biospecimen Core Laboratory under a Tulane University Biomedical Institutional Review Board approved protocol. The frozen biopsy was thawed, fixed with formalin, and then thoroughly rinsed with PBS. Although diSPIM is tolerant to irregularity of the tissue surface, the biopsy was cut flat with a vibratome for more efficient correlation of optical sections and subsequent FFPE sections. After cutting, the biopsy was about 14.8 mm × 2.7 mm × 0.4 mm in size. It was then optically cleared using the X-CLARITY protocol (X-CLARITY, Logos Biosystems). Next, the cleared sample was stained with DRAQ5 overnight with gentle agitation followed by PBS rinsing for 3 times, and then stained with eosin for 30 minutes. The concentrations of DRAQ5 and eosin (D&E) used were the same as in the cell staining protocol. After removal from eosin solution, the stained sample was rinsed again with deionized water and PBS successively, and then immersed in two changes of X-CLARITY mounting solution for RI-matching. Finally, the sample was fixed in the imaging chamber and immersed in X-CLARITY mounting solution for dual-view imaging with the ASI/Special Optics Cleared Tissue Objective (CTO) objective lenses.

Traditional H&E-stained sections of the same biopsy were prepared after diSPIM imaging by the Tulane Histology Research Laboratory for further comparison and analysis.

2.3 diSPIM imaging

The diSPIM system, originally developed by Hari Shroff and ASI and commercially available from ASI [15], has been described in our previous paper [24]. Since then, several adjustments to our system have been made (Fig. 1). Firstly, the scanner tube lenses have been replaced with adjustable tube lenses to keep 4-f spacing for easily switching between water objectives (Nikon, 10X, NA: 0.3) and cleared tissue objectives (CTO, ASI/Special Optics, 15.3X- 17.9 X, NA: 0.37-0.43 over RI range of 1.33 to 1.55, working distance: 12 mm) for dual-view multi-immersion imaging. For imaging the cleared prostate, we used the CTOs to minimize spherical aberrations. Secondly, we switched our SSD array from RAID 10 mode to RAID 0 mode for higher sequential writing speed. Finally, we changed our data acquisition card to PCI 6733 (National Instruments) to obtain more analog outputs for controlling of different illumination modes and laser lines. A 488 nm laser (Omicron, PhoxX) was used for imaging the eosin channel, and 647 nm laser (Omicron, LuxX + ) for the DRAQ5 channel. The beam waist was adjusted to ~12 μm when using 10X objectives and ~7 μm using CTOs at 488 nm wavelength. Volumetric images of one z layer were obtained by moving the sample with respect to the objectives using the XY motorized stage by raster scanning in the x-y direction, with multiple y strips acquired with about 20% overlap between two adjacent strips to ensure accuracy and uniformity of stitched images. For each y strip, the XY stage moved in the x direction with a constant speed, and the Tiger controller (ASI) was used to provide a trigger output once the stage arrived at a pre-determined position to synchronize the stage motion with the camera trigger. Dual-color imaging was achieved by automatically turning on and off the two lasers alternatively step-by-step along each y strip. The field-of-view (FOV) with the 10X objectives is about 1.33 mm × 1.33 mm, with the theoretical lateral resolution of 1.3 μm, and the FOV of the CTO varied from 0.75 mm × 0.75 mm to 0.87 mm × 0.87 mm, with the theoretical lateral resolution of 0.73 μm to 0.84 μm, over its RI range. For samples thicker than one FOV2 (considering the 45° angle of each FOV), the objectives can be moved vertically relative to the sample to capture more depth information, with about 20% overlap between two adjacent z layers. As shown in the system schematic (Fig. 1), the diSPIM necessitates a set of adjusted coordinates (prime coordinates) because of the 45° angle of the objectives compared to the traditional xyz coordinates. For SPIM-A (left illumination + right camera detection), x'Ay'zA' is used (Fig. 1(B)). X'A is along the axis of the illuminating beam that travels through the left objective, y' is the direction that the beam scans, and z'A is the detection axis of view A. Similarly, x'By'zB' is used for SPIM-B (Right illumination + left camera detection. See the red labels in Fig. 1(B)).

 figure: Fig. 1

Fig. 1 diSPIM schematic. A virtual light sheet generated by one of the micro-mirror scanners that scans in the y(y') direction rapidly illuminates the sample through the illumination objective at an oblique 45° angle from one objective. The emission signal from the sample is then collected by the detection objective lens positioned perpendicular to the illumination objective and imaged with the dedicated camera for that side. The stage moves in the x direction to create a 3D stack. The objectives move vertically to achieve extended z depth (A). The two light paths can then switch roles for illumination and detection alternatively for dual-view imaging. Compared to the traditional xyz coordinates, a new set of coordinates of x'A/By'z'A/B for diSPIM is used. X'A/B axis is along the illumination direction of left/right light path, z'A/B is the corresponding detection axis of view A/B (B), and y' is the same as y (C). BS: beam splitter. MM: micro-mirror scanner. TL: adjustable tube lens. DM + F: dichroic mirror + emission filter. Ill obj: illumination objective. Det obj: detection objective.

Download Full Size | PDF

2.4 Post image processing

After data sets corresponding to the two views for each color channel had been captured and stored digitally, the post image processing was run on a Dell Precision T7910 work station with Xeon CPU E5-2699 v3 processor and 128 GB RAM. Firstly, customized MATLAB code was used for shifting and transformation. Shifting is to restore the ± 45° angles of view A and view B, and transformation is to align the two views to the same orientation – either by resampling one of the views in 90°, or both views 45° clockwise / anticlockwise, for the subsequent dual-view registration step [32]. Secondly, we cropped a sub-volume with overlapped region from each single-view volume to do dual-view registration based on cell nuclei signals, and dual-view deconvolution using the Multiview Reconstruction plugin in Fiji [32,33]. The theoretical point spread function (PSF) was used in the deconvolution procedure. The theoretical resolution was utilized to generate a three-dimensional Gaussian kernel for use as the PSF, where full-width-at-half-maximum (FWHM) of major axis is equal to the axial resolution, and FWHMs of the other two directions are equal to the lateral resolution. The direction of major axis is parallel to the detection direction (orthogonal to the light sheet). The deconvolution iteration number was set to be 10. For D&E-stained samples, after shifting and transformation, we first remapped the DRAQ5 and eosin images into a composite RGB stack to simulate the traditional H&E images using the virtual transmission microscopy (VTM) method introduced by Giacomelli et al [31,34]. Next, we separated the RGB images into R, G, and B channels, and did the registration and deconvolution channel-by-channel based on the same inverted nuclei information in all the three channels. Then we fused the three deconvolved channels and inverted to form RGB stacks again. Stitching of different y strips was done with the Grid/Collection stitching plugin in Fiji [35]. Finally, the processed data was loaded into Amira (Thermo Fisher Scientific) for 3D visualization. Note that the eosin and DRAQ5 channels were not registered separately before being combined and remapped into the RGB colorspace. This is because these two dyes stain tissue very differently – DRAQ5 stains nuclei sparsely which can be readily used as fiduciaries for dual-view registration, but eosin staining is dense and less featured, which could make registration difficult. Therefore, utilizing the same nuclear signals in the remapped R, G and B channels for registration could avoid possible mismatches between separately registered DRAQ5 and eosin channels.

To compare dual-view deconvolution with single-view deconvolution, we also loaded the D&E images from SPIM-A into Amira and used the theoretical PSF to do non-blind deconvolution.

3. Results

3.1 Dual-view fusion and deconvolution of fluorescent beads phantom

Figure 2 shows a comparison of maximum intensity projections in the x'y', x'z' and y'z' planes between one of the single-view data sets and the dual-view deconvolution results of 500 nm fluorescent beads phantom using the 10X 0.3NA water immersion objectives. Most of the beads are preserved after deconvolution, with more isotropic resolution in 3D. Apparent improvement in resolution by dual-view deconvolution can be clearly seen in the images of the second row and the Gaussian fitted intensity plots, especially along the z' axis. Based on measurements from 10 beads in each field, the full width at half maximum (FWHM) for single-view x', y' and z' are 2.72 ± 0.17 μm, 1.48 ± 0.19 μm, and 4.73 ± 0.26 μm, and for dual-view deconvolved are 1.93 ± 0.14 μm, 1.12 ± 0.21 μm, and 1.54 ± 0.08 μm. Thus, 1.4-fold, 1.3-fold, and 3.1-fold reductions in the PSF size have been achieved in the x', y' and z' directions, respectively, by dual-view imaging and deconvolution.

 figure: Fig. 2

Fig. 2 Comparison of PSFs in x'y', x'z' and y'z' views, between one of the single-views and the dual-view deconvolution results, of 500 nm fluorescent beads phantom. All of the images are maximum intensity projections of shifted x'y' stacks along the z' axis. The bottom Gaussian fitted intensity plots are along x', z' and y' directions from left to right, based on the beads indicated with blue solid lines in single-views and red dash lines in dual-view deconvolved results. All scale bars denote 10 μm.

Download Full Size | PDF

3.2 Dual-view fusion and deconvolution of D&E stained buccal cells

Figure 3(A) shows a deconvolved volume of a buccal cell sample rendered in H&E pseudo-color. Buccal cells characterized by nuclei surrounded by pouches of cytoplasm with various shapes can be clearly seen. In Fig. 3(B-J), comparisons of minimum intensity projections in three orientations between single-view from SPIM-A and dual-view deconvolution results are shown. Note that the resolution in y'z' and x'z' has been improved significantly by dual-view fusion and deconvolution (D-G, I-J) eliminating distortions in cell and nucleus shape seen in the single-view. The green arrows and blue circles in A, B and C indicate the same region of the sample. Note that in 2D slices, some cells overlap with each other and are difficult to differentiate, as indicated by the green arrows in Fig. 3(B) and (C). But in 3D, rotating the cells to an appropriate orientation can easily separate them (indicated by the green arrow in Fig. 3(A), which shows the same cell in B and C).

 figure: Fig. 3

Fig. 3 Deconvoluted volume of D&E stained buccal cells sample (A) and the minimum intensity projections comparisons in three views between single-view and deconvolution results (B-J). The green arrows and blue circles in A, B and C indicate the same region of the sample. Note that rotating the data to an appropriate orientation could differentiate cells that are overlapped in 2D slices. Also, the resolution in y'z' and x'z' have been improved significantly by dual-view fusion and deconvolution (D-G, I-J). Scale bar in A: 150 μm, in B, C, H: 100 μm. Decon: Dual-view deconvolved. MIP: minimum intensity projection.

Download Full Size | PDF

3.3 Dual-view fusion and deconvolution of large D&E stained, cleared prostate biopsy

Figure 4(A) shows a single-view reconstruction of a D&E stained, optically-cleared prostate biopsy (37,955 × 6,860 × 1,100 voxels with voxel size of 0.39 x 0.39 x 0.39 μm3, 14.8 mm × 2.7 mm × 0.4 mm in size), and Fig. 4(B) shows the dual-view deconvolved volume from a cropped sub-volume in 4A comprising 7.92 gigavoxels (11,151 × 2,002 × 355 voxels with voxel size of 0.39 x 0.39 x 0.39 μm3). Figure 4(C-E) are the corresponding cross-sections in three orthogonal orientations from the volume, showing similar resolution and image qualities across all orientations. Figure 4(F) shows the XY planes at different depth ranges.

 figure: Fig. 4

Fig. 4 Dual-view deconvolved volume reconstruction (B, 11,151 × 2,002 × 355 voxels, 4.3 mm × 0.78 mm × 0.14 mm) from a large D&E-stained, cleared prostate biopsy (A, 37,955 × 6,860 × 1,100 voxels, 14.8 mm × 2.7 mm × 0.4 mm, single-view reconstruction shown), and selected ortho-sections in XY at depth of about 65 μm (C), XZ (D) and YZ (E). The locations of the ortho-sections in the sample are indicated with the orange, blue and green boxes in B. The border colors in C-E match the color of the boxes in B. Zoomed-in XY ortho-slices (location indicated by the black box in C) at different depths are also shown in F. Scale bar in A: 2 mm, B-D: 500 μm, E: 200 μm, and F: 100 μm.

Download Full Size | PDF

Small areas in XY, XZ and YZ planes from SPIM-A, SPIM-B, and dual-view reconstructed (Decon) prostate data sets were chosen to compare the local structural details among the three groups. As shown in Fig. 5, inverted intensity profiles were plotted along the same locations in SPIM-A, SPIM-B and dual-view deconvolved results (Decon), labeled by lines in the SPIM-A image column. Note that ideally, SPIM-A and SPIM-B should show similar imaging qualities, but in practice, the results may differ due to varied optical paths inside the sample in two different imaging angles, or slightly varied hardware alignment in SPIM-A and SPIM-B. However, the images after dual-view deconvolution are overall clearer than either of the two single-views. More peaks have been detected in the Decon profiles, indicating the ability to present fine structural details, and detection of small distances between cells is improved by dual-view imaging.

 figure: Fig. 5

Fig. 5 Small areas in XY, XZ and YZ planes from SPIM-A, SPIM-B and dual-view deconvolved (Decon) prostate data sets were chosen to compare high resolution local image details. Each image was a minimum intensity projection of 11 sequential images to avoid z offset among SPIM-A, SPIM-B and Decon views. Inverted intensity profiles were plotted among the same locations in SPIM-A, SPIM-B and Decon, indicated by lines in the SPIM-A image column. Scale bar: 15 μm.

Download Full Size | PDF

To evaluate the results quantitatively, a preliminary experiment was performed in which average cell numbers in the same volume (1,560 μm × 390 μm × 4 μm × n, slice number n = 10) from SPIM-A, SPIM-B, Decon, and H&E slices of the same sample were counted using Cell Profiler [36] and analyzed through one-way analysis of variance (ANOVA) and Tukey’s HSD Post Hoc Test (Fig. 6). Statistical analysis reveals that there is no significant difference (p = 0.075) between extracted cell numbers of SPIM-A and SPIM-B, but that the Decon reconstruction has significantly more cells (p < 0.0001) than the previous two groups. Even though the average cell number from Decon is still significantly different from that of H&E, possibly because of inexact registration between the D&E and H&E volumes, Decon still has a closer cell number to the H&E images compared with SPIM-A or SPIM-B. Tenegrad gradient values of the three groups were also calculated similarly. The Tenegrad gradient value of Decon is significantly higher (p < 0.0001) than either of the two single-views, indicating the effect of Decon to enhance image sharpness, resulting in more accurate nuclear counts.

 figure: Fig. 6

Fig. 6 Cell nuclei counts in the same volume from SPIM-A, SPIM-B, and Decon voumes, and from the approximate same volume from H&E slides. Decon has significant more cell number than the two single-view results and has a closer cell number to H&E images.

Download Full Size | PDF

Further evaluation of image details has been conducted in the frequency domain via 2D Fast Fourier Transform (FFT) of SPIM-A, SPIM-B, and dual-view deconvolution (Decon), in volumes of size 1,280 × 1,280 × 256 pixels in the prostate data sets. To explore the benefits of dual-view deconvolution over simpler single-view deconvolution, we also added deconvolution results from only SPIM-A as an example for comparison. The summed results were projected onto the X, Y and Z-axes, and then normalized as shown in Fig. 7. In the normalized X projection of the FFT shown in Fig. 7(A), the frequency bandwidth of dual-view deconvolution is the widest compared with that of either single-view deconvolution, or of SPIM-A or SPIM-B, indicating that more high-spatial-frequency image content, i.e. more details, are retained after dual-view deconvolution. Similarly, the Y and Z projections of the FFT are shown in Fig. 7(B) and (C). Based on the integration of normalized X, Y and Z projections in the frequency domain (Table 1), dual-view deconvolution shows at least 38.0%, 36.4% and 52.2% improvements in average signal power in X, Y and Z compared with single-views, and 16.1%, 22.7% and 14.7% improvement compared with single-view plus deconvolution. Moreover, high-frequency striping artifacts, which correspond to the two small peaks in single-view and single-view deconvolved FFT plots, as shown in the inset in Fig. 7(A), have also been reduced by dual-view deconvolution.

 figure: Fig. 7

Fig. 7 Normalized X, Y and Z projections in frequency domain, with higher frequency bandwidth in dual-view deconvolved prostate images (Decon-A + B) versus SPIM-A, SPIM-B, or SPIM-A deconvolved (Decon-A) data sets. The inset in A shows a zoomed-in area in the plots, indicating removal of high-frequency striping artifacts by dual-view deconvolution.

Download Full Size | PDF

Tables Icon

Table 1. Integration of Normalized X, Y and Z projection in frequency domain

4. Discussion

In this study, we have demonstrated that dual-view imaging and deconvolution can improve resolution three dimensionally, with 1.4-fold, 1.3-fold, and 3.1-fold improvements in resolution achieved in x', y' and z' (the detection axis for one of the single-views) directions respectively, compared with single-view using sub-diffraction beads and 10X water objectives. This method improves the imaging resolution of diSPIM using these objectives to less than 2 μm in all three directions, which is sufficient to resolve human cell nuclei in any arbitrary orientation. Typically, multi-view registration and deconvolution is applied to micrometer-size, translucent samples, sparsely labeled structures, or requires beads embedded with sample as fiduciaries, or sample rotation during imaging. The calculation is challenging and complicated when encountering large, opaque samples with dense labeling and different optical paths inside the scattering sample. Sample rotation and bead embedding further complicate sample preparation, and embedded beads may be incompatible with optical clearing. Here, we demonstrate that based on fluorescently-labeled nuclear signals present in densely-labeled tissues for dual-view registration, dual-view deconvolution can successfully be applied to cytological samples and millimeter- to centimeter-sized optically-cleared biopsy specimens, verifying the potential for accurate 3D cytology and histology. Furthermore, we demonstrate a method for dual-view registration and deconvolution of images after re-mapping into an inverted RGB colorspace to simulate the appearance of brightfield H&E images. It should be mentioned that isotropic resolution can also be achieved by axially swept light sheet microscopy (ASLM) without the need of deconvolution [37,38]. ASLM leverages axial sweeping of a scanned light sheet, with only signals excited by the diffraction-limited beam waist area being collected via an electronic confocal slit detection scheme, and with the axial resolution being mainly dependent on how thin the illumination beam waist is. The method may avoid some of the limitations of the dual view approach (i.e. lower data collection, processing, and storage requirements), but it may increase imaging time compared to traditional LSFM, and care must be taken to ensure that beam distortions within the sample due to scattering or aberration does not broaden the beam waist above the diffraction limit thereby decreasing axial resolution.

There are several situations in which 3D imaging with isotropic resolution could be useful in virtual histology or cytology imaging. Firstly, as demonstrated here, it could enable more accurate quantitative measurements of nuclear and cytoplasmic volume to calculate the nuclear-to-cytoplasmic ratio, which is useful in cancer diagnosis, and would provide a more accurate representation of true cellular shape, compared to traditional 2D cytology smears, or 3D microscopy images with low axial resolution. In addition, it could provide an enhanced ability to separate otherwise overlapped features in 2D optical slices (for instance, cell nuclei comprising glands) compared to other 3D imaging methods with low axial resolution. This could especially be helpful when studying and quantifying three-dimensional patterns of tumor growth. Accurate three-dimensional representation of tumor microarchitecture could also benefit cancer diagnosis. It has been demonstrated that 3D cytology could reduce the false negative rate for adenocarcinoma detection [39], and viewing 3D histology slices in a single orientation could improve intra-observer agreement [4]. Though further evidence in a larger data set is required to determine whether more isotropic resolution could further improve diagnostic accuracy over other single-view 3D imaging methods, the method presented here could be helpful by providing pathologists a tool for evaluating tissue histology in any desired orientation without fear of distortions introduced by the imaging method itself. Lastly, with better 3D resolution and higher imaging sharpness, the method presented here could build a solid foundation for classification and quantification of cells or tumor architecture, for instance expanding our ongoing work in topological analysis of tumor microarchitecture for quantitative tumor grading [40] from 2D to 3D. Other information, such as nuclear shape, gland size, gland shape, glandular connectedness, distance between adjacent glands, etc. can also be more accurately analyzed in 3D with more spatially isotropic resolution, for instance to supplement prostate cancer histology as one pertinent example of interest.

5. Conclusion

The gold standard of histopathology for tissue or cytology specimens is destructive, time consuming, and limited to 2D slices or smears. 3D imaging of cytology and histology samples is important for more comprehensive understanding and diagnosis of diseases, by observing and differentiating signals from different observation angles, and providing accurate 3D renderings of tumors and their microenvironment. However, current 3D imaging tools do not fulfill all the requirements of fast, high-resolution, and isotropic imaging for volumetric cytological samples or large, scattering tissue biopsies. With diSPIM imaging and dual-view deconvolution of virtual H&E images, more accurate determination of 3D architecture on those samples has been obtained. Enhanced, more isotropic 3D resolution, higher levels of image detail and higher image sharpness have been proven qualitatively and statistically in the dual-view deconvolved results compared with single-view imaging. The method described here should be further investigated in larger sample sets to determine the impact of improved and isotropic resolution on clinical diagnostic endpoints. Processing on centimeter-size samples is achievable by separating the data set into several small blocks and stitching together after deconvolution, although at the expense of longer processing times. More time-efficient image processing methods deserve further investigation and effort.

Funding

National Institutes of Health; National Cancer Institute; Innovative Molecular Analysis Technologies (IMAT) (1R33CA196457).

Acknowledgments

We would like to thank Jaylon M Tellis and Daniel J Bolus for assistance with the cytology experiment, Jon Daniels at Applied Scientific Instrumentation for helpful discussions and technical assistance, and Stephen Preibisch for helpful discussions regarding multiview fusion and deconvolution.

Disclosures

JQB: Instapath, Inc. (I)

References

1. A. H. Boag, L. A. Kennedy, and M. J. Miller, “Three-dimensional Microscopic Image Reconstruction of Prostatic Adenocarcinoma,” Arch. Pathol. Lab. Med. 125(4), 562–566 (2001). [PubMed]  

2. Y. Tolkach, S. Thomann, and G. Kristiansen, “Three-dimensional reconstruction of prostate cancer architecture with serial immunohistochemical sections: hallmarks of tumour growth, tumour compartmentalisation, and implications for grading and heterogeneity,” Histopathology 72(6), 1051–1059 (2018). [CrossRef]   [PubMed]  

3. M. E. van Royen, E. I. Verhoef, C. F. Kweldam, W. A. van Cappellen, G. J. Kremers, A. B. Houtsmuller, and G. J. L. H. van Leenders, “Three-dimensional microscopic analysis of clinical prostate specimens,” Histopathology 69(6), 985–992 (2016). [CrossRef]   [PubMed]  

4. A. K. Glaser, N. P. Reder, Y. Chen, E. F. McCarty, C. Yin, L. Wei, Y. Wang, L. D. True, and J. T. C. Liu, “Light-sheet microscopy for slide-free non-destructive pathology of large clinical specimens,” Nat. Biomed. Eng. 1(7), 0084 (2017). [CrossRef]   [PubMed]  

5. D. S. Gareau, Y. Li, B. Huang, Z. Eastman, K. S. Nehal, and M. Rajadhyaksha, “Confocal mosaicing microscopy in Mohs skin excisions: feasibility of rapid surgical pathology,” J. Biomed. Opt. 13(5), 054001 (2008). [CrossRef]   [PubMed]  

6. S. Nojima, E. A. Susaki, K. Yoshida, H. Takemoto, N. Tsujimura, S. Iijima, K. Takachi, Y. Nakahara, S. Tahara, K. Ohshima, M. Kurashige, Y. Hori, N. Wada, J. I. Ikeda, A. Kumanogoh, E. Morii, and H. R. Ueda, “CUBIC pathology: Three-dimensional imaging for pathological diagnosis,” Sci. Rep. 7(1), 9269 (2017). [CrossRef]   [PubMed]  

7. O. Assayag, M. Antoine, B. Sigal-Zafrani, M. Riben, F. Harms, A. Burcheri, K. Grieve, E. Dalimier, B. Le Conte de Poly, and C. Boccara, “Large Field, High Resolution Full-Field Optical Coherence Tomography: A Pre-clinical Study of Human Breast Tissue and Cancer Assessment,” Technol. Cancer Res. Treat. 13(5), 455–468 (2014). [PubMed]  

8. R. Levenson, F. Fereidouni, Z. Harmany, M. Tan, M. Lechpammer, and S. Demos, “Slide-Free Microscopy via UV Surface Excitation,” Microsc. Microanal. 22(S3), 1002–1003 (2016). [CrossRef]  

9. W. Xie, A. K. Glaser, M. E. Fauver, E. J. Seibel, S. M. Dintzis, J. C. Vaughan, N. P. Reder, J. T. C. Liu, W. Xie, Y. Chen, Y. Wang, L. Wei, C. Yin, A. K. Glaser, M. E. Fauver, E. J. Seibel, S. M. Dintzis, J. C. Vaughan, N. P. Reder, and J. T. C. Liu, “Microscopy with ultraviolet surface excitation for wide-area pathology of breast surgical margins,” J. Biomed. Opt. 24(2), 026501 (2019)

10. M. Wang, D. B. Tulman, A. B. Sholl, H. Z. Kimbrell, S. H. Mandava, K. N. Elfer, S. Luethy, M. M. Maddox, W. Lai, B. R. Lee, and J. Q. Brown, “Gigapixel surface imaging of radical prostatectomy specimens for comprehensive detection of cancer-positive surgical margins using structured illumination microscopy,” Sci. Rep. 6(May), 27419 (2016). [CrossRef]   [PubMed]  

11. E. Olson, M. J. Levene, and R. Torres, “Multiphoton microscopy with clearing for three dimensional histology of kidney biopsies,” Biomed. Opt. Express 7(8), 3089–3096 (2016).

12. Y. K. Tao, D. Shen, Y. Sheikine, O. O. Ahsen, H. H. Wang, D. B. Schmolze, N. B. Johnson, J. S. Brooker, A. E. Cable, J. L. Connolly, and J. G. Fujimoto, “Assessment of breast pathologies using nonlinear microscopy,” Proc. Natl. Acad. Sci. U.S.A. 111(43), 15304–15309 (2014). [CrossRef]   [PubMed]  

13. J. Huisken, J. Swoger, F. Del Bene, J. Wittbrodt, and E. H. K. Stelzer, “Optical sectioning deep inside live embryos by selective plane illumination microscopy,” Science 305(5686), 1007–1009 (2004). [CrossRef]   [PubMed]  

14. R. M. Power and J. Huisken, “A guide to light-sheet fluorescence microscopy for multiscale imaging,” Nat. Methods 14(4), 360–373 (2017). [CrossRef]   [PubMed]  

15. Y. Wu, P. Wawrzusin, J. Senseney, R. S. Fischer, R. Christensen, A. Santella, A. G. York, P. W. Winter, C. M. Waterman, Z. Bao, D. A. Colón-Ramos, M. McAuliffe, and H. Shroff, “Spatially isotropic four-dimensional imaging with dual-view plane illumination microscopy,” Nat. Biotechnol. 31(11), 1032–1038 (2013). [CrossRef]   [PubMed]  

16. P. J. Keller, A. D. Schmidt, A. Santella, K. Khairy, Z. Bao, J. Wittbrodt, and E. H. K. Stelzer, “Fast, high-contrast imaging of animal development with scanned light sheet-based structured-illumination microscopy,” Nat. Methods 7(8), 637–642 (2010). [CrossRef]   [PubMed]  

17. U. Krzic, S. Gunther, T. E. Saunders, S. J. Streichan, and L. Hufnagel, “Multiview light-sheet microscope for rapid in toto imaging,” Nat. Methods 9(7), 730–733 (2012). [CrossRef]   [PubMed]  

18. P. J. Keller, M. B. Ahrens, and J. Freeman, “Light-sheet imaging for systems neuroscience,” Nat. Methods 12(1), 27–29 (2015). [CrossRef]   [PubMed]  

19. H.-U. Dodt, U. Leischner, A. Schierloh, N. Jährling, C. P. Mauch, K. Deininger, J. M. Deussing, M. Eder, W. Zieglgänsberger, and K. Becker, “Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain,” Nat. Methods 4(4), 331–336 (2007). [CrossRef]   [PubMed]  

20. S. Liu, T. Yu, P. Fei, D. Zhu, J. Nie, and Y. Li, “Three-dimensional, isotropic imaging of mouse brain using multi-view deconvolution light sheet microscopy,” J. Innov. Opt. Health Sci. 10(05), 1743006 (2017). [CrossRef]  

21. R. McGorty, H. Liu, D. Kamiyama, Z. Dong, S. Guo, and B. Huang, “Open-top selective plane illumination microscope for conventionally mounted specimens,” Opt. Express 23(12), 16142–16153 (2015). [CrossRef]   [PubMed]  

22. B. Migliori, M. S. Datta, C. Dupre, M. C. Apak, S. Asano, R. Gao, E. S. Boyden, O. Hermanson, R. Yuste, and R. Tomer, “Light sheet theta microscopy for rapid high-resolution imaging of large biological samples,” BMC Biol. 16(1), 57 (2018). [CrossRef]   [PubMed]  

23. A.K. Glaser, N.P. Reder, Y. Chen, C. Yin, L. Wei, S. Kang, L.A. Barner, W. Xie, E.F. McCarty, C. Mao, A.R. Halpern, C.R. Stoltzfus, J.S. Daniels, M.Y. Gerner, P.R. Nicovich, J.C. Vaughan, L.D. True, and J.T.C. Liu, “Multi-immersion open-top light-sheet microscope for high-throughput imaging of cleared tissues,” bioRxiv Prepr. 1–16 (2019).

24. A. Kumar, Y. Wu, R. Christensen, P. Chandris, W. Gandler, E. McCreedy, A. Bokinsky, D. A. Colón-Ramos, Z. Bao, M. McAuliffe, G. Rondeau, and H. Shroff, “Dual-view plane illumination microscopy for rapid and spatially isotropic imaging,” Nat. Protoc. 9(11), 2555–2573 (2014). [CrossRef]   [PubMed]  

25. B. Hu, D. Bolus, and J. Q. Brown, “Improved contrast in inverted selective plane illumination microscopy of thick tissues using confocal detection and structured illumination,” Biomed. Opt. Express 8(12), 5546–5559 (2017). [CrossRef]   [PubMed]  

26. R. K. Chhetri, F. Amat, Y. Wan, B. Höckendorf, W. C. Lemon, and P. J. Keller, “Whole-animal functional and developmental imaging with isotropic spatial resolution,” Nat. Methods 12(12), 1171–1178 (2015). [CrossRef]   [PubMed]  

27. A. Kumar, R. Christensen, M. Guo, P. Chandris, W. Duncan, Y. Wu, A. Santella, M. Moyle, P. W. Winter, D. Colón-ramos, Z. Bao, and H. Shroff, “Using Stage- and Slit-Scanning to Improve Contrast and Optical Sectioning in Dual-View Inverted Light Sheet Microscopy (diSPIM),” Biol. Bull. 231(1), 26–39 (2016).

28. Y. Wu, P. Chandris, P. W. Winter, E. Y. Kim, V. Jaumouillé, A. Kumar, M. Guo, J. M. Leung, C. Smith, I. Rey-Suarez, H. Liu, C. M. Waterman, K. S. Ramamurthi, P. J. La Riviere, and H. Shroff, “Simultaneous multiview capture and fusion improves spatial resolution in wide-field and light-sheet microscopy,” Optica 3(8), 897–910 (2016). [CrossRef]   [PubMed]  

29. P. Kennel, L. Teyssedre, J. Colombelli, and F. Plouraboué, “Toward quantitative three-dimensional microvascular networks segmentation with multiview light-sheet fluorescence microscopy,” J. Biomed. Opt. 23(8), 1–14 (2018). [CrossRef]   [PubMed]  

30. P. Fei, J. Nie, J. Lee, Y. Ding, S. Li, H. Zhang, M. Hagiwara, T. Yu, T. Segura, C.-M. Ho, D. Zhu, and T. K. Hsiai, “Subvoxel light-sheet microscopy for high-resolution high-throughput volumetric imaging of large biomedical specimens,” Adv. Photonics 1(01), 1 (2019). [CrossRef]  

31. K. N. Elfer, A. B. Sholl, M. Wang, D. B. Tulman, S. H. Mandava, B. R. Lee, and J. Q. Brown, “DRAQ5 and eosin (‘D&E’) as an analog to hematoxylin and eosin for rapid fluorescence histology of fresh tissues,” PLoS One 11(10), e0165530 (2016). [CrossRef]   [PubMed]  

32. S. Preibisch, S. Saalfeld, J. Schindelin, and P. Tomancak, “Software for bead-based registration of selective plane illumination microscopy data,” Nat. Methods 7(6), 418–419 (2010). [CrossRef]   [PubMed]  

33. S. Preibisch, F. Amat, E. Stamataki, M. Sarov, R. H. Singer, E. Myers, and P. Tomancak, “Efficient Bayesian-based multiview deconvolution,” Nat. Methods 11(6), 645–648 (2014). [CrossRef]   [PubMed]  

34. M. G. Giacomelli, L. Husvogt, H. Vardeh, B. E. Faulkner-Jones, J. Hornegger, J. L. Connolly, and J. G. Fujimoto, “Virtual hematoxylin and eosin transillumination microscopy using epi-fluorescence imaging,” PLoS One 11(8), e0159337 (2016). [CrossRef]   [PubMed]  

35. S. Preibisch, S. Saalfeld, and P. Tomancak, “Globally optimal stitching of tiled 3D microscopic image acquisitions,” Bioinformatics 25(11), 1463–1465 (2009). [CrossRef]   [PubMed]  

36. A. E. Carpenter, T. R. Jones, M. R. Lamprecht, C. Clarke, I. H. Kang, O. Friman, D. A. Guertin, J. H. Chang, R. A. Lindquist, J. Moffat, P. Golland, and D. M. Sabatini, “CellProfiler: image analysis software for identifying and quantifying cell phenotypes,” Genome Biol. 7(10), R100 (2006). [CrossRef]   [PubMed]  

37. K. M. Dean, P. Roudot, E. S. Welf, G. Danuser, and R. Fiolka, “Deconvolution-free Subcellular Imaging with Axially Swept Light Sheet Microscopy,” Biophys. J. 108(12), 2807–2815 (2015). [CrossRef]   [PubMed]  

38. T. Chakraborty, M. Driscoll, M. Murphy, P. Roudot, B.-J. Chang, S. Vora, W. M. Wong, C. Nielson, H. Zhang, V. Zhemkov, C. Hiremath, E. D. D. La Cruz, I. Bezprozvanny, H. Zhao, R. Tomer, R. Heintzmann, J. Meeks, D. Marciano, S. Morrison, G. Danuser, K. M. Dean, and R. Fiolka, “Light-sheet microscopy with isotropic, sub-micron resolution and solvent-independent large-scale imaging,” bioRxiv (preprint).

39. M. G. Meyer, M. Fauver, J. R. Rahn, T. Neumann, F. W. Patten, E. J. Seibel, and A. C. Nelson, “Automated cell analysis in 2D and 3D: A comparative study,” Pattern Recognit. 42(1), 141–146 (2009). [CrossRef]  

40. P. Lawson, A. B. Sholl, J. Q. Brown, B. T. Fasy, and C. Wenk, “Persistent Homology for the Quantitative Evaluation of Architectural Features in Prostate Cancer Histology,” Sci. Rep. 9(1), 1139 (2019). [CrossRef]   [PubMed]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1
Fig. 1 diSPIM schematic. A virtual light sheet generated by one of the micro-mirror scanners that scans in the y(y') direction rapidly illuminates the sample through the illumination objective at an oblique 45° angle from one objective. The emission signal from the sample is then collected by the detection objective lens positioned perpendicular to the illumination objective and imaged with the dedicated camera for that side. The stage moves in the x direction to create a 3D stack. The objectives move vertically to achieve extended z depth (A). The two light paths can then switch roles for illumination and detection alternatively for dual-view imaging. Compared to the traditional xyz coordinates, a new set of coordinates of x'A/By'z'A/B for diSPIM is used. X'A/B axis is along the illumination direction of left/right light path, z'A/B is the corresponding detection axis of view A/B (B), and y' is the same as y (C). BS: beam splitter. MM: micro-mirror scanner. TL: adjustable tube lens. DM + F: dichroic mirror + emission filter. Ill obj: illumination objective. Det obj: detection objective.
Fig. 2
Fig. 2 Comparison of PSFs in x'y', x'z' and y'z' views, between one of the single-views and the dual-view deconvolution results, of 500 nm fluorescent beads phantom. All of the images are maximum intensity projections of shifted x'y' stacks along the z' axis. The bottom Gaussian fitted intensity plots are along x', z' and y' directions from left to right, based on the beads indicated with blue solid lines in single-views and red dash lines in dual-view deconvolved results. All scale bars denote 10 μm.
Fig. 3
Fig. 3 Deconvoluted volume of D&E stained buccal cells sample (A) and the minimum intensity projections comparisons in three views between single-view and deconvolution results (B-J). The green arrows and blue circles in A, B and C indicate the same region of the sample. Note that rotating the data to an appropriate orientation could differentiate cells that are overlapped in 2D slices. Also, the resolution in y'z' and x'z' have been improved significantly by dual-view fusion and deconvolution (D-G, I-J). Scale bar in A: 150 μm, in B, C, H: 100 μm. Decon: Dual-view deconvolved. MIP: minimum intensity projection.
Fig. 4
Fig. 4 Dual-view deconvolved volume reconstruction (B, 11,151 × 2,002 × 355 voxels, 4.3 mm × 0.78 mm × 0.14 mm) from a large D&E-stained, cleared prostate biopsy (A, 37,955 × 6,860 × 1,100 voxels, 14.8 mm × 2.7 mm × 0.4 mm, single-view reconstruction shown), and selected ortho-sections in XY at depth of about 65 μm (C), XZ (D) and YZ (E). The locations of the ortho-sections in the sample are indicated with the orange, blue and green boxes in B. The border colors in C-E match the color of the boxes in B. Zoomed-in XY ortho-slices (location indicated by the black box in C) at different depths are also shown in F. Scale bar in A: 2 mm, B-D: 500 μm, E: 200 μm, and F: 100 μm.
Fig. 5
Fig. 5 Small areas in XY, XZ and YZ planes from SPIM-A, SPIM-B and dual-view deconvolved (Decon) prostate data sets were chosen to compare high resolution local image details. Each image was a minimum intensity projection of 11 sequential images to avoid z offset among SPIM-A, SPIM-B and Decon views. Inverted intensity profiles were plotted among the same locations in SPIM-A, SPIM-B and Decon, indicated by lines in the SPIM-A image column. Scale bar: 15 μm.
Fig. 6
Fig. 6 Cell nuclei counts in the same volume from SPIM-A, SPIM-B, and Decon voumes, and from the approximate same volume from H&E slides. Decon has significant more cell number than the two single-view results and has a closer cell number to H&E images.
Fig. 7
Fig. 7 Normalized X, Y and Z projections in frequency domain, with higher frequency bandwidth in dual-view deconvolved prostate images (Decon-A + B) versus SPIM-A, SPIM-B, or SPIM-A deconvolved (Decon-A) data sets. The inset in A shows a zoomed-in area in the plots, indicating removal of high-frequency striping artifacts by dual-view deconvolution.

Tables (1)

Tables Icon

Table 1 Integration of Normalized X, Y and Z projection in frequency domain

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.