Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Multiview microscopy of single cells through microstructure-based indirect optical manipulation

Open Access Open Access

Abstract

Fluorescent observation of cells generally suffers from the limited axial resolution due to the elongated point spread function of the microscope optics. Consequently, three-dimensional imaging results in axial resolution that is several times worse than the transversal. The optical solutions to this problem usually require complicated optics and extreme spatial stability. A straightforward way to eliminate anisotropic resolution is to fuse images recorded from multiple viewing directions achieved mostly by the mechanical rotation of the entire sample. In the presented approach, multiview imaging of single cells is implemented by rotating them around an axis perpendicular to the optical axis by means of holographic optical tweezers. For this, the cells are indirectly trapped and manipulated with special microtools made with two-photon polymerization. The cell is firmly attached to the microtool and is precisely manipulated with 6 degrees of freedom. The total control over the cells' position allows for its multiview fluorescence imaging from arbitrarily selected directions. The image stacks obtained this way are combined into one 3D image array with a multiview image processing pipeline resulting in isotropic optical resolution that approaches the lateral diffraction limit. The presented tool and manipulation scheme can be readily applied in various microscope platforms.

© 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

Optical trapping has developed into a widely used approach in manipulation of biological objects. The possibility of handling microscopic particles without mechanical contact offers advantages in practically every area of experimental biology. The typical fundamental parameters of optical traps - micrometer trap size and pN exerted force - make it ideally suited to manipulate biological objects in 3D as well as to measure forces exerted by biological systems. In fact, thanks to continuous development the state of the art represents displacement measurements with sub-nanometer accuracy [1] and forces with femtoN sensitivity [2]. Among countless application examples, like study of DNA and DNA-associated proteins [3,4], mechanical protein folding-unfolding [5,6], study of molecular motors at the single-molecule level [7,8], etc., optical trapping offers great advantages in the manipulation of whole cells, too. Optical trapping of whole cells has been introduced in the very early phase of the development of the approach [9], and has been pursued subsequently [10,11]. However, it soon became apparent that direct optical trapping of live cells suffers from serious issues. Cells are typically characterized by a low refractive index contrast to water, which results in low optical trapping forces. The structural complexity of cells results in optical inhomogeneity that makes optical manipulation a complicated procedure [9,12]. Trapping occurs at high refraction index organelles: the actual point of fixation cannot be predicted. In conclusion, in the case of direct optical manipulation of cells the trapping strength and position are not known and cannot be precisely controlled. Furthermore, the high laser intensity at the focus is potentially harmful to the cell [1317]. While careful selection of the wavelength of the trapping light can reduce the damage, cell viability is always a problem and it has to be assessed in every experiment.

The above mentioned inherent problems of direct cell trapping can be eliminated by applying indirect manipulation, that is, by decoupling the trapping light from the live cell to be manipulated. In this scenario, an intermediate object is attached to the cell, and the trapping light interacts with this object. So far this was only achieved by the application of silica microbeads attached to the cell, as demonstrated for instance in studies to investigate mechanical properties of red blood cells [18]. Even greater improvement can be achieved with the use of purpose-built manipulators as intermediate objects (for an example, see Fig. 1(a)). Such microtools can be fabricated with an optimized shape for high precision trapping, where a set of small radius spherical handles provide well-defined trapping points and large trapping forces by using high refractive index materials [19]. Photodamage can be prevented for harmless cell manipulation by attaching the cell to a structural element that is positioned micrometers away from the trapping beams. Recently we introduced such an indirect optical micromanipulation method [20,21] where single cells could be manipulated with 6 degrees of freedom (6DoF) by the use of shape-optimized microtools produced by two-photon polymerization (TPP). The microtool, composed of SU-8 photoresist (n=1.6), is operated by holographic optical tweezers (HOT, Fig. 1(b)) and the cell is attached to them by biochemical means. We have also shown that positional accuracy and stability in the range of sub-100 nm can be routinely achieved. In this study, we present an application that highlights the benefits of the indirect manipulation method using shape-optimized microtools. To demonstrate its capabilities, we apply the method to improve the imaging of a wide-field fluorescent optical microscope by substantially increasing the axial resolution.

 figure: Fig. 1.

Fig. 1. The scheme of the polymer micromanipulator and its application to indirectly manipulate a single cell for multiview microscopy. (a) The model of the manipulator showing its main functional parts. Three spheres provide trapping sites for three holographic optical traps, while a concave shaped attachment disk provides a binding site for spherical cells. (b) The spatial arrangement of the manipulator-cell couple in the sample space relative to the optical axis of the trapping and observing objective. Pink cones indicate the trapping beams. The cell is rotated around the dashed-line axis for the multiview microscopic observations (parallel to axis y). (c) Scanning electron microscopic image of the cell manipulator structure.

Download Full Size | PDF

The elongated point spread function of an optical microscope results in a limited axial resolution of the three dimensional image, the transversal resolution being typically 3-5 times better than that in the direction along the optical axis. This disadvantage originates in the fundamental properties of optical imaging, but new procedures are being elaborated continuously to reduce this most unwelcome effect. The advantage of improved axial resolution is evident when studying cellular functions and events that are coupled to inherently three-dimensional cellular structures. For example, the actin cytoskeleton rearrangement in single cells upon immunological synapse formation could be observed in greater detail by relying on a lattice light sheet microscope providing isotropic resolution [22]. Another characteristic and very effective method is 4Pi microscopy [23], where the sample is observed by two large numerical aperture objectives positioned confocally in opposite direction both for delivering fluorescence excitation and emission detection. However, this arrangement is too complex for a number of applications, and different modifications of the classic single-sided, one objective microscopy also yields reasonable alternative solutions. Examples are those of structured illumination [24], the application of special pupils [25], or the combination of holographic fluorescence microscopy with confocal detection [26]. A straightforward way to eliminate the anisotropic resolution is the reconstruction of the sample from observations taken at different directions, either using tomography [2731], or superposition of 3D image stacks [32].

The latter procedure, often termed as multiview microscopy where image stacks obtained from different observation directions are used [33], depends on an effective method to access these directions of the sample. Such methods have already been applied successfully for multicellular systems where the sample was embedded in a gel matrix and rotated mechanically around an axis perpendicular to the optical axis [34,35], or a complex objective system is built around the sample [36]. When imaging single cells, an appropriate manipulation scheme has also to be applied that makes the needed orientations possible. The versatile technique of optical micromanipulation has already been used for rotational manipulation at the single cell level. This method naturally works in an aqueous environment, where the cells can be easily studied under physiological conditions. The torque for such rotation may originate in the angular momentum of the light forming the trap [37,38], the shape of the trapping light beam [39,40] or the shape of the trapped object [41,42]. 3D imaging of single cells was already approached with direct cell trapping by holographic optical tweezers, built on a spinning disk confocal microscope when several traps grabbed optically dense spots inside a cell enabling its positional manipulation [32]. Recently, an optofluidic cell rotator was also introduced for improved cell imaging [43], where the cell is held by counter propagating optical tweezers in a microfluidic channel such that it is free to rotate around an axis perpendicular to the channel direction and the fluid flow. Since this axis was not in the center of the channel, the non-symmetric force due to the parabolic flow velocity profile caused continuous, uninterrupted rotation of the cell during observation.

However, for the true gain in the size of the point spread function and in achieving isotropic resolution for 3D single cell imaging, a more precise and better controlled manipulation scheme with appropriate accuracy has to be applied. In this work, we show that our indirect optical manipulation method that is based on a purpose-built polymer microtool (Fig. 1(a)) is capable of positioning cells with the needed precision and stability. Applying this manipulation technique, we can record wide field z-scan image stacks taken from different viewing directions (rotation axis shown on Fig. 1(b)). Fusing these recordings into a single 3D stack, we realize fluorescence imaging with substantially improved axial resolution, which we validated with cell-attached fluorescent nanobeads. We show that our method can reconstruct the 3D structure of fixed white blood cells (K562) with fluorescently stained mitochondria. The resultant images of the improved resolution demonstrate the power of the indirect cell manipulation method.

2. Methods

The experimental setup consists of the combination of a conventional, wide-field fluorescent microscope completed with holographic optical tweezers. Here, the same high NA microscope objective is used to trap and manipulate the cell-attached microtools, as well as to excite the fluorophores and to collect the emitted light. We used the optical tweezers to rotate the cells into pre-defined orientations, to translate them through the observation plane and to hold them steady during the fluorescent imaging.

2.1 Microtool design and fabrication

The shape of the microtools was directed by the experimental details with regard to optimal manipulation efficiency. The structure is held by three optical traps produced by the holographic optical tweezers, the points of trapping are provided by the three spheres of the structure with diameter of 4 µm (Fig. 1(c)). The number of the trapping spheres was reduced to the minimal three required for 6 degrees of freedom (6DoF) actuation. Still, very good stability of the cell position could be achieved due to the following conditions: The cell is held about 10 micrometers away from the trapping light beams such a way that the symmetry axis of the microtool-cell complex is perpendicular to the optical path (Fig. 1(b)). Consequently, both lateral and axial motions of the cell translate into primarily lateral motions of the trapped microtool spheres; the trapping forces are known to be the highest for displacement in this direction ensuring maximal stability. Furthermore, the cell is attached to the structure through a concave disk of 8 µm radius of curvature, designed to accommodate the spherical shape of the cells of 12-20 µm diameter for maximum attachment probability and stability.

The structures were built by two-photon polymerization (TPP). TPP was carried out in the system described in detail recently [44]. The SU-8 2007 material (Microchem GmbH, Germany) was polymerized with the light from an ultrashort-pulsed laser ($\lambda$ = 780 nm, pulse length = 100 fs, repetition rate = 100 MHz, C-Fiber A, Menlo Systems, Germany). The single beam of the laser was split into four beams with a spatial light modulator (Pluto NIR, Holoeye GmbH, Germany) and these steady beams were focused by a Zeiss Achroplan 100X 1.25 NA oil immersion objective into a thin layer of the resin atop a microscope cover slide that was translated in 3D by a piezo scanner system (P-124 731.8L and P-721.10, Physik Instrumente GmbH, Germany). The scanning speed was between 1 and 32 µm/s at a laser intensity of 3 mW. Standard procedure was applied for the development of the illuminated resin: post-bake at 95 °C for 10 mins, development in mrDev 600 (Microchem GmbH, Germany), followed by rinsing in ethanol. Figure 1(c) shows the scanning electron microscopic image of a prepared structure. The parallel polymerization scheme enabled us to routinely fabricate about 1500 structures overnight, generally enough for a dozen of samples. The application of similar two-photon polymerized trapped structures has been published already by others [19,45] and by us [20,46,47].

2.2 Microstructure functionalization, cell attachment and labeling

Attachment of the cells to the structures was achieved by the affinity of the protein concanavalin A (ConA) towards the glycocalix of mammalian cells. The surface of the structures had to be functionalized but in contrast to our earlier work [20] the cells themselves didn’t need to be treated. Shortly, the functionalization of the SU-8 microtools started by an acid-treatment (30 mins incubation in the mixture of 1M nitric acid and 0.1M cerium(IV)-ammonium nitrate at RT (room temperature)) and a subsequent PEG-diamine coating (15 mM methanol solution of MW 2000 PEG-diamine at RT). In the next steps sulpho-NHS biotin (90 mins incubation in 1 mg/mL PBS (phosphate buffered saline) solution at RT) and streptavidin (overnight in 100 nM PBS solution at 4 °C) were bound to the surface. Finally, the structures were incubated in 1 mg/mL solution of biotinated ConA for 1 hr at 4 °C, then washed thoroughly with water and dried.

We used fixed K562 white blood cells in our experiments (LGC Standards, UK, cat no. CCL-243); the fixation was carried out as follows. First, the cell suspension was centrifuged twice for 7 mins at 125 RCF (relative centrifugal force) each to replace their growth medium with PBS; they were resuspended in PBS to obtain $\sim 10^6$ cell/mL. 750 µL of this suspension was mixed with 750 µL of 4 % formaldehyde in PBS and incubated at 4 °C for 20 mins while shaking. It was followed by two washing steps with centrifuge parameters as before. Eventually the cells were resuspended for the desired density ($\sim 10^6$ cell/mL) with PBS. The fixed cells were then decorated with fluorescent beads or stained with an organelle-specific fluorophore.

Measurements with bead-based resolution estimations were performed with 100 nm diameter, cell-attached fluorescent beads (CAFR100NM, Magsphere Inc., USA, exc. max.: 540 nm, em. max.: 584 nm), the diameter of which was below the resolution of the imaging system. First, 1 µL of the original bead solution was diluted 500x in PBS buffer, then centrifuged (14000 RCF) for 30 mins followed by the careful removal of 90 % of the supernatant obtaining $\sim$50 µL suspension; this second step was repeated twice. Next, 1 mL of the fixed cells was incubated with the entire bead suspension for 45 mins in dark. After the incubation, the cells were again washed in PBS twice for 3 mins each to remove the unbound beads. For the demonstration of isotropic cell organelle imaging with our method, the cells’ mitochondria were fluorescently stained (Mitotracker Deep Red, Thermo Fisher Scientific, exc.: 642 nm, em.: 662 nm). First, the mitochondrion stain was added into 1 mL of cell suspension to reach 6000x dilution, then the cells were incubated with it for 1 hr in dark and finally a washing step was applied similarly to the last step of bead attachment. Once the cells were labelled, they were collected in PBS containing 0.1 % Tween20 surfactant to prevent their adhesion to the glass walls of the sample holder. Approximately 10 µL of this suspension was dropped onto the functionalized micromanipulators, the droplet was gently stirred to remove the structures from their glass substrate and about 5 µL of this cell-manipulator mixture was pipetted onto a cleaned coverslide (24 mm x 40 mm). A two-sided tape was used as spacer and a second coverslide was used to close the sample chamber; the cell manipulation then took place within an approximately 80 µm high liquid layer of the sandwiched sample.

2.3 Microscopy and optical trapping

The optical trapping-assisted fluorescence observation was performed in an extended Nikon Eclipse TI inverted fluorescence microscope. The complete optical layout including the trapping beam management and the fluorescent excitation/observation path is shown on Fig. 2. Light for the optical tweezers came from a continuous wave fiber laser (L, $\lambda$=1070 nm, P=10 W, THFL-1P400-COL50, BKtel Photonics, France). The holographic optical tweezers (HOT) was based on a reflective phase only spatial light modulator (SLM, PLUTO NIR, Holoeye, Germany). A 4f lens system (lenses RL1 and RL2) was used to project the plane of the SLM to the back aperture of the objective [48] and a high NA microscope objective (O on Fig. 2, 60X, water immersion, NA=1.2, Olympus UPlanSApo) to generate the trapping foci in the sample (S). The near infrared light of the optical tweezers was coupled into the microscope with a low pass dichroic mirror (DM, cut off: $\lambda$=850 nm) so it did not interfere with the fluorescence excitation/observation. This optical system enabled the generation, and the totally controlled 3D motion of 3 trapping focal spots. The highest performance for the holographic optical traps was ensured by applying a wavefront correction hologram for the complete trapping optical system determined with the method of Cizmar [49].

 figure: Fig. 2.

Fig. 2. The optical layout of the imaging system. L: trapping laser source, BE: beam expander to slightly overfill the SLM surface, SLM: spatial light modulator, RL1 and RL2: relay lenses to project the SLM surface to the entrance pupil of the objective, DM: dichroic mirror that reflects the trapping beam into the objective but transmits the fluorescence beams, FF: fluorescence filter set, FS: fluorescent light source, CAM: camera, O: objective, S: sample. The inserted hologram creates the three trapping focal spots in the sample plane.

Download Full Size | PDF

For the required velocity of the manipulation of multiple foci, a fast calculation of the beam-shaping holograms was needed. We used an NVIDIA CUDA GPU (GeForce GTX 660 with 960 CUDA cores) to calculate the holograms as described in detail in [44], implementing the weighted Gerchberg-Saxton (GSW) algorithm [48]. With our procedure, we were able to calculate up to 10 foci with 10 iterations within the refresh cycle of our SLM (16.67 ms). This rate is sufficient for the real time continuous repositioning of the 3 traps necessary for the orientation of our microtools. We created a special user program for the actuation of the cell manipulators and for the synchronized control of the fluorescence recording camera. Our system enables real time, user-controlled manipulation of cells with 6DoF. We note that manipulation of a single structure with 3 holographic traps can be achieved with the simple "prisms and lenses" algorithm [48] that requires only CPU-based calculation for real time speed. Also, a GPU-based implementation of the GSW algorithm is publicly available (open-source) from: https://github.com/MartinPersson/HOTlab.

The fluorescent part of the microscope used a metal halide light source for excitation (FS on Fig. 2, model: Lumen 200S, Prior Scientific, Inc., USA) and filter sets (FF) that match the fluorescence characteristics of the fluorescent beads or that of the fluorophore used for cell staining (filter sets 49008, exc.: 560/40 nm, em.: 630/70 nm for the beads and 49006, exc.: 620/50 nm, em.: 700/70 nm for the cellular stain, both from Chroma Technology Corp., USA). The fluorescent images were recorded by an 1004x1002 pixels EMCCD camera (CAM, Rolera EMC2, Qimaging, Canada), controlled by our trapping software; the imaging train defines 120 nm lateral pixel distance on the recorded images. The bright-field images were taken with a CCD camera (GS3-U3-23S6M, Point Grey Research Inc., Canada).

2.4 Trapping of a cell and data acquisition

The data acquisition process included fluorescent sectioning of the cell along the optical axis at various orientations and its rotation to these orientations, repeatedly. It was the task of the HOT to move the cell along the z axis to pre-defined positions for sectioning, to hold the cell as steady as possible at these positions during image acquisition and finally to rotate it precisely to the orientations required for the multiple-angle imaging. Before these, however, a free-floating cell had to be attached to the functionalized and trapped microtool (see Visualization 1). The procedure was carried out similarly as reported in our earlier works [20,21]. First, the structure was trapped with the three trapping foci. Then its attachment disk was oriented towards the cell. Finally, it was pushed against the cell by its attachment disk for a few seconds while the ConA bound to the cells surface; the cell is now indirectly trapped and free to be actuated through the manipulator with 6DoF (see Visualization 2). 90 mW laser power was measured for each trapping beam at the objective entrance pupil; the transmittance of the objective at 1070 nm is approx. 50 %, so each beam delivers $\sim$45 mW in the focus. After taking hold of the cell, it was oriented such that the symmetry axis of the cell-microtool complex was perpendicular to the optical axis (Fig. 1(b)). The complex was rotated around this symmetry axis (dashed arrow in Fig. 3) during the acquisition process. The lateral positional stability of the indirectly trapped cell was determined by video-microscopic imaging of the cell-microtool complex and image analysis using a built-in MATLAB (The Mathworks Inc, Natick, Ma, USA) local feature detector function "detectSURFFeatures".

 figure: Fig. 3.

Fig. 3. The concept of the application of the cell manipulator microtool for multiview imaging. Step 1: HOT-assisted data acquisition via alternating cell translations to pre-defined positions (pos. 1 through pos. N) and image recordings at each position. Step 2: return the cell to pos. 1 and its rotation to a new orientation.

Download Full Size | PDF

The imaging process, as illustrated in Fig. 3 started with the fluorescent sectioning (z-scan) of the cell at the first orientational position (0 degree). Here, the cell was translated with the HOT along the optical axis through the static observation plane (microscope objective is not moving) in 250 nm steps (Step 1 on Fig. 3). At each vertical position, 3 fluorescent images were averaged with the EM-CCD camera using 100-120 ms integration time. The EM gain and integration time were set to avoid image saturation. In a typical sectioning images were recorded at about 80 positions spanning the approx. 20 µm diameter of the cell. After recording one stack, the cell was translated to its starting position and rotated 22.5 degrees with the optical trap (Step 2 on 3) for the next sectioning sequence. This process was repeated 8 times in the fluorescent bead experiments to complete a half rotation yielding altogether 9 sets of data (0-180 degrees). In the experiments imaging cells with the stained mitochondria the process was carried out at 5 rotational positions from 0 to 180 degrees with 45 degrees steps. The imaging in each rotational position resulted in a 3D data array of m-by-n-by-z dimension, where m and n are the dimensions of each frame in pixels and z is the number of frames; m and n were typically 400.

2.5 Image data processing

Methods for processing the image stacks were adopted from the literature of multiview microscopy [33,36,50]. It consisted of three main steps: i) pre-processing, where the out of focus intensity signals were largely removed from the data arrays by deconvolution; ii) the registration of the image stacks obtained from the different directions; iii) fusion of the deconvolved images to yield the single output 3D image with improved resolution. All steps were performed with home-developed routines coded in MATLAB; the calculations were performed on an NVIDIA Titan XP GPU equipped desktop PC relying on the built-in CUDA support of MATLAB functions.

Prior to the deconvolution the data was trimmed and interpolated as follows: first, the 3D arrays were cropped leaving only the cells and its direct surrounding on the pictures; second, each data array was interpolated along their own z axes so that the data points are separated by 120 nm in this direction to be equal to the lateral pixel distance. The 3D deconvolution of each data array was performed using a PSF measured with the fluorescence filter sets used in the experiments; nanoholes of $\sim$100 nm diameter, fabricated into a reflective gold layer were used as point-like light sources. We used the iterative Richardson-Lucy (RL) deconvolution algorithm. The iteration numbers were determined for beads from the relative change of the consecutive deconvolved stacks and from the dimensions of the deconvolved bead images obtained with a Gaussian fitting and for the mitochondrion-stained cell from the power spectrum of the deconvolved array. The determined iteration number for the fluorescent bead experiment was 26 and for the mitochondria-stained sample 60.

In the image registration procedure the deconvolved stacks of different orientations were precisely aligned using a correlation-based algorithm in MATLAB. In the first step of registration the data arrays were manually rotated around the experimental rotation axis by the angles used to rotate the structures in the measurements (multiples of 22.5°) leaving the first measurement (0°) as reference. Then, for the precise registration rigid transformations, i.e. translation and rotation of the data arrays were applied with an iterative direct search method. Here, first rotation axes were defined in the 2$\pi$ steradian solid angle by $\theta$ (polar) and $\phi$ (azimuth) angles, with 45° angular distance. The manually rotated array was then rotated around these few axes in the −15° to 15° range in 1° steps and the translational correlation between the rotated and the reference stacks was calculated for each position. Then, the axis resulting in the maximum correlation coefficient was chosen and a set of new axes were defined in the solid angle between this and its neighboring axes with the half of the angular distance as before. In the next iteration step, the manually rotated stack was rotated around these new axes and the correlation was calculated again. This iterative process always converged within 10 iterations, which was confirmed by the maximum correlation coefficient showing a plateau (Appendix 2, Fig. 11(a)). The process eventually yielded an axis of rotation, a rotation angle around it and 3 translation values along the Descartes axes that showed the highest correlation between the reference and the aligned array.

Finally, the images were fused to yield a single 3D stack as an output. Here, the deconvolved and interpolated data arrays of the different directions were first transformed by the determined translations and rotations. For some samples we observed photobleaching of the cells, which was corrected for before fusion with a normalization step: the data arrays were normalized to the reference one with the integrated fluorescent intensity of their 1500 most intense pixels. Two fusion methods were compared to find the final intensity of any given pixel location: the arithmetic average of the pixel intensities of the aligned arrays, and the weighted average of the 3D Fourier transforms of the stacks were calculated at each location of the frequency space using the following equation [50]:

$$I_{f}= \sum_{j=1}^{N}(w_{j}\: I_{j})$$
where $N$ is the number of image stacks, $I_{j}$ is the spectral data of image stack $j$, and $w_{j}$ are the weights calculates as follows:
$$w_{j}=\frac{\sqrt{\left |I_{j} \right |}}{\sum_{i=1}^{N}\sqrt{\left |I_{i} \right |}}$$
Finally, the $I_{f}$ average was inverse Fourier-transformed to get the reconstructed 3D array in the real space.

3. Results

3.1 Indirect optical manipulation with 6 degrees of freedom

The most important result of the present work is to demonstrate that the 6 degrees of freedom manipulation of single cells using polymer microstructures and HOT can easily support multiview microscopy to increase optical resolution. The cells are attached to the microtools within seconds (Fig. 4(a)-(c) and Visualization 1) and the subsequent manipulation allows for holding them firmly, translating them within the field of view in any direction at tens of micrometers distance, and most importantly in this case, allows for their precise and total rotational control. The cells can be rotated around any of the three axes quickly so that the full solid angle range is accessed within seconds (see Visualization 2), therefore the cell can be easily viewed from any direction. The indirect manipulation also ensures that the cell exposure to the trapping beams that grab the manipulators by their spherical parts becomes negligible when the cell-structure complex is aligned perpendicularly to the optical axis; in other orientations the cell is still micrometers away from the intense foci of the beams. Although the manipulator’s attachment disk touches the cell directly, it covers only a small, 5.5 % surface area considering a typical cell diameter of 16 µm; this ratio can be further reduced if the contact area for live cells is an issue. Figure 4(c)-(e) demonstrates that the trapping foci are about 10 micrometers away from the cell at all orientations for this particular structure.

 figure: Fig. 4.

Fig. 4. The process of cell attachment to a microtool and their total positional control. (a) Bright-field image of the three trapping foci (three bright spots on the left side) and a yet untrapped microtool (on the right side); the attachment disk and connector rods are defocused. (b) The microtool trapped and oriented with its disk towards the cell that sits on the bottom of the microfluidic channel. (c) The cell is attached to the microtool and elevated from the supporting glass. (d) The indirectly trapped cell is rotated by 90 degrees relative to its orientation on panel c. (e) The positional distribution of a given point on a fluctuating trapped cell; the insert shows the distribution zoomed-in.

Download Full Size | PDF

Even though the trapped structure-cell complex is firmly held, it of course undergoes thermal fluctuation. This motion in our case may blur the observed image of the cell therefore it needs to be accounted for. The positional stability of the cells was measured in order to evaluate the degree of this blur during an image acquisition session (Fig. 4(e)). The cells were held in place by a steady trap and 2000 frames were recorded with 1 ms exposition time. Analyzing the cell positions we found that the half width of the position fluctuation of the part of the cell that is the remotest from the manipulator and fluctuates the most is around 80-90 nm along the symmetry axis and 140-160 nm in the perpendicular direction (see Appendix 1, Fig. 10); from these values the angular fluctuation of the structure-cell couple was calculated to be 0.34 degrees on average. This fluctuation poses an upper limit for the degree of image blur of any observable fluorescent point source in the cell.

3.2 Resolution improvement along the optical axis

For multiview imaging, the firmly trapped cell-microtool couple is first oriented with its symmetry axis perpendicular to the optical axis. An image stack is then recorded by translating the cell along the optical axis. Multiview recordings are realized by repeating this scan with different rotational orientations around the symmetry axis. For further details, see Methods.

The enhancement of the axial resolution was checked with cells decorated with 100 nm diameter fluorescent beads. Our goal was to obtain images of these beads that have uniform sizes along all three dimensions. The beads attached to the outside of the cell membrane served as point-like sources characterizing the resolution improvement, a standard procedure in multiview microscopy [36]. Nine image sequences were recorded at orientations of multiplies of 22.5 degrees, covering the range from 0 to 180 degrees. First, these nine 3D data arrays were deconvolved with the measured point spread function (PSF) of our system using the Richardson-Lucy (RL) algorithm. The halt of this iterative algorithm for the bead images was determined by i) comparing the average width of the deconvolved bead images along the x and y axes obtained by a Gaussian fit to the lateral resolution of our system (w = 0.61$\lambda$/NA = 310 nm, where $\lambda$ = 610 nm and NA = 1.2) and by ii) calculating the relative difference between the $i^{th}$ and the $(i-1)^{th}$ deconvolved image according to the following formula:

$$\sum_{x}^{N}\left | S_{i}(x)-S_{i-1}(x) \right |/\sum_{x}^{N}S_{i-1}(x)$$
where $S_{i}(x)$ is the intensity of the image stack at the pixel of coordinate x after the $i^{th}$ iteration and $N$ is the number of pixels. The halt of the iteration was linked to that number where the average 1/e width of the Gaussian fits of the bead images reaches 310 nm (Fig. 5(a)) and where the relative difference (Fig. 5(b)) levels; therefore we stopped the deconvolution after 26 iterations. Figure 6(a) and (b) shows the view of a 3D image stack from a direction perpendicular to the optical axis (i.e. axis x on Fig. 1(b)) after recording and after deconvolution. It is apparent that deconvolution removes most of the out-of-focus intensities (noise) but keeps the elongated, most intense parts of the bead images.

 figure: Fig. 5.

Fig. 5. Evaluation of the required deconvolution iteration number and of the required number of 3D stacks in the fusion step. (a) The width of eight selected bead images along the x axis as the function of deconvolution iteration number. The widths were determined with a Gaussian fit to an intensity trace taken across the maximum intensity pixels of the bead images; open circles: calculated widths; the red line connects the average of the widths. (b) Relative differences between successive arrays, calculated with Eq. 3, as the function of deconvolution iteration number. (c) Average widths of six selected bead images along the 3 coordinate axes after fusion of various number of aligned stacks (1 means a single deconvolved image). Fourier-based fusion was used and the width was determined with a Gaussian fit similarly as in panel a.

Download Full Size | PDF

 figure: Fig. 6.

Fig. 6. Maximum intensity projections (MIP) of the 3D fluorescence intensity data arrays recorded on a trapped cell that was labelled with 100 nm fluorescent beads. MIP of an original, unprocessed data array recorded on the entire cell (a), of a deconvolved array (26 iterations) (b), of a fused array with arithmetic averaging (0°, 45°, 90° and 135° orientations) (c) and of one fused with the Fourier transform-based method (d). e-h Enlarged MIP images of four beads in the highlighted areas of the original, deconvolved, averaged and Fourier-fused arrays, respectively. The curves on the inset of (g) show the intensity traces over two adjacent bead images from the arithmetically averaged (blue) and Fourier-fused (red) arrays along the line shown on g. For better visualization of the 3D arrangement of the bead images see Visualization 3.

Download Full Size | PDF

After deconvolution, the image stacks were spatially registered resulting in precisely overlapping bead images, which is a pre-requisite for the successful fusion (Appendix 2, Fig. 11(b)-(d)). The center positions of the bead images on each aligned stack differ slightly more than one pixel from the respective image centers on the reference stack, showing the effectiveness of the registration procedure (Appendix 2, Fig. 11(b)). We reasoned the number of directions to fuse according to Fig. 5(c) that shows the widths (at 1/e of the maximum) of selected fused bead images as determined with a Gaussian fit. The fusion of only 2 (perpendicular) directions already reduces the widths along the optical axis from about 880 nm to about 708 nm. Increasing the number of fused images results in a decrease of the axial width to about 600 nm for 9 orientations, displaying a weak minimum (580 nm) at 4 fused directions (0°, 45°, 90° and 135°). Interestingly, the lateral widths slightly increase with the number of fused arrays but level after 4 arrays. Although there was no significant difference between 4, 5 or 9 directions, because of the presence of the minimum of the axial width we used the above 4 directions to assess the resolution improvement.

Considering fusion, there’s no standard theory for the fusion of the image stacks of the various directions, several methods are used in the literature. We chose to use two methods to illustrate their effect on resolution improvement: the arithmetic averaging of the stacks in the real space and their weighted averaging in the Fourier-space. The arithmetic average is used as this is the most simple and intuitive method, while the Fourier-based method is one of the best established in the field of multi-view microscopy [33,36,51] that preserves the most of the information content. The combined images are considerably shortened along the optical axis for the two fusion methods when compared to the originally elongated bead images, as illustrated by the intensity projection images (Fig. 6(a)-(d)); at the same time, the two fusion methods yield slightly different results. The enlarged regions of the 4 selected beads (Fig. 6(e)-(h)) emphasize more this radical shortening. They also illustrate the difference between the two fusion methods: the arithmetically averaged images are somewhat broader than the Fourier-averaged ones; as a result, images of two adjacent beads can be separated with higher contrast using the Fourier method (Fig. 6(g) inset). We have to note that in the Fourier-fused images small sidelobes tend to appear which are only about 5-15 % of the bead image maxima. Considering that the Fourier-based method yields larger resolution improvement along the optical axis, it keeps all the image information and it is in accordance with the literature, we use this fusion method to prove the resolution improvement for the bead and for the mitochondrion-stained images.

The resolution improvement, already evidenced from the maximum projection images was quantified by comparing the widths of selected bead images obtained again by Gaussian fitting along the three spatial axes (Fig. 7(b)) on the original, the deconvolved and the Fourier-fused arrays (the coordinate axes are those of the reference data array). The averaged 1/e width along the optical axis was reduced from 1.37 µm (original array) to 0.58 µm (fused array). This 2.4 times reduction is partly attributed to the deconvolution step but also stems from the fusion of the images taken at different orientations. The axial improvement was accompanied with a reduction in the lateral direction, which, however is only due to the deconvolution step. Interestingly, the fusion reversed this decrease by about 20 %, which may be attributed to the mentioned fluctuation of the cell, to the not completely rigid attachment of some beads to the cell membrane or even to the slight imperfection of the alignment. The intensity traces shown on Fig. 7(a) also display convincingly that along the optical axis the width decreases during the whole process while in the lateral direction mostly during the deconvolution step.

 figure: Fig. 7.

Fig. 7. The resolution improvement characterized with Gaussian fit of line traces along bead images. (a) Normalized intensity traces over the bead image marked on Fig. 6(a) with the arrow, along the three axes taken from the original, deconvolved and fused arrays. (b) Average 1/e widths calculated with selected bead images from the original, deconvolved and Fourier-fused arrays along the three axes. The widths were determined with a Gaussian fit; the fusion included 4 orientations.

Download Full Size | PDF

3.3 3D structure of a labelled cell

The real relevance of our multiview imaging technique lies in the imaging of biological objects. Therefore, we also evaluated its performance in the imaging of fluorescently labeled cells: we selectively stained the cell’s mitochondria (Fig. 8) and performed its multiview imaging. Based on our previous findings, we recorded and fused arrays of 4 distinct orientations to reconstruct the mitochondria’s 3D arrangement with improved axial resolution. Deconvolved and spatially aligned image stacks of a mitochondria stained cell are visualized on Fig. 8. Note that each of the single view image stacks (Fig. 8(a)-(c)) is blurred along a different direction (0, 45 and 90 degrees), while the fused result (Fig. 8(d), obtained from the 4 image stacks recorded in total) shows no anisotropy in its features. It is evident from the above results that our method is capable of imaging the 3D structure of a single cell from multiple directions with high spatial precision. For a 3D visualization of the above image stacks see Visualization 4.

 figure: Fig. 8.

Fig. 8. Multiview microscopy of a mitochondria stained K562 cell. a-c) Maximum intensity projections of deconvolved and spatially registered recordings of three distinct orientations. The optical axis is marked with an arrow for each recording. (d) Maximum intensity projection of the fused result of the 4 image stacks recorded altogether (0°, 45°, 90°, 135°).

Download Full Size | PDF

For these mitochondrion-stained arrays, the deconvolution was stopped after 60 iterations because the power spectrum of this array approximates properly the modulation transfer function (MTF) of the system PSF. We note here that the number of iterations in the literature is very often chosen according to subjective criteria, although its choice affects the contrast of the resulted images and therefore the feature sizes of the fused array. For fused images calculated from other iteration numbers, see Visualization 5.

Figure 9 visualizes the resolution enhancement in the stained mitochondria imaging. From the selected 2D slices of the image stacks, it is obvious that the deconvolution (Fig. 9(a), second column) removes most of the out-of-focus noise and that the Fourier-based fusion separates merged spots corresponding to the roughly 0.5 µm large mitochondria along the Z axis (Fig. 9(a), third column). Resolution improvement is also evidenced from the line traces (Fig. 9(b)) which could resolve those features that are not separable otherwise. The traces along the x axis on Fig. 9(b) (lowest graph) are only slightly different after deconvolution and fusion, indicating that fusion leaves the image patterns mostly unchanged in the lateral direction. While the resolution improvement in the case of bead-decorated samples can be directly determined from measurements in the image space, this is not possible in the case of the mitochondrion-stained sample. Therefore, the resolution here was evaluated by calculating the spatial frequency power spectra of the arrays (Fig. 9(c)). The spectrum of a single deconvolved array shows the typical asymmetric shape of the MTF of the imaging system, being much narrower in the kz direction. However, the spectrum of the fused array (4 directions) shows a strong radial symmetry with a significant broadening in the kz direction, indicating close to isotropic resolution.

 figure: Fig. 9.

Fig. 9. Resolution improvement measured on mitochondria-stained single cells. (a) Corresponding single slices taken from the original, deconvolved and fused 3D data arrays (columns) along the three axes (rows). (b) Intensity traces between the thin white lines on the single image slices of the corresponding rows. (c) MTF calculated from the measured point spread function (PSF), and power spectra obtained from a single array (deconvolved, 60 iterations) of a stained cell and from a fused array obtained with the Fourier transform based method using four deconvolved arrays (0°, 45°, 90° and 135° orientations). For the visualization of the resolution improvement, see Visualization 6.

Download Full Size | PDF

4. Discussion

In the presented work, we combined multiview wide-field fluorescent observation and microstructure assisted optical micromanipulation to realize resolution improved imaging of single cells. The stable cell-to-structure attachment and the high structure-to-water refractive index contrast ensured the precise actuation of the cell and its high spatial stability throughout the imaging process. Compared to confocal imaging of cells directly trapped with optical tweezers [32,52], it is evident that the good spatial stability of our trapping method enabled to achieve a higher quality imaging with an isotropic resolution close to the lateral diffraction limit, comparable to the state-of-the-art fluorescence tomography of dielectrophoretically rotated single cells [29] and multiview fluorescence imaging [53].

The use of the two-photon polymerized, functionalized 3D microstructures of task-specific shape guarantees the fast and easy access of the various orientations for imaging. This imaging scheme can be implemented in any type of sample holder wherever optical trapping can be carried out without the physical movement of the holder itself or inserting any mechanical tool from outside. The image sequences can be successfully combined into a single 3D image array, which displays practically isotropic resolution, as proved with 100 nm fluorescent beads. The slightly lower resolution along the original Z axis is mainly attributed to cell or bead fluctuations (being smaller than the optical resolution). The trapping force that primarily determines the fluctuation can be increased trivially with higher trapping laser power, or with re-designed manipulator structure with smaller trapping spheres; using two manipulator structures that hold the cell from two opposite directions may also reduce fluctuation. Interestingly, with 45 degrees rotations, only 4 viewing directions were enough to obtain the highest resolution improvement, the addition of further viewing directions in between did not result in further increase in resolution. It is important to emphasize that the optical manipulation that allows the access of these viewing orientations, is not limited to a single rotation axis, like the mechanical techniques where the entire sample is rotated, but cells can be viewed from any direction. One should, however avoid orientations where the manipulator or some of its part blocks the view of the cell.

The method applied on cells with labelled mitochondrion also yielded resolution-enhanced images where some features could be resolved along the optical axis only due to the multiview recording. Here, the experiments were performed on fixed cells, which do not change their structure during the course of the data acquisition (approx. 1 min/orientation). In order to follow dynamic events with our method inside live cells the data acquisition must be accelerated and cell fixation avoided. Faster acquisition would require selected plane fluorescent excitation where the light sheet is swiftly scanned across the cell for sectioning and the optical manipulation is used only to reach the various orientations for multiview recording. This scheme, with the extra benefit of reduced phototoxicity, could be combined with remote refocusing, and could lead to multi-orientation acquisition time of less than a minute. When live cells are used, their attachment to the manipulators must be done with extra care: cell treatment should be avoided and the biochemical agents used for the functionalization of the manipulators should not affect the physiology of the cells.

Finally, we emphasize that the procedure introduced here can be implemented in any other microscopies where imaging is performed with a single objective; most notably, comparable resolution improvement can be achieved also in light sheet or confocal microscopy. Optical trapping requires the use of high NA (1.2) objective; the fact, that this objective is also used for imaging, similarly to the most up-to-date multiview microscopy setups [35,43], ensures the presented high resolution. In comparison, multiview systems generally use low or medium NA, sometimes water dipping, objectives for imaging (from 0.2 up to 1) due to the required large working distance [54]. A potentially important future application of the optical manipulation method is the observation of cell-cell interactions with isotropic resolution, with the added benefit of the accurate timing of the reaction and its observation. The possibility of rotation of the cell around any axis can ensure unprecedented spatial control of the mutual position of the two cells where the contact surface can be freely selected.

Appendices

Appendix 1: Lateral fluctuation of a trapped cell

 figure: Fig. 10.

Fig. 10. Histogram describing the lateral fluctuation of a point on an indirectly trapped cell, marked with a yellow X (inset). The point is positioned $\sim$25 µm away from the plane of the three trapping foci (dashed red line). The original video data contained 2589 frames and the first frame was taken as reference. 50 feature points were chosen on the cell’s image with a MATLAB program (see Methods) and the fluctuation was evaluated by comparing the position of these points to those on the first frame. The inset shows the reference frame of the recorded video.

Download Full Size | PDF

Appendix 2: Evaluation of the spatial registration procedure

 figure: Fig. 11.

Fig. 11. Evaluation of the alignment procedure. a: The average of the maximum correlation coefficients after each iteration during the alignment procedure of the bead images. Each data point is the average of the maximum correlation coefficients of the 8 alignments performed between the reference (0 degree) cell orientation and the 22.5, 45, 67.5, 90, 112.5, 135, 157.5 and 180 degree orientations. It shows that the correlation does not increase significantly after 4 iterations and it completely levels after 8 illustrating the fast convergence of our algorithm. b: Histogram of the average distance of corresponding bead image centers on the aligned images. Altogether 23 beads were selected, and the average distance of the centers of the images of each beads in the aligned 4 arrays (0, 45, 90 and 135 degree orientations) was calculated; mean: 1.1 pixels. c and d: Maximum intensity projections of the reference (white spots) and the aligned 90 degree (black spots) image stacks of the fluorescent beads along two perpendicular direction, laid onto each other. The axes are those of the reference stack.

Download Full Size | PDF

Funding

Ministry of Finance (GINOP-2.3.2-15-2016-00001, GINOP-2.3.3-15-2016-00040); Horizon 2020 Framework Programme (654148 Laserlab-Europe); Nvidia (GPU grant program).

Acknowledgments

We are grateful for Péter Galajda (Institute of Biophysics, Biological Research Centre) for making his microscope system available for the extension with HOT.

Disclosures

The authors declare that there are no conflicts of interest related to this article.

References

1. E. A. Abbondanzieri, W. J. Greenleaf, J. W. Shaevitz, R. Landick, and S. M. Block, “Direct observation of base-pair stepping by RNA polymerase,” Nature 438(7067), 460–465 (2005). [CrossRef]  

2. J. C. Meiners and S. R. Quake, “Femtonewton force spectroscopy of single extended DNA molecules,” Phys. Rev. Lett. 84(21), 5014–5017 (2000). [CrossRef]  

3. I. Brouwer, G. Sitters, A. Candelli, S. J. Heerema, I. Heller, A. J. Melo de, H. Zhang, D. Normanno, M. Modesti, E. J. G. Peterman, and G. J. L. Wuite, “Sliding sleeves of XRCC4-XLF bridge DNA and connect fragments of broken DNA,” Nature 535(7613), 566–569 (2016). [CrossRef]  

4. S. B. Smith, Y. J. Cui, and C. Bustamante, “Overstretching B-DNA: The elastic response of individual double-stranded and single-stranded DNA molecules,” Science 271(5250), 795–799 (1996). [CrossRef]  

5. C. Cecconi, E. A. Shank, F. W. Dahlquist, S. Marqusee, and C. Bustamante, “Protein-DNA chimeras for single molecule mechanical folding studies with the optical tweezers,” Eur. Biophys. J. 37(6), 729–738 (2008). [CrossRef]  

6. M. S. Z. Kellermayer, S. B. Smith, H. L. Granzier, and C. Bustamante, “Folding-unfolding transitions in single titin molecules characterized with laser tweezers,” Science 276(5315), 1112–1116 (1997). [CrossRef]  

7. J. T. Finer, R. M. Simmons, and J. A. Spudich, “Single myosin molecule mechanics - piconewton forces and nanometer steps,” Nature 368(6467), 113–119 (1994). [CrossRef]  

8. K. Svoboda, C. F. Schmidt, B. J. Schnapp, and S. M. Block, “Direct observation of kinesin stepping by optical trapping interferometry,” Nature 365(6448), 721–727 (1993). [CrossRef]  

9. A. Ashkin, J. M. Dziedzic, and T. Yamane, “Optical trapping and manipulation of single cells using infrared-laser beams,” Nature 330(6150), 769–771 (1987). [CrossRef]  

10. H. Zhang and K. K. Liu, “Optical tweezers for single cells,” J. R. Soc., Interface 5(24), 671–690 (2008). [CrossRef]  

11. N. McAlinden, D. G. Glass, O. R. Millington, and A. J. Wright, “Accurate position tracking of optically trapped live cells,” Biomed. Opt. Express 5(4), 1026–1037 (2014). [CrossRef]  

12. C. Lopez-Quesada, A. S. Fontaine, A. Farre, M. Joseph, J. Selva, G. Egea, M. D. Ludevid, E. Martin-Badosa, and M. Montes-Usategui, “Artificially-induced organelles are optimal targets for optical trapping experiments in living cells,” Biomed. Opt. Express 5(7), 1993–2008 (2014). [CrossRef]  

13. S. Ayano, Y. Wakamoto, S. Yamashita, and K. Yasuda, “Quantitative measurement of damage caused by 1064-nm wavelength optical trapping of Escherichia coli cells using on-chip single cell cultivation system,” Biochem. Biophys. Res. Commun. 350(3), 678–684 (2006). [CrossRef]  

14. H. Liang, K. T. Vu, P. Krishnan, T. C. Trang, D. Shin, S. Kimel, and M. W. Berns, “Wavelength dependence of cell cloning efficiency after optical trapping,” Biophys. J. 70(3), 1529–1533 (1996). [CrossRef]  

15. Y. Liu, D. K. Cheng, G. J. Sonek, M. W. Berns, C. F. Chapman, and B. J. Tromberg, “Evidence for localized cell heating induced by infrared optical tweezers,” Biophys. J. 68(5), 2137–2144 (1995). [CrossRef]  

16. K. C. Neuman, E. H. Chadd, G. F. Liou, K. Bergman, and S. M. Block, “Characterization of photodamage to Escherichia coli in optical traps,” Biophys. J. 77(5), 2856–2863 (1999). [CrossRef]  

17. M. B. Rasmussen, L. B. Oddershede, and H. Siegumfeldt, “Optical tweezers cause physiological damage to Escherichia coli and listeria bacteria,” Appl. Environ. Microbiol. 74(8), 2441–2446 (2008). [CrossRef]  

18. H. Turlier, D. A. Fedosov, B. Audoly, T. Auth, N. S. Gov, C. Sykes, J. F. Joanny, G. Gompper, and T. Betz, “Equilibrium physics breakdown reveals the active nature of red blood cell flickering,” Nat. Phys. 12(5), 513–519 (2016). [CrossRef]  

19. D. B. Phillips, S. H. Simpson, J. A. Grieve, R. Bowman, G. M. Gibson, M. J. Padgett, J. G. Rarity, S. Hanna, M. J. Miles, and D. M. Carberry, “Force sensing with a shaped dielectric micro-tool,” EPL 99(5), 58004 (2012). [CrossRef]  

20. B. L. Aekbote, T. Fekete, J. Jacak, G. Vizsnyiczai, P. Ormos, and L. Kelemen, “Surface-modified complex su-8 microstructures for indirect optical manipulation of single cells,” Biomed. Opt. Express 7(1), 45–56 (2016). [CrossRef]  

21. G. Vizsnyiczai, B. L. Aekbote, A. Buzas, I. Grexa, P. Ormos, and L. Kelemen, High accuracy indirect optical manipulation of live cells with functionalized microtools (2016), vol. 9922 of Proceedings of SPIE, p. 992216.

22. M. Fritzsche, R. A. Fernandes, V. T. Chang, H. Colin-York, M. P. Clausen, J. H. Felce, S. Galiani, C. Erlenkämper, A. M. Santos, J. M. Heddleston, I. Pedroza-Pacheco, D. Waithe, J. B. de la Serna, B. C. Lagerholm, T.-L. Liu, T.-L. Chew, E. Betzig, S. J. Davis, and C. Eggeling, “Cytoskeletal actin dynamics shape a ramifying actin network underpinning immunological synapse formation,” Sci. Adv. 3(6), e1603032 (2017). [CrossRef]  

23. S. Hell and E. H. K. Stelzer, “Fundamental improvement of resolution with a 4pi-confocal fluorescence microscope using two-photon excitation,” Opt. Commun. 93(5-6), 277–282 (1992). [CrossRef]  

24. H. Choi, E. Yew, B. Hallacoglu, S. Fantini, C. Sheppard, and P. So, “Improvement of axial resolution and contrast in temporally focused widefield two-photon microscopy with structured light illumination,” Biomed. Opt. Express 4(7), 995–1005 (2013). [CrossRef]  

25. C. J. R. Sheppard and M. Gu, “Improvement of axial resolution in confocal microscopy using an annular pupil,” Opt. Commun. 84(1-2), 7–13 (1991). [CrossRef]  

26. N. Siegel and G. Brooker, “Improved axial resolution of finch fluorescence microscopy when combined with spinning disk confocal microscopy,” Opt. Express 22(19), 22298–22307 (2014). [CrossRef]  

27. R. Heintzmann and C. Cremer, “Axial tomographic confocal fluorescence microscopy,” J. Microsc. 206(1), 7–23 (2002). [CrossRef]  

28. Y. Chen, A. D. Aguirre, P. L. Hsiung, S. W. Huang, H. Mashimo, J. M. Schmitt, and J. G. Fujimoto, “Effects of axial resolution improvement on optical coherence tomography (OCT) imaging of gastrointestinal tissues,” Opt. Express 16(4), 2469–2485 (2008). [CrossRef]  

29. L. Kelbauskas, R. Shetty, B. Cao, K.-C. Wang, D. Smith, H. Wang, S.-H. Chao, S. Gangaraju, B. Ashcroft, M. Kritzer, H. Glenn, R. H. Johnson, and D. R. Meldrum, “Optical computed tomography for spatially isotropic four-dimensional imaging of live single cells,” Sci. Adv. 3(12), e1602580 (2017). [CrossRef]  

30. B. Cao, R. Shetty, D. Smith, L. Kelbauskas, and D. R. Meldrum, “Integrating fluorescence computed tomography with optical sheet illumination for imaging of live single cells,” Opt. Express 26(18), 24020–24030 (2018). [CrossRef]  

31. M. Habaza, M. Kirschbaum, C. Guernth-Marschner, G. Dardikman, I. Barnea, R. Korenstein, C. Duschl, and N. T. Shaked, “Rapid 3d refractive-index imaging of live cells in suspension without labeling using dielectrophoretic cell rotation,” Adv. Sci. 4(2), 1600205 (2017). [CrossRef]  

32. D. Wolfson, M. Steck, M. Persson, G. McNerney, A. Popovich, M. Goksor, and T. Huser, “Rapid 3D fluorescence imaging of individual optically trapped living immune cells,” J. Biophotonics 8(3), 208–216 (2015). [CrossRef]  

33. P. J. Shaw, D. A. Agard, Y. Hiraoka, and J. W. Sedat, “Tilted view reconstruction in optical microscopy - 3-dimensional reconstruction of drosophila-melanogaster embryo nuclei,” Biophys. J. 55(1), 101–110 (1989). [CrossRef]  

34. J. Huisken, J. Swoger, F. Del Bene, J. Wittbrodt, and E. H. K. Stelzer, “Optical sectioning deep inside live embryos by selective plane illumination microscopy,” Science 305(5686), 1007–1009 (2004). [CrossRef]  

35. U. Krzic, S. Gunther, T. E. Saunders, S. J. Streichan, and L. Hufnagel, “Multiview light-sheet microscope for rapid in toto imaging,” Nat. Methods 9(7), 730–733 (2012). [CrossRef]  

36. J. Swoger, J. Huisken, and E. H. Stelzer, “Multiple imaging axis microscopy improves resolution for thick-sample applications,” Opt. Lett. 28(18), 1654–1656 (2003). [CrossRef]  

37. M. Friese, T. Nieminen, N. Heckenberg, and H. Rubinsztein-Dunlop, “Optical alignment and spinning of laser-trapped microscopic particles (vol 394, pg 348, 1998),” Nature 395(6702), 621 (1998). [CrossRef]  

38. A. La Porta and M. Wang, “Optical torque wrench: Angular trapping, rotation, and torque detection of quartz microparticles,” Phys. Rev. Lett. 92(19), 190801 (2004). [CrossRef]  

39. T. Kolb, S. Albert, M. Haug, and G. Whyte, “Dynamically reconfigurable fibre optical spanner,” Lab Chip 14(6), 1186–1190 (2014). [CrossRef]  

40. A. Forrester, J. Courtial, and M. Padgett, “Performance of a rotating aperture for spinning and orienting objects in optical tweezers,” J. Mod. Opt. 50(10), 1533–1538 (2003). [CrossRef]  

41. L. Kelemen, S. Valkai, and P. Ormos, “Integrated optical motor,” Appl. Opt. 45(12), 2777–2780 (2006). [CrossRef]  

42. P. Galajda and P. Ormos, “Complex micromachines produced and driven by light,” Appl. Phys. Lett. 78(2), 249–251 (2001). [CrossRef]  

43. T. Kolb, S. Albert, M. Haug, and G. Whyte, “Optofluidic rotation of living cells for single-cell tomography,” J. Biophotonics 8(3), 239–246 (2015). [CrossRef]  

44. G. Vizsnyiczai, L. Kelemen, and P. Ormos, “Holographic multi-focus 3D two-photon polymerization with real-time calculated holograms,” Opt. Express 22(20), 24217–24223 (2014). [CrossRef]  

45. M. Simons, M. R. Pollard, C. D. Hughes, A. D. Ward, B. Van Houten, M. Towrie, S. W. Botchway, A. W. Parker, and N. M. Kad, “Directly interrogating single quantum dot labelled UvrA2 molecules on DNA tightropes using an optically trapped nanoprobe,” Sci. Rep. 5(1), 18486 (2015). [CrossRef]  

46. D. Palima, A. R. Banas, G. Vizsnyiczai, L. Kelemen, P. Ormos, and J. Gluckstad, “Wave-guided optical waveguides,” Opt. Express 20(3), 2004–2014 (2012). [CrossRef]  

47. G. Vizsnyiczai, T. Lestyan, J. Joniova, B. L. Aekbote, A. Strejckova, P. Ormos, P. Miskovsky, L. Kelemen, and G. Bano, “Optically trapped surface-enhanced raman probes prepared by silver photoreduction to 3D microstructures,” Langmuir 31(36), 10087–10093 (2015). [CrossRef]  

48. R. Di Leonardo, F. Ianni, and G. Ruocco, “Computer generation of optimal holograms for optical trap arrays,” Opt. Express 15(4), 1913–1922 (2007). [CrossRef]  

49. T. Cizmar, M. Mazilu, and K. Dholakia, “In situ wavefront correction and its application to micromanipulation,” Nat. Photonics 4(6), 388–394 (2010). [CrossRef]  

50. J. Swoger, P. Verveer, K. Greger, J. Huisken, and E. H. K. Stelzer, “Multi-view image fusion improves resolution in three-dimensional microscopy,” Opt. Express 15(13), 8029–8042 (2007). [CrossRef]  

51. P. Fei, J. Nie, J. Lee, Y. Ding, S. Li, H. Zhang, M. Hagiwara, T. Yu, T. Segura, C.-M. Ho, D. Zhu, and T. K. Hsiai, “Subvoxel light-sheet microscopy for high-resolution high-throughput volumetric imaging of large biomedical specimens,” Adv. Photonics 1(1), 016002 (2019). [CrossRef]  

52. M. Habaza, B. Gilboa, Y. Roichman, and N. T. Shaked, “Tomographic phase microscopy with 180° rotation of live cells in suspension by holographic optical tweezers,” Opt. Lett. 40(8), 1881–1884 (2015). [CrossRef]  

53. Y. Wu, P. Chandris, P. W. Winter, E. Y. Kim, V. Jaumouillé, A. Kumar, M. Guo, J. M. Leung, C. Smith, I. Rey-Suarez, H. Liu, C. M. Waterman, K. S. Ramamurthi, P. J. L. Riviere, and H. Shroff, “Simultaneous multiview capture and fusion improves spatial resolution in wide-field and light-sheet microscopy,” Optica 3(8), 897–910 (2016). [CrossRef]  

54. K. Greger, J. Swoger, and E. H. K. Stelzer, “Basic building units and properties of a fluorescence single plane illumination microscope,” Rev. Sci. Instrum. 78(2), 023705 (2007). [CrossRef]  

Supplementary Material (6)

NameDescription
Visualization 1       The video shows the process of trapping a functionalized polymer microtool used for the manipulation of a cell with the holographic optical tweezers, its orientation towards the targeted cell, and the attachment of the structure to the cell. The play
Visualization 2       The movie demonstrates the free manipulation of a cell with the optically trapped manipulator. As shown, the cell-structure couple can be freely translated along or rotated around any of the three coordinate axes. Rotation around the X axis allows th
Visualization 3       The movie shows the maximum intensity projections of a fluorescent bead decorated cell from various directions in three stages of the data evaluation process. All three parts of the movie are cropped in size. The original and the deconvolved images s
Visualization 4       The movie shows three deconvolved image stacks of a mitochondrium stained cell (0 deg, 45 deg and 90 deg) and one that is Fourier-fused using 4 orientations (0, 45, 90) and 135 degs). The 0 deg deconvolved stack is used as reference for the alignment
Visualization 5       The movie shows the fused 3D image stacks of a mitochondrium-stained cell. The three image stacks shown were made by Fourier-fusing 4 deconvolved image stacks of various iteration numbers.
Visualization 6       The movie shows the maximum intensity projections of a mitochondriumstained cell from various directions in three stages of the data evaluation process. All three parts of the movie are cropped in size. The original and the deconvolved images show th

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (11)

Fig. 1.
Fig. 1. The scheme of the polymer micromanipulator and its application to indirectly manipulate a single cell for multiview microscopy. (a) The model of the manipulator showing its main functional parts. Three spheres provide trapping sites for three holographic optical traps, while a concave shaped attachment disk provides a binding site for spherical cells. (b) The spatial arrangement of the manipulator-cell couple in the sample space relative to the optical axis of the trapping and observing objective. Pink cones indicate the trapping beams. The cell is rotated around the dashed-line axis for the multiview microscopic observations (parallel to axis y). (c) Scanning electron microscopic image of the cell manipulator structure.
Fig. 2.
Fig. 2. The optical layout of the imaging system. L: trapping laser source, BE: beam expander to slightly overfill the SLM surface, SLM: spatial light modulator, RL1 and RL2: relay lenses to project the SLM surface to the entrance pupil of the objective, DM: dichroic mirror that reflects the trapping beam into the objective but transmits the fluorescence beams, FF: fluorescence filter set, FS: fluorescent light source, CAM: camera, O: objective, S: sample. The inserted hologram creates the three trapping focal spots in the sample plane.
Fig. 3.
Fig. 3. The concept of the application of the cell manipulator microtool for multiview imaging. Step 1: HOT-assisted data acquisition via alternating cell translations to pre-defined positions (pos. 1 through pos. N) and image recordings at each position. Step 2: return the cell to pos. 1 and its rotation to a new orientation.
Fig. 4.
Fig. 4. The process of cell attachment to a microtool and their total positional control. (a) Bright-field image of the three trapping foci (three bright spots on the left side) and a yet untrapped microtool (on the right side); the attachment disk and connector rods are defocused. (b) The microtool trapped and oriented with its disk towards the cell that sits on the bottom of the microfluidic channel. (c) The cell is attached to the microtool and elevated from the supporting glass. (d) The indirectly trapped cell is rotated by 90 degrees relative to its orientation on panel c. (e) The positional distribution of a given point on a fluctuating trapped cell; the insert shows the distribution zoomed-in.
Fig. 5.
Fig. 5. Evaluation of the required deconvolution iteration number and of the required number of 3D stacks in the fusion step. (a) The width of eight selected bead images along the x axis as the function of deconvolution iteration number. The widths were determined with a Gaussian fit to an intensity trace taken across the maximum intensity pixels of the bead images; open circles: calculated widths; the red line connects the average of the widths. (b) Relative differences between successive arrays, calculated with Eq. 3, as the function of deconvolution iteration number. (c) Average widths of six selected bead images along the 3 coordinate axes after fusion of various number of aligned stacks (1 means a single deconvolved image). Fourier-based fusion was used and the width was determined with a Gaussian fit similarly as in panel a.
Fig. 6.
Fig. 6. Maximum intensity projections (MIP) of the 3D fluorescence intensity data arrays recorded on a trapped cell that was labelled with 100 nm fluorescent beads. MIP of an original, unprocessed data array recorded on the entire cell (a), of a deconvolved array (26 iterations) (b), of a fused array with arithmetic averaging (0°, 45°, 90° and 135° orientations) (c) and of one fused with the Fourier transform-based method (d). e-h Enlarged MIP images of four beads in the highlighted areas of the original, deconvolved, averaged and Fourier-fused arrays, respectively. The curves on the inset of (g) show the intensity traces over two adjacent bead images from the arithmetically averaged (blue) and Fourier-fused (red) arrays along the line shown on g. For better visualization of the 3D arrangement of the bead images see Visualization 3.
Fig. 7.
Fig. 7. The resolution improvement characterized with Gaussian fit of line traces along bead images. (a) Normalized intensity traces over the bead image marked on Fig. 6(a) with the arrow, along the three axes taken from the original, deconvolved and fused arrays. (b) Average 1/e widths calculated with selected bead images from the original, deconvolved and Fourier-fused arrays along the three axes. The widths were determined with a Gaussian fit; the fusion included 4 orientations.
Fig. 8.
Fig. 8. Multiview microscopy of a mitochondria stained K562 cell. a-c) Maximum intensity projections of deconvolved and spatially registered recordings of three distinct orientations. The optical axis is marked with an arrow for each recording. (d) Maximum intensity projection of the fused result of the 4 image stacks recorded altogether (0°, 45°, 90°, 135°).
Fig. 9.
Fig. 9. Resolution improvement measured on mitochondria-stained single cells. (a) Corresponding single slices taken from the original, deconvolved and fused 3D data arrays (columns) along the three axes (rows). (b) Intensity traces between the thin white lines on the single image slices of the corresponding rows. (c) MTF calculated from the measured point spread function (PSF), and power spectra obtained from a single array (deconvolved, 60 iterations) of a stained cell and from a fused array obtained with the Fourier transform based method using four deconvolved arrays (0°, 45°, 90° and 135° orientations). For the visualization of the resolution improvement, see Visualization 6.
Fig. 10.
Fig. 10. Histogram describing the lateral fluctuation of a point on an indirectly trapped cell, marked with a yellow X (inset). The point is positioned $\sim$25 µm away from the plane of the three trapping foci (dashed red line). The original video data contained 2589 frames and the first frame was taken as reference. 50 feature points were chosen on the cell’s image with a MATLAB program (see Methods) and the fluctuation was evaluated by comparing the position of these points to those on the first frame. The inset shows the reference frame of the recorded video.
Fig. 11.
Fig. 11. Evaluation of the alignment procedure. a: The average of the maximum correlation coefficients after each iteration during the alignment procedure of the bead images. Each data point is the average of the maximum correlation coefficients of the 8 alignments performed between the reference (0 degree) cell orientation and the 22.5, 45, 67.5, 90, 112.5, 135, 157.5 and 180 degree orientations. It shows that the correlation does not increase significantly after 4 iterations and it completely levels after 8 illustrating the fast convergence of our algorithm. b: Histogram of the average distance of corresponding bead image centers on the aligned images. Altogether 23 beads were selected, and the average distance of the centers of the images of each beads in the aligned 4 arrays (0, 45, 90 and 135 degree orientations) was calculated; mean: 1.1 pixels. c and d: Maximum intensity projections of the reference (white spots) and the aligned 90 degree (black spots) image stacks of the fluorescent beads along two perpendicular direction, laid onto each other. The axes are those of the reference stack.

Equations (3)

Equations on this page are rendered with MathJax. Learn more.

I f = j = 1 N ( w j I j )
w j = | I j | i = 1 N | I i |
x N | S i ( x ) S i 1 ( x ) | / x N S i 1 ( x )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.