Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Spatial resolution enhancement in holographic imaging via angular spectrum expansion

Open Access Open Access

Abstract

Digital holography numerically restores three-dimensional image information using optically captured diffractive waves. The required bandwidth is larger than that of hologram pixel at a closer distance in the Fresnel diffraction regime, which results in the formation of aliased replica patterns in digital hologram. From the analysis of sampling phenomenon, the replica functions are revealed to be the components of higher angular spectra of hologram. A undersampled hologram consists of the moire patterns formed by the modulation of original function by complex exponential function. There is a one-to-one correspondence between the replicas in both real and Fourier spaces. The acquisition methods of high-resolution images over a wide field view are proposed on the basis of the expansion process of angular spectrum by using replicas. Only the captured hologram with low numerical aperature or low resolution restores a high-resolution image when using an optimization algorithm. Numerical simulations and optical experiments are performed to investigate the proposed scheme.

© 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Optical microscopy is a fundamental tool to observe magnified images of a material through optical lenses. The spatial resolution of an image is limited by the wave characteristics of light, known as the Abbe diffraction limit, which depends on the performance of the optical lens that collects the diffracted light at a higher angular scope [1]. Hence, an upper bound of the spatial resolution appears when an objective lens with a finite numerical aperture (NA) is used. To overcome the limited NA of a finite objective, various approaches have been successfully carried out [25], where higher angular spectra of radiated light from materials are acquired in near-field and far-field imaging systems. Recently, the necessity of microscopic imaging technology to observe samples in a wide range together with high precision has been indicated [69]. This technology would allow the sub-micrometric structure of materials, particularly those of pathological specimens in biomedicine, to be inspected effectively.

Digital holography is an interferometric imaging method in which the diffraction fringe of a diffracted wave is optically captured on an image sensor, and the image is numerically reconstructed from the captured digital data based on scalar diffraction theory [1013]. The angular spectrum of a digital hologram can be expanded by measuring multiple holograms using an oblique incident beam on the specimen, thus resulting in an image resolution beyond the diffraction limit of existing optical systems. Synthetic-aperture Fourier holographic microscopy is a representative tool for obtaining high-resolution images within a wide field-of-view [3,6,7,1416]. Another diffraction imaging technology, i.e., Fourier ptychographic microscopy is used to extend the Fourier space [17,18], in which the complex amplitude is restored from the measured diffraction intensity via phase retrieval process. Although these imaging approaches effectively capture high-resolution image information in a wide field using only a low-NA objective, there still remains a system complexity such as the multiple measurements or post data processing.

Recently, there have been several studies on high-NA digital hologram [1921]. High-NA hologram suffers from aliased replica fringe when captured at a closer distance. In analysis of sampling theorem, the original image is well restored despite severe aliased errors. Because the aliasing errors arise from the required bandwidth larger than that of hologram pixel, it is not certain whether or not there is a constraint on spatial frequency in the image restoration.

Holographic imaging is a representative linear system [10]. Thus, digital hologram of a finite-sized object can be analyzed by a point hologram. Optical kernel functions directly correspond to elementary functions for a point object in real and Fourier spaces. When the functions are sampled in a digitized space, they can be represented as the summation of shifted form of original functions because of complex amplitude with a quadratic phase term [22,23].

In this study, the relationship between aliased replica functions in both real and Fourier spaces is mathematically or graphically investigated. Firstly, it is found out that the replication patterns are moire interfernce fringes, i.e., the modulation of original function by complex exponential function, which indicates that they are the components of higher angular spectra of hologram. A one-to-one correspondence exists between them in both real and Fourier spaces. A method for extending angular spectrum of hologram is studied using displacement of replication patterns in the space. This technique enables high-resolution images to be restored, which reduces the complexity of imaging system. Numerical simulation is performed to investigate the proposed scheme, and the results of the optical experiment are presented. Finally, the possibility of achieving the super-resolution beyond the Abbe diffraction limit is discussed in this strategy.

2. Enhancement in spatial resolution of holographic image by angular spectrum expansion

2.1 Abbe theory of spatial resolution in digital holography

Based on scalar diffraction theory [10], the diffractive wave field in the near-field region is characterized by optical kernel functions, i.e., an impulse response function in real space,

$$h(\rm{\bf{X}})= \it{} h_{0} \exp \left(i \frac{\pi}{\lambda z} \rm{\bf{XX^T}} \right),$$
and a transfer function in the Fourier space,
$$H(\rm{\bf{U}})= \it{} H_{0} \exp \left({-}i \pi \lambda z \rm{\bf{UU^T}} \right),$$
where $h_0 = \frac {e^{ikz}}{i \lambda z}$ and $H_0=e^{ikz}$. $\rm {\bf {X}}$ and $\rm {\bf {X^{'}}}$ represent two-dimensional (2D) vectors in $(x,y)$ and $(x',y')$ coordinates, respectively; and $k$ is the wavenumber of $\frac {2\pi }{\lambda }$ with wavelength $\lambda$. The convolution notation, $g(\bf {X})= \it {O}(\bf {X})*\it {h}(\bf {X})$ describes the diffractive wave field $g(\bf {X})$ that propagates from the object field $O(\bf {X'})$. For a point object $\delta (\bf {X^{'}})$, the spherical wave diverges forward in a free space under the constraint of the angular spectrum, $k \geq 2\pi \sqrt {\bf {UU^T}}$, where $\bf {U}$=[$u$ $v$] is the spatial frequency vector. The optical imaging performance depends on how much of higher components of angular spectrum in the diverging spherical wavelets is gathered through an optical lens.

Digital holography optically captures the wavefront of a diffracted wave from a material in digitized space, which is called the digital hologram. Figure 1(a) shows the geometric structure of a Fresnel holographic imaging system. The captured hologram data is band-limited in the spatial and frequency domains due to its finite aperture. Considering the spatial frequency vector of $\frac {\bf {X}}{\lambda z}$ in the Fresnel diffraction formula, the space bandwidth $B_w$ in a digital hologram with $N{\times }N$ pixels of $\it {\Delta }$ pixel interval is represented as

$$B_w=\frac{N\it{\Delta}}{\lambda z}.$$

According to the Abbe diffraction theory, the bandwidth value determines the resolution limit $R_{\rm {lim}}$ of restored image [21,24,25]:

$$R_{\rm{lim}}= \frac{\lambda z}{N\it{\Delta}}=\frac{\lambda}{2\rm{NA}},$$
where $\rm {NA}=\it {n} \sin \theta =\frac {N\it {\Delta }}{2z}$, and $n$ is the refractive index of free space. The hologram aperture function is an optical transfer function that defines the extent to which it collects the spatial frequency components of the diffracted wave.

 figure: Fig. 1.

Fig. 1. (a) Schematic illustrations of the Fresnel holographic imaging system. Point image is restored from digital hologram located at one-half of $z_c$. Green box denotes allowable image space defined by diffraction of hologram pixel. (b) Change in spatial resolution as a function of focal distance. Values for digital hologram consisting of 256$\times$256 pixels with a 8-$\mu$m pixel pitch are drawn. Inset figure presents the simulated diffraction behavior near focal plane.

Download Full Size | PDF

2.2 Replication properties of undersampled digital hologram in a digitized space

When the hologram is acquired at a closer distance, the bandwidth is larger than that of hologram pixel, which resluts in the aliasing errors in digital hologram. In this case, it is important to establish that the image resolution would be finer than the hologram pixel value because of the restriction in spatial frequency, as depicted in Fig. 1.

Holographic imaging is a linear system, and thus digital hologram of a finite object can be interpretable in terms of only an elementary function of point object [10]. The response function in real space becomes a hologram of point object from the relation, $g(\bf {X})= \delta (\bf {X})*\it {h}(\bf {X})$.

Let us investigate the sampling phenomenon of response function in digitized space. The Fourier transform of the response function sampled by the sampling matrix, $\textbf {P}$ in real space is expressed as

$${\boldsymbol{FT}} \left \{ \sum_{\bf{n}} h(\bf{nP}) \delta(\bf{X}-\bf{nP}) \right \} = \frac{\rm{1}}{|\rm{det} \, \bf{P}|} \sum_{\bf{m}} H (\bf{U}-\bf{mQ}),$$
where ${\boldsymbol {FT}} \{ \}$ indicates the Fourier transform; $\textbf {Q}$ equals to $\textbf {P}^{-\rm {T}}$; and $\textbf {n}$ and $\textbf {m}$ are integers in 2D notation. Taking the inverse Fourier transform into the right-hand side of Eq. (5) yields the modulated form of the function, which can be rewritten in the shifted form of a quadratic phase functions [22,23],
$$\sum_{\bf{n}} h(\bf{nP}) \delta(\bf{X}-\bf{nP}) = \frac{\rm{1}}{|\rm{det} \, \bf{P}|} \sum_{\bf{n}} \it{c_{\bf{n}} h}( \bf{X}-\lambda \it{z} \bf{nQ} ).$$
The respective order is multiplied by the constant value, $c_n=e^{\frac {-i\pi \lambda zn^2}{\it {\Delta ^{\rm {2}}}}}$. The critical distance $z_c$ is defined when the repetition period $\frac {\lambda z}{\it {\Delta }}$ of function is the same as a field size $N\it {\Delta }$:
$$z_c = \frac{N \it{\Delta}^2}{\lambda}.$$
There appears no aliased fringe at above $z_c$.

Similarly, when the transfer function is sampled, the same form as Eq. (6) can be obtained as follows:

$$\sum_{\bf{m}} H(\bf{mP_0}) \delta(\bf{U}-\bf{mP_0}) = \frac{\rm{1}}{|\rm{det} \, \bf{P_0}|} \sum_{\bf{m}} \it{c_{\bf{m}} H} \left( \bf{U}-\frac{mQ_0}{\lambda \it{z}} \right),$$
where $\textbf {P}_{0}$ is the sampling matrix in the Fourier space and $\textbf {Q}_0=\textbf {P}_0^{-\rm {T}}$. The transfer function is an angular spectrum of response function.

Undersampling properties of response function could be analyzed on the basis of Eq. (6). Principally, sampling characteristics depend on parameters $(z, \it {\Delta })$. As the sampling interval $\it {\Delta }$ increases or the distance $z$ is smaller compared to a critical distance, aliased replica patterns are generated. The shifted quadratic phase function in Eq. (6) appears as the modulation of original function by complex exponential function:

$$h( \bf{X}-\lambda \it{z} \bf{nQ}) = \it{c_o h} ( \bf{X}) \exp \left(-\it{i} \pi \rm{\bf{X}} \bf{nQ} \right).$$
The modulating term, i.e., complex exponential function is constant at specifications $(z_c, \it {\Delta })$, where the shifted term becomes original function itself, and thus no information is extracted.

Figure 2 depicts the graphical analysis for the undersampled digital hologram of point object. The point hologram in 2D space consisting of 256$\times$256 pixels with a 8-$\rm {\mu }$m pixel pitch was synthesized using a plane wave with a wavelength of 532 nm. The hologram was made at a distance of a half of $z_c$, which forms four replica Fresnel zones. In this case, the complex exponential function in replica function, $e^{\frac {-i\pi \rm {\bf {X}}} {\it {\Delta }}}$ is the sinusoidal wave with a period of ${2\it {\Delta }}$, in Fig. 2(b). The Fourier-transformed data is a shifted high-frequency component. All the shifted replica functions become the higher spatial-frequency components corresponding to those of original function. The spatial frequency, $\frac {\rm {\bf {X}}} {\lambda z}$ of concentric primary pattern linearly increases with a spatial distance. It is intersesting that although the replica zones seem to be the moire fringes with a low frequency in appearance, the aliased fringes should be higher spectrum components according to a spatial distance. Spectrum distributions considering a finite pixel size are drawn briefly in Fig. 2(c).

 figure: Fig. 2.

Fig. 2. Graphical analysis for the undersampled digital hologram of point object. (a) Real-valued hologram synthesized at a distance of a half of $z_c$. One-dimensional quadratic phase function along the lateral line at the center is overlapped on the Fresnel zones. (b) Original function and complex exponential function corresponding to $+1^{\rm {st}}$-order replica zone. (c) Spectrum distributions considering a finite pixel size.

Download Full Size | PDF

Furthermore, a curve shape of replicas by all the sampling periods are embedded in the form of moire fringe in the primary function, as illustrated in Fig. 3. The replica functions are formed at a reduced period of $\frac {\lambda z}{\it {s \Delta }}$ when the function is undersampled by $s$ multiples of $\it {\Delta }$. On the other hand, the number of replicas, $N$ are larger by a demagnification process, i.e., zoom-out process. This indicates that self-similar patterns are formed by means of an extrapolation operation with a scale parameter of $\varepsilon$. Theoretically, this phenomenon could be explained as a result of negative fractal dimension [26], $D = \lim _{\varepsilon \to 0} \frac {\log N(\varepsilon )}{\log (1/\varepsilon )} = -2$.

 figure: Fig. 3.

Fig. 3. Sampling phenomena of (a) response function and (b) transfer function of a point hologram in one-dimensional space. Black, red, and green markers represent original transfer function, and undersampled functions by factors of 2 and 4, respectively. Boxes indicate the corresponding primary functions. $u_c$ is the maximum spatial frequency with respect to bandwidth of original function.

Download Full Size | PDF

Figure 4 describes this phenomenon in the Wigner space. The point hologram made at a distance of one-third of $z_c$ forms nine replica zones. The Fresnel transform is represented as a shearing of the Wigner distribution function, $W(x,u)=W(x-\lambda zu,u)$. The overlapping of high-order spectra is inevitable at a distance below $z_c$, which causes aliasing fringes. The Wigner distribution is rotated by $90^{\circ }$ via the Fourier transform [27], which also represents the replications of angular spectrum. This shows clearly a one-to-one correspondance with both replica functions in real and Fourier spaces. The aliased replica components of angular spectrum correspond to the replication elements of digital hologram.

 figure: Fig. 4.

Fig. 4. Aliasing effects of undersampled hologram in the Wigner space. (a) Digital hologram for a point object synthesized at a distance of one-third of $z_c$. (b) Wigner distribution description of digital hologram. Point image is focused from inclined line designating spherical fringe of hologram. (c) 3-fold expanded angular spectrum corresponding to digital hologram. (d) Wigner distribution description of angular spectrum.

Download Full Size | PDF

2.3 Method for spatial-resolution enhancement in image retrieval process

The replica functions in the undersampled hologram play a role in higher angular spectrums of primary function. In the image retrieval process, the whole area of the digital hologram should be an aperture that satisfies the resolution relationship of Eq. (4). The hologram aperture extends to the whole area without a confinement of primary zone.

Obviously, the hologram aperture size could be extended by spatially replicating the primary function once the primary function is known. In this strategy, the primary functions both real and Fourier spaces can be applicable. This expands the angular spectrum of hologram, and thus results in the retrieval of high-resolution image. Mathematically, this concept would be possible because the replica function is the same as the original one except for the multiplication constant in Eqs. (6) and (8). However, in the optically captured hologram, the addition of external noises due to a measurement environment is inevitable, where it is hard to extract exact information about primary hologram function.

Recently, the research to expand the hologram aperture was performed by self-extraploation technique using a phase retrieval algorithm [13]. This method could be used for finding replica patterns from the primary function. Here, the computation performance would be enhanced because the replica patterns have a self-similarity, and the computational capacity is reduced with comparison to the non-aliased data.

As another approach, the high-resolution image is retrieved from the undersampled hologram optically captured while keeping high aperture size. In this case, the image can be effectively restored by replicating the angular spectrum in the Fourier space during the iterative optimization algorithm. The iterative algorithm uses the angular spectrum method:

$$O(\textbf{X}') = {\boldsymbol{IFT}} \left[ {\boldsymbol{FT}} \{ \it{g} (\bf{X}) \} \times \it{H^{-\rm{1}}} (\textbf{U}) \right].$$
Unlike the description of Fig. 1, the pixels in both planes have the same value irrespective of the distance because of the sampling relation, $\it {\Delta }=\frac {\rm {1}}{N \it {\Delta _u}}=\it {\Delta '}$, where an allowable image size is consistent with the hologram size. Undersampling by $m$-multiple pixels creates $m$-multiple replicas of the primary function. The $m$-fold expansion of angular spectrum during the reconstruction process helps to restore the high-resolution image.

Finally, the resolution performance would be enhanced when high-order diffractions from a material are used. High-order diffractions directly relate to the higher replica terms in Eq. (6). Optically, these terms can be measured through a grating device located in front of sample. It was reported that the captured hologram to collect the highly diffracted beams on centered region improves the image resolution [28]. Here, there is no need for a beam collecting process. Figure 5 is the schematic diagram for above proposed methods.

 figure: Fig. 5.

Fig. 5. Methods for increasing image resolution by expanding angular spectrum. (a) Expansion of hologram aperture size by directly searching replica patterns. (b) Image retrieval through the expansion process of angular spectrum for acquired low-resolution hologram. (c) Image retrieval by using captured high-order diffractions.

Download Full Size | PDF

3. Numerical analysis of resolution increment of holographic image

Figure 6 illustrates the reconstruction properties of image by using an extraction process of replica patterns. The initial complex-valued hologram for the object with 512$\times$512 pixels was synthesized by the Fresnel diffraction formula, and then cropped by a factor of 2 to obtain the low-NA hologram with 256$\times$256 pixels, in Fig. 6(a). The real-valued object consisting of several points with 2-$\mu$m pixel was used, and the initial hologram made at a half of $z_c$ has pixel resolution of 4 $\mu$m according to a sampling relation between hologram and object planes, $\it {\Delta '}=\frac {\lambda z}{N\it {\Delta }}$.

 figure: Fig. 6.

Fig. 6. Reconstruction properties of image by using an extraction process of replica patterns. (a) Low-NA hologram with 256$\times$256 pixels of an 8-$\mu$m pixel interval for several point objects. (b) Hologram extrapolated by using a phase retrieval algorithm. Reconstructed images for (c) low-NA hologram (d) extrapolated hologram. (e) One-dimensional profiles of original and extrapolated holograms.

Download Full Size | PDF

The replica patterns were extracted through a phase retrieval algorithm based on the Gerchberg-Saxton algorithm. The absolute value of restored image was used during the repetition procedure, which is sufficient for a constraint. Original replication patterns are successfully found at a large repetition, which results in a retrieval of original image. The one-dimensional profile of hologram in Fig. 6(e) clearly shows that the extrapolated data well matches with original one. As not displayed here, it was confirmed that the hologram made at a fourth of $z_c$ retrieves original replication patterns.

Figure 7 is the simulation results by using the undersampled hologram. Initial high-NA hologram for the USAF resolution target was calculated by the inverse process of Eq. (10), Both object and hologram spaces consist of 512$\times$512 pixels of a 4-$\mu$m pixel, and undersampled hologram prepared by 2-fold downsampling has 256$\times$256 pixels of an 8-$\mu$m pixel. Undersampling is performed by periodically placing sub-pixels of the same size as the original pixels. This type of hologram can be optically measured using 2D grid mask attached to the image sensor. The hologram data acquired through the $m$-fold sub-pixel mask enables $m$-fold expansion of the angular spectrum.

 figure: Fig. 7.

Fig. 7. Simulation results for image reconstruction of undersampled hologram. (a) Zero-padded angular spectrum into 512$\times$512 pixels in the logarithmic scale and (b) restored USAF target image through zero-padding technology. Right picture is the magnified image in red box. (c) 2$\times$2 expanded angular spectra by placing replica in an array. Red box denotes the zeroth order value. (d) Directly restored image via two-multiple expansion of angular spectrum in Fourier space.

Download Full Size | PDF

Figure 7(a) is the restored image through the zero-padding technology, where the retrieval of initial resolution is unavailable. However, as illustrated in Fig. 7(d), the image with the initial resolution of 4 $\mu$m is reconstructed from two-multiple expansion of the angular spectrum, which becomes a strong evidence that the replicated angular spectrum functions as the higher spectrum. Both magnified images show a clear discrimination. To remove the interference of high-order images, the extended angular spectrum was multiplied by a sinc function, $\rm {sinc} (\pi \it {\Delta } \textbf {U})$. There are still remnents of high-order noises and it shows relatively a poor image quality.

The iterative optimization algorithm based on the gradient descent method with a total variational regularization $\textbf {TV}$ was used to optimize the restored image [29,30]:

$$\arg \min_{O} \frac{1}{2} \parallel {\boldsymbol{Fr} \rm{(} \it{O} \rm{)} - \it{g}} \parallel^2 + \gamma \textbf{TV}(O).$$
The objective function consists of the least squares together with the $\textbf {TV}$ term, and $\gamma$ is a regularized parameter. ${\boldsymbol {Fr}}$() denotes the Fresnel transform of Eq. (10). The reconstructed image $O_k$ at respective iteration is updated by minimizing the loss function, i.e., the squared error between the original hologram $g_0$ and estimated one $g_k$. The angular spectrum of the errors was expanded via its repetition process of $m$ multiples, resulting in considering the high frequency components. The transfer function was also extended to $m$-multiple frequency space and the estimated hologram was downsampled to match original resolution. The convergence rate for optimization was arbitrarily controlled by changing the external parameters such as a learning rate $\alpha$ or regularization factor $\gamma$.

The iterative algorithm restores a high-quality image comparable to original image, when using the 4-fold downsampled hologram for the Shepp-Logan phantom, in Fig. 8. The PSNR value of the reproduced image is estimated to be approximately 73 dB. As not shown here, we also confirmed that two-fold or eight-fold undersampled hologram well restores the image. The sinc function was used only in reconstruction process using the eight-fold undersampled hologram, and it was not necessarily required for this algorithm. The spatial resolution of the reconstructed image is recovered to the original value in accordance to the expansion extent of the angular spectrum. Figure 8(f) is the cross-sectional profile of the restored image after optimization. The initial image with a spatial resolution of 4 $\mu$m is exactly recoverable by using an iterative optimization algorithm.

 figure: Fig. 8.

Fig. 8. Image reconstruction of undersampled hologram by using iterative opimization algorithm. (a) Low-resolution hologram with 128$\times$128 pixels of a 16-$\mu$m pixel interval for the Shepp-Logan phantom. (b) Directly restored image via four-multiple expansion of angular spectrum. (c) 4$\times$4 expanded angular spectra in the logarithmic scale after iterative optimization. (d) Restored image via the iterative optimization algorithm including 4-fold expansion of angular spectrum. Cross-sectional profiles of reconstructed images (e) without and (f) with iterative optimization algorithm (Algorithm 1).

Download Full Size | PDF

Tables Icon

Algorithm 1. Iterative optimization algorithm based on angular spectrum expansion

4. Optical experiments and discussion

Figure 9(a) illustrates an off-axis holographic technique to acquire an optical hologram for the USAF resolution target. A 532-nm green laser (LCX-532, Oxxius) was used as a light source. A hologram with 2160$\times$2160 pixels was captured on an image sensor (GS3-U3-89S6M-C, FLIR) at a distance of 86 mm. The captured hologram has a pixel pitch of 3.45 $\mu$m. The first-order region of the Fourier-transformed data in Fig. 9(c) was cropped to avoid non-diffraction beams and twin terms, and then moved to the center. The inverse Fourier transform generated the final complex-amplitude hologram.

 figure: Fig. 9.

Fig. 9. (a) Off-axis holographic technique to acquire an optical hologram. (b) Captured hologram for the USAF resolution target and (c) its Fourier-transformed data. Red box indicates the first-order region. $\theta$ is an off-axis angle.

Download Full Size | PDF

The reconstruction of the optical hologram is shown in Fig. 10. The low-resolution hologram was constructed via a 4-fold undersampling procedure, which is analogous to a hologram achieved using a 4-fold sub-pixel mask. The inferior image as compared with the original image was restored from the low-resolution hologram. However, the expansion of angular spectrum in the iterative optimization algorithm recovers original resolution, as confirmed in the magnified pictures in Fig. 10(d).

 figure: Fig. 10.

Fig. 10. Image reconstruction phenomenon of optical hologram. (a) Low-resolution optical hologram for USAF resolution target. (b) Image restored via the iterative optimization algorithm including the expansion process of angular spectrum. Magnified images and profiles of pixel values for the restored images (c) without and (d) with the spectrum expansion process.

Download Full Size | PDF

A digital hologram is a captured diffraction wave. As mentioned previously, once the primary hologram function is known, a high-resolution image can be completely recoverable in the numerical reconstruction process. It is desirable that the primary function is obtained using a sub-pixel mask, where the enhancement in the spatial resolution is shown to be limited by its undersampling extent. Principally, as referred to Fig. 3(a), this function exhibits a perfect form with no aliasing errors at a specified sampling rate. Therefore, the pixel value of whole area does not differ significantly from the quantity in the sub-pixel area, thus indicating that the primary function can be acquired without using a sub-pixel mask. In the numerical study of Figs. 7 and 8, we observed that even a low-resolution hologram prepared by an averaging operation of sub-pixel values clearly restores the image. On the other hand, to relaize this phenomenon in optical hologram, the precise experiment to capture the hologram well defining the NA should be implemented.

The imaging technology applied in this study overcomes the resolution limit of finite imaging systems, thus allowing high-resolution image to be restored over a wide field-of-view. The spatial resolution and field view of the measured image are determined based on the geometric structure of the imaging system. The use of an appropriate objective lens increases an imaging performance.

According to the Abbe resolution criterion, the maximum spatial resolution reaches a half of wavelength. The optical transfer function used in the Fresnel diffraction regime can be extended to the form, $\exp (iz \sqrt {k^2-4\pi ^2 \bf {UU^T}} )$ in the Rayleigh-Sommerfeld region. Although the extension of angular spectra through their replication is possible, the replica patterns in the high-NA appear to be distorted. Furthermore, it is not certain that this scheme is applicable to the evanescent field region. When these two points are theoretically comprehensible, a super-resolution imaging using this strategy would be meaningful.

5. Conclusions

The replication patterns of the digital hologram and its Fourier-transformed form in both real and Fourier spaces correlate with higher angular spectra. This phenomenon is found from the ananlysis of the sampling properties of hologram in a digitized space. The effective method for obtaining high-resolution images over a wide field view was developed to recover the complexity of the optical imaging system. The hologram numerical aperture can be increased only by expanding the angular spectrum, resulting in the resolution enhancement of restored image. Several methods of this holographic imaging were investigated through numerical simulations and optical experiments. An optical imaging system using a relatively low-NA objective lens can avoid disadvantages such as a narrow field-of-view and small depth-of-field.

Funding

Institute for Information and Communications Technology Promotion ((MSIP) (2021-0-00745)).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. M. Born and E. Wolf, Principles of Optics, 7th ed. (Cambridge University, 1999).

2. E. Betzig and J. K. Trautman, “Near-field optics: microscopy, spectroscopy, and surface modification beyond the diffraction limit,” Science 257(5067), 189–195 (1992). [CrossRef]  

3. R. Heintzmann and C. Cremer, “Laterally modulated excitation microscopy: improvement of resolution by using a diffraction grating,” Proc. SPIE 3568, 185–196 (1998). [CrossRef]  

4. S. A. Alexandrov, T. R. Hillman, T. Gutzler, et al., “Synthetic aperture Fourier holographic optical microscopy,” Phys. Rev. Lett. 97(16), 168102 (2006). [CrossRef]  

5. H. M. L. Faulkner and J. M. Rodenburg, “Movable aperture lensless transmission microscopy: A novel phase retrieval algorithm,” Phys. Rev. Lett. 93(2), 023903 (2004). [CrossRef]  

6. C. J. Schwarz, Y. Kuznetsova, and S. R. J. Brueck, “Imaging interferometric microscopy,” Opt. Lett. 28(16), 1424–1426 (2003). [CrossRef]  

7. T. Gutzler, T. R. Hillman, S. A. Alexandrov, et al., “Coherent aperture-synthesis, wide-field, high-resolution holographic microscopy of biological tissue,” Opt. Lett. 35(8), 1136–1138 (2010). [CrossRef]  

8. W. Bishara, T. W. Su, A. F. Coskun, et al., “Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution,” Opt. Express 18(11), 11181–11191 (2010). [CrossRef]  

9. Y. Baek, K. Lee, S. Shin, et al., “Kramers–Kronig holographic imaging for high-space-bandwidth product,” Optica 6(1), 45–2536 (2019). [CrossRef]  

10. J. W. Goodman, Introdction to Fourier Optics (McGraw-Hill, 1996).

11. U. Schnars and W. P. O. Jüpter, “Direct recording of holograms by a CCD target and numerical reconstruction,” Appl. Opt. 33(2), 179–181 (1994). [CrossRef]  

12. E. Cuche, F. Bevilacqua, and C. Depeursinge, “Digital holography for quantitative phase-contrast imaging,” Opt. Lett. 24(5), 291–293 (1999). [CrossRef]  

13. T. Latychevskaia and H. W. Fink, “Resolution enhancement in digital holography by self-extrapolation of holograms,” Opt. Express 21(6), 7726–7733 (2013). [CrossRef]  

14. J. H. Massig, “Digital off-axis holography with a synthetic aperture,” Opt. Lett. 27(24), 2179–2181 (2002). [CrossRef]  

15. V. Mico, Z. Zalevsky, P. García-Martínez, et al., “Synthetic aperture superresolution with multiple off-axis holograms,” J. Opt. Soc. Am. A 23(12), 3162–3170 (2006). [CrossRef]  

16. T. R. Hillman, T. Gutzler, S. A. Alexandrov, et al., “High-resolution, wide-field object reconstruction with synthetic aperture Fourier holographic optical microscopy,” Opt. Express 17(10), 7873–7892 (2009). [CrossRef]  

17. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]  

18. B. Lee, J. Hong, D. Yoo, et al., “Single-shot phase retrieval via Fourier ptychographic microscopy,” Optica 5(8), 976–983 (2018). [CrossRef]  

19. L. Onural, “Sampling of the diffraction field,” Appl. Opt. 39(32), 5929–5935 (2000). [CrossRef]  

20. A. Stern and B. Javidi, “Analysis of practical sampling and reconstruction from Fresnel fields,” Opt. Eng. 43(1), 239–250 (2004). [CrossRef]  

21. B. G. Chae, “Analysis on image recovery for on-axis digital Fresnel hologram with aliased fringe generated from self-similarity of point spread function,” Opt. Commun. 466, 125609 (2020). [CrossRef]  

22. L. Onural, “Some mathematical properties of the uniformly sampled quadratic phase function and associated issues in Fresnel diffraction simulations,” Opt. Eng. 43(11), 2557–2563 (2004). [CrossRef]  

23. B. G. Chae, “Wide viewing-angle holographic display based on enhanced-NA Fresnel hologram,” Opt. Express 29(23), 38221–38236 (2021). [CrossRef]  

24. P. Picart and J. Leval, “General theoretical formulation of image formation in digital Fresnel holography,” J. Opt. Soc. Am. A 25(7), 1744–1761 (2008). [CrossRef]  

25. D. P. Kelly, B. M. Hennelly, N. Pandey, et al., “Resolution limits in practical digital holographic systems,” Opt. Eng. 48(9), 095801 (2009). [CrossRef]  

26. B. B. Mandelbrot, The Fractal Geometry of Nature (Freeman, 1982).

27. A. W. Lohmann, R. G. Dorsch, D. Mendlovic, et al., “1,” J. Opt. Soc. Am. A 13(3), 470 (1996). [CrossRef]  

28. M. Paturzo, F. Merola, S. Grilli, et al., “Super-resolution in digital holography by a two-dimensional dynamic phase grating,” Opt. Express 16(21), 17107–17118 (2008). [CrossRef]  

29. B. G. Chae and S. Lee, “Sparse-view CT image recovery using two-step iterative shrinkage-thresholding algorithm,” ETRI. J. 37(6), 1251–1258 (2015). [CrossRef]  

30. E. J. Candes, J. Romberg, and T. Tao, “Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information,” IEEE Trans. Inf. Theory 52(2), 489–509 (2006). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (10)

Fig. 1.
Fig. 1. (a) Schematic illustrations of the Fresnel holographic imaging system. Point image is restored from digital hologram located at one-half of $z_c$. Green box denotes allowable image space defined by diffraction of hologram pixel. (b) Change in spatial resolution as a function of focal distance. Values for digital hologram consisting of 256$\times$256 pixels with a 8-$\mu$m pixel pitch are drawn. Inset figure presents the simulated diffraction behavior near focal plane.
Fig. 2.
Fig. 2. Graphical analysis for the undersampled digital hologram of point object. (a) Real-valued hologram synthesized at a distance of a half of $z_c$. One-dimensional quadratic phase function along the lateral line at the center is overlapped on the Fresnel zones. (b) Original function and complex exponential function corresponding to $+1^{\rm {st}}$-order replica zone. (c) Spectrum distributions considering a finite pixel size.
Fig. 3.
Fig. 3. Sampling phenomena of (a) response function and (b) transfer function of a point hologram in one-dimensional space. Black, red, and green markers represent original transfer function, and undersampled functions by factors of 2 and 4, respectively. Boxes indicate the corresponding primary functions. $u_c$ is the maximum spatial frequency with respect to bandwidth of original function.
Fig. 4.
Fig. 4. Aliasing effects of undersampled hologram in the Wigner space. (a) Digital hologram for a point object synthesized at a distance of one-third of $z_c$. (b) Wigner distribution description of digital hologram. Point image is focused from inclined line designating spherical fringe of hologram. (c) 3-fold expanded angular spectrum corresponding to digital hologram. (d) Wigner distribution description of angular spectrum.
Fig. 5.
Fig. 5. Methods for increasing image resolution by expanding angular spectrum. (a) Expansion of hologram aperture size by directly searching replica patterns. (b) Image retrieval through the expansion process of angular spectrum for acquired low-resolution hologram. (c) Image retrieval by using captured high-order diffractions.
Fig. 6.
Fig. 6. Reconstruction properties of image by using an extraction process of replica patterns. (a) Low-NA hologram with 256$\times$256 pixels of an 8-$\mu$m pixel interval for several point objects. (b) Hologram extrapolated by using a phase retrieval algorithm. Reconstructed images for (c) low-NA hologram (d) extrapolated hologram. (e) One-dimensional profiles of original and extrapolated holograms.
Fig. 7.
Fig. 7. Simulation results for image reconstruction of undersampled hologram. (a) Zero-padded angular spectrum into 512$\times$512 pixels in the logarithmic scale and (b) restored USAF target image through zero-padding technology. Right picture is the magnified image in red box. (c) 2$\times$2 expanded angular spectra by placing replica in an array. Red box denotes the zeroth order value. (d) Directly restored image via two-multiple expansion of angular spectrum in Fourier space.
Fig. 8.
Fig. 8. Image reconstruction of undersampled hologram by using iterative opimization algorithm. (a) Low-resolution hologram with 128$\times$128 pixels of a 16-$\mu$m pixel interval for the Shepp-Logan phantom. (b) Directly restored image via four-multiple expansion of angular spectrum. (c) 4$\times$4 expanded angular spectra in the logarithmic scale after iterative optimization. (d) Restored image via the iterative optimization algorithm including 4-fold expansion of angular spectrum. Cross-sectional profiles of reconstructed images (e) without and (f) with iterative optimization algorithm (Algorithm 1).
Fig. 9.
Fig. 9. (a) Off-axis holographic technique to acquire an optical hologram. (b) Captured hologram for the USAF resolution target and (c) its Fourier-transformed data. Red box indicates the first-order region. $\theta$ is an off-axis angle.
Fig. 10.
Fig. 10. Image reconstruction phenomenon of optical hologram. (a) Low-resolution optical hologram for USAF resolution target. (b) Image restored via the iterative optimization algorithm including the expansion process of angular spectrum. Magnified images and profiles of pixel values for the restored images (c) without and (d) with the spectrum expansion process.

Tables (1)

Tables Icon

Algorithm 1. Iterative optimization algorithm based on angular spectrum expansion

Equations (11)

Equations on this page are rendered with MathJax. Learn more.

h ( X ) = h 0 exp ( i π λ z X X T ) ,
H ( U ) = H 0 exp ( i π λ z U U T ) ,
B w = N Δ λ z .
R l i m = λ z N Δ = λ 2 N A ,
F T { n h ( n P ) δ ( X n P ) } = 1 | d e t P | m H ( U m Q ) ,
n h ( n P ) δ ( X n P ) = 1 | d e t P | n c n h ( X λ z n Q ) .
z c = N Δ 2 λ .
m H ( m P 0 ) δ ( U m P 0 ) = 1 | d e t P 0 | m c m H ( U m Q 0 λ z ) ,
h ( X λ z n Q ) = c o h ( X ) exp ( i π X n Q ) .
O ( X ) = I F T [ F T { g ( X ) } × H 1 ( U ) ] .
arg min O 1 2 F r ( O ) g 2 + γ TV ( O ) .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.