Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Exceeding the limits of algorithmic self-calibrated aberration recovery in Fourier ptychography

Open Access Open Access

Abstract

Fourier ptychographic microscopy is a computational imaging technique that provides quantitative phase information and high resolution over a large field-of-view. Although the technique presents numerous advantages over conventional microscopy, model mismatch due to unknown optical aberrations can significantly limit reconstruction quality. A practical way of correcting for aberrations without additional data capture is through algorithmic self-calibration, in which a pupil recovery step is embedded into the reconstruction algorithm. However, software-only aberration correction is limited in accuracy. Here, we evaluate the merits of implementing a simple, dedicated calibration procedure for applications requiring high accuracy. In simulations, we find that for a target sample reconstruction error, we can image without any aberration corrections only up to a maximum aberration magnitude of λ/40. When we use algorithmic self-calibration, we can tolerate an aberration magnitude up to λ/10 and with our proposed diffuser calibration technique, this working range is extended further to λ/3. Hence, one can trade off complexity for accuracy by using a separate calibration process, which is particularly useful for larger aberrations.

© 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Fourier ptychographic microscopy (FPM) is a well-known method that captures image data from multiple illumination angles to reconstruct a high-resolution image that achieves the resolution of a high-NA objective with the FOV of a low-NA objective [15]. In addition to providing resolution enhancement, FPM recovers quantitative phase information from intensity-only measurements of the sample. However experimental errors such as illumination misalignment and imaging aberrations have been shown to degrade the performance of FPM, both qualitatively and quantitatively [69]. Work in ptychography has laid the foundation for experimental and computational improvements in FPM [10,11].

One strategy for dealing with unknown aberrations in the imaging system is an algorithmic self-calibration process known as embedded pupil recovery (EPRY), which modifies the reconstruction algorithm to simultaneously recover both the unknown object and the pupil (aberration) function using the same dataset [6,12,13]. This method is purely algorithmic and extends the practical settings under which quantitatively accurate FPM is possible. However, the performance of EPRY is limited by the interdependence of object and pupil reconstructions. Images of distinct samples acquired using the same system do not necessarily reveal the same pupil function using EPRY.

An alternative approach is to measure the aberrations in advance using a separate set of calibration images, then correcting for them in the FPM reconstruction. Specifically, we consider using a speckle imaging approach, which only requires placing a weakly scattering diffuser at the sample plane of the imaging system and capturing images under different illumination angles [14]. Aberrations are recovered from the power spectra of acquired speckle images. Thus, we obtain an unbiased estimate of the pupil function by decoupling aberration and object recovery, which in turn provides an unbiased reconstruction of the sample. This in situ metrology technique is readily applicable to FPM, for which an imaging system must already have controllable illumination angles, and it only requires the additional acquisition of roughly 10 speckle images as a one-time calibration procedure.

We compare these two approaches to aberration correction in FPM for a particular application of interest - accurately measuring the phase of extreme ultraviolet (EUV) photomasks at the operating wavelength of 13.5 nm, which is of critical importance for EUV lithography [1518]. Characterizing the maximum error tolerance is crucial for porting FPM to synchrotron imaging systems [19], which typically operate at wavelengths shorter than visible light where the impact of wavefront errors is magnified.

We start with a model for the SHARP (SHARP High-NA Actinic Reticle review Project) microscope at the Advanced Light Source at Lawrence Berkeley National Laboratory. SHARP is an EUV microscope providing diffraction-limited imaging of photomasks to emulate the conditions of an EUV lithography scanner used in leading-edge semiconductor manufacturing. SHARP uses steerable plane wave illumination at a wavelength of 13.5nm coupled with a single off-axis zone plate to produce an image of the mask’s reflection at a resolution of $\lambda /2\mbox {NA} \approx 82 \text {nm}$ [20]. Images from SHARP are corrupted by field-varying aberrations that increase with distance from the center of the FOV [21,22], degrading image quality significantly at the edges of the image. Accurately characterizing the field-varying aberrations and correcting their effects could greatly increase the usable FOV on SHARP, thus reducing the need for spatial scanning and allowing for increased throughput and decreased operational cost.

In this work, we simulate the performance of these two methods for FPM under the presence of unknown aberrations of varying magnitude. Figure 1 provides a flowchart illustrating the comparison. For each method we identify the maximum magnitude of aberrations under which the complex-valued transmittance of the object can be reconstructed with under 10% error. In the absence of any aberration correction strategies, we find this level of accuracy can only be attained for $NA \approx 0.1$ when the aberrations are smaller than $\lambda / 40$. In contrast, we find that the purely algorithmic approach of EPRY extends the maximum tolerable aberration magnitude to $\lambda / 10$, an increase of $4\times$ compared with no calibration. Finally, our diffuser approach further extends the maximum aberration magnitude to $\lambda / 3$, an additional increase of $3.3\times$ compared with self-calibration and $13\times$ better than the case with no calibration. For SHARP, the aberration magnitude over a 5um distance within the FOV ranges from under $\lambda /21$ near the center of the image, to over $\lambda / 2$ near the edge [23]. Therefore, calibration-free FPM would be unable to attain quantitative accuracy over the full FOV; EPRY could enable quantitative accuracy close to the center of the FOV; and our proposed diffuser calibration could extend the usable FOV to encompass nearly the entire imaging sensor.

We structure our paper as follows: In Section 2, we define our optical system model and summarize both aberration recovery algorithms. In Section 3, we outline our simulation procedure and present comparative results for both reconstruction techniques considered. In Section 4, we discuss the how these results clearly demonstrate the value of independent aberration metrology for moderately and highly aberrated systems.

2. Optical system model

We model an imaging system with the required illumination for FPM - spatially coherent, steerable plane-wave illumination [1]. Defining NA as the NA of the illumination angle, we can compute the image from source point $\boldsymbol {u}=\frac {1}{\text {NA}}\left ( \sin {\theta _x}, \sin {\theta _y} \right )$ by applying the optical transfer function to the incident electric field [24], where $\mathcal {F}$ is the Fourier operator and $\mathcal {F}^{-1}$ is its inverse:

$$I_{\text{out}}(\boldsymbol{x}) = \left|\mathcal{F}^{{-}1} \left[\hat{P}(\boldsymbol{u}) \cdot \mathcal{F}[E_{\text{illumination}}(\boldsymbol{x}) \cdot O(\boldsymbol{x})]\right]\right|^2.$$

The term $E_{\text {illumination}} = \exp \left ( -i2\pi \frac {\text {NA}}{\lambda } \boldsymbol {u} \cdot \boldsymbol {x} \right )$ describes the incident plane-wave that enters the optical system with spatial frequency $\frac {\text {NA}}{\lambda } \boldsymbol {u}$. The term $O(\boldsymbol {x})$ represents the unknown object, and $\widehat {P}(\boldsymbol {u})$ represents the optical transfer function of the imaging system. We assume the following transfer function $\hat {P}(\boldsymbol {u})$ represents an ideal circular aperture with a phase aberration:

$$\hat{P}(\boldsymbol{u}) = \text{exp}\{i \cdot W(\boldsymbol{u})\} \cdot \text{circ}(\boldsymbol{u}).$$

The magnitude of the transfer function is modeled as a binary indicator function, $\text {circ}(\boldsymbol {u})$, owing to the approximately uniform attenuation across all frequencies within the aperture of standard zone-plate lenses in SHARP [25]. The system aberrations manifest in the phase of the transfer function $W(\boldsymbol {u})$, which we refer to as the wavefront error function (WEF).

2.1 Fourier ptychographic microscopy

Fourier ptychographic microscopy is a synthetic aperture microscopy technique that enables super-resolution imaging with quantitative phase retrieval. It is performed by acquiring multiple images of the sample at a series of illumination angles and solving an optimization problem to recover quantitative amplitude and phase. We perform FPM reconstructions with the sequential Gauss-Newton solver [6]. This algorithm iteratively updates its estimation of the object $O(\boldsymbol {u})$ in order to match the observed images. Mathematically, we solve the following optimization problem [1,6]:

$$\min_{O(\boldsymbol{u})} \sum_{\boldsymbol{l}} \sum_{\boldsymbol{x}} |\sqrt{I_l(\boldsymbol{x})} - \bigl|\mathcal{F}^{{-}1} \{\hat P(\boldsymbol{u}) \cdot O(\boldsymbol{u} - \boldsymbol{u}_l)\}| \bigr|^2.$$

2.2 Embedded pupil recovery

An extension to FPM called embedded pupil recovery (EPRY), described in [12] and further developed in [6], involves iteratively solving for the pupil function, along with the object, as part of a joint reconstruction process. The modified optimization problem becomes:

$$\min_{O(\boldsymbol{u}),P(\boldsymbol{u})} \sum_{\boldsymbol{l}} \sum_{\boldsymbol{x}} \bigl|\sqrt{I_l(\boldsymbol{x})} - |\mathcal{F}^{{-}1} \{\hat P(\boldsymbol{u}) \cdot O(\boldsymbol{u} - \boldsymbol{u}_l)\}| \bigr|^2.$$

The EPRY solver alternates between object and pupil updates during the iterative reconstruction. This software-only modification of FPM conveniently enables aberration estimation and digital removal without any hardware modifications. However, a drawback of joint reconstruction is that optimizing both the object and the pupil at once leads to interdependence between object and pupil reconstructions and therefore can lead to pupil-dependent object errors and vice-versa.

2.3 Diffuser-based characterization scheme

An alternate solution to measuring (and digitally removing) aberrations entails collecting images of a diffuser taken with different off-axis illumination, and then analyzing their power spectra [14,22]. This method makes use of self-interference patterns formed in the power spectra of speckle images [26,27], whose expected value depends on the aberrations and illumination conditions [14]. In many experimental settings, we are able to opportunistically find suitable diffusers, such as a holographic diffuser with index-matching oil in the visible range [14] or the surface roughness of an EUV photomask in the specific case of SHARP [22], which we simulate here. The deterministic Gaussian support of the diffuser $|\hat {\phi }_d|$ can be estimated by fitting the single-axis spectrum extracted during the calibration process [22]. Because the atomic-scale features of EUV photomasks are smaller than the imaging resolution, the support spectrum of the diffuser is sufficient to probe the entire imaging system pupil.

We first acquire a single defocused on-axis calibration image to recover a statistical description of the speckle via an initial low-dimensional nonlinear least-squares problem [22]. After the speckle has been characterized, we capture nine additional measurements, each with a different illumination angle, and then use a computational inverse problem to recover the Zernike aberration coefficients. This is performed by solving a nonlinear least-squares problem to minimize the error between observed measurements and those predicted by the forward model [14,22]. The process is mathematically described by the following objective function:

$$\boldsymbol{c}^* = \mathop{\textrm{argmin}}\limits_{\boldsymbol{c}} \sum_{j=1}^{K}|| M_j - f_j(\boldsymbol{c})||^2_2$$
where $M_j$ is the $j^{\text {th}}$ off-axis speckle measurement and $f_j$ is the forward model corresponding to the $j^{\text {th}}$ angle, mapping a set of input aberration coefficients $\boldsymbol {c}$ to the expected pupil interference pattern $f_j(\boldsymbol {c})$. Further details of the mathematical derivation of this method are discussed in the Appendix as well as in [14,22].

Although this aberration measurement strategy involves capturing an extra dataset and inserting new hardware (a diffuser), it is relatively easy to implement in any system that can accommodate FPM, such as SHARP. The use of a separate set of calibration measurements for pupil recovery removes the dependency between object and pupil reconstructions. As our results demonstrate, this can provide a substantial improvement in image quality for quantitative phase retrieval in an aberrated imaging system.

3. Results

We construct a model of the SHARP EUV microscope in MATLAB to simulate the performance of our system with ground truth datasets. Our parameters are $\lambda$ = 13.5 nm, NA = 0.33/4, and effective pixel size = 15 nm. Our analysis uses a 256 $\times$ 256 pixel patch of the imaging sensor due to illumination wavefront causing usable patch size constraints. We model aberrations using Zernike polynomials, excluding piston and tilt. Piston corresponds to a constant phase shift, which is not recoverable from intensity-only measurements, and tilt corresponds to an image plane spatial translation, which can be described without aberrations [14]. We simulate Zernike polynomials of degree 3 with aberration magnitude in terms of root mean square (rms) wavefront error. For the purposes of these experiments, we generate aberrations with random Zernike coefficients at a specified magnitude. At each aberration magnitude, we generate 15 random aberration polynomials and test FPM reconstruction on three different samples with unique magnitude and phase content, given by resized and centered crops from sample images. For diffuser aberration characterization, we initialize with 100 random polynomials and report the result with the lowest MSE after gradient descent optimization, consistent with previous literature [14,22].

To compare the performance of software-only EPRY and our diffuser-based characterization scheme in order to decide whether the extra costs of the diffuser-based system are worth it, we initialize an optical system with a preset aberration magnitude and run both methods on the system. We simulate both the noise-free case and a level of Poisson shot noise corresponding to a representative exposure on SHARP ($5\times 10^4$ photons/pixel).

In Figs. 2 and 3, we present a comparison of the recovered intensity and phase for each method at varying aberration magnitude. We see that benchmarked against the uncorrected FPM recovery results, EPRY performs well when the aberrations are relatively weak, but breaks down when aberration magnitude is greater than $\lambda /10$ waves-rms. On the other hand, our diffuser-based aberration recovery consistently yields field reconstructions within 10% error of the original for a much larger set of aberration magnitudes.

 figure: Fig. 1.

Fig. 1. Simulations comparing Fourier ptychographic microscopy (FPM) reconstruction quality in an aberrated system with two types of calibration: purely computational calibration (Embedded Pupil Recovery, EPRY) and a proposed diffuser calibration step (Proposed). (a) We simulate the captured FPM images for a complex object passing through an imaging system with $\lambda$/5 waves-rms of wavefront error (aberrations). (b) In EPRY, the object and pupil functions are jointly optimized from the aberrated FPM measurements. (c) Our proposed diffuser calibration step collects an additional set of images of a weakly scattering diffuser under varying angles of illumination. These images are used to recover the pupil function, which is then inserted into the FPM algorithm to solve for the object. (d) For aberrations of this magnitude, EPRY suffers from significant artifacts such as crosstalk between phase and amplitude, as well as low-frequency phase errors. Our proposed calibration achieves a much more faithful reconstruction for both pupil and object, with minimal reconstruction artifacts.

Download Full Size | PDF

 figure: Fig. 2.

Fig. 2. Comparison of recovered amplitude and phase using no aberration correction, EPRY and the proposed method at four different aberration magnitudes (in waves-rms). At $\lambda /10$ waves-rms, the uncorrected reconstruction has significant artifacts and low-frequency phase errors (indicated by phase wrapping artifacts) while both EPRY and the diffuser-based method perform well. For aberration magnitudes greater than $\lambda /10$, EPRY reconstructions suffer from high-frequency amplitude artifacts and low-frequency phase errors, while the proposed diffuser-calibrated reconstructions have good performance.

Download Full Size | PDF

In Table 3 we also see a quantitative comparison of the image recovery error for EPRY and diffuser-based recovery. With no noise, diffuser-based recovery is able to consistently recover the image to within 10% error for aberrations up to $\lambda /3$ waves-rms, while EPRY starts failing by $\lambda /10$ waves-rms. In contrast, the uncorrected image error stays high in all cases considered. With a representative experimental photon count of $5\times 10^4$ photon/pixel, the performance difference between these two algorithms is preserved, implying both algorithms are robust to representative levels of noise. A more detailed treatment of noise effects can be found in the Appendix.

4. Discussion

Compared to algorithmic self-calibration, diffuser precalibration significantly increases the maximum correctable aberration level when performing FPM. Maximum correctable aberration level is important in systems like SHARP that suffer from wavelength-scale wavefront errors. The main disadvantage of diffuser calibration is the requirement for a complete set of diffuser speckle images, both due to the extra steps needed for the data acquisition and due to the need for a speckle source. Fortunately, the latter is mitigated on SHARP as the blank part of a target photomask can be used, streamlining the process of taking diffuser calibration images.

Although aberration magnitude of the on-center 5 um patch on SHARP is known to be smaller than $\lambda /21$ waves-rms, the increased accuracy provided by diffuser precalibration at aberration magnitude between $\lambda /10$ and $\lambda /3$ waves-rms can be used to extend usable field of view. SHARP demonstrates these field-dependent aberrations, which are primarily caused by Petzval curvature, making it a system that could benefit our method’s possible FOV extension. Practically, diffuser precalibration improves data throughput by making otherwise discarded off-axis patch data usable, enabling more time-efficient utilization. More generally, our method enables use of lower quality optics without loss of accuracy.

5. Conclusion

In this paper, we compare two different methods of aberration correction for quantitative phase imaging. Despite embedded pupil recovery (EPRY) being a simple software-only extension of the original FPM algorithm, diffuser-based aberration recovery yields higher accuracy at aberration magnitudes between $\lambda$/10 and $\lambda$/3. With aberrations of magnitude below $\lambda$/10 rms, both algorithms are able to recover the object within 10% normalized mean square error. However, for stronger aberrations, taking a separate set of calibration measurements yields more accurate aberration recovery than EPRY. We demonstrate that diffuser-based aberration recovery is a more robust method, even when shot noise is introduced into the system. Additionally, imaging systems with a large FOV often suffer from field-varying aberrations, which can severely degrade FPM reconstructions unless properly compensated. By extending correctable aberration magnitudes, diffuser calibration can extend the usable FOV since field-varying aberrations tend to become stronger with increased off-axis distance. Given that EUV photomask blanks generally satisfy the weak-phase roughness required for diffuser-based aberration recovery, we recommend this method as a competitive and straightforward method for EUV phase imaging systems with aberrations. Furthermore the technique is readily applicable to any FPM system, provided that a suitable diffuser can be found, suggesting that in many settings this could be a method to extend beyond algorithmic limits the acceptable range of aberrations under which quantitatively accurate phase imaging can be conducted.

Appendix A. Diffuser-based aberration metrology

The model we will use is as follows:

$$\hat{I}_{\emptyset}(\boldsymbol{u}) = i \hat{\phi}(\boldsymbol{u}) \circ [\hat{P}^*(\boldsymbol{u}_j) \cdot \hat{P}(\boldsymbol{u} + \boldsymbol{u}_j) - \hat{P}(\boldsymbol{u}_j) \cdot \hat{P}^*(-\boldsymbol{u} + \boldsymbol{u}_j)]$$
where $\hat {\phi }(\boldsymbol {u})$ describes the diffuser and $\hat {I}_{\emptyset }$ describes the DC-suppressed counterpart of $\hat {I}$. The expression for intensity can be rearranged into a form describing the real valued forward model,
$$|\hat{I}_{\emptyset}(\boldsymbol{u})| = 2|\hat{\phi}(\boldsymbol{u})| \cdot |\text{sin}(\it S \{W(\boldsymbol{u}+\boldsymbol{u_0})\}|$$
where $\it S\{f(x) \} = (f(\boldsymbol {u}+\boldsymbol {u_0}) + f(\boldsymbol {u}-\boldsymbol {u_0}))/2$ describes the symmetric decomposition operator. Our expression for the diffuser can be further broken down into two components, $\eta (\boldsymbol {u})$ is a Rayleigh distributed noise parameter and $\hat {\phi }_d(\boldsymbol {u})$ is a Gaussian function, both of which are dependent upon the properties of the photomask. This yields the following characterization of the photomask:
$$|\hat{\phi}(\boldsymbol{u})| = |\hat{\phi}_d(\boldsymbol{u})| \cdot \eta (\boldsymbol{u})$$

We then collect a set of off-axis whitened measurements, which will be defined as:

$$\boldsymbol{m}_j = \frac{|\hat{I}_{\emptyset,j}|}{2 \cdot |\hat{\phi}_d|}$$

Finally, this stack of images can then be formulated into a nonlinear least squares inverse problem written as:

$$\boldsymbol{c}^* = \mathop{\textrm{argmin}}\limits_{\boldsymbol{c}} \sum_{j=1}^{K}||\mathbb{1}[\mathcal{U}_j] \circ (\boldsymbol{m}_j - \mathbb{E}[\eta] \cdot |\text{sin}(\boldsymbol{A}_j \boldsymbol{c})|)||^2$$
where $\boldsymbol {A}_j$ denotes the map from aberration coefficients to sampled self-interference pattern, $\mathcal {U}_j$ denotes the support of the interference pattern, $\mathbb {1}$ is the indicator function, $\mathbb {E}$ is the expectation, and $K$ is the number of images. The details of the problem formulation are more thoroughly derived in previous work [22].

Appendix B. EPRY optimizer convergence

We test optimizer convergence under conditions approximating the 6600 average photon of SHARP. Figure 3 shows that in this case Gauss-Newton optimization outperforms standard alternating projection based on a comparison of pupil recovery accuracy. We use normalized mean squared error as our accuracy metric, which is defined as:

$$E^2(m) = \frac{\sum_{\boldsymbol{u}}|S(\boldsymbol{u})-\alpha S_m(\boldsymbol{u})|^2}{\sum_u|S(\boldsymbol{u})|^2}$$
$$\alpha = \frac{\sum_{\boldsymbol{u}}S(\boldsymbol{u}) \cdot S^*_m(\boldsymbol{u})}{\sum_u|S_n(\boldsymbol{u})|^2}$$

 figure: Fig. 3.

Fig. 3. Cost per iteration showing convergence of optimization methods. The example aberration shown in this plot was randomly sampled from the space of $\lambda$/5 strength. Gauss-Newton in this example both converges faster and converges to a better result.

Download Full Size | PDF

At no aberration, Gauss-Newton (GN) is able to recover the pupil NMSE to within 3% error. An established alternative optimizer used in previous work, Alternating Projection (AP), only recovers within 5% error [28]. Aberrations at $\lambda$/10 are corrected to within 10% error by GN but only within 13% for AP. The superior performance of Gauss-Newton holds as we increase aberration levels up to $\lambda$/3, but the effects become less significant as aberration magnitude increases. Aberrations at 2$\lambda$/7 are corrected to within 28% by GN compared to within 29.2% by AP and by $\lambda$/3, the difference between the algorithms has disappeared.

We further see in Fig. 3 that starting for all iteration steps, Gauss-Newton optimization is more accurate than alternating projection by at least a 2% margin at each iterative step in the algorithm, reinforcing the choice to choose the Gauss-Newton optimizer.

Appendix C. Incorporation of model noise

Realistic optical systems often suffer from Poisson shot noise, which particularly affects systems with low photon counts. Previous work shows that the choice of gradient descent method used in the FPM reconstruction highly influences the the quality of the recovered image and pupil [6]. Gauss-Newton descent was found to yield significantly better reconstruction quality than standard alternating projection when faced with Poisson noise, which is a result reinforced by our findings [2]. Second-order methods also performed well, but we feel the slight gain in accuracy is not enough to justify the increased computational cost. Since the Poisson noise found in LBNL’s SHARP is on the order of 50,000 photons per pixel, photon noise is a significant effect that we decided to include in the Appendix.

Figure 4 presents a set of simulations at different aberration magnitudes, with varying degrees of Poisson noise being introduced. The number of test images and polynomials is kept the same at each aberration magnitude and noise level as in Table 1. As we decrease photon count to 50,000 photons/pixel (Fig. 4(b)) from $10^6$ photons/pixel (Fig. 4(a)), which is the level we see in SHARP, recovery at low aberration magnitude (below $0.3\lambda$ waves-rms) suffers. However, in the range of $0.3\lambda$ to $0.5\lambda$ waves-rms, recovery accuracy is still below 10% NMSE. EPRY performance is similar to that observed at $10^6$ photons/pixel. If we further decrease photon count to $10^3$ photons/pixel (Fig. 4(c)), neither EPRY nor diffuser-based recovery yield significant improvements compared to the uncorrected image, but EPRY is able to converge to a better solution than diffuser-based recovery is. Importantly, even if diffuser-based recovery does not perform as well at extremely low photon counts, it is still no worse than the accuracy obtained with an uncorrected FPM system. Another takeaway is that diffuser-based recovery cannot sense very weak aberrations when there strong noise, while EPRY is not as sensitive to noise. Thus, if the target samples or detector choice is known to lead to extremely low photon counts and low aberration magnitude, diffuser-based recovery is not recommended. But as long as exposure time can be adjusted to compensate for low photon count, we recommend diffuser-based aberration recovery as a more robust and effective precalibration algorithm compared to existing self-calibration embedded recovery.

 figure: Fig. 4.

Fig. 4. Comparisons of method reconstruction error at different aberration magnitudes and photon counts.

Download Full Size | PDF

Tables Icon

Table 1. Comparison of object reconstruction error for varying aberration magnitude and measurement noise. Without noise, EPRY permits a reconstruction error of under 10% (bold) when the magnitude of system aberrations is under $\lambda /10$ waves-rms. With our proposed diffuser precalibration, this can be further extended up to aberration magnitudes of $\lambda /3$ waves-rms. When $5 \times 10^4$ photons/pixel of noise is added, we see that that performance of both algorithms is degraded, but in all cases below $\lambda$/2 the diffuser method achieves greater accuracy than EPRY.

Funding

National Science Foundation (DMR 1548924).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. G. Zheng, R. Horstmeyer, and C. Yang, “Wide-field, high-resolution fourier ptychographic microscopy,” Nat. Photonics 7(9), 739–745 (2013). [CrossRef]  

2. L. Tian, X. Li, K. Ramchandran, and L. Waller, “Multiplexed coded illumination for fourier ptychography with an led array microscope,” Biomed. Opt. Express 5(7), 2376–2389 (2014). [CrossRef]  

3. L. Tian, Z. Liu, L.-H. Yeh, M. Chen, J. Zhong, and L. Waller, “Computational illumination for high-speed in vitro fourier ptychographic microscopy,” Optica 2(10), 904–911 (2015). [CrossRef]  

4. Z. F. Phillips, R. Eckert, and L. Waller, “Quasi-dome: A self-calibrated high-na led illuminator for fourier ptychography,” in Imaging Systems and Applications, (Optical Society of America, 2017), pp. IW4E–5.

5. P. Song, S. Jiang, H. Zhang, X. Huang, Y. Zhang, and G. Zheng, “Full-field fourier ptychography (ffp): Spatially varying pupil modeling and its application for rapid field-dependent aberration metrology,” APL Photonics 4(5), 050802 (2019). [CrossRef]  

6. L. Yeh, L. Tian, Z. Liu, M. Chen, J. Zhong, and L. Waller, “Experimental robustness of fourier ptychographic phase retrieval algorithms,” Opt. Express 23(26), 33214–33240 (2015). [CrossRef]  

7. R. Eckert, Z. F. Phillips, and L. Waller, “Efficient illumination angle self-calibration in fourier ptychography,” Appl. Opt. 57(19), 5434–5442 (2018). [CrossRef]  

8. X. Chen, Y. Zhu, M. Sun, D. Li, Q. Mu, and L. Xuan, “Apodized coherent transfer function constraint for partially coherent fourier ptychographic microscopy,” Opt. Express 27(10), 14099–14111 (2019). [CrossRef]  

9. G. Zheng, X. Ou, R. Horstmeyer, and C. Yang, “Characterization of spatially varying aberrations for wide field-of-view microscopy,” Opt. Express 21(13), 15131–15143 (2013). [CrossRef]  

10. P. Li and A. Maiden, “Lensless led matrix ptychographic microscope: problems and solutions,” Appl. Opt. 57(8), 1800–1806 (2018). [CrossRef]  

11. A. Maiden, D. Johnson, and P. Li, “Further improvements to the ptychographical iterative engine,” Optica 4(7), 736–745 (2017). [CrossRef]  

12. X. Ou, G. Zheng, and C. Yang, “Embedded pupil function recovery for fourier ptychographic microscopy,” Opt. Express 22(5), 4960–4972 (2014). [CrossRef]  

13. J. Chung, G. W. Martinez, K. C. Lencioni, S. R. Sadda, and C. Yang, “Computational aberration compensation by coded-aperture-based correction of aberration obtained from optical fourier coding and blur estimation,” Optica 6(5), 647–661 (2019). [CrossRef]  

14. G. Gunjala, A. Shanker, V. Jaedicke, N. Antipa, and L. Waller, “Optical transfer function characterization using a weak diffuser,” in Three-Dimensional and Multidimensional Microscopy: Image Acquisition and Processing XXIII, vol. 9713 International Society for Optics and Photonics (SPIE, 2016), pp. 190–200.

15. S. Sherwin, I. Cordova, R. Miyakawa, L. Waller, A. Neureuther, and P. Naulleau, “Quantitative phase retrieval for euv photomasks,” in Extreme Ultraviolet (EUV) Lithography XI, vol. 11323 (International Society for Optics and Photonics, 2020), p. 1132315.

16. M. Burkhardt, A. De Silva, J. Church, L. Meli, C. Robinson, and N. Felix, “Investigation of mask absorber induced image shift in euv lithography,” in Extreme Ultraviolet (EUV) Lithography X, vol. 10957 (International Society for Optics and Photonics, 2019), p. 1095710.

17. I. Mochi, S. Fernandez, R. Nebling, U. Locans, P. Helfenstein, R. Rajeev, A. Dejkameh, D. Kazazis, L.-T. Tseng, and Y. Ekinci, “Absorber and phase defect inspection on euv reticles using rescan,” in Extreme Ultraviolet (EUV) Lithography X, vol. 10957 (International Society for Optics and Photonics, 2019), p. 109570W.

18. R. A. Claus, Y.-G. Wang, A. Wojdyla, M. P. Benk, K. A. Goldberg, A. R. Neureuther, and P. P. Naulleau, “Examination of phase retrieval algorithms for patterned euv mask metrology,” in Photomask Technology 2015, vol. 9635 (International Society for Optics and Photonics, 2015), p. 96350F.

19. K. Wakonig, A. Diaz, A. Bonnin, M. Stampanoni, A. Bergamaschi, J. Ihli, M. Guizar-Sicairos, and A. Menzel, “X-ray fourier ptychography,” Sci. Adv. 5(2), eaav0282 (2019). [CrossRef]  

20. K. A. Goldberg, M. P. Benk, A. Wojdyla, D. G. Johnson, and A. P. Donoghue, “New ways of looking at masks with the sharp euv microscope,” in Extreme Ultraviolet (EUV) Lithography VI, vol. 9422 (International Society for Optics and Photonics, 2015), p. 94221A.

21. R. Miyakawa, C. Anderson, and P. Naulleau, “High-na metrology and sensing on berkeley met5,” in Extreme Ultraviolet (EUV) Lithography VIII, vol. 10143 (International Society for Optics and Photonics, 2017), p. 101430N.

22. G. Gunjala, S. Sherwin, A. Shanker, and L. Waller, “Aberration recovery by imaging a weak diffuser,” Opt. Express 26(16), 21054–21068 (2018). [CrossRef]  

23. G. Gunjala, A. Wojdyla, S. Sherwin, A. Shanker, M. P. Benk, K. A. Goldberg, P. P. Naulleau, and L. Waller, “Extreme ultraviolet microscope characterization using photomask surface roughness,” Sci. Rep. 10(1), 11673 (2020). [CrossRef]  

24. J. W. Goodman, Introduction to Fourier optics (Roberts and Company Publishers, 2005).

25. M. P. Benk, R. H. Miyakawa, W. Chao, Y.-G. Wang, A. Wojdyla, D. G. Johnson, A. P. Donoghue, and K. A. Goldberg, “A broader view on euv-masks: adding complementary imaging modes to the sharp microscope,” in Photomask Technology 2014, vol. 9235 (International Society for Optics and Photonics, 2014), p. 92350K.

26. J. W. Goodman, Speckle phenomena in optics: theory and applications (Roberts and Company Publishers, 2007).

27. J. W. Goodman, Statistical optics (John Wiley & Sons, 2015).

28. Z. Zalevsky, D. Mendlovic, and R. G. Dorsch, “Gerchberg–saxton algorithm applied in the fractional fourier or the fresnel domain,” Opt. Lett. 21(12), 842–844 (1996). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (4)

Fig. 1.
Fig. 1. Simulations comparing Fourier ptychographic microscopy (FPM) reconstruction quality in an aberrated system with two types of calibration: purely computational calibration (Embedded Pupil Recovery, EPRY) and a proposed diffuser calibration step (Proposed). (a) We simulate the captured FPM images for a complex object passing through an imaging system with $\lambda$/5 waves-rms of wavefront error (aberrations). (b) In EPRY, the object and pupil functions are jointly optimized from the aberrated FPM measurements. (c) Our proposed diffuser calibration step collects an additional set of images of a weakly scattering diffuser under varying angles of illumination. These images are used to recover the pupil function, which is then inserted into the FPM algorithm to solve for the object. (d) For aberrations of this magnitude, EPRY suffers from significant artifacts such as crosstalk between phase and amplitude, as well as low-frequency phase errors. Our proposed calibration achieves a much more faithful reconstruction for both pupil and object, with minimal reconstruction artifacts.
Fig. 2.
Fig. 2. Comparison of recovered amplitude and phase using no aberration correction, EPRY and the proposed method at four different aberration magnitudes (in waves-rms). At $\lambda /10$ waves-rms, the uncorrected reconstruction has significant artifacts and low-frequency phase errors (indicated by phase wrapping artifacts) while both EPRY and the diffuser-based method perform well. For aberration magnitudes greater than $\lambda /10$, EPRY reconstructions suffer from high-frequency amplitude artifacts and low-frequency phase errors, while the proposed diffuser-calibrated reconstructions have good performance.
Fig. 3.
Fig. 3. Cost per iteration showing convergence of optimization methods. The example aberration shown in this plot was randomly sampled from the space of $\lambda$/5 strength. Gauss-Newton in this example both converges faster and converges to a better result.
Fig. 4.
Fig. 4. Comparisons of method reconstruction error at different aberration magnitudes and photon counts.

Tables (1)

Tables Icon

Table 1. Comparison of object reconstruction error for varying aberration magnitude and measurement noise. Without noise, EPRY permits a reconstruction error of under 10% (bold) when the magnitude of system aberrations is under λ / 10 waves-rms. With our proposed diffuser precalibration, this can be further extended up to aberration magnitudes of λ / 3 waves-rms. When 5 × 10 4 photons/pixel of noise is added, we see that that performance of both algorithms is degraded, but in all cases below λ /2 the diffuser method achieves greater accuracy than EPRY.

Equations (12)

Equations on this page are rendered with MathJax. Learn more.

I out ( x ) = | F 1 [ P ^ ( u ) F [ E illumination ( x ) O ( x ) ] ] | 2 .
P ^ ( u ) = exp { i W ( u ) } circ ( u ) .
min O ( u ) l x | I l ( x ) | F 1 { P ^ ( u ) O ( u u l ) } | | 2 .
min O ( u ) , P ( u ) l x | I l ( x ) | F 1 { P ^ ( u ) O ( u u l ) } | | 2 .
c = argmin c j = 1 K | | M j f j ( c ) | | 2 2
I ^ ( u ) = i ϕ ^ ( u ) [ P ^ ( u j ) P ^ ( u + u j ) P ^ ( u j ) P ^ ( u + u j ) ]
| I ^ ( u ) | = 2 | ϕ ^ ( u ) | | sin ( S { W ( u + u 0 ) } |
| ϕ ^ ( u ) | = | ϕ ^ d ( u ) | η ( u )
m j = | I ^ , j | 2 | ϕ ^ d |
c = argmin c j = 1 K | | 1 [ U j ] ( m j E [ η ] | sin ( A j c ) | ) | | 2
E 2 ( m ) = u | S ( u ) α S m ( u ) | 2 u | S ( u ) | 2
α = u S ( u ) S m ( u ) u | S n ( u ) | 2
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.