Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Coherent modulation imaging using unknown modulators

Open Access Open Access

Abstract

Coherent modulation imaging (CMI) is an effective lensless diffraction imaging method with fast algorithmic convergence and high robustness to data defects. In the reported algorithms for CMI, one important requirement is that the modulator function need to be known a priori; and an additional step for the modulator characterization is required to be carried out in advance by other methods, such as ptychography, which could be cumbersome in practice. Here, we propose an improved algorithm that allows for the transmission function of a completely unknown modulator to be recovered during the same iterative process of image reconstruction. We have verified the method in both simulations and optical experiments. This improvement would turn CMI into a more practical and standalone technique for broader applications in biology and materials science.

© 2021 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

Coherent diffraction imaging (CDI) uses diffraction intensity information to reconstruct the wavefield distribution through iterative calculation [14], and its theoretical resolution is solely diffraction-limited. CDI has become one important imaging technique in the field of X-ray imaging [57] and visible light imaging [810], as well as the high-resolution electron microscopy [11,12] because it does not require high-quality lenses or complicated optical elements like aberration correctors. The conventional CDI has some disadvantages though, namely, poor robustness to noise and missing data due to beam stop [13], high dynamic requirements of detectors [14], and inapplicability for extended objects [15].

Ptychography uses a localized illumination probe and records diffraction patterns of a sample at multiple lateral positions relative to the illumination probe. The overlapping of the illumination area between adjacent measurements provides a such strong constraint that both the complex amplitude of the probe and the sample function can be well retrieved [1619]. However, due to its long data acquisition process, ptychography is not well suitable for fast dynamics study. Some attempts to implement ptychography from a single measurement have been reported, but at the cost of a complicated setup and low information acquisition efficiency [2022]. When imaging biological samples like frozen and hydrated samples, cumulative radiation damage caused by x-rays or electrons [23,24] is inevitable. Therefore, for those radiation-sensitive samples, a single-shot technique that can collect information before the onset of sample damage is highly preferred.

Coherent modulation imaging (CMI) is a variant of the single-shot CDI method [25,8]. Combining the phase modulation and the support constraint in sample space, the ambiguous solutions can be effectively eliminated in the iterative process, leading to fast convergence. It has been successfully demonstrated in X-ray phase imaging of extended samples with inner structures [26]. Since only one diffraction pattern is required, CMI is suitable for studying dynamical samples and even with multiple wavelengths [27]. In addition, because the flexibility of the modulator designing, the weak cascade modulators [28] or other special structures can be used.

In the first reported implementation of CMI, the modulator function is required to be precisely known in advance. The modulator function is usually obtained by other measurement techniques, such as the ptychography. To make CMI a standalone technique, less dependent on other methods, an automatic modulator refinement algorithm has recently been proposed [29]. It works well when an initial guess of the modulator function that deviates from the actual function mainly in an additive manner can be provided. In this letter, we propose an improved algorithm that allows for the transmission function of a completely unknown modulator to be reconstructed along with the multiple object exit waves. The key aspects of the proposed algorithm lie in 1) multiple measurements with the same modulator, 2) an averaging operation on the estimates of the modulator function, and importantly 3) the use of a range constraint on the modulator amplitude. The proposed algorithm is based on the fact that the modulator function remains the same among all measurements, and the average of estimated modulator functions deduced from each measurement will provide a more accurate estimate than any individuals.

2. Methods

Figure 1(a) shows our visible light experimental layout of CMI. A plane wave emitted from a laser source illuminates the sample through a pinhole. The exiting waves of objects are modulated by a phase plate (modulator) and then reached the detector, where the diffraction pattern is recorded. In the proposed method, multiple diffraction patterns are recorded for different objects. The multiple objects can be formed by rotating one sample to different angles, or by switching to completely different samples.

 figure: Fig. 1.

Fig. 1. System layout. (a) schematic of optical setup arrangement; by rotating the sample holder or replacing the sample, a series of diffraction patterns are recorded at the detector. (b) illustrations of the light path and key planes.

Download Full Size | PDF

Figure 1(b) shows the key planes along the wave propagation path. We use the subscripts of the positional vector ${\mathbf r}$, namely, ${{\mathbf r}_\textrm{s}},{\; }{{\mathbf r}_\textrm{m}}$, ${{\mathbf r}_M}$ and ${{\mathbf r}_D}$, to represent the plane that the support constraint is to be applied, the front and rear surfaces of the modulator, and the detector, respectively. ${z_1}$represents the distance from the object to the modulator, and ${z_2}$ is the distance from the modulator to the detector.

Figure 2 shows the flowchart of the reconstruction algorithm. This algorithm iterates back and forth through three planes: the support plane, the modulator plane, and the detector plane. The reconstruction process starts from random initial guesses ${M_0}$ for the modulator function and ${\varphi _{n,0}}({{{\mathbf r}_\textrm{s}}} )$ for the exiting waves of multiple objects, $n = 1,2, \ldots ,{\; }N$. n is the measurement number. N is the total number of objects used. In the following, details of the key steps are described.

 figure: Fig. 2.

Fig. 2. The flowchart of the algorithm with multiple objects. $\varphi $ wave fields; M modulator function; $\textrm{S}$ support; ${\textbf{P}_{{Z_{1,2}}}}$ propagation operator; ${\textbf P}_{{Z_{1,2}}}^{ - 1}$ inverse propagation operator; I diffraction intensity; The superscript ^ indicates the revised version after the modulus constraint has been applied; The subscript n indicates the measurement number; The subscript k is the current running iteration number; The subscript s, m, M, D indicate the support plane, the front and rear surface of the modulator, and the detector plane, respectively.

Download Full Size | PDF

2.1 Support constraint

A localized illumination probe is formed on the object by either an aperture or a focusing lens. The extent of the probe is used as the support $S({{{\mathbf r}_\textrm{s}}} )$, defined as

$$S({{\bf r}_s}) = \left\{ {\begin{array}{cc} 1&{{{\bf r}_s} \in \textrm{support region}}\\ 0&{\textrm{otherwise }} \end{array}} \right.,$$
The support constraint is applied on the wavefield estimate ${\varphi _{\textrm{n},\textrm{k}}}({{{\mathbf r}_\textrm{s}}} )$ according to Eq. (2),
$${\varphi _{n,k}}({{\bf r}_s}) = {\hat{\varphi }_{n,k - 1}}({{\bf r}_s}) \cdot S + \beta ({\hat{\varphi }_{n,k - 1}}({{\bf r}_s}) - {\varphi _{n,k - 1}}({{\bf r}_s})) \cdot (1 - S),$$
The constant $\beta $ is a control parameter, determining the rate that the pixel values outside the support are driven to zero [26]; $\beta $ usually takes value within [0, 1] and a value of 0.35 was used throughout our work. k is the current running iteration number. $\beta = 0.35$

2.2 Modulation

After propagation a distance of ${\textrm{z}_1}$, the wavefield arrives at the modulator. The resultant wavefield ${\varphi _{\textrm{n},\textrm{k}}}({{{\mathbf r}_m}} )$ is then modulated. For thin modulators, the wavefield exiting from the modulator is given by

$${\varphi _{n,k}}({{\bf r}_M}) = {M_k} \cdot {\varphi _{n,k}}({{\bf r}_m}),$$

2.3 Modulus constraint

The wave ${\varphi _{\textrm{n},\textrm{k}}}({{{\mathbf r}_\textrm{M}}} )$ propagates further a distance ${\textrm{z}_2}$, reaches the detector. The modulus of calculated ${\varphi _{\textrm{n},\textrm{k}}}({{{\mathbf r}_D}} )$ is replaced by the square root of the measured intensity${\; }{I_\textrm{n}}({{{\mathbf r}_D}} ).{\; }$The revised wavefield is given as

$${\hat{\varphi }_{n,k}}({{\bf r}_D}) = {{{\varphi _{n,k}}({{\bf r}_D}) \cdot \sqrt {{I_n}({{\bf r}_D})} } / {({{|{{\varphi_{n,k}}({{\bf r}_D})} |}_{ds}} + \varepsilon )}},$$

2.4 Modulator function updating

The updated wavefield ${\hat{\varphi }_{\textrm{n},\textrm{k}}}({{{\mathbf r}_D}} )$ is propagated backward through the distance ${\textrm{z}_2}$, yielding revised wavefield, ${\hat{\varphi }_{\textrm{n},\textrm{k}}}({{{\mathbf r}_M}} )$, on the rear surface of the modulator. The revised modulator function is obtained according to Eq. (5),

$${\tilde{M}_k} = \sum\nolimits_{n = 1}^N {{{{{\hat{\varphi }}_{n,k}}({{\bf r}_M}) \cdot \varphi _{n,k}^ \ast ({{\bf r}_m})} / {(\sum\nolimits_{n = 1}^N {{\varphi _{n,k}}({{\bf r}_m}) \cdot \varphi _{n,k}^ \ast ({{\bf r}_m})} + \varepsilon )}}} ,$$
where we use the superscript * to indicate the conjugation operation.

Another important step is to enforce a range constraint $[{{c_{\textrm{min}}},{c_{\textrm{max}}}} ]$ onto the resultant modulator function to form a new estimate of ${\hat{M}_\textrm{k}}$, as shown in Eqs. (6a6b). Note that there is no need to know precisely the range of modulator amplitude variation in advance. It is usually sufficient to set to [0, 1], to eliminate the unrealistic values for any passive objects [30]. A narrow range could help to increase the convergence rate though.

$$\begin{array}{cc} {{{\hat{M}}_k} = \frac{{{c_{\max }} \cdot {{\tilde{M}}_k}}}{{|{{{\tilde{M}}_k}} |+ \varepsilon }},\begin{array}{cc} {}&{\textrm{if}} \end{array}}&{|{{{\tilde{M}}_k}} |} \end{array} > {c_{\max }},$$
$$\begin{array}{cc} {{{\hat{M}}_k} = \frac{{{c_{\min }} \cdot {{\tilde{M}}_k}}}{{|{{{\tilde{M}}_k}} |+ \varepsilon }},\begin{array}{cc} {}&{\textrm{if}} \end{array}}&{|{{{\tilde{M}}_k}} |} \end{array} \le {c_{\min }},$$
In Eqs. (4-6), $\varepsilon $ is a small number to prevent from dividing by zeros. A value of 0.001 was used in the paper.

2.5 demodulation

To demodulate the revised modulator function of ${\hat{M}_\textrm{k}}$ to obtain the wave fields ${\hat{\varphi }_{\textrm{n},\textrm{k}}}({{{\mathbf r}_m}} )$ just in front of the modulator, a formula from the ePIE algorithm [19] is used, as shown in Eq. (7).

$${\hat{\varphi }_{n,k}}({{\bf r}_m}) = {\varphi _{n,k}}({{\bf r}_m}) + \frac{{\hat{M}_k^ \ast }}{{|{{{\hat{M}}_k}} |_{\max }^2}} \cdot ({\hat{\varphi }_{n,k}}({{\bf r}_M}) - {\varphi _{n,k}}({{\bf r}_M})),$$
Back-propagating ${\hat{\varphi }_{\textrm{n},\textrm{k}}}({{{\mathbf r}_m}} )$ by the distance ${\textrm{z}_1}$gives the revised object exiting waves ${\hat{\varphi }_{\textrm{n},\textrm{k}}}({{{\mathbf r}_s}} )$. The steps (i-v) are repeated until a fixed number of iterations is conducted or an error metric criterion is satisfied [26].

3. Simulations

To verify the effectiveness of the proposed method, we have first conducted simulations in the near-field geometry. The laser wavelength was λ = 520 nm. The illumination probe was about 1.2 mm in diameter. The distances ${\textrm{z}_1} = 40$ mm, and ${\textrm{z}_2} = 20$ mm. The array size of diffraction patterns was $512 \times 512$ pixels, and the detector pixel size was $5.4{\; }\mathrm{\mu }\textrm{m}$. Angular spectrum algorithm was used for the wave propagation along ${\textrm{z}_1}$ and ${\textrm{z}_2}$. The calculated field of view was 2.76 mm. The illumination probe was set to have 1010 photons and the Poisson noise was added in the calculated diffraction intensities.

In the simulations, the modulator was a binary phase plate with a randomly distributed phase of 0 or $0.5\mathrm{\pi }$, whose distribution is shown in Fig. 3(a1). A total of 10 object functions were used in our simulation, and one of them is shown in Figs. 3(b1-b2), wherein the yellow circle indicates the extent of the illuminated area.

 figure: Fig. 3.

Fig. 3. Simulation results of the proposed method. (a1) is the phase of the simulated modulator, (b1) is the amplitude of the first simulated object. Reconstruction results (a2, b2) after 8000 iterations, (a2) is the recovered phase of the modulator, and (b2) is the amplitude reconstruction for (b1). The red square inset in (a1) and (a2) show the zoom-in of the central 20×20 region. (a3) is the difference in the phase value between the simulated modulator and the reconstructed modulator. The color bars in (a1), (a2) are in radians. Phase profile (b3) takes across the red line in (b1) and (b2).

Download Full Size | PDF

In the reconstruction process, an all-one matrix was used for the initial guesses of the modulator function and the object exiting waves. We set the amplitude constraints $[{{c_{\textrm{min}}},{c_{\textrm{max}}}} ]$ to $[{1,1} ]$, assuming a pure phase plate modulator. This tight amplitude range constraint will be relaxed later.

Figure 3(a2) shows the reconstructed modulator function. It can be seen from the middle $20 \times 20$ pixels area that the restored values are well consistent with the original one shown in Fig. 3(a1). Furthermore, Fig. 3(a3) shows the difference between the simulated and reconstructed phases of the modulator, which varies within [-0.001, 0.001] for the central $200 \times 200$ pixels region. The binary phase of the modulator has been recovered precisely. Figure 3(b2) shows the reconstructed object exiting wave, in comparison to the original one in Fig. 3(b1). Figure3(b3) shows the phase difference details of the corresponding red cross-sections in Fig. 3(b1) and Fig. 3(b2). There is a trivial constant deviation of 0.0358rad, and the fluctuation is less than $8 \times {10^{ - 4}}\; $rad.

To evaluate the quality of the reconstructed modulator function and object exiting waves, we use the RMS error metric [31], defined in Eq. (8).

$${\gamma _{N,O}} = {\bf F}\{ {\varphi _N}({f_x},{f_y})\} \cdot {\bf F}{\{ {\varphi _O}({f_x},{f_y})\} ^\ast }$$
$${\gamma _{N,N}} = {\bf F}\{ {\varphi _N}({f_x},{f_y})\} \cdot {\bf F}{\{ {\varphi _N}({f_x},{f_y})\} ^\ast }$$
$${\gamma _{O,O}} = {\bf F}\{ {\varphi _O}({f_x},{f_y})\} \cdot {\bf F}{\{ {\varphi _O}({f_x},{f_y})\} ^\ast }$$
$$\textrm{RMS} = \sqrt {1 - {{{{\left|{\sum\limits_{{f_x},{f_y}} {{\gamma_{N,Org}}} } \right|}^2}} / {\left( {\sum\limits_{{f_x},{f_y}} {{\gamma_{N,N}}} \sum\limits_{{f_x},{f_y}} {{\gamma_{Org,Org}}} } \right)}}} ,$$
where $\textrm{F}\{{\; } \}$ denotes the Fourier transform, and ${\varphi _O}({{\textrm{f}_\textrm{x}},{\textrm{f}_\textrm{y}}} )$ is the original wave field or modulator function, ${\varphi _\textrm{N}}({{\textrm{f}_\textrm{x}},{\textrm{f}_\textrm{y}}} )$ is the calculated wavefield or modulator function.

Figure 4 shows the RMS of the reconstructed object wave and the modulator function. The relationship between the RMS and the number of measured objects is shown in Fig. 4(a). The comparison between the extended algorithm and the original algorithm in Ref. [26] is shown in Fig. 4(b). Here 6 objects were used in this simulation.

 figure: Fig. 4.

Fig. 4. Reconstruction RMS error metric. (a) RMS evolution and its dependence on the number of measurements. (b) The comparison of different algorithms in terms of RMS: original CMI algorithm (red lines), extended algorithm (blue lines). The solid lines are for the object, and the dashed lines are for the modulator.

Download Full Size | PDF

It can be seen in Fig. 4(a) that the RMS values for the modulator decrease as the iteration progressed. When the number of measurements is greater than 3, the proposed algorithm starts to work. The reconstruction quality improves as the number of measurements increases. When the number of measurements is greater than 6, the quality of reconstruction tends to be stable, with an RMS reaching the order of magnitude of 10−3 to 10−4. More simulations show that there is no clear quantitative limit on the required number of measurements, which depends on the size of the illumination area and the complexity of the object waves. Figure 4(b) shows the reconstruction results of different algorithms. The traditional CMI algorithm cannot work entirely for an unknown modulator, but the proposed algorithm can provide results of good quality. In the presented results, a range of [1,1] has been used. When the range was relaxed to [0, 1], we found that a rerun of the algorithm the second time using the retrieved modulator function will give a final RMS error of 0.006.

4. Experiment demonstration

Visible light experiments using the setup as shown in Fig. 1(a) have been carried out. The optical source used was a Thorlabs 4-channel pigtailed diode laser with a wavelength of 517.2 nm. A 1.4 mm diameter pinhole was attached to the sample, i.e., $\textrm{d} = 0$. A fabricated phase plate with randomly distributed pillars was placed between the object and the detector. The transmission function of the phase plate was unknown in this experiment. The distance z1 was measured to be 45.4 mm, and the distance z2 was 22.1 mm. The detector used was an Andor Zyla 5.5 with a pixel size of $6.5\; \mathrm{\mu }\textrm{m}$. The central part of $512 \times 512\; $pixels of the recorded diffraction pattern was cropped out for reconstruction. The object was a tissue paper and was randomly rotated to different angles to record 30 diffraction patterns. The proposed algorithm was used to reconstruct the recorded patterns. The amplitude range $[{{c_{\textrm{min}}},{c_{\textrm{max}}}} ]$ is set to $[{0.4,0.5} ]$. The reconstructed results of the objects and modulator after 5000 iterations are shown in Fig. 5 and Fig. 6.

 figure: Fig. 5.

Fig. 5. The reconstruction results by the extended CMI algorithm. (a1) and (a2) show the 3rd and the 5th diffraction pattern recorded by the detector. The amplitude (b) and the phase (c) of the object reconstruction correspond to (a), respectively. In (b-c) only the area of 256×256 pixels in the middle of the reconstruction is shown.

Download Full Size | PDF

 figure: Fig. 6.

Fig. 6. The reconstruction of unknown modulators by the extended CMI algorithm. (a1) and (b1) represent the amplitude and phase respectively; (a2) and (b2) are the zoom-in views of the central 100×100 region in the red boxes, and (b3) show the phase profile along the blue dashed line in (b2).

Download Full Size | PDF

Figures 5(a1) and 5(a2) show two typical recorded diffraction patterns. Figure 5(b) and 5(c) are the reconstructed amplitude, and phase, corresponding to (a), respectively. From the results, the fabric structure of the tissue paper can be distinguished, and the diameter of a tissue fibre in the red box is about 6.6${\; }\mathrm{\mu }$m wide, which is close to the imaging resolution of the system that equals to the detector pixel size. The amplitude and the phase of the reconstructed modulator are shown in Fig. 6(a1) and Fig. 6(b1), respectively. It can be seen that the reconstructed region is circular with a diameter of 1.6 mm. The size of the illuminated area is related to the size of the pinhole and the angle of light scattered from the sample. Figures 6(a2) and 6(b2) show the zoom-in view of the red box regions. It can be seen that the modulator details have been well reconstructed. Figure 6(b3) shows the phase profile along the blue line in Fig. 6(b2).

To further verify the accuracy of the reconstructed modulator, we conducted an experiment using an onion epidermis as the sample and then performed the conventional CMI reconstruction using the retrieved modulator function as shown in Fig. 6.

Figure 7(a) shows the recorded diffraction intensity of the onion sample. Figure 7(b1) shows the reconstructed sample amplitude. The zoom-in view of the box region is shown in Fig. 7(b2). It can be seen that the nucleus, chloroplast plasma membrane, and cell wall of onion epidermal cells can be observed. This result proves the validity of the extended algorithm for the measurement of the modulator.

 figure: Fig. 7.

Fig. 7. The reconstruction of the onion epidermal sample from a single measurement using the retrieved modulator as a priori information. (a) the recorded diffraction pattern, (b1) the reconstructed amplitude, (b2) the zoom-in of red boxed area in (b1) with 6 times magnification.

Download Full Size | PDF

5. Conclusion

In summary, we report an extended algorithm for coherent modulation imaging. The algorithm allows the use of an unknown modulator in CMI. The core of the algorithm is to reconstruct the modulator function by averaging the multiple estimates derived from each measurement and a range constraint is set on the modulator amplitude. As the multiple object exit-waves are reconstructed, the modulator function can be retrieved. This method saves the need to calibrate the modulator in advance when conducting CMI experiments. The performance of the proposed method has been demonstrated and discussed in detail in both simulations and experiments. We believe the extended algorithm would make CMI a much more independent technique and would find wide use for materials science and biology.

Funding

National Natural Science Foundation of China (11775105, 12074167); Science and Technology Planning Project of Shenzhen Municipality (KQTD20170810110313773); Centers for Mechanical Engineering Research and Education at MIT and SUSTech (MechERE Centers at MIT and SUSTech) (6941806).

Disclosures

The authors declare no conflicts of interest. This work is original and has not been published elsewhere.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. J. R. Fienup, “Reconstruction of an object from the modulus of its Fourier transform,” Opt. Lett. 3(1), 27–29 (1978). [CrossRef]  

2. J. R. Fienup, “Phase retrieval algorithms: a comparison,” Appl. Opt. 21(15), 2758–2769 (1982). [CrossRef]  

3. S. Marchesini, “A unified evaluation of iterative projection algorithms for phase retrieval,” Rev. Sci. Instrum. 78(1), 011301 (2007). [CrossRef]  

4. Y. Shechtman, Y. C. Eldar, O. Cohen, H. N. Chapman, J. Miao, and M. Segev, “Phase retrieval with application to optical imaging: a contemporary overview,” IEEE Signal Process. Mag. 32(3), 87–109 (2015). [CrossRef]  

5. J. Miao, T. Ishikawa, I. K. Robinson, and M. M. Murnane, “Beyond crystallography: diffractive imaging using coherent x-ray light sources,” Science 348(6234), 530–535 (2015). [CrossRef]  

6. H. N. Chapman and K. A. Nugent, “Coherent lensless x-ray imaging,” Nat. Photonics 4(12), 833–839 (2010). [CrossRef]  

7. S. H. Shahmoradian, E. H. R. Tsai, A. Diaz, M. Guizar-Sicairos, J. Raabe, L. Spycher, M. Britschgi, A. Ruf, H. Stahlberg, and M. Holler, “Three-Dimensional Imaging of Biological Tissue by Cryo X-Ray Ptychography,” Sci. Rep. 7(1), 6291 (2017). [CrossRef]  

8. F. Zhang and J. M. Rodenburg, “Phase retrieval based on wave-front relay and modulation,” Phys. Rev. B 82(12), 121104 (2010). [CrossRef]  

9. X. Pan, C. Liu, and J. Zhu, “Phase retrieval with extended field of view based on continuous phase modulation,” Ultramicroscopy 204, 10–17 (2019). [CrossRef]  

10. W. Xu, H. Lin, H. Wang, and F. Zhang, “Super-resolution near-field ptychography,” Opt. Express 28(4), 5164–5178 (2020). [CrossRef]  

11. F. Hue, J. M. Rodenburg, A. M. Maiden, F. Sweeney, and P. A. Midgley, “Wave-front phase retrieval in transmission electron microscopy via ptychography,” Phys. Rev. B 82(12), 121415 (2010). [CrossRef]  

12. E. Carlino, F. Scattarella, L. D. Caro, C. Giannini, D. Siliqi, A. Colombo, and D. E. Galli, “Coherent Diffraction Imaging in Transmission Electron Microscopy for Atomic Resolution Quantitative Studies of the Matter,” Materials 11(11), 2323 (2018). [CrossRef]  

13. X. Huang, J. Nelson, J. Steinbrener, J. Kirz, J. J. Turner, and C. Jacobsen, “Incorrect support and missing center tolerances of phasing algorithms,” Opt. Express 18(25), 26441–26449 (2010). [CrossRef]  

14. K. Giewekemeyer, H. T. Philipp, R. N. Wilke, A. Aquila, M. Osterhoff, M. W. Tate, K. S. Shanks, A. V. Zozulya, T. Salditt, S. M. Gruner, and A. P. Mancuso, “High-dynamic-range coherent diffractive imaging: ptychography using the mixed-mode pixel array detector,” J. Synchrotron Radiat. 21(5), 1167–1174 (2014). [CrossRef]  

15. A. Barty, J. Kupper, and H. N. Chapman, “Molecular imaging using x-ray free-electron lasers,” Annu. Rev. Phys. Chem. 64(1), 415–435 (2013). [CrossRef]  

16. J. M. Rodenburg and H. M. L. Faulkner, “A phase retrieval algorithm for shifting illumination,” Appl. Phys. Lett. 85(20), 4795–4797 (2004). [CrossRef]  

17. H. M. L. Faulkner and J. M. Rodenburg, “Movable aperture lensless transmission microscopy: A novel phase retrieval algorithm,” Phys. Rev. Lett. 93(2), 023903 (2004). [CrossRef]  

18. J. M. Rodenburg, “Ptychography and related diffractive imaging methods,” Adv. Imaging Electron Phys. 150, 87–184 (2008). [CrossRef]  

19. A. M. Maiden and J. M. Rodenburg, “An improved ptychographical phase retrieval algorithm for diffractive imaging,” Ultramicroscopy 109(10), 1256–1262 (2009). [CrossRef]  

20. P. Sidorenko and O. Cohen, “Single-shot ptychography,” Optica 3(1), 9–14 (2016). [CrossRef]  

21. D. Goldberger, J. Barolak, C. G. Durfee, and D. E. Adams, “Three-dimensional single-shot ptychography,” Opt. Express 28(13), 18887–18898 (2020). [CrossRef]  

22. B. Lee, J. Y. Hong, D. Yoo, J. Cho, Y. Jeong, S. Moon, and B. Lee, “Single-shot phase retrieval via Fourier ptychographic microscopy,” Optica 5(8), 976 (2018). [CrossRef]  

23. X. Huang, K. Lauer, J. N. Clark, W. Xu, E. Nazaretski, R. Harder, I. K. Robinson, and Y. S. Chu, “Fly-scan ptychography,” Sci. Rep. 5(1), 9074 (2015). [CrossRef]  

24. J. Deng, D. J. Vine, S. Chen, Q. Jin, Y. S. G. Nashed, T. Peterka, S. Vogt, and C. Jacobsen, “X-ray ptychographic and fluorescence microscopy of frozen-hydrated cells using continuous scanning,” Sci. Rep. 7(1), 445 (2017). [CrossRef]  

25. F. Zhang, G. Pedrini, and W. Osten, “Phase retrieval of arbitrary complex-valued fields through aperture plane modulation,” Phys. Rev. A 75(4), 043805 (2007). [CrossRef]  

26. F. Zhang, B. Chen, G. R. Morrison, J. Vila-Comamala, M. Guizar-Sicairos, and I. K. Robinson, “Phase retrieval by coherent modulation imaging,” Nat. Commun. 7(1), 13367 (2016). [CrossRef]  

27. D. Xue, X. Pan, C. Liu, and J. Zhu, “Single shot multi-wavelength phase retrieval with coherent modulation imaging,” Opt. Lett. 43(8), 1762–1765 (2018). [CrossRef]  

28. Z. He, B. Wang, J. Bai, G. Barbastathis, and F. Zhang, “High-quality reconstruction of coherent modulation imaging using weak cascade modulators,” Ultramicroscopy 214, 112990 (2020). [CrossRef]  

29. B. Wang, Q. Wang, W. Lyu, and F. Zhang, “Modulator refinement algorithm for coherent modulation imaging,” Ultramicroscopy 216, 113034 (2020). [CrossRef]  

30. T. Latychevskaia and H. W. Fink, “Solution to the Twin Image Problem in Holography,” Phys. Rev. Lett. 98(23), 233901 (2007). [CrossRef]  

31. J. R. Fienup, “Invariant error metrics for image reconstruction,” Appl. Opt. 36(32), 8352–8357 (1997). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (7)

Fig. 1.
Fig. 1. System layout. (a) schematic of optical setup arrangement; by rotating the sample holder or replacing the sample, a series of diffraction patterns are recorded at the detector. (b) illustrations of the light path and key planes.
Fig. 2.
Fig. 2. The flowchart of the algorithm with multiple objects. $\varphi $ wave fields; M modulator function; $\textrm{S}$ support; ${\textbf{P}_{{Z_{1,2}}}}$ propagation operator; ${\textbf P}_{{Z_{1,2}}}^{ - 1}$ inverse propagation operator; I diffraction intensity; The superscript ^ indicates the revised version after the modulus constraint has been applied; The subscript n indicates the measurement number; The subscript k is the current running iteration number; The subscript s, m, M, D indicate the support plane, the front and rear surface of the modulator, and the detector plane, respectively.
Fig. 3.
Fig. 3. Simulation results of the proposed method. (a1) is the phase of the simulated modulator, (b1) is the amplitude of the first simulated object. Reconstruction results (a2, b2) after 8000 iterations, (a2) is the recovered phase of the modulator, and (b2) is the amplitude reconstruction for (b1). The red square inset in (a1) and (a2) show the zoom-in of the central 20×20 region. (a3) is the difference in the phase value between the simulated modulator and the reconstructed modulator. The color bars in (a1), (a2) are in radians. Phase profile (b3) takes across the red line in (b1) and (b2).
Fig. 4.
Fig. 4. Reconstruction RMS error metric. (a) RMS evolution and its dependence on the number of measurements. (b) The comparison of different algorithms in terms of RMS: original CMI algorithm (red lines), extended algorithm (blue lines). The solid lines are for the object, and the dashed lines are for the modulator.
Fig. 5.
Fig. 5. The reconstruction results by the extended CMI algorithm. (a1) and (a2) show the 3rd and the 5th diffraction pattern recorded by the detector. The amplitude (b) and the phase (c) of the object reconstruction correspond to (a), respectively. In (b-c) only the area of 256×256 pixels in the middle of the reconstruction is shown.
Fig. 6.
Fig. 6. The reconstruction of unknown modulators by the extended CMI algorithm. (a1) and (b1) represent the amplitude and phase respectively; (a2) and (b2) are the zoom-in views of the central 100×100 region in the red boxes, and (b3) show the phase profile along the blue dashed line in (b2).
Fig. 7.
Fig. 7. The reconstruction of the onion epidermal sample from a single measurement using the retrieved modulator as a priori information. (a) the recorded diffraction pattern, (b1) the reconstructed amplitude, (b2) the zoom-in of red boxed area in (b1) with 6 times magnification.

Equations (12)

Equations on this page are rendered with MathJax. Learn more.

S ( r s ) = { 1 r s support region 0 otherwise  ,
φ n , k ( r s ) = φ ^ n , k 1 ( r s ) S + β ( φ ^ n , k 1 ( r s ) φ n , k 1 ( r s ) ) ( 1 S ) ,
φ n , k ( r M ) = M k φ n , k ( r m ) ,
φ ^ n , k ( r D ) = φ n , k ( r D ) I n ( r D ) / ( | φ n , k ( r D ) | d s + ε ) ,
M ~ k = n = 1 N φ ^ n , k ( r M ) φ n , k ( r m ) / ( n = 1 N φ n , k ( r m ) φ n , k ( r m ) + ε ) ,
M ^ k = c max M ~ k | M ~ k | + ε , if | M ~ k | > c max ,
M ^ k = c min M ~ k | M ~ k | + ε , if | M ~ k | c min ,
φ ^ n , k ( r m ) = φ n , k ( r m ) + M ^ k | M ^ k | max 2 ( φ ^ n , k ( r M ) φ n , k ( r M ) ) ,
γ N , O = F { φ N ( f x , f y ) } F { φ O ( f x , f y ) }
γ N , N = F { φ N ( f x , f y ) } F { φ N ( f x , f y ) }
γ O , O = F { φ O ( f x , f y ) } F { φ O ( f x , f y ) }
RMS = 1 | f x , f y γ N , O r g | 2 / ( f x , f y γ N , N f x , f y γ O r g , O r g ) ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.