Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Scanning a focus through scattering media without using the optical memory effect

Open Access Open Access

Abstract

Wavefront shaping makes it possible to form a focus through opaque scattering materials. In some cases, this focus may be scanned over a small distance using the optical memory effect. However, in many cases of interest, the optical memory effect has a limited range or is even too small to be measured. In such cases, one often resorts to measuring the full transmission matrix (TM) of the sample to completely control the light transmission. However, this process is time-consuming and may not always be possible. We introduce a new method, to the best of our knowledge, for focusing and scanning the focus at any arbitrary position behind the medium by measuring only a subset of the TM, called sparse field focusing (SFF). With SFF, the scan range is not limited to the memory effect, and there is no need to measure the full TM. Our experimental results agree well with our theoretical model. We expect that this method will find applications in imaging through scattering media, especially when the optical memory effect range is small.

© 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

It is challenging to perform high-resolution imaging deep inside scattering media. Due to the inhomogeneity of the refractive index, light is scattered during propagation. However, wavefront-shaping techniques can compensate for this distortion and achieve a focus despite scattering [1,2]. For imaging applications, it is desirable to scan the constructed focus in a two-dimensional plane behind or inside a scattering medium.

There are two approaches to scan the focus acquired by wavefront shaping. First, a single corrected focus is scanned to a new position by applying a shift and/or tilt to the incident wavefront. When the correlation of corrections between the new and the previous positions is high, the previous correction can also be applied to form a focus in the new position. The correlation is called the optical memory effect [37]. In this approach, a focus can be scanned over a limited distance called the memory-effect range or, alternatively, isoplanatic patch. However, to focus light at a position outside this range, a different correction is needed. This problem is illustrated in Figs. 1(a) and 1(b). Figure 1(a) shows the required shaped wavefront to focus the scattered light through a strongly scattering layer. In Fig. 1(b), shifting the incident wavefront causes the light to propagate through a different part of the sample than what the wavefront was originally constructed for. Therefore, the shifted wavefront will not form a focus. This is the limitation of the ordinary scanning technique. The optical memory-effect range is small when focusing deep inside biological tissues (e.g., 6 μm through 1 mm of chicken breast tissue) [4].

 figure: Fig. 1.

Fig. 1. Focusing and scanning via (a), (b) conventional methods and (c), (d) SFF. (a) Focusing scattered light through a turbid medium. (b) Shifting the incident wavefront destroys the focus. (c) Discrete set of shaped waves illuminates the medium. The focus is formed by the superposition of the resulting plane waves in the image plane. (d) Changing the relative phase (solid line) between wavefronts makes the focus move. Note: for clarity, only three non-overlapping incident waves are drawn. In the experiment, several hundreds of overlapping incident waves are used.

Download Full Size | PDF

The second approach is to measure the full transmission matrix (TM) of the scattering medium. The TM is the input-output response of the scattering medium. Knowledge of the full TM makes it possible to focus at any arbitrary position behind the medium [810]. Furthermore, the measured TM provides the required information to transmit images through the medium [11,12]. However, measuring the full TM, if at all possible, is computationally expensive, memory consuming, and slow.

In this Letter, we present a method in which a corrected focus is scanned through a scattering medium beyond its isoplanatic patch, by only measuring a subset of the TM. We will first present our new concept of sparse field focusing (SFF) and experimentally demonstrate that it achieves a scan range that far exceeds the isoplanatic patch. Then we present an analytical model for SFF and compare it to our experimental results.

In our method, the scattering medium is illuminated by a group of superposed wavefronts. Each of these wavefronts is shaped (optimized) in such a way that, after scattering, the light forms a plane wave at the back side of the sample (the image plane). Superposing the optimized wavefronts creates a focus as a result of constructive interference of the transmitted plane waves at the image plane.

Figures 1(c) and 1(d) show the principle of SFF. In Fig. 1(c), the scattering medium is illuminated by a set of wavefronts optimized to form apodized plane waves at the image plane. The apodized plane waves interfere constructively and form a focus at the image plane. Mathematically, the field in the image plane, E(x,y), is now a linear combination of M apodized plane waves added to the background field:

E(x,y)=m=1MAm(x,y)exp(ikmxx+ikmyy+iφm)+Ebg,
where Am(x,y) is the amplitude of the mth optimized field in the image plane. kmx and kmy are the components of the wave vector parallel to the image plane, and φm is an optional and additional phase shift. For simplicity, we only consider one polarization state. When φm=0, the waves interfere constructively to form a focus at x=0,y=0. Practically, not all the light can contribute to form plane waves; part of the light forms a background speckle, Ebg. (See Appendix A for the quantitative treatment.)

Figure 1(d) shows the proposed method of scanning the focus constructed using SFF. To scan the focus by a distance of Δx and Δy, we apply phase shifts of φm=kmxΔx+kmyΔy to the incident waves. Since we only change the overall phase of each shaped wave, each individual wave will still propagate through the medium in the exact same way as without a phase shift. From Eq. (1), we see that the waves now interfere constructively at a shifted position x=Δx and y=Δy. In other words, the focus has been shifted without the need to use a wavefront-shaping algorithm to re-calculate the wavefront for focusing in new isoplanatic patches.

We used the setup depicted in Fig. 2 to measure the partial TM of a scattering sample. A 632.8 nm He–Ne laser beam was expanded and split into two paths; one was reflected off a phase-only spatial light modulator (SLM, GAEA-2 NIR, Holoeye). After a 4f system, the SLM was imaged onto the back focal plane of a microscope objective (A-Plan 100×/0.8, Zeiss), which focused the light onto the surface of the sample. The intensity distribution at the back focal plane of the second objective was imaged with the CMOS1 camera (acA2000-165umNIR, Basler), providing feedback for wavefront shaping. An identical CMOS camera (CMOS2) was used only to visually inspect the focus that is formed by SFF; it was not used for wavefront shaping. P2 was used to select only one of the polarization states.

 figure: Fig. 2.

Fig. 2. Schematic of the experimental setup. HWP, half-wave plate; M, mirror; BS, 50% non-polarizing beam splitter; P, polarizer; CMOS, complementary metal oxide semiconductor camera; obj, microscope objective lens; L1, L2, L3, L4, and L5, lenses with focal lengths of 150, 75, 100, 150, and 200 mm. The inset shows the distribution of 500 targets on CMOS1, and the circle around the targets corresponds to the back pupil of obj2.

Download Full Size | PDF

The sample under study is a 11±3μm thick layer of zinc-oxide (Sigma Aldrich, average grain size 200 nm) on a coverslip with a thickness of 170 μm. The transport mean free path of similar zinc-oxide samples was measured to be around 0.6 μm at a wavelength of λ=632.8nm [13]. Consequently, the sample is optically thick so that there is no transmitted ballistic light. Due to the isotropic scattering, there is no anisotropic memory effect [4]; therefore, this effect cannot be used to scan the focus inside (or at the back surface) of the sample.

We performed wavefront shaping by running a stepwise sequential algorithm [14] and obtaining feedback from 500 individual targets on CMOS1. Each target is a circular region with a diameter of three pixels, corresponding to 11 μm at the back pupil plane of obj2, which is smaller than the speckle size in that plane (diameter of 30 μm). The locations of the targets are shown in Fig. 2 (inset). During the wavefront-shaping process, the reference path is blocked. After performing wavefront shaping, each optimized wave, corresponding to a row of the TM, provides the information needed to construct a focus in the back focal plane (CMOS1) and, consequently, a plane wave in the image plane.

Next, we superposed these optimized waves in the image plane in order to make a focus. For this superposition, all the optimized waves need to be in phase to have constructive interference. The wavefront-shaping algorithm does not give the overall phase for each wave, so an interferometric measurement is needed to determine the relative phase among the optimized waves. The optimized waves have the same phase as the original speckle pattern [1]; therefore, it suffices to measure the phase of the original speckle pattern in the targets on CMOS1 using phase-step holography. We unblocked the reference path and performed phase-step holography. Once the relative overall phase among waves has been measured, we blocked the reference path and subtracted the optimized wavefronts to their measured overall phase so that all optimized waves are in phase. Finally, we summed the M optimized fields in order to generate a superposition of M optimized waves in the image plane. After displaying the phase of this superposed field on the SLM, a bright focus appeared in the image plane.

Figure 3(a) shows the random speckle pattern in the image plane when an unshaped beam is focused onto the sample. In Fig. 3(b), the result of interfering 500 optimized waves is shown. A bright focus is formed in the image plane. Figure 3(c) shows the intensity profile of the focus acquired by interfering 500 waves and the intensity profile of the theoretical diffraction-limited focus (dashed red). The acquired focus is 47 times brighter than the non-optimized speckle pattern. The full width at half-maximum of the obtained focus and the theoretical diffraction-limited focus are 0.520 and 0.407 μm, respectively. This slight difference is most likely caused by a small misalignment of CMOS2, not perfectly placed in the plane conjugated to CMOS1, or the aberration caused by L5.

 figure: Fig. 3.

Fig. 3. Intensity at the image plane (a) with a non-shaped incident beam and (b) when combining 500 optimized plane waves. The acquired focus is 47 times brighter than the original speckle pattern. (c) Intensity profile of the formed focus at the image plane. The dashed line is the intensity profile of the theoretical diffraction-limited focus. (d) Measured intensity enhancement as a function of the displacement from the center for the vertical scanning (blue circles). The predicted value for the enhancement, as given by Eq. (2), is represented by the red solid line.

Download Full Size | PDF

Next, we tried to test how far the focus can be scanned by manipulating the relative overall phase among the optimized waves. First, we calculated the required phase shift, θ, for scanning the focus for a specified displacement along the vertical axis in the image plane. Next, to determine the phase shift of each incident wavefront, φm [Eq. (1)], we linearly mapped the range from 0 to θ to the vertical coordinates of 500 target positions shown in Fig. 2 (inset). By applying the phase shift to the incident wavefronts, the focus was scanned along the vertical axis in the image plane (see Visualization 1). We measured the enhancement of the scanned focus, defined as the ratio of the optimized intensity at the focus location to the reference intensity which is the averaged intensity over 100 positions for the sample [2]. In Fig. 3(d), the measured enhancement is plotted as a function of the spatial displacement of the focus from the beam center during the vertical scanning. The focus can be scanned over a range of 30 μm. Measuring 500 optimized waves using 1010 SLM segments took 8 minutes. Scanning the focus for 241 scanning points took 30 seconds. These time intervals are mainly limited by the response time of the SLM, which can be improved using the recent advances in wavefront shaping [15].

Finally, we verified that the formed focus could not be shifted using the optical memory effect applying tilt or shift, or a combination of the two. This only causes the intensity of the focus to decrease (data are not shown).

We present an analytical model that describes the enhancement of a focus coming from a superposition of M optimized fields [Eq. (1)]. In Appendix A, we show that the enhancement of this focus, η(x,y), equals

η(x,y)=|γ|2M(N1)NsF(x,y)+1,
where M is the number of optimized fields, and N is the number of controlled segments on the SLM used for wavefront shaping. |γ|2 is the wavefront-shaping fidelity describing the quality of the wavefront modulation [16,17]. Since we use phase-only modulation, the fidelity cannot exceed π/4 [1,2]. Form function F(x,y) corresponds to the ensemble averaged intensity in the image plane, normalized to a maximum of one; i.e., F(x,y) is the shape of the diffuse transmission as may be calculated using diffusion theory. From Eq. (2), (x,y) also describes how the enhancement decreases as the focus is scanned away from the center. As such, it corresponds to the envelope of the scan area. Ns is the effective number of speckles in this area (see Appendix A). As can be seen from Eq. (2), the enhancement is inversely proportional to the scan area Ns. In our experiment, the average fidelity of the wavefront shaping was measured to be 0.54 with N=1010. The predicted enhancement for the scanned focus using Eq. (2) is shown in Fig. 3(d) (red solid line).

The focus is scanned for n individual scanning points by changing the relative phase between M incident wavefronts. In other words, we perform a sparse sampling of M rows of the TM. Measuring only M TM rows is sufficient to focus at n positions through scattering media. To quantify how efficient SFF can correct in various isoplantic patches, the gain, A, is defined as the total number of individual scan points (n) divided by the number of shaped wavefronts (M) given by the equation

A=nM.
In our experiment, two-dimensional scanning in the image plane provided 2984±390 individual scanning points with an enhancement higher than 10. Using Eq. (3), the calculated gain for our experiment is 6.0±0.8, meaning that we obtained the full TM by performing 6 times less measurement than measuring the full TM.

In Fig. 3(d), the measured enhancement decreases, where the focus is scanned further away from the center as the model (red solid line), given by Eq. (2), predicts. This decrease follows the distribution of the ensemble averaged intensity in the image plane, which results in a low enhancement for the focus positions further away from the beam center and limits the scan range.

According to Eqs. (2) and (3), there is a trade-off between the gain (A) and enhancement (η). To increase η, we can increase the number of optimized waves (M), but the number of measurements increases causing the gain to decrease.

In summary, we have presented a novel focusing and scanning through scattering media with fewer measurements than those in conventional methods [1,8,18]. This method enables us to scan the focus approximately 30 μm through a strongly scattering medium, while the isoplanatic patch is less than 0.38 μm. We assume that the scattering sample remains stable during the focusing and scanning experiment. Our experimental results show that we can scan the focus through the scattering medium for a number of individual points which is 6.0±0.8 times greater than the number of the measured rows of the TM. The enhancement of the intensity of the focus can be described by Eq. (2). We confirmed that we can achieve a similar resolution by measuring only part of the TM as when measuring the full TM. In this Letter, we assume that both sides of the sample are accessible. However, for cases in which there is no access to the back side of the sample, focusing may be done using an embedded guide-star [1922]. Since it is not possible or desirable to have a guide-star everywhere, we also envision that our sparse sampling approach may be adapted to imaging inside scattering media using a subset of embedded guide-stars.

APPENDIX A

In this appendix, we derive the enhancement of the constructed focus using SFF [Eq. (2)]. In our analytical model, we describe scattering in the sample with the TM elements, tba, which have a circular Gaussian distribution. The transmitted field in output mode b located in the image plane is

Eb=a=1NtbaEa,
where Ea is the input field coming from the phase modulator. We optimize the incident field, Ea, by getting feedback from the intensity of multiple targets located in the back focal plane. The field in the back focal plane is the Fourier transform of the field in the image plane [23]. The field in target m placed in the back focal plane is
EkmbEbexp(ikmb),
where km is the wave vector component. After maximizing the intensity the of M targets in the back focal plane, the optimized incident field of input mode a, E^a, is decomposed into a contribution of the ideal incident field and an orthogonal part to the ideal field, ζam, accounting for experimental imperfections. E^a is given by
E^a=Dγm=1Mbtba*exp(ikmb)+m=1M1|γ|2NMζam,
where the prefactor D=(NMb|tba|2)1/2 normalizes the total incident intensity by assuming that the fields for different M targets and N SLM segments are orthogonal. ζam has a complex Gaussian distribution with mean zero and standard deviation one. * represents the complex conjugate. The fidelity parameter, |γ|2, for phase-only modulation is given by [17]
|γ|2=π4SNR1+SNR,
where SNR is the signal-to-noise ratio of the feedback signal used for wavefront shaping. Replacing the incident field in Eq. (A1) by Eq. (A3) gives
E^b=a=1NtbaDγm=1Mbtba*exp(ikmb)+a=1Ntbam=1M1|γ|2NMζam,
which is the field in the image plane corresponding to the M optimized targets in the back focal plane. The ensemble averaged optimized intensity in the image plane is
|E^b|2=|γ|2M(N1)|tba|22b|tba|2+|tba|2,
where the angle brackets denote ensemble averaging over disorder. The enhancement of the constructed focus in output mode β, η(β), is defined as the ratio of the optimized intensity [Eq. (A6)] to the ensemble averaged intensity, |Eb|2=|tba|2:
η(β)=|γ|2M(N1)|tβa|2b|tba|2+1,
We define the number of speckles as NsbIb/maxIb, with Ib=|tba|2, the ensemble averaged diffuse intensity. Rewriting Eq. (A7) gives
η(β)=|γ|2M(N1)Ns|tβa|2max|tba|2+1.
When we substitute F(β)=|tβa|2/max|tba|2 in Eq. (A8), we derive Eq. (2) describing that the enhancement follows the distribution of the original diffuse intensity.

Funding

Nederlandse Organisatie voor Wetenschappelijk Onderzoek (Vidi grant 14879).

Acknowledgment

The authors would like to thank Gerwin Osnabrugge for the helpful discussions.

REFERENCES

1. I. M. Vellekoop and A. P. Mosk, Opt. Lett. 32, 2309 (2007). [CrossRef]  

2. J. Kubby, S. Gigan, and M. Cui, Wavefront Shaping for Biomedical Imaging, Advances in Microscopy and Microanalysis (Cambridge University, 2019).

3. I. M. Vellekoop and C. M. Aegerter, Opt. Lett. 35, 1245 (2010). [CrossRef]  

4. B. Judkewitz, R. Horstmeyer, I. M. Vellekoop, I. N. Papadopoulos, and C. Yang, Nat. Phys. 11, 684 (2015). [CrossRef]  

5. S. Schott, J. Bertolotti, J.-F. Léger, L. Bourdieu, and S. Gigan, Opt. Express 23, 13505 (2015). [CrossRef]  

6. J.-H. Park, W. Sun, and M. Cui, Proc. Natl. Acad. Sci. USA 112, 9236 (2015). [CrossRef]  

7. G. Osnabrugge, R. Horstmeyer, I. N. Papadopoulos, B. Judkewitz, and I. M. Vellekoop, Optica 4, 886 (2017). [CrossRef]  

8. S. M. Popoff, G. Lerosey, R. Carminati, M. Fink, A. C. Boccara, and S. Gigan, Phys. Rev. Lett. 104, 100601 (2010). [CrossRef]  

9. H. Yu, T. R. Hillman, W. Choi, J. O. Lee, M. S. Feld, R. R. Dasari, and Y. Park, Phys. Rev. Lett. 111, 153902 (2013). [CrossRef]  

10. M. Kim, W. Choi, Y. Choi, C. Yoon, and W. Choi, Opt. Express 23, 12648 (2015). [CrossRef]  

11. S. Popoff, G. Lerosey, M. Fink, A. C. Boccara, and S. Gigan, Nat. Commun. 1, 81 (2010). [CrossRef]  

12. A. P. Mosk, A. Lagendijk, G. Lerosey, and M. Fink, Nat. Photonics 6, 283 (2012). [CrossRef]  

13. E. G. van Putten, “Disorder-enhanced imaging with spatially controlled light,” Ph.D. thesis (University of Twente, 2011).

14. I. M. Vellekoop and A. P. Mosk, Opt. Commun. 281, 3071 (2008). [CrossRef]  

15. O. Tzang, E. Niv, S. Singh, S. Labouesse, G. Myatt, and R. Piestun, Nat. Photonics, 1 (2019). [CrossRef]  

16. I. M. Vellekoop, Opt. Express 23, 12189 (2015). [CrossRef]  

17. H. Yilmaz, W. L. Vos, and A. P. Mosk, Biomed. Opt. Express 4, 1759 (2013). [CrossRef]  

18. K. Wang, W. Sun, C. T. Richie, B. K. Harvey, E. Betzig, and N. Ji, Nat. Commun. 6, 7276 (2015). [CrossRef]  

19. I. M. Vellekoop, E. G. van Putten, A. Lagendijk, and A. P. Mosk, Opt. Express 16, 67 (2008). [CrossRef]  

20. C.-L. Hsieh, Y. Pu, R. Grange, and D. Psaltis, Opt. Express 18, 12283 (2010). [CrossRef]  

21. J. Aulbach, B. Gjonaj, P. Johnson, and A. Lagendijk, Opt. Express 20, 29237 (2012). [CrossRef]  

22. O. Katz, E. Small, Y. Guan, and Y. Silberberg, Optica 1, 170 (2014). [CrossRef]  

23. J. Goodman, Introduction to Fourier Optics, McGraw-Hill Physical and Quantum Electronics Series (W. H. Freeman, 2005).

Supplementary Material (1)

NameDescription
Visualization 1       Scanning the focus through the scattering medium using sparse field focusing.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (3)

Fig. 1.
Fig. 1. Focusing and scanning via (a), (b) conventional methods and (c), (d) SFF. (a) Focusing scattered light through a turbid medium. (b) Shifting the incident wavefront destroys the focus. (c) Discrete set of shaped waves illuminates the medium. The focus is formed by the superposition of the resulting plane waves in the image plane. (d) Changing the relative phase (solid line) between wavefronts makes the focus move. Note: for clarity, only three non-overlapping incident waves are drawn. In the experiment, several hundreds of overlapping incident waves are used.
Fig. 2.
Fig. 2. Schematic of the experimental setup. HWP, half-wave plate; M, mirror; BS, 50% non-polarizing beam splitter; P, polarizer; CMOS, complementary metal oxide semiconductor camera; obj, microscope objective lens; L1, L2, L3, L4, and L5, lenses with focal lengths of 150, 75, 100, 150, and 200 mm. The inset shows the distribution of 500 targets on CMOS1, and the circle around the targets corresponds to the back pupil of obj2.
Fig. 3.
Fig. 3. Intensity at the image plane (a) with a non-shaped incident beam and (b) when combining 500 optimized plane waves. The acquired focus is 47 times brighter than the original speckle pattern. (c) Intensity profile of the formed focus at the image plane. The dashed line is the intensity profile of the theoretical diffraction-limited focus. (d) Measured intensity enhancement as a function of the displacement from the center for the vertical scanning (blue circles). The predicted value for the enhancement, as given by Eq. (2), is represented by the red solid line.

Equations (11)

Equations on this page are rendered with MathJax. Learn more.

E ( x , y ) = m = 1 M A m ( x , y ) exp ( i k m x x + i k m y y + i φ m ) + E bg ,
η ( x , y ) = | γ | 2 M ( N 1 ) N s F ( x , y ) + 1 ,
A = n M .
E b = a = 1 N t b a E a ,
E k m b E b exp ( i k m b ) ,
E ^ a = D γ m = 1 M b t b a * exp ( i k m b ) + m = 1 M 1 | γ | 2 N M ζ a m ,
| γ | 2 = π 4 SNR 1 + SNR ,
E ^ b = a = 1 N t b a D γ m = 1 M b t b a * exp ( i k m b ) + a = 1 N t b a m = 1 M 1 | γ | 2 N M ζ a m ,
| E ^ b | 2 = | γ | 2 M ( N 1 ) | t b a | 2 2 b | t b a | 2 + | t b a | 2 ,
η ( β ) = | γ | 2 M ( N 1 ) | t β a | 2 b | t b a | 2 + 1 ,
η ( β ) = | γ | 2 M ( N 1 ) N s | t β a | 2 max | t b a | 2 + 1 .
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.