Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Achieving the shot-noise limit using experimental multi-shot digital holography data

Open Access Open Access

Abstract

In this paper, we achieve the shot-noise limit using straightforward image-post-processing techniques with experimental multi-shot digital holography data (i.e., off-axis data composed of multiple noise and speckle realizations). First, we quantify the effects of frame subtraction (of the mean reference-only frame and the mean signal-only frame from the digital-hologram frames), which boosts the signal-to-noise ratio (SNR) of the baseline dataset with a gain of 2.4 dB. Next, we quantify the effects of frame averaging, both with and without the frame subtraction. We show that even though the frame averaging boosts the SNR by itself, the frame subtraction and the stability of the digital-hologram fringes are necessary to achieve the shot-noise limit. Overall, we boost the SNR of the baseline dataset with a gain of 8.1 dB, which is the gain needed to achieve the shot-noise limit.

1. Introduction

With the use of a strong reference, digital holography potentially enables a shot-noise-limited detection regime. Such a detection regime allows researchers to combat the low signal-to-noise ratios (SNRs) that often occur when performing field applications like long-range imaging [110]. Thus, digital holography is an enabling technology.

Using digital holography for field applications like long-range imaging requires the use of a laser beam to actively illuminate an extended object. In addition, digital holography requires the use of a receiver with a local oscillator to interfere the scattered-return signal with an ideal-local reference after propagation through the atmosphere. Inherent in this process are coupled phenomena, which result from rough-surface scattering [11,12] and distributed-volume atmospheric aberrations [13,14]. Respectively, both speckle [1519] and scintillation [2024] manifest, in addition to anisoplanatism [25,8], which gives rise to the deep-turbulence problem [2529].

With the above details in mind, Spencer recently used a scalar formulation (and the assumptions therein) to develop closed-form expressions for the SNR, $S/N$, associated with off-axis and on-axis recording geometries often used when performing digital holography [30]. For all intents and purposes, these closed-form expressions took the following form:

$$S/N = \eta_t\alpha\frac{\overline{m}_S\overline{m}_R}{\overline{m}_S+\overline{m}_R+\sigma_{n}^2},$$
where $\eta _t$ is the total-system efficiency, $\alpha$ is a recording-geometry constant, $\overline {m}_S$ and $\overline {m}_R$ are, respectively, the mean number of signal and reference photoelectrons (assuming Poisson statistics), and $\sigma _n^2$ is the total-noise variance associated with the focal-plane array (FPA) read out integrated circuitry (assuming Gaussian statistics). With the use of a strong reference, $\overline {m}_R\gg \overline {m}_s$ and $\overline {m}_R\gg \sigma _n^2$. As such, we can approach a shot-noise-limited detection regime, such that
$$S/N = \eta_t\alpha\overline{m}_S.$$

In writing Eqs. (1) and (2), one must acknowledge that the number of hologram photoelectrons, $\overline {m}_H=\overline {m}_S+\overline {m}_R$, can not exceed the pixel-well depth of the FPA, as that would lead to camera-saturation effects. This last point leads to an interesting trade space using modern-day cameras, and recent modeling and simulations efforts validated the use of these closed-form expressions [31,32]. In particular, these analyses made use of wave-optics simulations, assuming an ideal total-system efficiency (i.e., $\eta _t=100\%$), and showed that one is not guaranteed a shot-noise-limited detection regime if the pixel-well depth is on the order of $\sigma _n^2$.

Independent of being in a shot-noise-limited detection regime, recent laboratory experiments also showed that efficiency losses further limit the achievable SNR [3335]. With Eqs. (1) and (2) in mind, these experiments showed that one can decompose the total-system efficiency, $\eta _t$, into independent multiplicative terms, which represent the various physical phenomena that induce efficiency losses. These efficiency losses degrade the achievable SNR and are quantifiable with the appropriate digital-holography datasets and image-post-processing techniques.

Another laboratory experiment recently showed that given multi-shot digital holography data (in this case, off-axis data composed of multiple noise and scintillation realizations), one can use straight forward post processing techniques like frame subtraction and frame averaging to boost the SNRs associated with their digital-holography datasets [28]. This experiment, however, did not attempt to quantify these SNR boosts in terms of efficiency losses. In turn, we realized that such an analysis could have distinct benefits for other laboratory experiments, like those that use digital-holographic microscopy [36]. We also realized that such an analysis could have distinct benefits for field applications like long-range imaging, as previously mentioned, in addition to imaging through fog [37].

These aforementioned realizations provided the motivation needed to perform the digital-holography research presented in this paper. Put simply, we wanted to quantify the effects of straightforward image-post-processing techniques in terms of the efficiency losses that degrade the achievable SNR. In turn, we discovered that we can use frame subtraction and frame averaging, along with multi-shot digital holography data (in this case, off-axis data composed of multiple noise and speckle realizations), to achieve the shot-noise limit. Given the detailed analysis presented herein, this discovery serves as a novel contribution to the digital-holography research community. With this novelty statement in mind, it is important to note that past research efforts have claimed to achieve the shot-noise limit [38], but their definition for what this fundamental limit entails differs from the detailed analysis presented herein.

In what follows, we define the shot-noise limit (for the experimental multi-shot digital holography data referred to throughout this paper) as the gain needed to boost the SNR, such that it equals the closed-form expression given in Eq. (2) with an ideal total-system efficiency (i.e., $\eta _t = 100\%$). In Section 2, we simply refer to this shot-noise-limited SNR as the ideal SNR [cf. Equation (3)]. We also provide the background details needed to understand the experimental setup, SNR calculations, and efficiency calculations used to achieve the shot-noise limit. In Section 3, we then quantify the effects of frame subtraction, and in Section 4 we quantify the effects of frame averaging, both with and without the frame subtraction. Thereafter, we conclude this paper in Section 5, and we include an appendix that shows that frame subtraction is a necessary first step to achieve the shot-noise limit.

2. Background details

In this section, we discuss the background details associated with the experimental setup used to collect the various digital-holography datasets referred to throughout this paper. We also discuss the background details associated with the SNR and efficiency calculations. Previous efforts made use of similar setups and calculations to investigate the various efficiency losses that degrade the achievable SNR [3335]. These previous efforts, in addition to the recent work of Radosevich et al. [28], provide the insights needed to develop the straightforward image-post-processing techniques presented in this paper to achieve the shot-noise limit.

2.1 Experimental setup

We collected the various digital-holography datasets referred to throughout this paper, like the baseline dataset illustrated in Fig. 1, in the off-axis image plane recording geometry (IPRG) [25,31]. For this purpose, we started with a continuous-wave, master-oscillator (MO) laser (Cobalt Samba 1000) with a wavelength of 532 nm and a linewidth less than 1 MHz. We then split the light from the MO laser into a local oscillator (LO) and an illuminator using a half-wave plate and polarizing beam splitter (PBS) cube. For the LO, we fiber coupled the light split off from the PBS cube and placed the tip of the single-mode, polarization-maintaining fiber next to an imaging lens. The diverging light from the fiber tip illuminated a $2048 \times 1536$ pixel region of interest on the focal-plane array (FPA) of the camera (Point Grey Grasshopper3 GS3-U3-32S4M-C) to create a reference. As shown in Fig. 1 (a), the FPA’s coverglass produced an etalon-interference pattern, which yielded a non-uniform reference.

For the illuminator, we expanded the near-Gaussian beam to a diameter of approximately 4 cm and illuminated a sheet of Spectralon. By design, the Spectralon provided an optically rough surface with 99% reflectivity and near-Lambertain scattering, which produced speckle. We imaged this speckle with a one-inch-diameter lens onto the FPA to create a signal [see Fig. 1 (b)]. In accordance with the off-axis IPRG [25,31], we placed the imaging lens, with a focal length of 350 mm, 2.46 m away from the Spectralon.

 figure: Fig. 1.

Fig. 1. Overview of the baseline dataset used in this paper. The top row depicts the average frames, whereas the bottom row depicts the corresponding average Fourier-plane energies, where the camera-integration time and optical-path-length differences were $t_i = 100\,\mu s$ and $\Delta \ell = 0\,m$, respectively. Here, (a) shows the mean reference-only frame $\overline {m}_R(x,y)$, (b) shows the mean signal-only frame $\overline {m}_S(x,y)$, (c) shows the mean digital-hologram frame $\overline {m}_H(x,y)$, (d) shows the mean reference-only energy in the Fourier plane $\overline {E}_R \left ( f_x, f_y\right )$, (e) shows the mean signal-only energy in the Fourier plane $\overline {E}_S \left ( f_x, f_y\right )$, and (f) shows the mean digital-hologram energy in the Fourier plane $\overline {E}_H \left ( f_x, f_y\right )$. Note that the dashed circle in (d) and (e) is the pupil filter, which illustrates the sampled noise in the Fourier plane.

Download Full Size | PDF

To achieve a strong reference, the reference strength was set to approximately 25% of the FPA’s pixel-well depth, such that $\overline {m}_R \approx 2,676\,$ pe, where $\overline {m}_R$ is again the mean number of reference photoelectrons. We then set the signal strength to $\overline {m}_S \approx 71\,$pe, where $\overline {m}_S$ is again the mean number of signal photoelectrons. As shown in Fig. 1 (c), the resulting digital hologram maintained aspects of the near-Gaussian speckle pattern due to the signal and the etalon-interference pattern due to the reference.

In this paper, we used four datasets with a combination of two different camera-integration times, $t_i = 100\,\mu$s and 100 ms, and two different optical-path-length differences between the signal and reference, $\Delta \ell = 0\,$m and 247.5 m. We created the optical-path-length differences by inserting an additional 165 m length of fiber, with a refractive index of 1.5, in the reference path, relative to the fixed signal path. Each dataset contains a series of 200 digital-hologram frames, 200 signal-only frames, and 200 reference-only frames.

For the 200 digital-hologram and signal-only frames, we collected 10 speckle realizations by rotating the Spectralon to illuminate a completely different portion of the optically rough surface. To average the shot noise, we collected 20 digital-hologram, signal-only, and reference-only frames sequentially for each speckle realization. Our experimental procedure, overall, consisted of collecting 20 digital-hologram, 20 signal-only, and 20 reference-only frames, then we rotated the Spectralon and repeated this process 10 times. Thus, in Fig. 1 we show the average of the 200 reference-only frames, signal-only frames, and digital-hologram frames, respectively, in the top row and their corresponding average energies in the Fourier plane in the bottom row.

As shown in Fig. 1 (a) and (c), the etalon-interference pattern due to the reference produced two main sets of fringes. The approximate periodicity of both fringe sets corresponded to low-spatial-frequency features in the Fourier plane, as seen Fig. 1 (d) and (f), respectively. Fortunately, these low-spatial-frequency features are outside of the pupil filter and did not considerably contribute to the sampled noise in the Fourier plane. However, as we show in the ensuing analysis, the non-uniform reference can yield excess noise above the reference shot noise [33].

In accordance with the off-axis IPRG [25,31], we had an image-plane sampling quotient, $q_I$, of 2.7 and a circular pupil approximately centered in the top-right quadrant of the Fourier plane [see Fig. 1 (f)]. As a reminder, $q_I$ represents the number of pupil diameters across the Fourier plane. The autocorrelation of the signal created a strong, DC-centered feature in the Fourier plane. This feature was approximately conical, as described by the chat function [39,40], with a diameter of twice the pupil in the Fourier plane. With a $q_I = 2.7$, the pupil filter sampled a significant portion of this chat-like feature from the autocorrelation of the signal in the Fourier plane [see Fig. 1 (e)]. As previously explained [33], this sampling of the chat-like feature yields excess noise due to the signal that increases quadratically with signal strength.

2.2 Signal-to-noise ratio calculations

With the shot-noise limit in mind, we derived a closed-form expression for the ideal SNR, $S/N_i$. To do so, we assumed a uniform and strong reference, such that the dominant noise was the reference shot noise. Thus, for the off-axis IPRG [25,31], we obtained the following closed-form expression [cf. Equation (2), where $\eta _t = 100\%$]:

$$S/N_i = \frac{4 q_I^2}{\pi} \overline{m}_S,$$
where again, $q_I$ is the image-plane sampling quotient and $\overline {m}_S$ is the mean number of signal photoelectrons. With $q_I =2.7$ and $\overline {m}_S = 71\,$pe, $S/N_i = 661$ for the baseline dataset (cf. Fig. 1).

To estimate the SNR from the collected digital-hologram frames, we used the following calculation in the Fourier plane:

$$S/N^\prime = \frac{\left \langle \overline{E}_H \left (f_x,f_y \right) - \overline{E}_N \left (f_x,f_y \right) \right \rangle_P}{\left \langle \overline{E}_N \left(f_x,f_y \right) \right \rangle_P },$$
where $S/N^\prime$ is the estimated SNR, $\overline {E}_H\left ( f_x,f_y\right )$ is the mean hologram energy (i.e., the magnitude squared of the complex data), $\overline {E}_N\left ( f_x,f_y\right )$ is the mean noise energy, and $\langle \cdot \rangle _P$ denotes a spatial average over the pupil filter in the Fourier plane. To estimate $\overline {E}_N\left ( f_x,f_y\right )$, we assumed that the noise in the Fourier plane was symmetric about the y-axis, so that $\overline {E}_N\left ( f_x,f_y\right ) = \overline {E}_H\left ( f_x,-f_y\right )$. This assumption was appropriate, since the reference did not show any noticeable features within the pupil filter nor in the adjacent quadrant, and the chat-like feature was approximately radially symmetric [cf. Fig. 1 (b)].

2.3 Efficiency calculations

From Eqs. (3) and (4), we calculated the estimated total-system efficiency, $\eta ^\prime _t$, as

$$\eta^\prime_t = \frac{S/N^\prime}{S/N_i}.$$

This calculation quantifies how much the estimated SNR, $S/N^\prime$ [cf. Equation (4)], is below the ideal, shot-noise limited SNR, $S/N_i$ [cf. Equation (3)]. Therefore, we achieved the shot-noise limit in the ensuing analysis when $\eta ^\prime _t = 100\%$.

Various physical phenomena, in practice, induce efficiency losses that degrade the achievable SNR, which made the shot-noise limit extremely difficult to achieve. For example, we included one such loss, the quantum efficiency of the FPA, in the definition of $\overline {m}_S$ in Eq. (3); thus, one might refer to the shot-noise limit defined in this paper as the quantum limit. To account for other efficiency losses, we used the total-system efficiency $\eta _t$ [cf. Equations (1) and (2)], and deconstructed it into independent multiplicative terms [3335].

For simplicity in the analysis, we deconstructed the total-system efficiency $\eta _t$ into two-major efficiencies, such that $\eta _t = \eta _m \eta _n$, where $\eta _m$ is the mixing efficiency and $\eta _n$ is the noise efficiency. Note that $\eta _m$ characterizes how well the signal and reference interfere and how well the FPA digitally records the resulting hologram. Also note that $\eta _n$ characterizes how much noise is above the reference shot noise.

Various physical phenomena, in practice, contribute to the mixing efficiency $\eta _m$, such as the signal-reference polarization, the pixel modulation transfer function, the laser coherence, and the laboratory vibrations. Previous efforts analyzed $\eta _m$ in terms of independent multiplicative terms [3335], but here, we only accounted for the overall $\eta _m$. To estimate $\eta _m$, we made use of the following calculation:

$$\eta^\prime_m = \frac{\pi}{4 q_I^2}\frac{\left \langle \overline{E}_H(f_x,f_y) - \overline{E}_N(f_x,f_y) \right \rangle_P}{\left \langle\overline{m}_R(x,y) ~\overline{m}_S(x,y) \right \rangle_I},$$
where $\eta ^\prime _m$ is the estimated $\eta _m$. In Eq. (6), $\langle \cdot \rangle _P$ again denotes a spatial average over the pupil filter in the Fourier plane, whereas $\langle \cdot \rangle _I$ denotes a spatial average over the entire image plane; therefore, the factor of $\pi/\left (4 q_I^2 \right )$ is the ratio of the pupil area to the Fourier plane area.

Both the reference and signal, in practice, yield excess noise that is above the reference shot noise [33]. Thus, we accounted for the total excess noise using the noise efficiency $\eta _n$. To estimate $\eta _n$, we made use of the following calculation:

$$\eta^\prime_n = \frac{\left \langle \overline{m}_R(x,y) \right \rangle_I}{\left \langle \overline{E}_N\left(f_x,f_y \right) \right \rangle_P},$$
where $\eta ^\prime _n$ is the estimated $\eta _n$. By definition, Eq. (7) is the ratio of the reference shot-noise variance, which is Poisson distributed, to the total noise. Therefore, when $\eta ^\prime _n < 100\%$ , the hologram contains more noise than the reference shot noise, and when $\eta^{\prime}_{n} ≥ 100\%$, the hologram contains less noise than the reference shot noise. In this latter regime, we specifically overcome the shot-noise floor [cf. Equation (24)].

With Eqs. (3)–(7) in mind, in Table 1 we provide the initial estimates for the baseline dataset (cf. Figure 1), where the $\pm$ denotes the standard deviation. Here, $\eta ^\prime _t \approx \eta ^\prime _m \eta ^\prime _n$, which supports the background details presented throughout this section.

Tables Icon

Table 1. Initial estimates for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m).

3. Frame subtraction

We can describe the mean digital-hologram frame, $\overline {m}_H(x,y)$, as

$$\overline{m}_H(x,y) = \overline{m}_R(x,y) + \overline{m}_S(x,y)+ \beta \overline{ U_R^\ast (x,y) U_S(x,y)} + \beta \overline{U_R(x,y) U_S^\ast (x,y)} ,$$
where $\overline {m}_R(x,y)$ is the mean reference-only frame, $\overline {m}_S(x,y)$ is the mean signal-only frame, $\beta$ is the irradiance to photoelectron conversion factor, $U_R$ is the reference field, $U_S$ is the signal field, and the superscript asterisks denote complex conjugates. Since $\overline {m}_R(x,y)$ and $\overline {m}_S(x,y)$ contribute to the total excess noise, we can subtract these frames from $\overline {m}_H(x,y)$ to minimize the excess reference and signal noise, respectively. This frame subtraction, in turn, boosts the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant (i.e., unchanged).

We can quantify this last statement using the subtracted-total gain, $\gamma _{st}$, and the subtracted-noise gain, $\gamma _{sn}$, respectively, such that

$$\gamma_{st}=10\log_{10} \left( \frac{ \eta_{st}^\prime}{\eta_t^\prime} \right)=10\log_{10} \left( \frac{ S/N_s^\prime}{S/N^\prime} \right)$$
and
$$\gamma_{sn}=10\log_{10} \left( \frac{ \eta^\prime_{sn}}{\eta^\prime_n} \right).$$

In Eqs. (9) and (10), $\eta ^\prime _{st}$ is the final estimated total-system efficiency after frame subtraction, $\eta _t^\prime$ is the initial estimated total-system efficiency [cf. Equation (5) and Table 1], $S/N_s^\prime$ is the estimated SNR after frame subtraction, $S/N^\prime$ is the initial estimated SNR [cf. Equation (4) and Table 1], $\eta _{sn}^\prime$ is the final estimated noise efficiency after frame subtraction, and $\eta _{n}^\prime$ is the initial estimated noise efficiency [cf. Equation (7) and Table 1].

In what follows, we quantify the effects of frame subtraction via the subtracted-total gain, $\gamma _{st}$, and the subtracted-noise gain, $\gamma _{sn}$. We do so by subtracting the mean reference-only frame, $\overline {m}_R(x,y)$, and the mean signal-only frame, $\overline {m}_S(x,y)$, from the mean digital-hologram frame, $\overline {m}_H(x,y)$, prior to demodulation (i.e., before performing an inverse Fourier transform and filtering the appropriate pupil function in the Fourier plane). First, we calculate $\gamma _{st}$ and $\gamma _{sn}$ by subtracting $\overline {m}_R(x,y)$ and $\overline {m}_S(x,y)$ independently from $\overline {m}_H(x,y)$. Then, we calculate $\gamma _{st}$ and $\gamma _{sn}$ when we subtract both $\overline {m}_R(x,y)$ and $\overline {m}_S(x,y)$ from $\overline {m}_H(x,y)$. Based on these calculations, we find that $\gamma _{st}\approx \gamma _{sn}$ to the first decimal place. This outcome says that the estimated mixing efficiency stays relatively unchanged with frame subtraction. Thus, we conclude that frame subtraction has minimal effects on the estimated mixing efficiency.

Before moving on in the analysis, it is important to note that this section only presents results for the baseline dataset (cf. Fig. 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m) because the results for the other digital-holography datasets yielded the same conclusions.

3.1 Mean reference-only frame subtraction

Recall that the non-uniform reference yields excess noise in the mean digital-hologram frame, $\overline {m}_H(x,y)$ [see Fig. 1 (a) and (c)]. Since it is a straightforward image-post-processing technique, we specifically used frame subtraction to perform non-uniformity correction. Ideally, subtracting the mean reference-only frame, $\overline {m}_R(x,y)$, from $\overline {m}_H(x,y)$ should remove this lack of uniformity in the reference and the associated excess noise, thus boosting the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant. In turn, we tried different types of frame subtraction.

With respect to the reference-only frames, the most effective type of frame subtraction that we tried was to subtract the mean reference-only frame, $\overline {m}_R(x,y)$, from the individual reference frames. As such, the mean reference-subtracted, reference-only frame, $\overline {m}^{\left ( -R \right )}_R(x,y)$, took the following form:

$$\overline{m}^{\left ({-}R \right )}_R(x,y) = \overline{m_R(x,y) - \overline{m}_R(x,y) },$$
where $m_R(x,y)$ is an individual reference-only frame. Note that $\overline {m}_R(x,y)$ in Eq. (11) represents the mean reference-only frame from a 20-frame file recorded sequentially with $m_R(x,y)$, and $\overline {m}^{\left ( -R \right )}_R(x,y)$ is the mean over 200 frames (i.e., we used ten separate 20-frame files). We performed the frame subtraction this way because using $\overline {m}_R(x,y)$ over 200 frames was less effective, as discussed below.

With Eq. (11) in mind, we observed a residual difference on the order of $\pm 100$ pe across $\overline {m}^{\left ( -R \right )}_R(x,y)$, which in comparison to Fig. 1 (a), was much improved. Additionally, we demodulated each $m^{\left ( -R \right )}_R(x,y)$ frame and took the mean of the Fourier plane energy to provide $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$, as shown in Fig. 2 (a). In comparison to Fig. 1 (d), we observed that the low-spatial-frequency features, apparent in $\overline {E}_R \left ( f_x, f_y\right )$, disappeared. Furthermore, the mean value of $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$ in the pupil filter was 2,603 $\pm$ 36 $pe^2$. For comparison, the mean value of $\overline {E}_R \left ( f_x, f_y\right )$ in the pupil filter for Fig. 1 (d) was 3,483 $\pm$ 18 $pe^2$. Therefore, these results show that the frame subtraction did remove some of the excess noise caused by the non-uniform reference.

As previously mentioned, when we defined $\overline {m}_R(x,y)$ as the mean over 200 frames in Eq. (11), the frame subtraction was less effective. Even though there were no observable differences in the 200 reference-only frames, there were noticeable differences after frame subtraction, such as $\overline {m}^{\left ( -R \right )}_R(x,y)$ having appreciable residual differences and $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$ having low-spatial-frequency features. In addition, the mean value of $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$ in the pupil filter was 2,946 $\pm$ 158 $pe^2$. These differences suggest that there were some minor-temporal changes to the lack of uniformity in the reference. We believe these changes could be due to a drift in the MO laser’s center frequency, since we have measured it to drift as much as 240 Hz/s over 30 minutes [35], which is about the amount of time it took to record the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m). Since the lack of uniformity in the reference is mostly due to the etalon-interference pattern caused by the FPA’s coverglass, a change in wavelength would cause the resultant fringes to change.

 figure: Fig. 2.

Fig. 2. The results of the mean reference-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m). Here, (a) shows the mean energy in the Fourier plane with respect to the reference-only frames, $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$, and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frames, $\overline {E}_H^{\left ( -R \right )} \left ( f_x, f_y\right )$. The dashed circle in (a) shows the pupil filter to illustrate the excess noise due to the reference sampled in the Fourier plane.

Download Full Size | PDF

With respect to the digital-hologram frames, the most effective type of frame subtraction that we tried was to subtract the mean reference-only frame, $\overline {m}_R(x,y)$, from the individual digital-hologram frames. As such, the mean reference-subtracted, digital-hologram frame, $\overline {m}^{\left ( -R \right )}_H(x,y)$, took the following form:

$$\overline{m}^{\left ({-}R \right )}_H(x,y) = \overline{m_H(x,y) - \overline{m}_R(x,y) },$$
where $m_H(x,y)$ is an individual digital-hologram frame. Note that $\overline {m}_R(x,y)$ in Eq. (12) represents the mean reference-only frame from the 20-frame file recorded sequentially after the corresponding digital-hologram frame, $m_H(x,y)$, and $\overline {m}^{\left ( -R \right )}_H(x,y)$ is the mean over 200 frames (i.e., we used ten separate 20-frame files).

With Eq. (12) in mind, we observed more uniformity across $\overline {m}^{\left ( -R \right )}_H(x,y)$, which in comparison to Fig. 1 (c), means that we removed some of the excess noise due to the non-uniform reference. Next, we demodulated each $m^{\left ( -R \right )}_H(x,y)$ frame and took the mean of the Fourier plane energy to provide $\overline {E}_H^{\left ( -R \right )} \left ( f_x, f_y\right )$, as shown in Fig. 2 (b). In comparison to Fig. 1 (f), we observed that the low-spatial-frequency features, apparent in $\overline {E}_H \left ( f_x, f_y\right )$, disappeared.

We then calculated the subtracted-total gain, $\gamma _{st}$ [cf. Equation (9)], and the subtracted-noise gain, $\gamma _{sn}$ [cf. Equation (10)], which resulted in values of 0.3 dB for both, as shown in Table 2. Overall, the performance increase was less than expected. To help quantify this last statement, it is important to note that the non-uniform reference contributed about 30% of the total excess noise. Thus, if we effectively removed all of the excess noise due to the non-uniform reference, then we would have expected $S/N_s^\prime$ and $\eta _{sn}^\prime$ to increase to 135 and 54.3%, respectively, with $\gamma _{st}\approx \gamma _{sn}\approx 1.1$ dB. These values are not what we report in Table 2; nonetheless, the mean reference-only frame subtraction did, in fact, boost the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant.

Tables Icon

Table 2. Summary of the frame-subtraction results.

3.2 Mean signal-only frame subtraction

Recall that the signal also yields excess noise in the mean digital-hologram frame, $\overline {m}_H$. This excess noise is due to the pupil filter partially sampling a chat-like feature from the autocorrelation of the signal in the Fourier plane during demodulation [see Fig. 1 (e) and (f)]. Ideally, subtracting the mean signal-only frame, $\overline {m}_S$, from $\overline {m}_H$ should remove this chat-like feature and the associated excess noise, thus boosting the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant. In turn, we tried different types of frame subtraction.

With respect to the signal-only frames, the most effective type of frame subtraction that we tried was to subtract the mean signal-only frame, $\overline {m}_S$, from the individual signal frames. As such, the mean signal-subtracted, signal-only frame, $\overline {m}^{\left ( -S \right )}_S(x,y)$, took the following form:

$$\overline{m}^{\left ({-}S \right )}_S(x,y) = \overline{m_S(x,y) - \overline{m}_S(x,y) },$$
where $m_S(x,y)$ is an individual signal-only frame. Note that $\overline {m}_S(x,y)$ in Eq. (13) represents the mean signal-only frame from a 20-frame file recorded sequentially with $m_S(x,y)$ for the same speckle realization, and $\overline {m}^{\left ( -S \right )}_S(x,y)$ is the mean over 200 frames (i.e., we used ten separate speckle realizations).

With Eq. (13) in mind, we observed a residual difference on the order of $1\times 10^{-14}$ pe across $\overline {m}^{\left ( -S \right )}_S(x,y)$, which in comparison to Fig. 1 (b), was negligible. Additionally, we demodulated each $m^{\left ( -S \right )}_S(x,y)$ frame and took the mean of the Fourier plane energy to provide $\overline {E}_S^{\left ( -S \right )} \left ( f_x, f_y\right )$, as shown in Fig. 3 (a). In comparison to Fig. 1 (e), we observed that the chat-like feature, apparent in $\overline {E}_S \left ( f_x, f_y\right )$, mostly disappeared, but a small, doughnut-shaped residual remained on the order of 3 $pe^2$. This doughnut-shaped residual was observable in the individual $E_S^{\left ( -S \right )} \left ( f_x, f_y\right )$ frames; thus, we believe that there were some minor-temporal changes to the nearly Gaussian beam used for the illuminator in the experimental setup. For comparison, the mean value of $\overline {E}_S\left ( f_x, f_y\right )$ in the pupil filter was 2,611 $pe^2$ and the mean value of $\overline {E}_S^{\left ( -S \right )} \left ( f_x, f_y\right )$ in the pupil filter was 106 $pe^2$. Therefore, these results show that the signal-only frame subtraction did, in fact, remove the majority of the excess noise caused by the chat-like feature.

With respect to the digital-hologram frames, the most effective type of frame subtraction that we tried was to subtract the mean signal-only frame, $\overline {m}_S(x,y)$, from the individual digital-hologram frames. As such, the mean signal-subtracted, digital-hologram frame, $\overline {m}^{\left ( -S \right )}_H(x,y)$, took the following form:

$$\overline{m}^{\left ({-}S \right )}_H(x,y) = \overline{m_H(x,y) - \overline{m}_S(x,y) },$$
where $m_H(x,y)$ is an individual digital-hologram frame. Note that $\overline {m}_S(x,y)$ in Eq. (14) represents the mean signal-only frame from a 20-frame file recorded sequentially with $m_H(x,y)$ for the same speckle realization, and $\overline {m}^{\left ( -S \right )}_H(x,y)$ is the mean over 200 frames (i.e., we used ten separate speckle realizations).

 figure: Fig. 3.

Fig. 3. The results of the mean signal-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m). Here, (a) shows the mean energy in the Fourier plane with respect to the signal-only frame, $\overline {E}_S^{\left ( -S \right )} \left ( f_x, f_y\right )$, and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frame, $\overline {E}_H^{\left ( -S \right )} \left ( f_x, f_y\right )$. The dashed circle in (a) shows the pupil filter to illustrate the excess noise due to the signal sampled in the Fourier plane.

Download Full Size | PDF

With Eq. (14) in mind, we observed more uniformity across $\overline {m}^{\left ( -S \right )}_H(x,y)$, which in comparison to Fig. 1 (c), means that we removed some of the excess noise due to the signal. Next, we demodulated each $m^{\left ( -S \right )}_H(x,y)$ frame and took the mean of the Fourier plane energy to provide $\overline {E}_S^{\left ( -R \right )} \left ( f_x, f_y\right )$, as shown in Fig. 3 (b). In comparison to Fig. 1 (f), we observed that the chat-like feature, apparent in $\overline {E}_H \left ( f_x, f_y\right )$, mostly disappeared. We also observed that the doughnut-shaped residual was negligible (i.e., it was much less than the reference shot noise).

We then calculated the subtracted-total gain, $\gamma _{st}$ [cf. Equation (9)], and the subtracted-noise gain, $\gamma _{sn}$ [cf. Equation (10)], which resulted in values of 1.9 dB for both, as shown in Table 2. Overall, the performance increase was less than expected. To help quantify this statement, it is important to note that due to the pupil filter partially sampling the chat-like feature during demodulation, the signal contributed about 70% of the total excess noise. Thus, if we effectively removed all of the excess noise due to the chat-like feature, then we would have expected $S/N_s^\prime$ and $\eta _{sn}^\prime$ to increase to 192 and 76.8%, respectively, with $\gamma _{st}\approx \gamma _{sn}\approx 2.7$ dB. These values are not what we report in Table 2; nonetheless, the mean signal-only frame subtraction did, in fact, boost the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant.

3.3 Mean reference- and signal-only frame subtraction

To build on the results presented in Figs. 2 and 3, we combined the mean reference-only frame subtraction with the mean signal-only frame subtraction. In turn, the mean reference- and signal-subtracted, digital-hologram frame, $\overline {m}^{\left ( -RS \right )}_H(x,y)$, took the following form:

$$\overline{m}^{\left ({-}RS \right )}_H(x,y) = \overline{m_H(x,y) - \overline{m}_R(x,y) -\overline{m}_S(x,y) },$$
where $m_H(x,y)$ is again an individual digital-hologram frame. Here, $\overline {m}_R(x,y)$ and $\overline {m}_S(x,y)$ are the mean reference-only frame and the mean signal-only frame, respectively, from a 20-frame file recorded sequentially with $m_H(x,y)$ for the same speckle realization, and $\overline {m}^{\left ( -RS \right )}_H(x,y)$ is the mean over 200 frames (i.e., we used ten separate speckle realizations).

With Eq. (15) in mind, we observed more uniformity across $\overline {m}^{\left ( -RS \right )}_H(x,y)$, as shown in Fig. 4 (a), which in comparison to Fig. 1 (c), means that we removed some of the total excess noise due to the signal and reference. Next, we demodulated each $m^{\left ( -RS \right )}_H(x,y)$ frame and took the mean of the Fourier plane energy to provide $\overline {E}_H^{\left ( -RS \right )} \left ( f_x, f_y\right )$, as shown in Fig. 4 (b). In comparison to Fig. 1 (f), we observed that the low-spatial-frequency features and the chat-like feature, apparent in $\overline {E}_H \left ( f_x, f_y\right )$, mostly disappeared.

Again, we calculated the subtracted-total gain, $\gamma _{st}$ [cf. Equation (9)], and the subtracted-noise gain, $\gamma _{sn}$ [cf. Equation (10)], which resulted in values of 2.4 dB for both, as shown in Table 2. Overall, the performance increase was better than expected. To help quantify this statement, we expected $\gamma _{st}$ and $\gamma _{sn}$ to be the sum of the gains achieved from the mean reference-only frame subtraction and the mean signal-only frame subtraction independently, which would have been 2.2 dB. However, the gain from this combination was 2.4 dB. Even though we did not achieve the shot-noise limit, the mean reference- and signal-only frame subtraction did, in fact, boost the SNR by increasing the noise efficiency while keeping the mixing efficiency relatively constant.

 figure: Fig. 4.

Fig. 4. The results of the mean reference- and signal-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m). Here, (a) shows the mean reference- and signal-subtracted, digital-hologram frame, $\overline {m}^{\left ( -RS \right )}_H(x,y)$, and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frame, $\overline {E}_H^{\left ( -RS \right )} \left ( f_x, f_y\right )$.

Download Full Size | PDF

4. Frame averaging

Frame averaging is a straightforward image-post-processing technique, which when effectively used with multi-shot digital holography data, boosts the SNR by decreasing the noise. If we assume that the collected digital-holography datasets are shot-noise limited, then the SNR directly depends on the signal strength [cf. Equation (3)]. Therefore, the SNR boost due to frame averaging should scale with the number of frames averaged; however, there are practical limitations to this last statement. One such limitation is that the digital-hologram fringes must be stable from frame to frame.

With the potential benefits of frame averaging in mind, we wanted to investigate two-independent phenomena that affect the stability of the digital-hologram fringes: (i) laboratory vibrations and (ii) optical-path-length differences between the reference and signal.

(i) Laboratory vibrations cause the digital-hologram fringes to fluctuate across the FPA pixels. When these fringe fluctuations occur during the camera-integration time, $t_i$, the digital-hologram fringes start to wash out and cause an efficiency loss that degrades the achievable SNR. A previous effort quantified the effects of laboratory vibrations for the experimental setup used in this paper [35]. In particular, when $t_i = 100$ ms, laboratory vibrations cause an efficiency loss of 6%, whereas when $t_i = 100\,\mu$, laboratory vibrations are negligible.

(ii) Optical-path-length differences between the reference and signal also cause the digital-hologram fringes to fluctuate across the FPA pixels. A previous effort quantified the effects of optical-path-length differences for the experimental setup used in this paper [35]. In practice, if the optical-path-length difference, $\Delta \ell$, is greater than zero, then the relative phase difference between the reference and signal fluctuates, which causes fringe fluctuations. The degree of the fringe fluctuations, of course, depends on the MO laser’s coherence length with respect to $\Delta \ell$.

In what follows, we examine the effects of (i) and (ii) on the stability of the digital-hologram fringes while performing frame averaging. For this purpose, we analyze four digital-holography datasets with a combination of $t_i = 100\,\mu$s and 100 ms for the camera-integration times and $\Delta \ell = 0$ m and 248 m for the optical-path-length differences. To quantify the boost in the SNR due to frame averaging, we calculate the appropriate gain as a function of the number of frames averaged. For this purpose,

$$\overline{m}_{\overline{H}}(x,y) = \overline{m_H(x,y)}$$
denotes frame averaging without frame subtraction and
$$\overline{m}_{\overline{H}}^{({-}RS)}(x,y) = \overline{m_H(x,y) - \overline{m}_R(x,y) - \overline{m}_S(x,y)}$$
denotes frame averaging with frame subtraction. Here, $m_H(x,y)$ is again an individual digital-hologram frame, and $\overline {m}_R(x,y)$ and $\overline {m}_S(x,y)$ are again the mean reference-only frame and the mean signal-only frame, respectively, from a 20-frame file recorded sequentially with $m_H(x,y)$ for the same speckle realization. Note that in the following frame-averaging results, we calculated the mean and standard deviation over ten speckle realizations. Also note that frame averaging across different speckle realizations did not produce useful results due to the time lapse and lack of stability in the digital-hologram fringes between the dataset recordings.

4.1 Mixing and noise gain results

To characterize the effects of frame averaging on the mixing efficiency, we calculated the averaged-mixing gain, $\gamma _{am}$, and the averaged-subtracted-mixing gain, $\gamma _{asm}$, such that

$$\gamma_{am}=10\log_{10} \left( \frac{ \eta_{am}^\prime}{\eta_{m}^\prime} \right)$$
and
$$\gamma_{asm}=10\log_{10} \left( \frac{ \eta_{asm}^\prime}{\eta_m^\prime} \right).$$

In Eq. (18), $\eta _{am}^\prime$ is the final estimated mixing efficiency after frame averaging, whereas in Eq. (19), $\eta _{asm}^\prime$ is the final estimated mixing efficiency after frame subtraction and averaging. For both Eq. (18) and (19), $\eta _m^\prime$ is the initial estimated noise efficiency [cf. Equation (6) and Table 1]. Similarly, to characterize the effects of frame averaging on the estimated noise efficiency, we calculated the averaged-noise gain, $\gamma _{an}$, and the averaged-subtracted-noise gain, $\gamma _{asn}$, such that

$$\gamma_{an} =10\log_{10} \left( \frac{ \eta^\prime_{an}}{\eta^\prime_n} \right)$$
and
$$\gamma_{asn}=10\log_{10} \left( \frac{ \eta^\prime_{asn}}{\eta^\prime_n} \right).$$

In Eq. (20), $\eta _{an}^\prime$ is the final estimated noise efficiency after frame averaging, whereas in Eq. (21), $\eta _{asn}^\prime$ is the final estimated noise efficiency after frame subtraction and averaging. For both Eq. (20) and (21), $\eta _n^\prime$ is the initial estimated noise efficiency [cf. Equation (7) and Table 1]. With Eqs. (18)–(21) in mind, Fig. 5 shows frame-averaging results for these mixing and noise gain calculations.

Referencing Fig. 5, the frame averaging greatly improved the noise efficiency, especially when we first included the benefits of frame subtraction. On average the gain was 6.1 dB or $202\%\pm 60\%$ with frame subtraction. However, frame averaging was detrimental to the mixing efficiency, especially when the digital-hologram fringes were less stable.

 figure: Fig. 5.

Fig. 5. Frame-averaging results showing the averaged-mixing gain, $\gamma _{am}$, the averaged-subtracted-mixing gain, $\gamma _{asm}$, the averaged-noise gain, $\gamma _{an}$, and the averaged-subtracted-noise gain, $\gamma _{asn}$, all as a function of the number of frames averaged [cf. Equations (18)–(21), respectively]. The data points display the mean over 10 speckle realizations, whereas the error bars display the standard deviation. For the mixing-gain calculations, there is no observable difference between the case with frame subtraction and the case with no frame subtraction; thus, $\gamma _{asm} = \gamma _{am}$ in a single line. Here, we display results for four digital-holography datasets with a combination of camera-integration times ($t_i$) and optical-path-length differences ($\Delta \ell$), such that in (a) $t_i = 100\,\mu$s and $\Delta \ell =0\,$m, in (b) $t_i = 100$ ms and $\Delta \ell =0\,$m, in (c) $t_i = 100\,\mu$s and $\Delta \ell =248\,$m, and in (d) $t_i = 100\,$ms and $\Delta \ell =248\,$m.

Download Full Size | PDF

To make sense of this last point, we needed to look at the details associated with all four digital-holography datasets. For example, when $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m [cf. Figure 5 (a)], the digital-hologram fringes were the most stable, since the estimated mixing efficiencies only decreased from 38% to 36%. On the other hand, when $t_i = 100\,$ms and $\Delta \ell = 0\,$m [cf. Figure 5 (b)], we incurred laboratory vibrations with the longer camera-integration time ($t_i$), and the estimated mixing efficiencies decreased more from 32% to 23%. Furthermore, when $t_i = 100\,\mu$s and $\Delta \ell = 248\,$m [cf. Figure 5 (c)], we induced a long optical-path-length difference ($\Delta \ell$), and the estimated mixing efficiencies decreased even more from 33% to 17%. Therefore, when $t_i = 100\,$ms and $\Delta \ell = 248\,$m [cf. Figure 5 (d)], we incurred laboratory vibrations and induced optical-path-length differences, such that the frame averaging was the most deleterious, decreasing the mixing efficiency from 15% to 1.6%, where it hovered after just a few frames being averaged. These outcomes signify that the digital-hologram fringes were increasingly less stable across all four digital-holography datasets.

Before moving on in the analysis, first note that frame subtraction provides no observable impact on the mixing efficiency, which is the reason why we only show one line for mixing-gain calculations in Fig. 5. Also note that we include a 20-frame summary of the frame-averaging results presented in this subsection, specifically without frame subtraction, in Table 3, and specifically with frame subtraction, in Table 4.

Tables Icon

Table 3. Summary of the frame-averaging results, specifically without frame subtraction. Here, $\gamma _{at}=\gamma _{am}+\gamma _{an}$.

Tables Icon

Table 4. Summary of the frame-averaging results, specifically with frame subtraction. Here, $\gamma _{ast}=\gamma _{st}+\gamma _{asm}+\gamma _{asn}$.

4.2 Total gain results

To characterize the effects of frame averaging on the total-system efficiency, we calculated the averaged-total gain, $\gamma _{at}$, and the averaged-subtracted-total gain, $\gamma _{ast}$, such that

$$\gamma_{at}=10\log_{10} \left( \frac{ \eta_{at}^\prime}{\eta_t^\prime} \right) = 10\log_{10} \left( \frac{S/N^\prime_a}{S/N^\prime} \right)$$
and
$$\gamma_{ast}= 10\log_{10} \left( \frac{ \eta_{ast}^\prime}{\eta_t^\prime} \right) = 10\log_{10} \left( \frac{S/N_{as}^\prime }{S/N^\prime}\right).$$

In Eq. (22), $\eta ^\prime _{at}$ is the final estimated total-system efficiency after frame averaging and $S/N^\prime _a$ is the final estimated SNR after frame averaging, whereas in Eq. (23), $\eta ^\prime _{ast}$ is the final estimated total-system efficiency after frame subtraction and averaging, and $S/N^\prime _{as}$ is the final estimated SNR after frame subtraction and averaging. For both Eq. (22) and (23), $\eta _t^\prime$ is the initial estimated total-system efficiency [cf. Equation (5) and Table 1], and $S/N^\prime$ is the initial estimated SNR [cf. Equation (4) and Table 1]. Additionally, we calculated the gain needed to surpass the shot-noise floor, $\gamma _{\textrm{SNF}}$, and thereafter achieve the shot-noise limit, $\gamma _{\textrm{SNL}}$, such that

$$\gamma_{\textrm{SNF}}= 10\log_{10} \left( 1/\eta^\prime_n \right)$$
and
$$\gamma_{\textrm{SNL}}= 10\log_{10} \left( 1/\eta^\prime_t \right),$$
where $\eta ^\prime _n$ is the initial estimated noise efficiency [cf. Eq. (7) and Table 1] and $\eta ^\prime _t$ is the initial estimated total-system efficiency [cf. Eq. (5) and Table 1]. Recall that we defined the shot-noise limit as the gain needed to boost the SNR, such that it equals the ideal, shot-noise-limited SNR, $S/N_i$, given in Eq. (3). With Eqs. (22) and (23) in mind, Fig. 6 shows frame-averaging results for these total-gain calculations relative to the gain needed to surpass the shot-noise floor and thereafter achieve the shot-noise limit [cf. Equation (24) and (25)].

Referencing Fig. 6, we clearly achieved the shot-noise limit when the fringes were the most stable, and we first included the benefits of frame subtraction, in addition to the frame averaging. In particular, when $t_i = 100\,\mu$s and $\Delta \ell = 0\,$m [cf. Figure 6 (a)]. We were still able to boost the SNR when laboratory vibrations and optical-path-length differences were independently present [cf. Figure 6 (b) and (c), respectively]. When both of the aforementioned effects were present, however, the frame subtraction and averaging was deleterious after averaging just two frames because the digital-hologram fringes were unstable from frame to frame [cf. Figure 6 (d)]. This outcome was due to the fact that the frame averaging decreased the mixing efficiency more than the frame averaging increased the noise efficiency.

 figure: Fig. 6.

Fig. 6. Frame-averaging results showing the averaged-total gain, $\gamma _{at}$, and the averaged-subtracted-total gain, $\gamma _{ast}$, relative to the gain needed to surpass the shot-noise floor, $\gamma _{\textrm{SNF}}$, and thereafter achieve the shot-noise limit, $\gamma _{\textrm{SNL}}$, all as a function of the number of frames averaged [cf. Equations (22)–(24), respectively]. The data points display the mean over 10 speckle realizations, whereas the error bars display the standard deviation. Here, we display results for four digital-holography datasets with a combination of camera-integration times ($t_i$) and optical-path-length differences ($\Delta \ell$), such that in (a) $t_i = 100\,\mu$s and $\Delta \ell =0\,$m, in (b) $t_i = 100$ ms and $\Delta \ell =0\,$m, in (c) $t_i = 100\,\mu$s and $\Delta \ell =248\,$m, and in (d) $t_i = 100\,$ms and $\Delta \ell =248\,$m.

Download Full Size | PDF

The frame-averaging results presented in Fig. 6 clearly show that frame averaging boosts the SNR by itself, but frame subtraction is a necessary first step to achieve the shot-noise limit, in addition to surpassing the shot-noise floor. In practice, frame subtraction improved the frame averaging by at least 3.4 dB across all four digital-holography datasets. To gain further insight into why frame subtraction improved the frame averaging, we show Fourier-plane results in Appendix A. and simulation results with an ideal mixing efficiency in Appendix B.

In Table 3 and Table 4, we include a 20-frame summary of the frame-averaging results presented in this subsection. It is important to note that in Table 3, $\gamma _{am} + \gamma _{an} = \gamma _{at}$ and in Table 4, $\gamma _{st} + \gamma _{asm} + \gamma _{asn} = \gamma _{ast}$ (within the mean rounding error and standard deviations over 10 speckle realizations). These outcomes demonstrate the completeness of the detailed analysis presented herein.

5. Conclusion

In this paper, we achieved the shot-noise limit using straightforward post-processing techniques with experimental multi-shot digital holography data (i.e., off-axis data composed of multiple noise and speckle realizations). First, we quantified the effects of frame subtraction (of the mean reference-only frame and the mean signal-only frame from the digital-hologram frames), which boosted the signal-to-noise ratio (SNR) of the baseline dataset with a gain 2.4 dB. Next, we quantified the effects of frame averaging, both with and without the frame subtraction. We then showed that even though the frame averaging boosted the SNR by itself, the frame subtraction was a necessary first step in order to beat the shot-noise limit. This outcome was due to the autocorrelation of the signal in the Fourier plane, which resulted from collecting the multi-shot digital holography data in an off-axis recording geometry. We also showed that the effectiveness of the frame averaging depends on the stability of the digital-hologram fringes. Overall, we boosted the SNR of the baseline dataset with a gain of 8.1 dB, which was the gain needed to achieve the shot-noise limit.

Appendix A.

To gain insight into why frame subtraction improved the frame averaging, this appendix illustrates the noise reduction in the Fourier plane from frame averaging in the presence of a strong, chat-like feature. Recall that this chat-like feature manifests in the Fourier plane due to the autocorrelation of the signal. With a strong, chat-like feature present, we compared the mean Fourier-plane energy in Fig. 7 (a) to the mean Fourier-plane energy with frame averaging in Fig. 7 (b). We observed that the frame averaging does decrease the overall Fourier-plane background noise, but the chat-like feature remains as strong. However, when we first included the benefits of frame subtraction, in addition to the frame averaging, as shown in Fig. 7 (c), we observed that the chat-like feature was much weaker than in Fig. 7 (a) and (b). It is important to note that in Fig. 3 (b) and Fig. 4 (b), the chat-like feature was not observable with frame subtraction, but the chat-like feature does strengthen with frame averaging, as seen in Fig. 7 (c). This outcome illustrates why frame subtraction improved the frame averaging, specifically in the presence of a strong, chat-like feature.

 figure: Fig. 7.

Fig. 7. The following Fourier-plane results are for the fourth digital-holography dataset, where $t_i = 100\,\mu$s and $\Delta \ell = 248\,$m [cf. Figures 5 (d) and 6 (d)]. Here, (a) shows the mean Fourier-plane energy, $\overline {E}_H \left ( f_x, f_y\right )$, (b) shows the mean Fourier-plane energy with frame averaging, $\overline {E}_{\overline {H}} \left ( f_x, f_y\right )$, and (c) shows the mean Fourier-plane energy with frame subtraction and frame averaging, $\overline {E}^{(-RS)}_{\overline {H}} \left ( f_x, f_y\right )$.

Download Full Size | PDF

Appendix B.

This appendix simulates multi-shot digital holography data in the off-axis IPRG to further illustrate the benefits of the frame subtraction and averaging performed in this paper. As shown in Fig. 8, we used uniform illumination of a 1951 USAF bar chart as the object. For simplicity, we assumed far-field propagation; otherwise, all modeled parameters follow those provided in Sec. 2.1.

 figure: Fig. 8.

Fig. 8. Simulation results using frame averaging both with and without frame subtraction. The top row (a)-(c) depicts the magnitude and the bottom row (d)-(f) depicts the wrapped phase of the demodulated data. The first column is a single frame of demodulated data without frame subtraction and averaging. The second column shows the frame averaging only case, where we demodulated the mean digital-hologram frame from 20 realizations of noise. The third column shows the frame averaging with frame subtraction case, where we demodulated the mean digital-hologram frame with the mean signal-only and reference-only frames subtracted from 20 realizations of noise.

Download Full Size | PDF

To simulate a non-uniform reference, we used the mean reference frame from the baseline dataset [cf. Figure 1(a)] and normalized it to $2,500\,pe$, which was the approximate reference strength in the experiment. We also normalized the mean signal frame to correspond to an ideal, shot-noise limited SNR, $S/N_i$, of 2 [cf. Equation (3)]. In turn, we also simulated the effects of shot noise, read noise, and 12-bit digitization noise.

Note that we did not include the effects of speckle in these simulations. In practice, speckle causes a lot of spatial variation in plots of the 2D wrapped phase, which makes it difficult to discern whether or not the frame subtraction and averaging is adding bias or artifacts to the digital-holography datasets. This last point is the reason that we did not include plots of the 2D wrapped phase throughout the main body of this paper, but do so in this appendix.

Altogether, we simulated 20 realizations of noise and performed frame averaging both with and without frame subtraction. In accordance with the off-axis IPRG, we then demodulated the data by taking the inverse Fourier transform, filtering the pupil in the Fourier plane, and Fourier transforming back to the image plane.

In the first column of Fig. 8, the estimated SNR, $S/N^\prime$, is 0.4 [cf. Equation (4)], whereas in the second and third columns the estimated SNRs, $S/N^\prime _a$ and $S/N^\prime _{as}$, are 1.9 and 6.3, respectively. With that said, the demodulated data in the first column corresponds to the case with no frame subtraction or averaging. The second and third columns then correspond to the cases with frame averaging only and frame averaging with frame subtraction (hence the subscript a and as, respectively).

Also note that these simulations model an ideal mixing efficiency (i.e., $\eta _m=100\%$). Thus, the frame subtraction, in addition to the frame averaging, is most effective because there are essentially no frame-to-frame discrepancies. In this case, frame subtraction almost perfectly subtracts out the excess noise. This last point is why the estimated SNR exceeds the ideal, shot-noise-limited SNR (i.e., $S/N^\prime _{as}>S/N_i$), while the experimental data (presented throughout the body of this paper) only achieved the ideal, shot-noise limited SNR (i.e., $S/N^\prime _{as} \approx S/N_i$).

Overall, the simulation results presented in Fig. 8 further illustrate the benefits of the frame subtraction and averaging performed in this paper. They also show that frame subtraction and averaging does not add any bias or artifacts to the digital-holography datasets (if performed correctly). This final point further emphasizes the novelty of the detailed analysis presented herein.

Acknowledgments

The authors of this paper would like to thank the Joint Directed Energy Transition Office for sponsoring this research, as well as C. J. Pellizzari and S. A. Owens for many insightful discussions regarding the results presented within.

Disclosures

The authors declare no conflicts of interest. Approved for public release; distribution is unlimited. Public Affairs release approval #AFRL-2021-0465.

References

1. S. T. Thurman and J. R. Fienup, “Phase-error correction in digital holography,” J. Opt. Soc. Am. A 25(4), 983–994 (2008). [CrossRef]  

2. S. T. Thurman and J. R. Fienup, “Correction of anisoplanatic phase errors in digital holography,” J. Opt. Soc. Am. A 25(4), 995–999 (2008). [CrossRef]  

3. J. C. Marron, R. L. Kendrick, N. Seldomridge, T. D. Grow, and T. A. Höft, “Atmospheric turbulence correction using digital holographic detection: experimental results,” Opt. Express 17(14), 11638–211 (2009). [CrossRef]  

4. A. E. Tippie and J. R. Fienup, “Phase-error correction for multiple planes using a sharpness metric,” Opt. Lett. 34(5), 701–703 (2009). [CrossRef]  

5. A. E. Tippie and J. R. Fienup, “Multiple-plane anisoplanatic phase correction in a laboratory digital holography experiment,” Opt. Lett. 35(19), 3291–3293 (2010). [CrossRef]  

6. C. J. Pellizzari, M. F. Spencer, and C. A. Bouman, “Phase-error estimation and image reconstruction from digital-holography data using a Bayesian framework,” J. Opt. Soc. Am. A 34(9), 1659–1669 (2017). [CrossRef]  

7. C. J. Pellizzari, M. T. Banet, M. F. Spencer, and C. A. Bouman, “Demonstration of single-shot digital holography using a Bayesian framework,” J. Opt. Soc. Am. A 35(1), 103–107 (2018). [CrossRef]  

8. C. J. Pellizzari, M. F. Spencer, and C. A. Bouman, “Imaging through distributed-volume aberrations using single-shot digital holography,” J. Opt. Soc. Am. A 36(2), A20–A33 (2019). [CrossRef]  

9. S. T. Thurman, “Phase-error correction in digital holography using single-shot data,” J. Opt. Soc. Am. A 36(12), D47–D61 (2019). [CrossRef]  

10. C. J. Pellizzari, M. F. Spencer, and C. A. Bouman, “Coherent plug-and-play: Digital holographic imaging through atmospheric turbulence using model-based iterative reconstruction and convolutional neural networks,” IEEE Tran. Comp. Img. 6, 1607–1621 (2020). [CrossRef]  

11. M. W. Hyde, S. Basu, M. F. Spencer, S. J. Cusumano, and S. T. Fiorino, “Physical optics solution for the scattering of a partially-coherent wave from a statistically rough material surface,” Opt. Express 21(6), 6807–6825 (2013). [CrossRef]  

12. M. F. Spencer, M. W. Hyde, S. Basu, and M. A. Marciniak, “The scattering of partially coherent electromagnetic beam illumination from a statistically rough surface modeled as a perfect electrical conductor,” Proc. SPIE 9205, 92050J (2014). [CrossRef]  

13. M. F. Spencer, “Wave-optics investigation of turbulence thermal blooming interaction: I. using steady-state simulations,” Opt. Eng. 59(08), 1 (2020). [CrossRef]  

14. M. F. Spencer, “Wave-optics investigation of turbulence thermal blooming interaction: Ii. using time-dependent simulations,” Opt. Eng. 59(08), 1 (2020). [CrossRef]  

15. N. R. Van Zandt, J. E. McCrae, and S. T. Fiorino, “Modeled and measured image-plane polychromatic speckle contrast,” Opt. Eng. 55(2), 024106 (2016). [CrossRef]  

16. N. R. Van Zandt, J. E. McCrae, M. F. Spencer, M. J. Steinbock, M. W. Hyde, and S. T. Fiorino, “Polychromatic wave-optics models for image-plane speckle. 1. Well-resolved objects,” Appl. Opt. 57(15), 4090–4102 (2018). [CrossRef]  

17. N. R. Van Zandt, M. F. Spencer, M. J. Steinbock, B. M. Anderson, M. W. Hyde, and S. T. Fiorino, “Polychromatic wave-optics models for image-plane speckle. 2. Unresolved objects,” Appl. Opt. 57(15), 4103–4110 (2018). [CrossRef]  

18. N. R. Van Zandt, M. F. Spencer, and S. T. Fiorino, “Speckle mitigation for wavefront sensing in the presence of weak turbulence,” Appl. Opt. 58(9), 2300–2310 (2019). [CrossRef]  

19. N. R. Van Zandt and M. F. Spencer, “Improved adaptive-optics performance using polychromatic speckle mitigation,” Appl. Opt. 59(4), 1071–1081 (2020). [CrossRef]  

20. J. D. Barchers, D. L. Fried, and D. J. Link, “Evaluation of the performance of Hartmann sensors in strong scintillation,” Appl. Opt. 41(6), 1012–1021 (2002). [CrossRef]  

21. M. J. Steinbock, M. W. Hyde, and J. D. Schmidt, “LSPV+7, a branch-point-tolerant reconstructor for strong turbulence adaptive optics,” Appl. Opt. 53(18), 3821–3831 (2014). [CrossRef]  

22. B. Bordbar and M. A. Vorontsov, “Complex field sensing in strong scintillations with multi-aperture phase contrast techniques,” J. Opt. 22(10), 10LT01 (2020). [CrossRef]  

23. D. Lechner, A. Zepp, M. Eichhorn, and S. Gałdysz, “Adaptable shack-hartmann wavefront sensor with diffractive lenslet arrays to mitigate the effects of scintillation,” Opt. Express 28(24), 36188–36205 (2020). [CrossRef]  

24. J. R. Crepp, S. O. Letchev, S. J. Potier, J. H. Follansbee, and N. T. Tusay, “Measuring phase errors in the presence of scintillation,” Opt. Express 28(25), 37721–37733 (2020). [CrossRef]  

25. M. F. Spencer, R. A. Raynor, M. T. Banet, and D. K. Marker, “Deep-turbulence wavefront sensing using digital-holographic detection in the off-axis image plane recording geometry,” Opt. Eng. 56(3), 031213 (2016). [CrossRef]  

26. M. T. Banet, M. F. Spencer, and R. A. Raynor, “Digital-holographic detection in the off-axis pupil plane recording geometry for deep-turbulence wavefront sensing,” Appl. Opt. 57(3), 465–475 (2018). [CrossRef]  

27. D. E. Thornton, M. F. Spencer, and G. P. Perram, “Deep-turbulence wavefront sensing using digital holography in the on-axis phase shifting recording geometry with comparisons to the self-referencing interferometer,” Appl. Opt. 58(5), A179–A189 (2019). [CrossRef]  

28. C. J. Radosevich, C. J. Pellizzari, S. Horst, and M. F. Spencer, “Imaging through deep turbulence using single-shot digital holography data,” Opt. Express 28(13), 19390–19401 (2020). [CrossRef]  

29. M. T. Banet and M. F. Spencer, “Compensated-beacon adaptive optics using least-squares phase reconstruction,” Opt. Express 28(24), 36902–36914 (2020). [CrossRef]  

30. M. F. Spencer, “Spatial Heterodyne,” Encycl. Mod. Opt. II Vol. IV, 369–400 (Elsevier, 2018).

31. M. F. Spencer and D. E. Thornton, “Signal-to-noise models for digital- holographic detection,” Proc. SPIE 1065, 7 (2018). [CrossRef]  

32. C. J. Radosevich and M. F. Spencer, “Closed-form expressions for digital-holographic detection in a laboratory setting,” Proc. SPIE 11135, 12 (2019). [CrossRef]  

33. D. E. Thornton, M. F. Spencer, C. A. Rice, and G. P. Perram, “Digital holography efficiency measurements with excess noise,” Appl. Opt. 58(34), G19–G30 (2019). [CrossRef]  

34. D. E. Thornton, D. Mao, M. F. Spencer, C. A. Rice, and G. P. Perram, “Digital holography experiments with degraded temporal coherence,” Opt. Eng. 59(10), 1 (2020). [CrossRef]  

35. D. E. Thornton, M. F. Spencer, C. A. Rice, and G. P. Perram, “Impacts of Laboratory Vibrations and Laser Flicker Noise on Digital Holography,” IEEE J. Quantum Electron. 56(5), 1–7 (2020). [CrossRef]  

36. G. Nehmetallah, R. Aylo, and L. Williams, Analog and Digital Holography with Matlab (SPIE Press, 2015).

37. A. V. Kanaev, A. T. Watnik, D. F. Gardner, C. Metzler, K. P. Judd, P. Lebow, K. M. Novak, and J. R. Lindle, “Imaging through extreme scattering in extended dynamic media,” Opt. Lett. 43(13), 3088–3091 (2018). [CrossRef]  

38. F. Verpillat, F. Joud, M. Atlan, and M. Gross, “Digital Holography at Shot Noise Level,” J. Disp. Tech. 6(10), 455–464 (2010). [CrossRef]  

39. J. W. Goodman, Statistical Optics, 2nd ed. (Wiley, 2015).

40. P. Merritt and M. F. Spencer, Beam Control for Laser Systems, 2nd ed. (Directed Energy Professional Society, 2018).

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (8)

Fig. 1.
Fig. 1. Overview of the baseline dataset used in this paper. The top row depicts the average frames, whereas the bottom row depicts the corresponding average Fourier-plane energies, where the camera-integration time and optical-path-length differences were $t_i = 100\,\mu s$ and $\Delta \ell = 0\,m$ , respectively. Here, (a) shows the mean reference-only frame $\overline {m}_R(x,y)$ , (b) shows the mean signal-only frame $\overline {m}_S(x,y)$ , (c) shows the mean digital-hologram frame $\overline {m}_H(x,y)$ , (d) shows the mean reference-only energy in the Fourier plane $\overline {E}_R \left ( f_x, f_y\right )$ , (e) shows the mean signal-only energy in the Fourier plane $\overline {E}_S \left ( f_x, f_y\right )$ , and (f) shows the mean digital-hologram energy in the Fourier plane $\overline {E}_H \left ( f_x, f_y\right )$ . Note that the dashed circle in (d) and (e) is the pupil filter, which illustrates the sampled noise in the Fourier plane.
Fig. 2.
Fig. 2. The results of the mean reference-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$ s and $\Delta \ell = 0\,$ m). Here, (a) shows the mean energy in the Fourier plane with respect to the reference-only frames, $\overline {E}_R^{\left ( -R \right )} \left ( f_x, f_y\right )$ , and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frames, $\overline {E}_H^{\left ( -R \right )} \left ( f_x, f_y\right )$ . The dashed circle in (a) shows the pupil filter to illustrate the excess noise due to the reference sampled in the Fourier plane.
Fig. 3.
Fig. 3. The results of the mean signal-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$ s and $\Delta \ell = 0\,$ m). Here, (a) shows the mean energy in the Fourier plane with respect to the signal-only frame, $\overline {E}_S^{\left ( -S \right )} \left ( f_x, f_y\right )$ , and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frame, $\overline {E}_H^{\left ( -S \right )} \left ( f_x, f_y\right )$ . The dashed circle in (a) shows the pupil filter to illustrate the excess noise due to the signal sampled in the Fourier plane.
Fig. 4.
Fig. 4. The results of the mean reference- and signal-only frame subtraction for the baseline dataset (cf. Figure 1, where $t_i = 100\,\mu$ s and $\Delta \ell = 0\,$ m). Here, (a) shows the mean reference- and signal-subtracted, digital-hologram frame, $\overline {m}^{\left ( -RS \right )}_H(x,y)$ , and (b) shows the mean energy in the Fourier plane with respect to the digital-hologram frame, $\overline {E}_H^{\left ( -RS \right )} \left ( f_x, f_y\right )$ .
Fig. 5.
Fig. 5. Frame-averaging results showing the averaged-mixing gain, $\gamma _{am}$ , the averaged-subtracted-mixing gain, $\gamma _{asm}$ , the averaged-noise gain, $\gamma _{an}$ , and the averaged-subtracted-noise gain, $\gamma _{asn}$ , all as a function of the number of frames averaged [cf. Equations (18)–(21), respectively]. The data points display the mean over 10 speckle realizations, whereas the error bars display the standard deviation. For the mixing-gain calculations, there is no observable difference between the case with frame subtraction and the case with no frame subtraction; thus, $\gamma _{asm} = \gamma _{am}$ in a single line. Here, we display results for four digital-holography datasets with a combination of camera-integration times ( $t_i$ ) and optical-path-length differences ( $\Delta \ell$ ), such that in (a) $t_i = 100\,\mu$ s and $\Delta \ell =0\,$ m, in (b) $t_i = 100$  ms and $\Delta \ell =0\,$ m, in (c) $t_i = 100\,\mu$ s and $\Delta \ell =248\,$ m, and in (d) $t_i = 100\,$ ms and $\Delta \ell =248\,$ m.
Fig. 6.
Fig. 6. Frame-averaging results showing the averaged-total gain, $\gamma _{at}$ , and the averaged-subtracted-total gain, $\gamma _{ast}$ , relative to the gain needed to surpass the shot-noise floor, $\gamma _{\textrm{SNF}}$ , and thereafter achieve the shot-noise limit, $\gamma _{\textrm{SNL}}$ , all as a function of the number of frames averaged [cf. Equations (22)–(24), respectively]. The data points display the mean over 10 speckle realizations, whereas the error bars display the standard deviation. Here, we display results for four digital-holography datasets with a combination of camera-integration times ( $t_i$ ) and optical-path-length differences ( $\Delta \ell$ ), such that in (a) $t_i = 100\,\mu$ s and $\Delta \ell =0\,$ m, in (b) $t_i = 100$  ms and $\Delta \ell =0\,$ m, in (c) $t_i = 100\,\mu$ s and $\Delta \ell =248\,$ m, and in (d) $t_i = 100\,$ ms and $\Delta \ell =248\,$ m.
Fig. 7.
Fig. 7. The following Fourier-plane results are for the fourth digital-holography dataset, where $t_i = 100\,\mu$ s and $\Delta \ell = 248\,$ m [cf. Figures 5 (d) and 6 (d)]. Here, (a) shows the mean Fourier-plane energy, $\overline {E}_H \left ( f_x, f_y\right )$ , (b) shows the mean Fourier-plane energy with frame averaging, $\overline {E}_{\overline {H}} \left ( f_x, f_y\right )$ , and (c) shows the mean Fourier-plane energy with frame subtraction and frame averaging, $\overline {E}^{(-RS)}_{\overline {H}} \left ( f_x, f_y\right )$ .
Fig. 8.
Fig. 8. Simulation results using frame averaging both with and without frame subtraction. The top row (a)-(c) depicts the magnitude and the bottom row (d)-(f) depicts the wrapped phase of the demodulated data. The first column is a single frame of demodulated data without frame subtraction and averaging. The second column shows the frame averaging only case, where we demodulated the mean digital-hologram frame from 20 realizations of noise. The third column shows the frame averaging with frame subtraction case, where we demodulated the mean digital-hologram frame with the mean signal-only and reference-only frames subtracted from 20 realizations of noise.

Tables (4)

Tables Icon

Table 1. Initial estimates for the baseline dataset (cf. Figure 1, where t i = 100 μ s and Δ = 0 m).

Tables Icon

Table 2. Summary of the frame-subtraction results.

Tables Icon

Table 3. Summary of the frame-averaging results, specifically without frame subtraction. Here, γ a t = γ a m + γ a n .

Tables Icon

Table 4. Summary of the frame-averaging results, specifically with frame subtraction. Here, γ a s t = γ s t + γ a s m + γ a s n .

Equations (25)

Equations on this page are rendered with MathJax. Learn more.

S / N = η t α m ¯ S m ¯ R m ¯ S + m ¯ R + σ n 2 ,
S / N = η t α m ¯ S .
S / N i = 4 q I 2 π m ¯ S ,
S / N = E ¯ H ( f x , f y ) E ¯ N ( f x , f y ) P E ¯ N ( f x , f y ) P ,
η t = S / N S / N i .
η m = π 4 q I 2 E ¯ H ( f x , f y ) E ¯ N ( f x , f y ) P m ¯ R ( x , y )   m ¯ S ( x , y ) I ,
η n = m ¯ R ( x , y ) I E ¯ N ( f x , f y ) P ,
m ¯ H ( x , y ) = m ¯ R ( x , y ) + m ¯ S ( x , y ) + β U R ( x , y ) U S ( x , y ) ¯ + β U R ( x , y ) U S ( x , y ) ¯ ,
γ s t = 10 log 10 ( η s t η t ) = 10 log 10 ( S / N s S / N )
γ s n = 10 log 10 ( η s n η n ) .
m ¯ R ( R ) ( x , y ) = m R ( x , y ) m ¯ R ( x , y ) ¯ ,
m ¯ H ( R ) ( x , y ) = m H ( x , y ) m ¯ R ( x , y ) ¯ ,
m ¯ S ( S ) ( x , y ) = m S ( x , y ) m ¯ S ( x , y ) ¯ ,
m ¯ H ( S ) ( x , y ) = m H ( x , y ) m ¯ S ( x , y ) ¯ ,
m ¯ H ( R S ) ( x , y ) = m H ( x , y ) m ¯ R ( x , y ) m ¯ S ( x , y ) ¯ ,
m ¯ H ¯ ( x , y ) = m H ( x , y ) ¯
m ¯ H ¯ ( R S ) ( x , y ) = m H ( x , y ) m ¯ R ( x , y ) m ¯ S ( x , y ) ¯
γ a m = 10 log 10 ( η a m η m )
γ a s m = 10 log 10 ( η a s m η m ) .
γ a n = 10 log 10 ( η a n η n )
γ a s n = 10 log 10 ( η a s n η n ) .
γ a t = 10 log 10 ( η a t η t ) = 10 log 10 ( S / N a S / N )
γ a s t = 10 log 10 ( η a s t η t ) = 10 log 10 ( S / N a s S / N ) .
γ SNF = 10 log 10 ( 1 / η n )
γ SNL = 10 log 10 ( 1 / η t ) ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.