Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Hyperspectral wide-field time domain single-pixel diffuse optical tomography platform

Open Access Open Access

Abstract

We present the design and comprehensive instrumental characterization of a time domain diffuse optical tomography (TD-DOT) platform based on wide-field illumination and wide-field hyperspectral time-resolved single-pixel detection for functional and molecular imaging in turbid media. The proposed platform combines two digital micro-mirror devices (DMDs) to generate structured light and a spectrally resolved multi-anode photomultiplier tube (PMT) detector in time domain for hyperspectral data acquisition over 16 wavelength channels based on the time-correlated single-photon counting (TCSPC) technique. The design of the proposed platform is described in detail and its characteristics in spatial, temporal and spectral dimensions are calibrated and presented. The performance of the system is further validated through a phantom study where two absorbers in glass tubes with spectral contrast are mapped in a turbid medium of ~20 mm thickness. The method presented here offers the potential of accelerating the imaging process and improving reconstruction results in TD-DOT and thus facilitates its wide spread use in preclinical and clinical in vivo imaging scenarios.

© 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement

1. Introduction

Optical imaging is a powerful non-invasive tool to retrieve the distributions of exogenous fluorophores and/or endogenous chromophores in biological tissues. Especially, diffuse optical tomography (DOT) has found applications in numerous biomedical clinical and preclinical scenarios like breast cancer detection [1–3], functional brain imaging [4,5] and small animal imaging [6,7]. In addition, hybrid imaging systems that fuse DOT with other traditional medical imaging modalities [8–10] lead to complementary investigations of structural and functional information simultaneously or measurement cross-validations between different imaging modalities. However, the inherent ill-conditioned nature of DOT poses a great challenge to the performances of 3D reconstruction and renders it susceptible to noise and other modeling/instrumental uncertainties. Temporal modulation of light intensity, especially launching ultrashort mode-locking pulses in TD-DOT has proven to be a key factor to improve its performance. The abundant temporal information offered by time-resolved systems enables differentiating tissue absorption and scattering with minimal cross-talk [11,12] and sparse sampling of fluorescence contrast with improved accuracy [13] compared to its continuous wave (CW) counterparts. In addition, TD-DOT not only offers fluorescence lifetime as a robust and quantitative contrast for molecular unmixing but also presents improved resolution and reduced cross-talk in the 3D reconstruction of molecular information due to the combination of early-arriving photons and late-arriving highly diffused photons [14,15]. However, when there is need to acquire dense spatial, temporal and spectral hypercubes for optimal DOT performances, long data acquisition times are a limiting factor.

Recently we have proposed a novel instrumental approach to acquire such experimental hypercubes in relative short acquisition times by leveraging well-established concepts in compressive sensing and by using a double spatial light modulators (SLM) configuration [16,17]. The combination of structured light both in the illumination and detection channels for fast and robust DOT was first reported by Belanger et al [18]. The instrumental implementation was built around two DMD units and a single-pixel PMT detector in CW-DOT. This configuration allowed a 2 Hz frame rate acquisition in a phantom study [18]. The wide-field illumination and single-pixel detection configurations permitted reducing measurement number needed for tomography, which tremendously increased the detection SNR. This approach was further extended to TD-DOT by our group [17]. In Ref [17], the double-DMD configuration was combined with a time-resolved spectrophotometer based on a spectrally resolved multi-anode PMT detector in time domain for hyperspectral single-pixel acquisition. A Quantized Low Spatial Frequency base (QLSF) was selected as it provided best tomography results and ease of implementation experimentally. This novel instrumental paradigm that enabled the acquisition of 4D data cube (x, y, t, λ) was validated in fluorescence TD-DOT to resolve the relative concentrations of two dyes with lifetime and spectral contrast. This novel instrumental design was replicated recently in [19] with the addition of a stage to rotate the phantoms held in an upright position. However, if these previous studies focused on proof of concepts, none did report in details in the design of the system sub-components and their characterization.

Herein, we provide a comprehensive description of our instrumental platform and demonstrate its potential for performing hyperspectral TD-DOT. The key instrumental components of the system and the whole platform are characterized in spatial, temporal and spectral dimensions. We further validate the performance of this system with an in vitro study where the concentrations of two NIR absorbing dyes with spectral contrast suspended in a tissue-mimic liquid phantom are retrieved using the dense hyperspectral single-pixel data sets acquired in time domain with improved quantification and crosstalk. The paper is arranged as follows: in the second section, the detailed description of the system and characterization results are provided; then, the mathematical imaging model used in reconstruction is introduced in the third section; in vitro phantom study details and results are explored in the fourth section which is followed by conclusions and discussions in the last section.

2. System design and characteristics

2.1 System instrumentation overview

To implement the wide-field structured illumination and hyperspectral single-pixel structured detection methodology, we proposed a system design for fluorescence molecular tomography in Refs [16,17]. Herein we report for the first time on the detailed characterization of its components as well as its updating with a broadband supercontinuum pulsed fiber laser to enable hyperspectral functional imaging. A scheme of the proposed system is shown in Fig. 1(a) and its physical implementation (laser source not included) is depicted in Fig. 1(b). It employs two kinds of high-power pulsed lasers as light sources for delivering ultra-short NIR light pulses to the samples. Two DMD-based SLMs are implemented to enable structured light illumination and single-pixel acquisition in transmission. The spatially integrated light exiting the detection DMD is coupled into a time domain Czerny-Turner spectrometer based on a spectrograph and a multi-anode time-resolved PMT. Under each illumination and detection pair, we collect sixteen spectrally resolved temporal point spread functions (TPSFs) using TCSPC technique.

 figure: Fig. 1

Fig. 1 (a) The scheme of the proposed hyperspectral wide-field time-resolved diffuse optical tomography platform (Laser and its coupling optics are not shown here). L1: lens, f = 25.4 mm; L2: lens, f = 25.4 mm; L3: lens, f = 40 mm; L4: lens, f = 30 mm; M1: plane mirror; M2, M3: concave mirrors; G: ruled reflective blazed grating, 750 nm blaze, 1200 lines/mm. (b) A photo that shows the physical implementation of the proposed system (Laser is not included).

Download Full Size | PDF

2.2 Light source

To provide a comprehensive depiction of this platform, we report its characterization of two different time-resolved light sources. For molecular imaging, we employ a Ti:sapphire mode-locked pulse laser (Mai Tai HP, Spectral Physics, CA) which is capable of generating light pulses from 690 nm to 1040 nm with ~100 fs pulse width, 80 MHz repetition rate and <15 nm spectral bandwidth (in terms of FWHM: full width at half maximum). This laser is best for fluorescence imaging as it provides high-power mono-spectral excitation. The Mai Tai output is delivered to the illumination DMD using a multi-mode fiber of 400 μm core diameter (P-400-10-VIS-NIR, Ocean Optics, FL) and a collimator (F810SMA-780, Thorlabs Inc, NJ) with ~80% transmission. For functional imaging, a supercontinuum pulsed fiber laser (SC-Pro, YSL Photonics, Wuhan, China) is employed for broadband hyperspectral excitation. It generates ultrafast supercontinuum pulses in a broad spectrum range from 400 nm to 2200 nm, with 1 MHz - 25 MHz tunable repetition rate, 150 - 200 ps pulse width and >4 W total power at 25 MHz repetition rate (>1 mW/nm spectral power density in the range of 700 nm - 820 nm). Its output is spectrally filtered using free-space optics for hyperspectral excitation before being coupled into the illumination DMD (Fig. 2(a)). The collimated output of SC-Pro is expanded by a beam expander (constructed with a microscope objective: M-10X, Newport Optics, CA and a lens: AC-254-030-B, Thorlabs Inc, NJ) and then filtered by two dichroic mirrors (FF801-Di02-25 × 36 and FF700-Di01-25 × 36, Semrock, NY) to preserve the NIR spectrum and prevent other parts of the spectrum from contaminating the measurements. Before coupling into the illumination DMD, the spectrum and total power are monitored by a spectrophotometer (USB2000, Ocean Optics, FL) and a photodetector (PDA100A, Thorlabs Inc, NJ). A typical output spectrum recorded at USB2000 is shown in Fig. 2(b).

 figure: Fig. 2

Fig. 2 SC-Pro supercontinuum fiber laser coupling. (a) The physical implementation of the coupling optics setup for the SC-Pro laser. (b) A typical output spectrum of the laser before injecting into the illumination DMD.

Download Full Size | PDF

2.3 Illumination module and detection module

On the illumination side, the PK101 Pico projector used in Ref [17] is replaced with another DMD-based projector (D4110 with VIS S2 + optics module, Digital Light Innovations, TX) for better coupling efficiency and light intensity coding linearity (see Fig. 3(a) and (b)). This module is capable of generating wide-field illumination bases for DOT with a 1024 × 768 micro-mirror array (0.7” chip size, 13.68 µm pixel pitch). The incoming collimated light is first focused into a reflective integrator rod with a condenser lens (LB1761-B, Thorlabs Inc, NJ) to homogenize the light field. Then the light is relayed onto the surface of the DMD chip for modulation and further projected onto the imaging plate with a projection lens of the S2 + optics (a 9-mm spacer ring is added to the lens to reduce its projection distance). Besides binary optical masks, 8-bit grayscale optical masks can also be generated by imposing pulse width modulation (PWM) on the switching of micro-mirrors at up to 60 Hz frame rate.

 figure: Fig. 3

Fig. 3 The setup of DMD-based illumination and detection modules. (a) The physical implementation of the illumination module. (b) The internal structure and light propagation path inside the illumination DMD. (c) Physical implementation of the detection module. (d) Internal structure and light path inside the detection module.

Download Full Size | PDF

On the detection side, another DMD-based SLM (D4110 with NIR S2 + optical module, Digital Light Innovations, TX) is employed to modulate the emission light field onto wide-field detection masks with the same DMD chip as in the illumination side (see Fig. 3(c) and (d)). An 8.6-mm spacer ring is added to the detection lens to reduce its working distance to ~10 cm. Transmitted spatially modulated light signals collected by the detection DMD are coupled into an 11-mm fiber light guide (mono-fiber: core diameter = 200 µm, NA = 0.22) with a relay lens group (LB1761-B, LA1422-B and LB1757-B, Thorlabs Inc, NJ). An optical filter is usually required for fluorescence imaging and optional for hyperspectral functional investigation. The fiber light guide not only transports the emission light signals but also converts the optical aperture cross-section from a 3-mm-diameter circular aperture to a 7 × 1 mm2 rectangular shape to fulfill the slit input requirement of the spectrally resolved PMT detector. The mono-fibers inside the light guide are randomly arranged from the input side to the output side to minimize the interference of spatial multiplexing on spectral multiplexing considering the relatively large slit size here. The hyperspectral detector used in the system combines a spectrograph (MS125, Newport Optics, CA) with a multi-anode time-resolved PMT (PML-16-C, Becker & Hickl GmbH, Germany) to achieve hyperspectral data acquisition in time domain. The spectrograph (focal length = 120 mm, f-number = 3.7) employs two concave mirrors and a 1200 lines/mm ruled reflectance grating (77412, Newport Optics, CA) that blazes at 750 nm to disperse the light signals onto the active area (16 × 16 mm2) of the PMT photocathode [20]. Each of its sixteen 0.8 × 16 mm2 pixels (1 mm pixel pitch) serves as a single-pixel time-resolved camera at the corresponding wavelength channel. The detection wavelength range can be adjusted by replacing gratings with different line densities and the center wavelength position can be tuned by rotating the grating.

The TCSPC technique is applied to acquire time-resolved data sets with SPC-150 module (Becker & Hickl GmbH, Germany) under the control of LabVIEW. Additionally, a NIR CMOS camera (UI-5240CP-NIR-GL, IDS GmbH, Germany) is integrated into the platform to account for the distortions, spatial intensity non-uniformity caused by the optical system by integrating the calibration results into the forward model of TD-DOT.

The system’s abilities to perform spatial light modulation of the excitation and emission light fields in time domain and signal multiplexing at the multi-anode PMT are crucial towards its goal of reconstructing functional and molecular information in preclinical samples. Thus, the platform performances are extensively reported in the spatial, temporal and spectral dimensions.

2.4 Spatial characterization

As TD-DOT is a model-based imaging technique, it is critical to capture the exact spatial distribution of the structured light illuminated on the sample and optical mask employed in the single-pixel scheme. Thus, each optical pattern is calibrated spatially by using the NIR CMOS camera. Figures 4(a)-(h) show the examples of camera captured QLSF illumination and detection masks. On the detection side, the modulated emission light field is sampled by the mono-fibers inside the fiber light guide, as is shown in Fig. 4(e)-(h). The experimental calibration of the patterns enables simulating such effect in our forward model calculations.

 figure: Fig. 4

Fig. 4 Examples of illumination and detection optical masks recorded using an NIR camera. (a)-(c) Spatial distribution of QLSF illumination masks #1, #2 and #3. (d) Full set of 36 illumination masks for TD-DOT. (e)-(g) Spatial distribution of QLSF detection masks #1, #2 and #3. (h) Full set of 36 detection masks for TD-DOT.

Download Full Size | PDF

For grayscale optical masks derived from transforms like discrete cosine transform (DCT), discrete wavelet transform (DWT) and discrete Fourier transform (DFT), the linearity of light intensity coding of SLM is characterized by projecting and recording two testing optical masks in the same field of view (FOV) on the imaging plate: one full-field illumination mask and one calibration mask with linear grayscale distribution (from 0 on the left to 255 on the right, Fig. 5(a)). The calibration mask is normalized by the full-field mask to cancel out the effect of illumination non-uniformity and averaged along the vertical direction (see Fig. 5 (b)). Then, the intensity coding linearity is calculated by:

linearity=(δ/255)×100%
whereδis the maximum deviation of grayscale values from linear distribution, and ‘255’ is the maximum level for 8-bit grayscale. This linearity mainly relies on the switch of micro-mirrors under PWM control signal thus depends on the DMD chip and corresponding electronic control circuit. For the 0.7” DMD used in this work, a <2% intensity coding linearity is observed (see Fig. 5(c)). It is worth noting that for the 0.17” DMD used for structured illumination in Ref [17], a relatively poor coding linearity of ~14.41% is observed and grayscale correction is necessary for higher projection fidelity. For example, a look-up table can be applied to generate a ~1% linearity [21].

 figure: Fig. 5

Fig. 5 Light intensity coding linearity test and results for 0.7” DMD. (a) Computer fed calibration mask for light intensity coding linearity test. (b) Recorded calibration mask normalized by recorded full-field illumination mask using the 0.7” DMD. (c) Output intensity coding level distribution (blue dashed line) from linear input (red line) for 0.7” DMD.

Download Full Size | PDF

2.5 Temporal characterization

The temporal performance of a time-domain imaging system is mainly characterized by its instrument response function (IRF), which is the system response to a short laser pulse. A robust IRF that is unsusceptible to time, wavelength and laser power is ideal for TD-DOT. In this platform, IRFs are measured by placing a diffusing paper on imaging plate. IRFs acquired by the system at different wavelengths using the two laser sources (Mai Tai laser and SC-Pro laser) are recorded and plotted in Fig. 6(a) and (b). Their corresponding FWHMs are calculated after interpolating the recorded IRFs to 1 ps resolution to evaluate the temporal resolution of the system (see Fig. 6(c)). It is shown that a <170 ps FWHM is achievable throughout the spectral range considered. This indicates that the double-DMD scheme does not compromise the temporal resolution considering the ~150 ps temporal resolution of the detector itself. The temporal stability of IRF is tested by observing the variations of FWHM and peak position t0 of the recorded IRFs over a period of >2 hours after turning on the gain voltage of PMT. Testing results using the Mai Tai laser are shown in Fig. 6(d) and (e). The FWHM drifts are within ± 5 ps around the mean value. The IRF peak position t0 experiences larger drift during the first 20 min of operation after which t0 drifts around the steady state mean value within a ~ ± 10 ps range.

 figure: Fig. 6

Fig. 6 Temporal characteristics of the system. (a) IRFs captured using Mai Tai laser from 700 nm to 810 nm. (b) IRFs recorded using SC-Pro fiber laser from 740 nm to 810 nm. (c) FWHMs of the IRFs recorded using two light sources. (d) IRF FWHM stability measured using Mai Tai laser over 2-hour operation time at 750 nm. (e) IRF peak position t0 variation measured using Mai Tai laser over 2-hour operation time at 750 nm.

Download Full Size | PDF

2.6 Spectral characterization

The transmission efficiency test over our primary spectrum of application mainly focuses on the SLMs. The tests are carried out by injecting different laser powers at the testing wavelengths (span from 700 nm to 820 nm) through a fiber to the DMDs and focusing their output signals onto the sensor of an optical power meter (S310C-thermal power sensor, Thorlabs, NJ) using a convex lens. The laser power at the fiber end is then measured to calculate the power transmission. For each testing wavelength, three input power values are used and the final transmission efficiency at this wavelength is obtained through linear regression. The test results for both the illumination and detection DMDs are shown in Fig. 7(a) - (c). The D4110 DMD with VIS optical module achieves >12.6% power transmission efficiency over the spectrum, while the D4110 DMD with NIR optical module offers significantly improved power transmission to allow above ~40% transmission across the testing NIR wavelength range. This is due to the NIR optical coating imposed on the projection optics and substantially reduces the energy loss for longer wavelengths. As a comparison, the Pico projector used in Ref [17] is capable of delivering >10% of the input laser power onto the imaging plate with a full-field pattern (see Fig. 7(c)). In addition, placing the D4110 NIR module on the detection side helps to make full use of its high transmission efficiency.

 figure: Fig. 7

Fig. 7 Spectral characterization results of the platform. Output powers obtained for different input powers with (a) D4110 VIS optical module, (b) D4110 NIR optical module, (c) The comparison of power transmission efficiency for the three DMD optical modules. (d) Spectral resolution test result of the PMT detector. Green line: input spectrum at 700 nm with FWHM = 1.88 nm. Blue dotted line: detected spectrum by the multi-anode PMT. Red dashed line: interpolated spectrum for analysis.

Download Full Size | PDF

The spectral resolution of the detector is independently characterized with a supercontinuum laser (WL-SC400-4, Fianium Inc, United Kingdom). An acousto-optic tunable filter (AOTF) (AOTF-V1-N2-DD, Fianium Inc, United Kingdom) is implemented to achieve an input spectrum of <2 nm FWHM. The spectrum at 700 nm is injected into the system and detected by the multi-anode detector. The output spectrum of the 16 spectral channels is interpolated and its FWHM is calculated to estimate the spectral resolution. The 1200 lines/mm grating in the spectrophotometer results in ~5.3 nm center wavelength distance between adjacent channels. The spectral resolution, in terms of FWHM, is estimated to be ~10 nm (see Fig. 7(d)). This spectral resolution is mainly determined by the blazed grating, slit width of the spectrograph and pixel size of the multi-anode PMT.

3. Optical inverse problem

In this work, a time-resolved mesh-based wide-field forward-adjoint Monte Carlo (aMC) method optimized for wide-field structured light strategies [22,23] is employed to compute the forward model and associated Jacobian matrix. We apply the Rytov approximation [24] to linearize the forward problem of TD-DOT. Suppose that the TD-DOT is performed using Ns illumination masks and Nd detection masks, and the emitted light fluence under thelth(l=1,2,,Ns) illumination mask rs,land themth(m=1,2,,Nd)detection mask rd,m at the kth wavelength channel (center wavelength λk) and delay time point t is expressed as:

Uλk(rs,l,rd,m,t)=U0λk(rs,l,rd,m,t)·exp[Φpertλk(rs,l,rd,m,t)]
where U0λk(rs,l,rd,m,t) and Uλk(rs,l,rd,m,t) are emission light fields measured without and with perturbations in optical properties.Φpertλk(rs,l,rd,m,t) is the phase shift due to the perturbations and can be calculated as:
Φpertλk(rs,l,rd,m,t)=ln(Uλk(rs,l,rd,m,t)U0λk(rs,l,rd,m,t))
At the same time, Φpertλk(rs,l,rd,m,t)can be derived from the absorption perturbationδμaλk(r)at space locationrandλkby:
Φpertλk(rs,l,rd,m,t)=Ωwλk(rs,l,rd,m,r,t)·δμaλkd3r
where
wλk(rs,l,rd,m,r,t)=αλkGλk(rs,l,rd,m,t)0tdtGλk(rs,l,r,tt)·Gλk(r,rd,m,t)
is the weight function obtained with the Green’s functions of forward and adjoint light fieldsGλk(rs,l,r,tt),Gλk(r,rd,m,t)and the forward light field at the detection maskG0λk(rs,l,rd,m,t). αλkis a constant that accounts for the system response and model-related coefficients atλkand Ω is the imaging volume. Suppose Ω is discretized into Nnode nodes and data sets are acquired with P source-detector pairs and Ttime gates. Then, the discretized distribution vector of δμaλkwithin Ω can be expressed as xλkand retrieved by solving the inverse problem of the following equation:
bλk=WΩ,λkxλk
wherebλk=[γ1λkγP×Tλk](k=1,2,,N),γiλk=ln[Uλk(rs,l,rd,m,t)/U0λk(rs,l,rd,m,t)] (i=1,2,,P×T)defines the measurement vector, andWΩ,λkis the weight matrix (for T time gates) at wavelengthλk.

Assume that the absorption perturbationδμaλkis contributed byLabsorbers in the medium, thus the absorption contrast δμaλk(r)=n=1LCn(r)·εn,k (n=1,2,,L), where Cn(r)is the concentration of the nth absorber at r and εn,k denotes its extinction coefficient at λk. Then the weight function of the nth absorber at λkin terms of concentration becomes:

wnλk(rs,l,rd,m,r,t)=εn,k·wλk(rs,l,rd,m,r,t)
and the inverse problem to retrieve the concentrations of Labsorbers using measurements from Psource-detector pairs, Nwavelengths, and Ttime gates can be established as:
[bλ1bλN]=[W1Ω,λ1WLΩ,λ1W1Ω,λNWLΩ,λN][C1ΩCLΩ]
whereWnΩ,λkdenotes the weight matrix for the nth absorber at the kth wavelength and vector CnΩ is the absorber concentration over the whole volume.

We adopted an optode calibration method [25] to suppress the artifacts induced by the fluctuations in source-detector coupling coefficients. In this method, coupling amplitude terms slanddm(l=1,2,,Ns;m=1,2,,Nd)for sourcers,land detector rd,m respectively are added to each source-detector pair so Eq. (4) can be updated as:

γiλk=ln[Uλk(rs,l,rd,m,t)/U0λk(rs,l,rd,m,t)]=lnsl+lndm+Ωwλk(rs,l,rd,m,r,t)·δμaλkd3r
Thus Eq. (6) can be updated as:
bλk=W^Ω,λkx^λk=[μaλkWΩ,λkWSWD][xλk/μaλksd]T
whereWSand WDrepresent the involvement of source and detector masks for each measurement using “1” (source or detector used for acquiring the measurements) and “0” (source or detector not used). xλk/μaλkis the relative absorption perturbation to the background medium, so that the reconstructed vector becomes dimensionless and the dynamic range can be reduced. Vectors sanddare coupling coefficient vectors (independent of wavelength). Similarly, the forward problems described in Eq. (8) and can be updated as:
[b^λ1b^λN]=[W1Ω,λ1WLΩ,λ1W1Ω,λNWLΩ,λN][C1ΩCLΩ]
by stacking sensitivity matrices and updated measurements from different wavelengths. The measurements are updated based on Eq. (10) so that contributions from coupling coefficients to bλkare removed and b^λkonly accounts for the contributions of absorbers.

The 3D distributions of two absorbers are retrieved by inverting the forward problem described in Eq. (11). In this study, L1-norm based regularization method [26] is implemented to solve the inverse problem. Information from both the early and late time gates are employed where reconstruction of early-gate serves as the initial guess to the final reconstruction [13].

4. Phantom study and results

A liquid phantom study is conducted to validate the system performance for functional tomographic reconstruction in turbid media. Two water-soluble absorbers: India ink (Speedball Art Products, NC) and Epolight 2735 (Epolin Inc, NJ) are used to generate spectrally resolved absorption contrasts while intralipid (20% stock solution, Sigma-Aldrich, MO) is used to control the scattering property of the medium. An 80 × 50 × 22.5 mm3 liquid phantom is prepared in a polycarbonate clear tank (see Fig. 8(a)). In the medium, the concentrations of India ink (volume concentration), Epolight 2735 (mass concentration), and Intralipid are set to 0.0024%, 0.0008%, and 0.8% respectively to generate optical properties of µa = 0.15 cm−1 and µs = 8.39 cm−1 at 740 nm. Two glass tubes (10.25 mm and 10.38 mm in diameter and 16 mm center-to-center distance) are suspended at 10 mm depth in the liquid medium. Intralipid concentration is set to 0.8% in both tubes to keep the scattering properties same as the medium. In the left tube, concentrations of Epolight 2735 and India ink are set to ~0.0034% and ~0.0024% to create 3.249 times of absorption perturbation from Epolight 2735. In the right tube, the concentration of Epolight 2735 and India ink are prepared as ~0.0008% and ~0.0092% to create 2.825 times of absorption perturbation from India ink. Figure 8(b) depicts the absorption coefficient trends of the absorber mixtures in the medium and the solutions added to the two tubes over the detection wavelength range. The extinction coefficients of the two absorbing materials are calibrated using Monte Carlo-based time-resolved spectroscopy [22]. Figure 8(c) shows the absorption coefficients of 0.0008% Epolight 2735 and 0.0024% India ink obtained from the calibration tests and a clear spectral contrast could be observed.

 figure: Fig. 8

Fig. 8 Liquid phantom structure and optical property calibration results for the hyperspectral functional DOT study. (a) A photo of the liquid phantom used. (b) The absorption coefficients of the medium and materials within the two tubes retrieved using time-resolved spectroscopy. (c) The calibrated absorption coefficients of Epolight 2735 (0.0008%) and India ink (0.0024%) over the detection wavelength range.

Download Full Size | PDF

In this study, the SC-Pro supercontinuum fiber laser is employed as the light source to create hyperspectral illumination from 700 nm to 800 nm as shown in Fig. 2(b) at 25 MHz repetition rate. The power output of the laser is set to 75% of its maximum power. The same set of 36 × 36 illumination and detection optical masks shown in Fig. 5(d) and (h) is applied. The FOV is set to 40 × 30 mm2 on both sides. The detection range is set as 740 nm - 818 nm (center wavelengths of channels) over 16 wavelength channels. The exposure time for each measurement is 3 s. TPSFs of the unperturbed and perturbed measurements over the first 12 wavelength channels (from 740 nm to ~800 nm) obtained using the first source-detection pair are plotted in Fig. 9(a) and (b), where >3010 and >1900 maximum photon counts are obtained for all the 12 channels. The phase shifts due to absorption perturbations (shown in Eq. (3)) are retrieved from the 10th (both illumination and detection masks in the left half of the phantom surface) and 325th (both illumination and detection masks in the right half of the phantom surface) source-detector pairs as examples (see Fig. 9(c) and (d)). Perturbations of Epolight 2735 and Indian ink dominate those two measurements respectively and the phase shift trend is in accordance with our calibration results of Epolight 2735 and Indian ink absorption perturbation depicted in Fig. 8(b).

 figure: Fig. 9

Fig. 9 Examples of the TPSFs and phase shifts obtained by the system in the phantom study. (a) TPSFs obtained in the absence of absorption perturbation under the 1st source-detector pair. (b) TPSFs obtained in the presence of absorption perturbation under the 1st source-detector pair. (c) Phase shift obtained from the 10th source-detector pair measurement (Epolight 2735 absorption perturbation dominates). (d) Phase shift obtained from the 325th source-detector pair measurement (Indian ink absorption perturbation dominates).

Download Full Size | PDF

The maximum reconstruction crosstalk and the relative concentration ratio of the two absorbers are employed to evaluate the performance of the proposed platform. The maximum crosstalk is computed as follows:

Crosstalk1=max[C˜2(Ω1)]max[C˜1(Ω1)]×100%
Crosstalk2=max[C˜1(Ω2)]max[C˜2(Ω2)]×100%
Max_Crosstalk=max(Crosstalk1,Crosstalk2)
Here, C˜1and C˜2 are reconstructed concentrations of two absorbers normalized to their own maximum, while Ω1 and Ω2are real distribution spaces of absorbers 1 and 2 at 50% isovalue. Time-resolved data of four gates: 50% rising gate, peak gate, 80% decaying gate and 60% decaying gate are applied, where reconstructions using 50% rising gate are used as initial guess of the final reconstruction. The implemented spectral information is controlled to increase from two channels (740 nm and 745 nm) to twelve channels (740 nm, ···, 797 nm). The retrieved absorber concentrations using two, four, and twelve channels are shown in Figs. 10(a-c). With data from only two wavelength channels, the two absorbers are separated with relatively high maximum crosstalk ~95.85%, however, by increasing the spectral information to twelve wavelength channels, the maximum crosstalk is reduced to 35.76%. The relationship between maximum crosstalk and relative reconstructed concentration ratio are summarized in Fig. 11, where a decreasing trend of maximum crosstalk is easily observed with the increase of spectral information in reconstruction. At the same time, the quantification accuracy of the reconstructed concentration ratio increases with spectral multiplexing. The estimation error of the relative concentration of the two absorbers reduces from 81.07% (using 2 wavelength channels for reconstruction) to 0.17% (using 12 wavelength channels for reconstruction).

 figure: Fig. 10

Fig. 10 Reconstructed absorber concentration distributions using data from four time-gates (50% rising gate, peak gate, 80% decaying gate, and 60% decaying gate) and multiple wavelength channels. (a) Reconstruction using 2 wavelength channels (740 nm – 745 nm) (maximum crosstalk = 95.85%). (b) Reconstruction using 4 wavelength channels (740 nm – 756 nm) (maximum crosstalk = 52.29%). (c) Reconstruction using 12 wavelength channels (740 nm – 797 nm) (maximum crosstalk = 35.76%). (d) Reconstruction of absorber concentrations by linear decomposition at each node using data from 12 wavelength channels. (maximum crosstalk = 51.78%). All plots are 50% isovolumic surfaces of individual absorber concentrations.

Download Full Size | PDF

 figure: Fig. 11

Fig. 11 The effects of spectral information on unmixing performance and quantification accuracy. (a) The relationship between spectral information and maximum reconstruction crosstalk. (b) The relationship between spectral information and retrieved concentration ratio of two absorbers.

Download Full Size | PDF

Finally, the performance of the above method to retrieve absorber concentrations is compared with the method that performs linear decomposition at each node within the phantom volume. The results of using the reconstructed absorption maps at twelve wavelength channels with data of four time-gates to conduct linear decomposition is shown in Fig. 10(d). The result is highly compromised in terms of maximum crosstalk (51.78%) and relative quantification accuracy (reconstructed relative concentration ratio = 0.56 against ground truth = 0.38) compared to the result shown in Fig. 10(c). Linear decomposition at each node offers poor performance because it fails to exploit the correlations between nodes.

5. Discussion and conclusion

To sum up, we report on a detailed calibration of the proposed time-resolved DOT system based on wide-field structured illumination and hyperspectral single-pixel detection and validate the system performance with phantom studies. Spectral and spatial characteristics of two DMDs on illumination and detection sides show their abilities to project wide-field patterns over large area. By inputting patterns recorded during the calibration stage into our MC code, we are able to account for the non-uniformity during illumination and detection. The temporal calibration indicates that temporal resolution is not compromised by the wide-field technique.

Using a supercontinuum fiber laser to perform hyperspectral excitation of the sample offers a spectral information boost within the same data acquisition time compared to mono-spectral excitation situations. Moreover, the hyperspectral wide-field single-pixel detection implementation facilitates fast collection and utilization of this abundant information. The benefits of the proposed method are also reflected by the reconstruction results where the maximum crosstalk and quantification accuracy of the relative concentration ratios retrieved through TD-DOT are improved with increasing the spectral information. Note that overall, the study reported herein is not optimized in terms of optical reconstructions strategies as well as acquisition speeds. The focus of this report is to provide a detailed characterization of the instrumental design and subcomponent of our hyperspectral dual-DMD setup which involves non-trivial elements. We opt to present the characterization of the system as usually done for time-resolved instruments with the addition of the spectral DMD characterization and validation in phantom experiments as typically done in the field. We expect overall that significant improvement in reconstructions can be achieved via more refined inverse problem methodologies, such as multimodal strategies. Similarly, we expect that significant reduction in acquisition speed can be achieved by optimizing the system or performing data postprocessing.

Indeed, the maximum photon counts allowed and data acquisition time of this study is limited by the 25 MHz repetition rate of the supercontinuum fiber laser to avoid pile-up effect during TCSPC data acquisition. Since supercontinuum fiber lasers with 80 MHz repetition rate are widely available in the market, the time needed to acquire these hyperspectral information-rich data sets could be significantly reduced to <20 min. Moreover, we have not investigated what is the required maximum photon counts in the acquired TPSF to allow for robust functional imaging. In the case of FMT, this photon counts can be reduced further, and hence, could lead to one order of magnitude in time of acquisition. Similarly, postprocessing methodologies such as gating could lead to improved photon counts without compromising the temporal information [27,28]. Moreover, the system is not fully optimized in the detection channel where we still have space for improving the transmission by replacing the inefficient components like fiber light guide and high f-number spectrograph. Furthermore, the optical masks we applied have proven to be robust and working well for in vivo imaging [29] but other sets of patterns can be considered [30,31]. For instance, we recently reported that a Hadamard base ranked by frequency provided the best results for 2D lifetime imaging when a single-pixel methodology was employed and in further studies, we will extend this work to tomographic imaging [32]. Last, one significant appeal of spatial light modulators is their ability to adaptively adjust illumination [21]. Such scheme is well suited to account for inhomogeneity inside biological tissue and complex geometries leading to large variation in dynamical range acquired when the animal is in a prone position as required for live preclinical studies.

Funding

National Science Foundation (NSF) (CBET 1149407); National Institute of Health (NIH) (R01 EB19443, R01 BRG CA207725).

Acknowledgments

The authors gratefully acknowledge YSL Photonics from China for loaning us the supercontinuum fiber laser and the Computational Center for Nanotechnology Innovations (CCNI) at Rensselaer Polytechnic Institute for the technical support and computation resource facilitating the completion of this work. We would like to thank NVIDIA for the GPU donation used in some of this work.

Disclosures

The authors declare that there are no conflicts of interest related to this article.

References

1. D. R. Leff, O. J. Warren, L. C. Enfield, A. Gibson, T. Athanasiou, D. K. Patten, J. Hebden, G. Z. Yang, and A. Darzi, “Diffuse optical imaging of the healthy and diseased breast: a systematic review,” Breast Cancer Res. Treat. 108(1), 9–22 (2008). [CrossRef]   [PubMed]  

2. D. Grosenick, H. Rinneberg, R. Cubeddu, and P. Taroni, “Review of optical breast imaging and spectroscopy,” J. Biomed. Opt. 21(9), 091311 (2016). [CrossRef]   [PubMed]  

3. V. Venugopal and X. Intes, “Recent advances in optical mammography,” Curr. Med. Imaging Rev. 8(3), 244–259 (2012). [CrossRef]  

4. J. C. Hebden, A. Gibson, T. Austin, R. M. Yusof, N. Everdell, D. T. Delpy, S. R. Arridge, J. H. Meek, and J. S. Wyatt, “Imaging changes in blood volume and oxygenation in the newborn infant brain using three-dimensional optical tomography,” Phys. Med. Biol. 49(7), 1117–1130 (2004). [CrossRef]   [PubMed]  

5. A. T. Eggebrecht, S. L. Ferradal, A. Robichaux-Viehoever, M. S. Hassanpour, H. Dehghani, A. Z. Snyder, T. Hershey, and J. P. Culver, “Mapping distributed brain function and networks with diffuse optical tomography,” Nat. Photonics 8(6), 448–454 (2014). [CrossRef]   [PubMed]  

6. C. Darne, Y. Lu, and E. M. Sevick-Muraca, “Small animal fluorescence and bioluminescence tomography: a review of approaches, algorithms and technology update,” Phys. Med. Biol. 59(1), R1–R64 (2014). [CrossRef]   [PubMed]  

7. F. Leblond, S. C. Davis, P. A. Valdés, and B. W. Pogue, “Pre-clinical whole-body fluorescence imaging: Review of instruments, methods and applications,” J. Photochem. Photobiol. B 98(1), 77–94 (2010). [CrossRef]   [PubMed]  

8. F. S. Azar and X. Intes, Translational Multimodality Optical Imaging (Artech House Publishing, 2008).

9. Q. Pian, C. Wang, X. Chen, J. Liang, L. Zhao, G. Wang, and X. Intes, “Multimodal biomedical optical imaging review: towards comprehensive investigation of biological tissues,” Curr. Mol. Imaging 3(2), 72–87 (2014). [CrossRef]  

10. Q. Fang, J. Selb, S. A. Carp, G. Boverman, E. L. Miller, D. H. Brooks, R. H. Moore, D. B. Kopans, and D. A. Boas, “Combined optical and X-ray tomosynthesis breast imaging,” Radiology 258(1), 89–97 (2011). [CrossRef]   [PubMed]  

11. V. Venugopal, J. Chen, and X. Intes, “Development of an optical imaging platform for functional imaging of small animals using wide-field excitation,” Biomed. Opt. Express 1(1), 143–156 (2010). [CrossRef]   [PubMed]  

12. F. Nouizi, M. Torregrossa, R. Chabrier, and P. Poulet, “Improvement of absorption and scattering discrimination by selection of sensitive points on temporal profile in diffuse optical tomography,” Opt. Express 19(13), 12843–12854 (2011). [CrossRef]   [PubMed]  

13. J. Chen, V. Venugopal, and X. Intes, “Monte Carlo based method for fluorescence tomographic imaging with lifetime multiplexing using time gates,” Biomed. Opt. Express 2(4), 871–886 (2011). [CrossRef]   [PubMed]  

14. Z. Li and M. Niedre, “Hybrid use of early and quasi-continuous wave photons in time-domain tomographic imaging for improved resolution and quantitative accuracy,” Biomed. Opt. Express 2(3), 665–679 (2011). [CrossRef]   [PubMed]  

15. M. Pimpalkhare, J. Chen, V. Venugopal, and X. Intes, “Ex vivo fluorescence molecular tomography of the spine,” Int. J. Biomed. Imaging 2012, 942326 (2012). [CrossRef]   [PubMed]  

16. Q. Pian, R. Yao, N. Sinsuebphon, and X. Intes, “Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging,” Nat. Photonics 11(7), 411–414 (2017). [CrossRef]   [PubMed]  

17. Q. Pian, R. Yao, L. Zhao, and X. Intes, “Hyperspectral time-resolved wide-field fluorescence molecular tomography based on structured light and single-pixel detection,” Opt. Lett. 40(3), 431–434 (2015). [CrossRef]   [PubMed]  

18. S. Bélanger, M. Abran, X. Intes, C. Casanova, and F. Lesage, “Real-time diffuse optical tomography based on structured illumination,” J. Biomed. Opt. 15(1), 016006 (2010). [CrossRef]   [PubMed]  

19. A. Farina, M. Betcke, L. di Sieno, A. Bassi, N. Ducros, A. Pifferi, G. Valentini, S. Arridge, and C. D’Andrea, “Multiple-view diffuse optical tomography system based on time-domain compressive measurements,” Opt. Lett. 42(14), 2822–2825 (2017). [CrossRef]   [PubMed]  

20. Becker & Hickl GmbH, PML-16-C User Handbook (Berlin, Germany, 2006).

21. V. Venugopal and X. Intes, “Adaptive wide-field optical tomography,” J. Biomed. Opt. 18(3), 036006 (2013). [CrossRef]   [PubMed]  

22. J. Chen, Q. Fang, and X. Intes, “Mesh-based Monte Carlo method in time-domain widefield fluorescence molecular tomography,” J. Biomed. Opt. 17(10), 106009 (2012). [CrossRef]   [PubMed]  

23. R. Yao, X. Intes, and Q. Fang, “Generalized mesh-based Monte Carlo for wide-field illumination and detection via mesh retessellation,” Biomed. Opt. Express 7(1), 171–184 (2016). [CrossRef]   [PubMed]  

24. M. A. O’Leary, “Imaging with diffuse photon density waves,” Ph.D. dissertation, Dept. Phys., Univ. of Pennsylvania, Philadelphia, PA, 1996, pp. 58–59.

25. D. Boas, T. Gaudette, and S. Arridge, “Simultaneous imaging and optode calibration with diffuse optical tomography,” Opt. Express 8(5), 263–270 (2001). [CrossRef]   [PubMed]  

26. L. Zhao, H. Yang, W. Cong, G. Wang, and X. Intes, “Lp regularization for early gate fluorescence molecular tomography,” Opt. Lett. 39(14), 4156–4159 (2014). [CrossRef]   [PubMed]  

27. J. Chen and X. Intes, “Time-gated perturbation Monte Carlo for whole body functional imaging in small animals,” Opt. Express 17(22), 19566–19579 (2009). [CrossRef]   [PubMed]  

28. J. Chen, V. Venugopal, F. Lesage, and X. Intes, “Time-resolved diffuse optical tomography with patterned-light illumination and detection,” Opt. Lett. 35(13), 2121–2123 (2010). [CrossRef]   [PubMed]  

29. V. Venugopal, J. Chen, F. Lesage, and X. Intes, “Full-field time-resolved fluorescence tomography of small animals,” Opt. Lett. 35(19), 3189–3191 (2010). [CrossRef]   [PubMed]  

30. J. Dutta, S. Ahn, A. A. Joshi, and R. M. Leahy, “Illumination pattern optimization for fluorescence tomography: theory and simulation studies,” Phys. Med. Biol. 55(10), 2961–2982 (2010). [CrossRef]   [PubMed]  

31. N. Ducros, C. D’andrea, G. Valentini, T. Rudge, S. Arridge, and A. Bassi, “Full-wavelet approach for fluorescence diffuse optical tomography with structured illumination,” Opt. Lett. 35(21), 3676–3678 (2010). [CrossRef]   [PubMed]  

32. M. Ochoa, Q. Pian, R. Yao, N. Ducros, and X. Intes, “Assessing patterns for compressive fluorescence lifetime imaging,” Opt. Lett. 43(18), 4370–4373 (2018). [CrossRef]   [PubMed]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (11)

Fig. 1
Fig. 1 (a) The scheme of the proposed hyperspectral wide-field time-resolved diffuse optical tomography platform (Laser and its coupling optics are not shown here). L1: lens, f = 25.4 mm; L2: lens, f = 25.4 mm; L3: lens, f = 40 mm; L4: lens, f = 30 mm; M1: plane mirror; M2, M3: concave mirrors; G: ruled reflective blazed grating, 750 nm blaze, 1200 lines/mm. (b) A photo that shows the physical implementation of the proposed system (Laser is not included).
Fig. 2
Fig. 2 SC-Pro supercontinuum fiber laser coupling. (a) The physical implementation of the coupling optics setup for the SC-Pro laser. (b) A typical output spectrum of the laser before injecting into the illumination DMD.
Fig. 3
Fig. 3 The setup of DMD-based illumination and detection modules. (a) The physical implementation of the illumination module. (b) The internal structure and light propagation path inside the illumination DMD. (c) Physical implementation of the detection module. (d) Internal structure and light path inside the detection module.
Fig. 4
Fig. 4 Examples of illumination and detection optical masks recorded using an NIR camera. (a)-(c) Spatial distribution of QLSF illumination masks #1, #2 and #3. (d) Full set of 36 illumination masks for TD-DOT. (e)-(g) Spatial distribution of QLSF detection masks #1, #2 and #3. (h) Full set of 36 detection masks for TD-DOT.
Fig. 5
Fig. 5 Light intensity coding linearity test and results for 0.7” DMD. (a) Computer fed calibration mask for light intensity coding linearity test. (b) Recorded calibration mask normalized by recorded full-field illumination mask using the 0.7” DMD. (c) Output intensity coding level distribution (blue dashed line) from linear input (red line) for 0.7” DMD.
Fig. 6
Fig. 6 Temporal characteristics of the system. (a) IRFs captured using Mai Tai laser from 700 nm to 810 nm. (b) IRFs recorded using SC-Pro fiber laser from 740 nm to 810 nm. (c) FWHMs of the IRFs recorded using two light sources. (d) IRF FWHM stability measured using Mai Tai laser over 2-hour operation time at 750 nm. (e) IRF peak position t0 variation measured using Mai Tai laser over 2-hour operation time at 750 nm.
Fig. 7
Fig. 7 Spectral characterization results of the platform. Output powers obtained for different input powers with (a) D4110 VIS optical module, (b) D4110 NIR optical module, (c) The comparison of power transmission efficiency for the three DMD optical modules. (d) Spectral resolution test result of the PMT detector. Green line: input spectrum at 700 nm with FWHM = 1.88 nm. Blue dotted line: detected spectrum by the multi-anode PMT. Red dashed line: interpolated spectrum for analysis.
Fig. 8
Fig. 8 Liquid phantom structure and optical property calibration results for the hyperspectral functional DOT study. (a) A photo of the liquid phantom used. (b) The absorption coefficients of the medium and materials within the two tubes retrieved using time-resolved spectroscopy. (c) The calibrated absorption coefficients of Epolight 2735 (0.0008%) and India ink (0.0024%) over the detection wavelength range.
Fig. 9
Fig. 9 Examples of the TPSFs and phase shifts obtained by the system in the phantom study. (a) TPSFs obtained in the absence of absorption perturbation under the 1st source-detector pair. (b) TPSFs obtained in the presence of absorption perturbation under the 1st source-detector pair. (c) Phase shift obtained from the 10th source-detector pair measurement (Epolight 2735 absorption perturbation dominates). (d) Phase shift obtained from the 325th source-detector pair measurement (Indian ink absorption perturbation dominates).
Fig. 10
Fig. 10 Reconstructed absorber concentration distributions using data from four time-gates (50% rising gate, peak gate, 80% decaying gate, and 60% decaying gate) and multiple wavelength channels. (a) Reconstruction using 2 wavelength channels (740 nm – 745 nm) (maximum crosstalk = 95.85%). (b) Reconstruction using 4 wavelength channels (740 nm – 756 nm) (maximum crosstalk = 52.29%). (c) Reconstruction using 12 wavelength channels (740 nm – 797 nm) (maximum crosstalk = 35.76%). (d) Reconstruction of absorber concentrations by linear decomposition at each node using data from 12 wavelength channels. (maximum crosstalk = 51.78%). All plots are 50% isovolumic surfaces of individual absorber concentrations.
Fig. 11
Fig. 11 The effects of spectral information on unmixing performance and quantification accuracy. (a) The relationship between spectral information and maximum reconstruction crosstalk. (b) The relationship between spectral information and retrieved concentration ratio of two absorbers.

Equations (14)

Equations on this page are rendered with MathJax. Learn more.

l i n e a r i t y = ( δ / 255 ) × 100 %
U λ k ( r s , l , r d , m , t ) = U 0 λ k ( r s , l , r d , m , t ) · exp [ Φ p e r t λ k ( r s , l , r d , m , t ) ]
Φ p e r t λ k ( r s , l , r d , m , t ) = ln ( U λ k ( r s , l , r d , m , t ) U 0 λ k ( r s , l , r d , m , t ) )
Φ p e r t λ k ( r s , l , r d , m , t ) = Ω w λ k ( r s , l , r d , m , r , t ) · δ μ a λ k d 3 r
w λ k ( r s , l , r d , m , r , t ) = α λ k G λ k ( r s , l , r d , m , t ) 0 t d t G λ k ( r s , l , r , t t ) · G λ k ( r , r d , m , t )
b λ k = W Ω , λ k x λ k
w n λ k ( r s , l , r d , m , r , t ) = ε n , k · w λ k ( r s , l , r d , m , r , t )
[ b λ 1 b λ N ] = [ W 1 Ω , λ 1 W L Ω , λ 1 W 1 Ω , λ N W L Ω , λ N ] [ C 1 Ω C L Ω ]
γ i λ k = ln [ U λ k ( r s , l , r d , m , t ) / U 0 λ k ( r s , l , r d , m , t ) ] = ln s l + ln d m + Ω w λ k ( r s , l , r d , m , r , t ) · δ μ a λ k d 3 r
b λ k = W ^ Ω , λ k x ^ λ k = [ μ a λ k W Ω , λ k W S W D ] [ x λ k / μ a λ k s d ] T
[ b ^ λ 1 b ^ λ N ] = [ W 1 Ω , λ 1 W L Ω , λ 1 W 1 Ω , λ N W L Ω , λ N ] [ C 1 Ω C L Ω ]
C r o s s t a l k 1 = max [ C ˜ 2 ( Ω 1 ) ] max [ C ˜ 1 ( Ω 1 ) ] × 100 %
C r o s s t a l k 2 = max [ C ˜ 1 ( Ω 2 ) ] max [ C ˜ 2 ( Ω 2 ) ] × 100 %
M a x _ C r o s s t a l k = max ( C r o s s t a l k 1 , C r o s s t a l k 2 )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.