Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Computational optical sensing and imaging: introduction to the feature issue

Open Access Open Access

Abstract

This joint feature issue of Optics Express and Applied Optics showcases technical innovations by participants of the 2023 topical meeting on Computational Optical Sensing and Imaging and the computational imaging community. The articles included in the feature issue highlight advances in imaging science that emphasize synergistic activities in optics, signal processing and machine learning. The issue features 26 contributed articles that cover multiple themes including non line-of-sight imaging, imaging through scattering media, compressed sensing, lensless imaging, ptychography, computational microscopy, spectroscopy and optical metrology.

© 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

The 2023 Optica Imaging Congress [1], held at the Park Plaza Hotel in Boston, Massachusetts, USA, brought together researchers with wide ranging expertise in optics and photonics. The event hosted multiple co-located topical meetings including the Computational Optical Sensing and Imaging (COSI) meeting [2], which traces its origins to a 1998 OSA topical meeting on Integrated Image Gathering and Processing [2]. Since its founding, the COSI topical meeting and members of the COSI community have sought to tackle longstanding imaging challenges through the concurrent design and joint optimization of the electro-optic chain and signal processing [3]. Through the years, COSI’s sphere of influence has expanded from wavefront coding and phase retrieval to accommodate a wide range of topics including but not limited to compressed sensing, super-resolution, lensless imaging, non-line-of-sight imaging, imaging through scattering media, neuromorphic sensing and quantum sensing.

The 2023 edition of the COSI topical meeting showcased the latest innovations in imaging science, emphasizing synergistic activities in optics, signal processing and machine learning. The technical program included a diverse collection of keynote, invited, and contributed talks from around the world, spanning topics that range from theoretical advances in photonics to imaging applications in medicine, defense and industry.

As in previous years [4,5], Optica solicited submissions for a feature issue, to follow the COSI topical meeting. The current feature issue comprises 30 articles in total, with 25 articles in Optics Express and 5 articles in Applied Optics. The following sections provide a summary of each contribution as it relates to recurring themes within the feature issue.

2. Non line-of-sight imaging

The nascent field of non line-of-sight (NLoS) imaging continues to be a hot topic within computational imaging. Sultan et al. [6] propose a variation of methods based on the spatial Wigner function to improve upon existing NLOS reconstruction techniques in the presence of an occluder, thus relying on the shadows, as well as the light fields, present in the scene. Hashemi et al. [7] look at the problem of identifying “clutter”, i.e. unwanted signals in the case of passive NLOS imaging, e.g., in the case in which the scene is illuminated by a simple LED screen. Liu et al. [8] also work with passive NLOS and specifically with polarised long-wavelength infrared light and show the ability to identify people at more than 6m distance from the last scattering surface, significantly further than in previous approaches. Han et al. [9] instead devise a method for improving NLOS image resolution that in turn depends on the temporal resolution in the case of active illumination. Their approach employs temporal ghost imaging techniques to improve the temporal resolution of their detection from ns to 10 ps. Milanese et al. [10] report progress on their LinoSPAD linear array for single photon counting with applications in NLoS imaging and LIDAR.

3. Imaging through scattering media

The design and optimization of modern imaging systems is predicated on the assumption that light is transported along uninterrupted ray paths originating at the illumination source, bouncing off the object and terminating at the image sensor. This assumption contrasts the myriad ways in which light is transported within scattering media such as fog, smoke, turbid waters, and biological media. The challenging problem of imaging objects embedded within scattering media is gaining increased interest within the COSI topical meeting, and the COSI community. The topical meeting featured two sessions on Imaging through scattering media. This feature issue includes an article by Lin et al. [11] who propose the use of a dynamic learning approach for polarization imaging through turbid media, by adaptively blending features from different polarization components to accommodate a wide variety of scattering scenarios.

4. Advances in lensless imaging and computational microscopy

The use of deep learning models to solve inverse problems in imaging science has attracted significant interest in recent times. The COSI feature issue includes four articles that reflect this development. Lee et al. [12] present a self-supervised learning for performing functional tasks with mask-based lensless cameras. They used contrastive representation learning has been used to extract semantic information from mask-modulated measurements with implicit priors. Rogalski et al. [13] introduce a physics-driven neural network for twin-image removal in digital in-line holographic microscopy, which does not require extensive experimental training data. Chen et al. [14] describe a deep-learning approach for structured illumination microscopy, where low-contrast simulation data was used in training to provide reliable super-resolution reconstruction under suboptimal illuminations. Hu et al. [15] put forth a deep-learning framework for super-resolution imaging of metallic nanostructures, expected to find applications in nano-scale fabrication and low-magnification scanning electron microscopy. Gong et al. [16] describe a data-driven approach to realizing full color wide-field imaging though a multimode fiber, with applications in clinical medicine and industrial monitoring.

The feature issue includes two articles that describe specific advances in microscopy. Hsu et al. [17] report on a volume holographic grating for Airy light sheet microscopes, demonstrating a low-cost alternative to spatial modulator-based beam shaping. Gupta et al. [18] report on an axicon probe-based common path optical coherence tomography system and the tissue characterization results using the proposed device.

5. Advances in compressed sensing

Compressed Sensing remains an active topic of research within COSI. The feature issue includes three articles that highlight the latest advances in compressed sensing. Zhang et al. [19] report the development of a single-pixel sensor operable to detect nanosecond transients with a slow detector. Guzman et al. [20] describe a deep learning framework for reconstituting high-speed motion/dynamics from compressive measurements acquired under pulsed infrared illumination. Zhang et al. [21] report differential compressed sensing ghost imaging, demonstrating improved experimental robustness against measurement errors in single pixel imaging systems. Pei et al. [22] describe a data driven approach to reconstituting video frames of ultra-fast dynamics using compressed ultrafast photography.

6. Advances in ptychographic imaging

Ptychography has remained a constant fixture in recent editions of the COSI topical meeting. The feature issue includes two articles that highlight the latest advances in conventional and Fourier ptychography. Eschen et al. [23] demonstrate the first structured illumination tabletop ptychography setup, enabling high resolution extreme ultraviolet microscopy. Divitt et al. [24] show a promising version of Fourier ptychography where patterned illumination is used to reconstruct distant and moving objects at high resolution.

7. Advances in metrology

The wide range of metrology applications examined in the feature issue demonstrate the increasing influence of COSI within optical science and engineering. Zhang et al. [25] describe a computational technique for ascertaining the size of an X-ray focal spot using an approach that is reminiscent of knife edge measurement of Gaussian beams. Tkachuk et al. [26] report a strategy for measuring the amplitude and phase of tightly focused free-space optical beams originating from photonic devices, with sub-wavelength accuracy and polarization sensitivity. Yue et al. [27] report the development of a machine-learned attention mechanism that can identify the topological charge of orbital angular momentum beams under the corrupting influence of turbulence. Kang et al. [28] describe a high-precision metrology technique for Integrated circuit and MEMS device inspection, which addresses shortcomings of state-of-the-art methods in composite fringe projection profilometry. Yang et al. [29] propose a data driven solution to the measurement of large-scale complex deformations using Digital Image Correlation. Staffas et al. [30] present a comparative assessment of the range accuracy and noise robustness of state-of-the-art LIDAR technologies (such as frequency modulated continuous wave and time of flight) in the light starved regime, using a superconducting nanowire single photon detector. Glandon et al. [31] report the development of a 3D LIDAR system operable to identify human subjects from their movement at increased standoff. Jeong et al. [32] describe a near-infrared eye tracker with a dedicated patterned mirror allowing for self-calibration and gaze extraction.

8. Spectroscopy and spectral imaging

The feature issue includes three articles that highlight advances in spectroscopy and spectral imaging. Sun et al. [33] describe the design of a sub-wavelength grating structure operable as an ultra-compact long wave infrared spectral filter with tunable characteristics. Singh et al. [34] report the characterisation of various explosive materials by means of terahertz time-domain spectroscopy. Gallastegi et al. [35] describe a hyperspectral imaging technique that exploits the wavelength dependence of atmospheric absorption for passive ranging using only thermal emissions.

Acknowledgements

The editors of the COSI feature issue would like to express their sincere thanks to the Editor-in-Chief and Senior Deputy Editor of Optics Express: Dr. James Leger and Dr. Thomas Murphy, the Editor-in-Chief of Applied Optics: Dr. Gisele Bennett, for providing the opportunity to host and compile the feature issue. We additionally wish to thank the following staff at Optica: Ms. Carmelita Washington, Ms. Cristina Kapler, Mr. Dan McDonold, Ms. Julie Rovesti, Mr. Marco Dizon, Ms. Nabila Akhtar, Ms. Nicole Williams-Jones, Ms. Rebecca Robinson, and Ms. Sharon Jeffress for their assistance with the manuscript review process.

Disclosures

The authors declare that there are no conflicts of interest related to this article.

References

1. Optica Imaging Congress–2023, https://opg.optica.org/conference.cfm?meetingid=126&yr=2023.

2. Optica Topical Meeting on Computational Optical Sensing and Imaging–2023, https://opg.optica.org/conference.cfm?meetingid=15&yr=2023

3. J. N. Mait, G. W. Euliss, and R. A. Athale, “Computational imaging,” Adv. Opt. Photon. 10, 409–483 (2018). [CrossRef]  

4. OE Feature issues, https://opg.optica.org/oe/feature.cfm

5. AO Feature issues, https://opg.optica.org/ao/feature.cfm

6. T. Sultan, S. A. Reza, and A. Velten, “Towards a more accurate light transport model for non-line-of-sight-imaging,” Opt. Express 32, 7731–7761 (2024). [CrossRef]  

7. C. Hashemi, R. Avelar, and J. Leger, “Clutter rejection in passive non-line-of-sight imaging via blind multispectral unmixing,” Opt. Express 32, 2132–2146 (2024). [CrossRef]  

8. H. Liu, P. Wang, X. He, et al., “PI-NLOS: polarized infrared non-line-of-sight imaging,” Opt. Express 31, 44113–44126 (2023). [CrossRef]  

9. J. Miao, E. Guo, Y. Shi, et al., “Super-resolution non-line-of-sight imaging based on temporal encoding,” Opt. Express 31, 40235–40248 (2023). [CrossRef]  

10. T. Milanese, C. Bruschini, S. Burri, et al., “LinoSPAD2: an FPGA-based, hardware-reconfigurable 512 × 1 single-photon camera system,” Opt. Express 31, 44295–44314 (2023). [CrossRef]  

11. B. Lin, X. Fan, P. Peng, et al., “Dynamic polarization fusion network (DPFN) for imaging in different scattering systems,” Opt. Express 32, 511–525 (2024). [CrossRef]  

12. Y.-T. C. Lee and C.-H. Tien, “Semantic representation learning for mask-modulated lensless camera by contrastive cross-modal transferring,” Appl. Opt. 63, C24–C31 (2024). [CrossRef]  

13. M. Rogalski, P. Arcab, L. Stanaszek, et al., “Physics-driven universal twin-image removal network for digital in-line holographic microscopy,” Opt. Express 32, 742–761 (2024). [CrossRef]  

14. Y. Chen, Q. Liu, J. Zhang, et al., “Deep learning enables contrast-robust super-resolution reconstruction in structured illumination microscopy,” Opt. Express 32, 3316–3328 (2024). [CrossRef]  

15. X. Hu, X. Jia, K. Zhang, et al., “Deep-learning-augmented microscopy for super-resolution imaging of nanoparticles,” Opt. Express 32, 879–890 (2024). [CrossRef]  

16. H. Zhang, L. Wang, Q. Xiao, et al., “Wide-field color imaging through multimode fiber with single wavelength illumination: plug-and-play approach,” Opt. Express 32, 5131–5148 (2024). [CrossRef]  

17. H.-C. Hsu, S. Vyas, J.-C. Wu, et al., “Volume holographic illuminator for airy light-sheet microscopy,” Opt. Express 32, 167–178 (2024). [CrossRef]  

18. P. Gupta, K. Vairagi, V. Sharma, et al., “Tissue characterization using axicon probe-assisted common-path optical coherence tomography,” Optics Express, to be published. [CrossRef]  

19. X. Zhang, H. Zhong, and L. Cao, “Study of computational sensing using frequency-domain compression,” Opt. Express 32, 1677–1685 (2024). [CrossRef]  

20. F. Guzmán, J. Skowronek, E. Vera, et al., “Compressive video via IR-pulsed illumination,” Opt. Express 31, 39201–39212 (2023). [CrossRef]  

21. X. Zhang, H. Zhong, L. Cao, et al., “Robust computational imaging against environmental influence factors,” Opt. Express 32, 1669–1676 (2024). [CrossRef]  

22. C. Pei, D. D.-U. Li, Q. Shen, et al., “A high-performance reconstruction method combines total variation with a video denoiser for compressed ultrafast imaging,” Appl. Opt. 63, C32–C40 (2024). [CrossRef]  

23. W. Eschen, C. Liu, M. Steinert, et al., “Structured illumination ptychography and at-wavelength characterization with an EUV diffuser at 13.5 nm wavelength,” Optics Express 32, 3480–3491 (2024). [CrossRef]  

24. S. Divitt, S. Park, H. Gemar, et al., “Structured illumination and image enhancement of three-dimensional and moving objects at a distance via incoherent fourier ptychography,” Appl. Opt. 63, C8–C14 (2024). [CrossRef]  

25. P. Yang, J. Duan, and Y. Zhao, “Effective focal spot measurement method for X-ray source based on the dynamic translation of a light barrier,” Opt. Express 32, 2982–3005 (2024). [CrossRef]  

26. V. V. Tkachuk, J. P. Korterik, L. Chang, et al., “Sub-wavelength scale characterization of on-chip coupling mirrors,” Opt. Express 32, 2972–2981 (2024). [CrossRef]  

27. Y. Zhang, W. Zhao, T. Xu, et al., “Topological charge identification of superimposed orbital angular momentum beams under turbulence using an attention mechanism,” Opt. Express 32, 1941–1955 (2024). [CrossRef]  

28. D. Wang, W. Zhou, Z. Zhang, et al., “Anti-crosstalk absolute phase retrieval method for microscopic fringe projection profilometry using temporal frequency-division multiplexing,” Opt. Express 31, 39528–39545 (2023). [CrossRef]  

29. J. Yang, K. Qian, and L. Wang, “Re-DICnet: an end-to-end recursive residual refinement DIC network for larger deformation measurement,” Opt. Express 32, 907–921 (2024). [CrossRef]  

30. T. Staffas, A. Elshaari, and V. Zwiller, “Frequency modulated continuous wave and time of flight LIDAR with single photons: a comparison,” Opt. Express 32, 7332–7341 (2024). [CrossRef]  

31. A. Glandon, L. Vidyaratne, N. K. Dhar, et al., “3D far-field Lidar sensing and computational modeling for human identification,” Appl. Opt. 63, C15–C23 (2024). [CrossRef]  

32. Y. Jeong, S. Shin, B. Koo, et al., “Slim and robust eye tracker on eyeglass temples with NIR patterned mirrors,” Opt. Express 31, 39880–39892 (2023). [CrossRef]  

33. P. Sun, H. Cai, Y. Ren, et al., “Research on tunable extraordinary optical transmission spectrum properties of long-wavelength infrared metamaterials,” Appl. Opt. 63, C1–C7 (2024). [CrossRef]  

34. K. Singh, U. Aalam, A. Mishra, et al., “Spectroscopic and imaging considerations of THz-TDS and ULF-Raman techniques towards practical security applications,” Opt. Express 32, 1314–1324 (2024). [CrossRef]  

35. U. D. Gallastegi, H. Rueda-Chacón, M. J. Stevens, et al., “Absorption-based hyperspectral thermal ranging: Performance analyses, optimization, and simulations,” Opt. Express 32, 151–166 (2024). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.