Multidimensional Compressive Optical Microscopy

Yun Li,Lina Xu,Ting Sun,Kevin F. Kelly

DOI: https://doi.org/10.1364/ntm.2013.nth2b.5

2013-01-01

Abstract:In this work, we will summarize recent developments in model-based compressive imaging and its application to hyperspectral optical microscopy and its benefits to fluorescence, dark field, Raman, and video data.

What problem does this paper attempt to address?

Compressive Hyperspectral Imaging Enhanced Biomedical Imaging

Zhenrong Zheng

DOI: https://doi.org/10.26717/bjstr.2019.22.003778

2019-01-01

Abstract:Chenning Tao and Zhenrong Zheng* Author Affiliations State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, China Received: October 28, 2019 | Published: November 07, 2019 Corresponding author: Zhenrong Zheng, State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, China DOI: 10.26717/BJSTR.2019.22.003778
Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Chenning Tao,Huanzheng Zhu,Xucheng Wang,Shuhang Zheng,Qin Xie,Chang Wang,Rengmao Wu,Zhenrong Zheng

DOI: https://doi.org/10.1364/oe.416388

IF: 3.8

2021-01-01

Optics Express

Abstract:Hyperspectral imaging that obtains the spatial-spectral information of a scene has been extensively applied in various fields but usually requires a complex and costly system. A single-pixel detector based hyperspectral system mitigates the complexity problem but simultaneously brings new difficulties on the spectral dispersion device. In this work, we propose a low-cost compressive single-pixel hyperspectral imaging system with RGB sensors. Based on the structured illumination single-pixel imaging configuration, the lens-free system directly captures data by the RGB sensors without dispersion in the spectral dimension. The reconstruction is performed with a pre-trained spatial-spectral dictionary, and the hyperspectral images are obtained through compressive sensing. In addition, the spatial patterns for the structured illumination and the dictionary for the sparse representation are optimized by coherence minimization, which further improve the reconstruction quality. In both spatial and spectral dimensions, the intrinsic sparse properties of the hyperspectral images are made full use of for high sampling efficiency and low reconstruction cost. This work may introduce opportunities for optimization of computational imaging systems and reconstruction algorithms towards high speed, high resolution, and low cost future.
Compressive Imaging and Spectroscopy – Beyond the Single Pixel Camera

ting sun,yun li,lina xu,kevin f kelly

DOI: https://doi.org/10.1007/978-3-642-36359-7_13

2014-01-01

Abstract:The development of visible and infrared imaging systems continues to be an extremely active area of physics and engineering research despite the already considerable history of its development and accomplishments. This is due to the significant breakthroughs in the mathematics of image processing and the substantial advances in device performance over the last decade. Recently, many efforts in imaging that combine the relatively inexpensive and readily available computational power of microprocessors with new optical schemes have been undertaken to increase image resolution while decreasing acquisition time. One such approach that we have been investigating in our lab is based on compressive sensing mathematics coupled with micro-optoelectronic modulators. In essence, imaging via compressive sensing is a new strategy for imaging with a single detector in place of an imaging array. Additionally, the single detector can be replaced with a spectrometer to perform compressive hyperspectral imaging.
Multispectral image compression by cluster-adaptive subspace representation

Hui-Liang Shen,Ke Li,John H. Xin

DOI: https://doi.org/10.1109/ICIP.2010.5652058

2010-01-01

ICIP

Abstract:Multispectral imaging has attracted much interest in color science area, for its ability in providing much more spectral information than 3-channel color images. Due to the huge data volume, it is necessary to compress multispectral images for efficient transmission. This paper proposes a framework for spectral compression of multispectral image by using cluster-adaptive subspaces representation. In the framework, multispectral image is initially segmented by hierarchical analysis of the transform coefficients in the global subspace, and then ambiguous pixels are identified and classified into proper clusters based on linear discriminant analysis. The dimensionality of each adaptive subspace is determined by specified reconstruction error level, followed by further cluster splitting if necessary. The efficiency of the proposed method is verified by experiments on real multispectral images.
Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Yang Zhang,Xinyu Liu,Zhou Xu,Qiangbo Zhang,Chang Wang,Zhenrong Zheng

DOI: https://doi.org/10.1364/oe.531917

IF: 3.8

2024-01-01

Optics Express

Abstract:A single-pixel detector based hyperspectral system provides an effective way to obtain the spatial-spectral information of target scenes. However, complex spectral dispersion and the substantial number of measurements not only increase the complexity of the system but also decrease the sampling efficiency and the reconstruction accuracy. In this paper, we propose a compressive sensing (CS) theory based single-pixel hyperspectral imaging system. Based on structured illumination, the spatial information is modulated by binary spatial patterns displayed on a liquid crystal on silicon (LCoS), while polarizing elements at specific angles, acting as a serious of filters, modulate the spectral dimension, effectively avoiding spectral dispersion. In terms of sampling efficiency, the application of CS significantly decreases the number of measurements required compared to the Nyquist-Shannon sampling theorem. Besides, to improve the reconstruction accuracy, mutual coherence minimization is employed to optimize the pre-trained dictionary, spatial patterns and filters. Furthermore, a two-step encoding method based on macro-pixel segmentation is proposed to address the issue of low resolution constrained by the size of the dictionary. Compared to the unoptimized system and dictionary, the proposed method achieves more accurate reconstruction results in both spectral and spatial dimensions. This work may provide opportunities for high-resolution single-pixel hyperspectral imaging systems based on CS. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Applications of Compressive Sensing in Optical Imaging

Ke Jun,Zhang Linxia,Zhou Qun

DOI: https://doi.org/10.3788/aos202040.0111006

2020-01-01

Acta Optica Sinica

Abstract:The early application of compressive sensing in optical imaging focuses on spatial compressive imaging. In recent years, increasing compressive imaging systems have employed detector array instead of a single detector for collecting measured values. Moreover, the scope of compressive imaging expands from two-dimensional space to three-dimensional ranging, high-speed imaging, multispectral imaging, ghost imaging, and holography imaging. Herein, we analyzed recent works on high-resolution compressive imaging, compressive sensing ranging, and temporal high-speed compressive imaging with details, summarized the research progresses of measured matrix design by combining spatial compressive imaging, works on sensing matrix design in spatial compressive imaging, discussed their challenges and future development opportunities, and reviewed the applications of compressive sensing in multispectral imaging, ghost imaging, and holography imaging. Furthermore, we summarized the improvement of reconstruction performance of system targets by applying deep learning to compressive imaging.
Multidimensional Compressed Sensing for Spectral Light Field Imaging

Wen Cao,Ehsan Miandji,Jonas Unger

DOI: https://doi.org/10.5220/0012431300003660

2024-02-28

Abstract:This paper considers a compressive multi-spectral light field camera model that utilizes a one-hot spectralcoded mask and a microlens array to capture spatial, angular, and spectral information using a single monochrome sensor. We propose a model that employs compressed sensing techniques to reconstruct the complete multi-spectral light field from undersampled measurements. Unlike previous work where a light field is vectorized to a 1D signal, our method employs a 5D basis and a novel 5D measurement model, hence, matching the intrinsic dimensionality of multispectral light fields. We mathematically and empirically show the equivalence of 5D and 1D sensing models, and most importantly that the 5D framework achieves orders of magnitude faster reconstruction while requiring a small fraction of the memory. Moreover, our new multidimensional sensing model opens new research directions for designing efficient visual data acquisition algorithms and hardware.

Computer Vision and Pattern Recognition,Graphics,Machine Learning,Image and Video Processing
Compressive Whiskbroom Sensing and Data Reconstruction for Hyperspectral Imaging

Yingbiao JIA,Yan FENG

2017-01-01

Abstract:Owing to the requirements of high spectral resolution, conventional hyperspectral remote-sensing imaging systems are susceptible to bottleneck problems related to high rate sampling and mass data storage. Compressive sampling possesses the potential to solve many problems associated with hyperspectral remote sensing. An optical imaging system for compressive whiskbroom sensing in hyperspectral remote-sensing imaging is proposed in this paper. The proposed system comprises spatial grating, a cylindrical lens, a two-dimensional coded aperture, and a linear sensor array. The system, which enables multiple simultaneous compressive measurements, is designed for spectrum sensing operations. An iterative prediction reconstruction algorithm is designed based on the spatial correlation of hyperspectral images. Experimental results show that the reconstruction signal-to-noise ratio of the proposed algorithm is improved by more than 10dB when the sampling rate exceeds 0.2. The sampling simplicity of the system makes it suitable for hyperspectral compressive imaging in space-borne and airborne remote-sensing platforms.
Compressive Imaging Techniques in Optical Remote Sensing

Fengxia YAN,Jubo ZHU,Jiying LIU,Zelong WANG

DOI: https://doi.org/10.3969/j.issn.1009-8518.2014.01.008

2014-01-01

Abstract:Compressive sampling provides a new way for increasing the capability of information acqui-sition. Compressive sampling asserts that it is possible to accurately reconstruct signals from sub-Nyquist sam-pling, provided we make some additional assumptions(sparse or compressible) about the signal in question. The compressive imaging technology, which is based on the compressive sampling theory, integrates the proc-esses of sampling, compression and processing perfectly, avoiding resource waste caused by a traditional“sam-ple-then-compress”mode, and is a potential imaging technique for optical remote sensing. This paper first re-views the basic theory of compressive sampling. Then, several optical compressive imaging systems are intro-duced. Finally three physical experiments are designed to validate the principle of compressive imaging and the experiment results can be used as reference for the future optical remote compressive imaging system.
Compressive Hyperspectral Microscopic Imaging Using Spectral-Coded Illumination

Ting Yang,Zhilong Xu,Wenyi Ren,Yang Feng,Dan Wu,Rui Zhang,Yingge Xie

DOI: https://doi.org/10.1016/j.optlastec.2023.109631

2023-01-01

Abstract:A hyperspectral microscopic imaging system based on compressive sensing theory using spectral-coded illumination is presented in this paper. The spectral modulator, which consists of a liquid crystal variable retarder and two polarizers, is employed to encode the spectral transmittance of the incident light by adjusting the voltage of the liquid crystal variable retarder. The paper also provides the imaging model and reconstruction method, and the feasibility is confirmed through computer simulations and laboratory experiments. The imaging system combines traditional microscopy with spectrally encoded illumination and offers an alternative approach for designing a low-cost and compact hyperspectral microscope.
Dual-compressed Photoacoustic Single-Pixel Imaging

Yuning Guo,Baowen Li,Xiaobo Yin

DOI: https://doi.org/10.1093/nsr/nwac058

IF: 20.6

2022-01-01

National Science Review

Abstract:Photoacoustic imaging, an acoustic imaging modality with potentially optical resolution in an optical turbid medium, has attracted great attention. However, the convergence of wavefront optimization and raster scanning in computational photoacoustic imaging leads to the challenge of fast mapping, especially for a spatial resolution approaching the acoustic deep-subwavelength regime. As a sparse sampling paradigm, compressive sensing has been applied in numerous fields to accelerate data acquisition without significant quality losses. In this work, we propose a dual-compressed approach for photoacoustic surface tomography that enables high-efficiency imaging with 3D spatial resolution unlimited by the acoustics in a turbid environment. The dual-compressed photoacoustic imaging with single-pixel detection, enabled by spatially optical modulation with synchronized temporally photoacoustic coding, allows decoding of the fine optical information from the modulated acoustic signal even when the variance of original photoacoustic signals is weak. We perform a proof-of-principle numerical demonstration of dual-compressed photoacoustic imaging, that resolves acoustic sub-acoustic-wavelength details with a significantly reduced number of measurements, revealing the potential for dynamic imaging. The dual-compressed concept, which transforms unobtrusive spatial difference into spatio-temporal detectable information, can be generalized to other imaging modalities to realize efficient, high-spatial-resolution imaging.
Compressive sensing theory and optical compressive imaging systems

Fengxia YAN,Zelong WANG,Jubo ZHU,Jiying LIU

DOI: https://doi.org/10.11887/j.cn.201402024

2014-01-01

Abstract:Compressive sensing provides a new way for increasing the ability of information acquisition.Compressive sensing asserts that it is possible to accurately reconstruct signals from sub-Nyquist sampling,provided some additional assumptions (sparse or compressible)are made about the signal in question.The compressive imaging technology,which is based on the compressive sensing theory,integrates the processes of sensing,compression and processing perfectly,avoiding the resource waste caused by a traditional “sample-then-compress”framework.With a review of some of the recent progress in compressive sensing theory from the following three aspects:sparsity,the design of measuring matrix and recovery conditions,the reconstruction algorithms,several optical compressive imaging systems are introduced,and some key challenges in this area have been discussed in the end.
Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world.

Xun Cao,Tao Yue,Xing Lin,Stephen Lin,Xin Yuan,Qionghai Dai,Lawrence Carin,David J. Brady

DOI: https://doi.org/10.1109/MSP.2016.2582378

IF: 15.204

2016-01-01

IEEE Signal Processing Magazine

Abstract:Multispectral cameras collect image data with a greater number of spectral channels than traditional trichromatic sensors, thus providing spectral information at a higher level of detail. Such data are useful in various fields, such as remote sensing, materials science, biophotonics, and environmental monitoring. The massive scale of multispectral data-at high resolutions in the spectral, spatial,...
Single-Shot Compressed Photoacoustic Tomographic Imaging with a Single Detector in a Scattering Medium

Yuning Guo,Baowen Li,Xiaobo Yin

DOI: https://doi.org/10.1103/physrevapplied.13.044009

IF: 4.6

2020-01-01

Physical Review Applied

Abstract:Photon scattering imposes a fundamental restriction on optical imaging in turbid media. In this work, we propose a compressive-sensing-based photoacoustic imaging modality that allows single-shot tomography with a single detector in a scattering medium. The nonuniform optical speckle grains created in the diffusive regime, which act as a conventional drawback of optical modality, are used to generate ultrasound locally. The photoacoustic signals from spatial positions can be well extracted from a superimposed signal via introduction of locally modulated time delays. Taking advantage of the compressed measurement assisted by the acoustic mask, we demonstrate a theoretical compressed framework of three-dimensional photoacoustic surface tomography with a broad field of view after one-time optical illumination. This approach can increase the photoacoustic imaging efficiency greatly and reveals the potential for dynamic imaging in optically diffusive media.
Compressive Holography for Multilayer Imaging

Ping Su,Zhenpeng Luo,Jianshe Ma

DOI: https://doi.org/10.1364/dh.2020.hf3d.2

2020-01-01

Abstract:Compressive sensing (CS) is employed in holographic imaging for multilayer imaging. We show tomography of a continuous sample by introducing a microscope objective (MO) in an in-line compressive holographic system, and analyze the reasons why applying compressive holographic microscopy can achieve tomography of continuous samples.
Compressive hyperspectral imaging in the molecular fingerprint band

Jake M Charsley,Marius Rutkauskas,Yoann Altmann,Valentina Risdonne,Michela Botticelli,Margaret J Smith,Christina R T Young,Derryck T Reid

DOI: https://doi.org/10.1364/OE.451380

2022-05-09

Abstract:Spectrally-resolved imaging provides a spectrum for each pixel of an image that, in the mid-infrared, can enable its chemical composition to be mapped by exploiting the correlation between spectroscopic features and specific molecular groups. The compatibility of Fourier-transform interferometry with full-field imaging makes it the spectroscopic method of choice, but Nyquist-limited fringe sampling restricts the increments of the interferometer arm length to no more than a few microns, making the acquisition time-consuming. Here, we demonstrate a compressive hyperspectral imaging strategy that combines non-uniform sampling and a smoothness-promoting prior to acquire data at 15% of the Nyquist rate, providing a significant acquisition-rate improvement over state-of-the-art techniques. By illuminating test objects with a sequence of suitably designed light spectra, we demonstrate compressive hyperspectral imaging across the 700-1400 cm-1 region in transmission mode. A post-processing analysis of the resulting hyperspectral images shows the potential of the method for efficient non-destructive classification of different materials on painted cultural heritage.
Multifocal multiview imaging and data compression based on angular–focal–spatial representation

Kejun Wu,Qiong Liu,Kim-Hui Yap,You Yang

DOI: https://doi.org/10.1364/ol.505496

IF: 3.6

2024-01-24

Optics Letters

Abstract:Kejun Wu, Qiong Liu, Kim-Hui Yap, You Yang Multifocal multiview (MFMV) is an emerging high-dimensional optical data that allows to record richer scene information but yields huge ... [Opt. Lett. 49, 562-565 (2024)]

optics
Compressive microscopic imaging with “positive–negative” light modulation

Wen-Kai Yu,Xu-Ri Yao,Xue-Feng Liu,Ruo-Ming Lan,Ling-An Wu,Guang-Jie Zhai,Qing Zhao

DOI: https://doi.org/10.1016/j.optcom.2016.03.067

IF: 2.4

2016-01-01

Optics Communications

Abstract:An experiment on compressive microscopic imaging with single-pixel detector and single-arm has been performed on the basis of “positive–negative” (differential) light modulation of a digital micromirror device (DMD). A magnified image of micron-sized objects illuminated by the microscope's own incandescent lamp has been successfully acquired. The image quality is improved by one more orders of magnitude compared with that obtained by conventional single-pixel imaging scheme with normal modulation using the same sampling rate, and moreover, the system is robust against the instability of light source and may be applied to very weak light condition. Its nature and the analysis of noise sources is discussed deeply. The realization of this technique represents a big step to the practical applications of compressive microscopic imaging in the fields of biology and materials science.
Optimized Design of an Emerging Optical Imager Using Compressive Sensing

Gang Liu,Desheng Wen,Zongxi Song,Zhixin Li,Weikang Zhang,Xin Wei

DOI: https://doi.org/10.1016/j.optlastec.2018.08.046

IF: 4.939

2018-01-01

Optics & Laser Technology

Abstract:The emerging optical imager utilizes Fourier-domain interferometry and can reduce system weight, size and power by an order of magnitude compared to conventional optical telescopes at the same resolution. The compressive sensing theory demonstrates that incomplete and noisy measurements may actually suffice for accurate reconstruction of compressible or sparse signals. In this paper, we propose an optimized design of the emerging optical imager based on compressive sensing theory. It simplifies data acquisition structure and reduces data transmission burden. In addition, the system robustness is improved.
Multi-view in Lensless Compressive Imaging

Hong Jiang,Gang Huang,Paul Wilford

DOI: https://doi.org/10.1017/atsip.2014.16

2014-01-01

APSIPA Transactions on Signal and Information Processing

Abstract:Multi-view images are acquired by a lensless compressive imaging architecture, which consists of an aperture assembly and multiple sensors. The aperture assembly consists of a two dimensional array of aperture elements whose transmittance can be individually controlled to implement a compressive sensing matrix. For each transmittance pattern of the aperture assembly, each of the sensors takes a measurement. The measurement vectors from the multiple sensors represent multi-view images of the same scene. We present theoretical framework for multi-view reconstruction and experimental results for enhancing quality of image using multi-view.

Multidimensional Compressive Optical Microscopy

Compressive Hyperspectral Imaging Enhanced Biomedical Imaging

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Compressive Imaging and Spectroscopy – Beyond the Single Pixel Camera

Multispectral image compression by cluster-adaptive subspace representation

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Applications of Compressive Sensing in Optical Imaging

Multidimensional Compressed Sensing for Spectral Light Field Imaging

Compressive Whiskbroom Sensing and Data Reconstruction for Hyperspectral Imaging

Compressive Imaging Techniques in Optical Remote Sensing

Compressive Hyperspectral Microscopic Imaging Using Spectral-Coded Illumination

Dual-compressed Photoacoustic Single-Pixel Imaging

Compressive sensing theory and optical compressive imaging systems

Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world.

Single-Shot Compressed Photoacoustic Tomographic Imaging with a Single Detector in a Scattering Medium

Compressive Holography for Multilayer Imaging

Compressive hyperspectral imaging in the molecular fingerprint band

Multifocal multiview imaging and data compression based on angular–focal–spatial representation

Compressive microscopic imaging with “positive–negative” light modulation

Optimized Design of an Emerging Optical Imager Using Compressive Sensing

Multi-view in Lensless Compressive Imaging