Study of computational sensing using frequency-domain compression

Xiao Zhang,Haozhe Zhong,Liangqi Cao

DOI: https://doi.org/10.1364/oe.507968

IF: 3.8

2024-01-04

Optics Express

Abstract:Xiao Zhang, Haozhe Zhong, Liangqi Cao The computational sensing and imaging technique has been extended from spatial domain to temporal domain for capturing fast light signals ... [Opt. Express 32, 1677-1685 (2024)]

optics

What problem does this paper attempt to address?

Photonics-enabled Compressive Sensing with Spectral Encoding Using an Incoherent Broadband Source.

Zhijing Zhu,Hao Chi,Tao Jin,Shilie Zheng,Xianbin Yu,Xiaofeng Jin,Xianmin Zhang

DOI: https://doi.org/10.1364/ol.43.000330

IF: 3.6

2018-01-01

Optics Letters

Abstract:In this Letter, we propose an approach to achieving photonics-enabled compressive sensing of sparse wideband radio frequency signals in which an incoherent broadband source is applied, and the mixing and integration functions are realized in the optical domain. A spectrum shaper is employed to slice and encode the spectrum of the broadband light according to a predetermined random sequence. Because of the dispersion-induced group delay, the mixing between the incoming signal and the random bit sequence is achieved. At the output of the spectrum shaper, an array of photodetectors is employed to realize down-sampling, and the input sparse signal can be captured in a single-shot mode. Since no pulsed laser is employed, our scheme obviates the need for time-domain synchronization between the repetitive ultra-fast pulses and the random sequence. Experimental demonstrations and numerical results are presented to verify the feasibility and potential of the approach.
Compressive sensing in a photonic link for acquisition of spectrally-sparse wideband signals: Potentials and limitations

Hao Chi,Ying Chen,Xiaofeng Jin,Shilie Zheng,Kianmin Zhang

DOI: https://doi.org/10.1109/ICOCN.2013.6617221

2013-01-01

Abstract:Compressive sensing (CS) is a novel technology to realize sub-Nyquist sampling for measuring of sparse signals. Due to the advantages of high bandwidth offered by photonics, realization of compressive sensing in a photonic link is of great interest. In this paper, we discussed the limitations of CS in a conventional photonic link A potential solution is proposed. To further reduce sampling rate, we propose to combine the techniques of photonic time stretch and CS. In addition, the photonic CS with random mixing realized by a spatial light modulator is discussed. Theoretical limit on frequency resolution for spectral mixing is derived.
Compressive Sensing in A Photonic Link with Optical Integration

Ying Chen,Xianbin Yu,Hao Chi,Xiaofeng Jin,Xianmin Zhang,Shilie Zheng,Michael Galili

DOI: https://doi.org/10.1364/ol.39.002222

IF: 3.6

2014-01-01

Optics Letters

Abstract:In this Letter, we present a novel structure to realize photonics-assisted compressive sensing (CS) with optical integration. In the system, a spectrally sparse signal modulates a multiwavelength continuous-wave light and then is mixed with a random sequence in optical domain. The optical signal passes through a length of dispersive fiber, the dispersion amount of which is set to ensure that the group delay between the adjacent wavelength channels is equal to the bit duration of the applied random sequence. As a result, the detected signal is a delay-and-sum version of the randomly mixed signal, which is equivalent to the function of integration required in CS. A proof-of-concept experiment with four wavelengths, corresponding to a compression factor of 4, is demonstrated. More simulation results are also given to show the potential of the technique. (C) 2014 Optical Society of America
A Compressive Sensing Approach for MIMO-OFDM-Based Integrated Sensing and Communication

Zihan Lin,Zhaoyang Zhang,Xin Tong,Zhaohui Yang

DOI: https://doi.org/10.1109/globecom54140.2023.10437002

2023-01-01

Abstract:Future communication networks will integrate the sensing functions, requiring the system to utilize limited radio resources to simultaneously achieve high-throughput communication and high-precision sensing. Compressive sensing technology is of great potential for such applications. In this paper, we design an efficient multiple-input multiple-output (MIMO) - orthogonal frequency division multiplexing (OFDM) integrated sensing and communication (ISAC) system based on compressive sensing. Specifically, we obtain the delay-Doppler and angle of departure (AoD) / angle of arrival (AoA) measurements by exploiting the sparse and random time-frequency resource allocation patterns and array structures. Our approach leverages the sparsity of environmental information and employs the Kronecker method to construct a compressive measurement matrix with Vandermonde structure. Our method provides high-resolution performance comparable to Nyquist sampling, while significantly reducing the usage of time-frequency resource units and the number of antennas, without introducing excessive additional hardware links for sensing and computation. Numerical simulations demonstrate the feasibility of the method, and our results indicate that compressive sensing recovery algorithms outperform traditional method with a lower probability of recovery errors and better robustness.
Compressive Imaging and Spectroscopy – Beyond the Single Pixel Camera

ting sun,yun li,lina xu,kevin f kelly

DOI: https://doi.org/10.1007/978-3-642-36359-7_13

2014-01-01

Abstract:The development of visible and infrared imaging systems continues to be an extremely active area of physics and engineering research despite the already considerable history of its development and accomplishments. This is due to the significant breakthroughs in the mathematics of image processing and the substantial advances in device performance over the last decade. Recently, many efforts in imaging that combine the relatively inexpensive and readily available computational power of microprocessors with new optical schemes have been undertaken to increase image resolution while decreasing acquisition time. One such approach that we have been investigating in our lab is based on compressive sensing mathematics coupled with micro-optoelectronic modulators. In essence, imaging via compressive sensing is a new strategy for imaging with a single detector in place of an imaging array. Additionally, the single detector can be replaced with a spectrometer to perform compressive hyperspectral imaging.
Frequency Scanning Interferometry Based on Compressive Sensing and Frequency Sampling

Kai Tian,Junkang Guo,Zhigang Liu

DOI: https://doi.org/10.1364/fio.2023.jm7a.137

2023-01-01

Abstract:We report a frequency scanning interferometry method with low sampling frequency, which lays the foundation for the realization of the composite measurement of time domain and space domain based on charge coupled device camera detection.
High-Throughput Photonic Time-Stretch Optical Coherence Tomography with Data Compression

Chaitanya K. Mididoddi,Fangliang Bai,Guoqing Wang,Jinchao Liu,Stuart Gibson,Chao Wang

DOI: https://doi.org/10.1109/jphot.2017.2716179

IF: 2.4

2017-01-01

IEEE Photonics Journal

Abstract:Photonic time stretch enables real-time high-throughput optical coherence tomography (OCT), but with massive data volume being a real challenge. In this paper, data compression in high-throughput optical time-stretch OCT has been explored and experimentally demonstrated. This is made possible by exploiting the spectral sparsity of an encoded optical pulse spectrum using a compressive sensing approach. Both randomization and integration have been implemented in the optical domain avoiding electronic bottleneck. A data compression ratio of 66% has been achieved in high-throughput OCT measurements with 1.51-MHz axial scan rate using greatly reduced data sampling rate of 50 MS/s. Potential to improve compression ratio has been exploited. In addition, using a dual pulse integration method, capability of improving frequency measurement resolution in the proposed system has been demonstrated. A number of optimization algorithms for the reconstruction of the frequency-domain OCT signals have been compared in terms of reconstruction accuracy and efficiency. Our results show that the l(1) magic implementation of the primal-dual interior point method offers the best compromise between accuracy and reconstruction time of the time-stretch OCT signal tested.
Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Di Wu,Gordon Wetzstein,Christopher Barsi,Thomas Willwacher,Matthew O’Toole,Nikhil Naik,Qionghai Dai,Kyros Kutulakos,Ramesh Raskar

DOI: https://doi.org/10.1007/978-3-642-33718-5_39

2012-01-01

Abstract:Light transport has been analyzed extensively, in both the primal domain and the frequency domain; the latter provides intuition of effects introduced by free space propagation and by optical elements, and allows for optimal designs of computational cameras for tailored, efficient information capture. Here, we relax the common assumption that the speed of light is infinite and analyze free space propagation in the frequency domain considering spatial, temporal, and angular light variation. Using this analysis, we derive analytic expressions for cross-dimensional information transfer and show how this can be exploited for designing a new, time-resolved bare sensor imaging system.
Ultra-fast Lensless Computational Imaging through 5D Frequency Analysis of Time-resolved Light Transport

Di Wu,Gordon Wetzstein,Christopher Barsi,Thomas Willwacher,Qionghai Dai,Ramesh Raskar

DOI: https://doi.org/10.1007/s11263-013-0686-0

IF: 13.369

2014-01-01

International Journal of Computer Vision

Abstract:Light transport has been analyzed extensively, in both the primal domain and the frequency domain. Frequency analyses often provide intuition regarding effects introduced by light propagation and interaction with optical elements; such analyses encourage optimal designs of computational cameras that efficiently capture tailored visual information. However, previous analyses have relied on instantaneous propagation of light, so that the measurement of the time dynamics of light–scene interaction, and any resulting information transfer, is precluded. In this paper, we relax the common assumption that the speed of light is infinite. We analyze free space light propagation in the frequency domain considering spatial, temporal, and angular light variation. Using this analysis, we derive analytic expressions for information transfer between these dimensions and show how this transfer can be exploited for designing a new lensless imaging system. With our frequency analysis, we also derive performance bounds for the proposed computational camera architecture and provide a mathematical framework that will also be useful for future ultra-fast computational imaging systems.
Perceptual Compressive Sensing for Image Signals

Yi Yang,Oscar C. Au,Lu Fang,Xing Wen,Weiran Tang

DOI: https://doi.org/10.1109/icme.2009.5202443

2009-01-01

Abstract:Human eyes have different sensitivity to different frequency components of image signals, typically, low frequency components are relatively more crucial to the perceptual quality of images than high frequency components. Based on this observation, we propose a novel sampling scheme for compressive sensing framework by designing a weighting scheme for the sampling matrix. By adjusting the weighting coefficients, we can tune the structure of the sampling matrix to favor the frequency components that are important to human perception, so that those components could be more precisely recovered in the reconstruction procedure. Experimental results reveal that our proposed scheme can greatly enhance the performance of compressive sensing framework in both PSNR and visual quality without increasing the complexity of the framework structure or computational procedure.
Advances in Theory of Compressive Sensing and Applications in Communication

Xiuzhi Guan,Yulong Gao,Jian Chang,ZhongZHao Zhang

DOI: https://doi.org/10.1109/IMCCC.2011.169

2011-01-01

Abstract:Sampling is the link between analog signal and digital signal. With the rapid development of information technologies, demands for the amount of information are increasing at very fast speed. So the systems in existence are very difficult to meet the challenges of sampling at high speed, transmitting and storing large volume data. How to acquire information in signal efficiently is an urgent problem in electronic information fields. Compressive Sensing (CS) is a new theory of signal sampling, coding and encoding, which makes full use of signal's sparsity and compressibility [1][2]. This paper mainly introduce the model of Compressive Sensing theory, algorithm of Compressive Sensing theory. In the end, the applications fields of Compressive Sensing in communication are introduced.
Instantaneous frequency measurement based on photonic compressive sensing with sub-Nyquist pseudo-random binary sequences

Runcheng Li,Shuna Yang,Bo Yang,Yiran Gao,Hongxia He,Hao Chi

DOI: https://doi.org/10.1364/ol.520471

IF: 3.6

2024-03-30

Optics Letters

Abstract:Runcheng Li, Shuna Yang, Bo Yang, Yiran Gao, Hongxia He, Hao Chi We propose a novel, to the best of our knowledge, approach to realizing instantaneous frequency measurement with ultrahigh measurement ... [Opt. Lett. 49, 1832-1835 (2024)]

optics
Compressive Sensing Based High-Speed Time-Stretch Optical Microscopy for Two-Dimensional Image Acquisition

Qiang Guo,Hongwei Chen,Zhiliang Weng,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1364/oe.23.029639

IF: 3.8

2015-01-01

Optics Express

Abstract:In this paper, compressive sensing based high-speed time-stretch optical microscopy for two-dimensional (2D) image acquisition is proposed and experimentally demonstrated for the first time. A section of dispersion compensating fiber (DCF) is used to perform wavelength-to-time conversion and then ultrafast spectral shaping of broadband optical pulses can be achieved via high-speed intensity modulation. A 2D spatial disperser comprising a pair of orthogonally oriented dispersers is employed to produce spatially structured illumination for 2D image acquisition and a section of single mode fiber (SMF) is utilized for pulse compression in the optical domain. In our scheme, a 1.2-GHz photodetector and a 50-MHz analog-to-digital converter (ADC) are used to acquire the energy of the compressed pulses. Image reconstructions are demonstrated at a frame rate of 500 kHz and a sixteen-fold image compression is achieved in our proof-of-concept demonstration.
From compressive sampling to compressive tasking: retrieving semantics in compressed domain with low bandwidth

Zhihong Zhang,Bo Zhang,Xin Yuan,Siming Zheng,Xiongfei Su,Jinli Suo,David J. Brady,Qionghai Dai

DOI: https://doi.org/10.1186/s43074-022-00065-1

IF: 16.5

2022-09-07

PhotoniX

Abstract:High-throughput imaging is highly desirable in intelligent analysis of computer vision tasks. In conventional design, throughput is limited by the separation between physical image capture and digital post processing. Computational imaging increases throughput by mixing analog and digital processing through the image capture pipeline. Yet, recent advances of computational imaging focus on the "compressive sampling", this precludes the wide applications in practical tasks. This paper presents a systematic analysis of the next step for computational imaging built on snapshot compressive imaging (SCI) and semantic computer vision (SCV) tasks, which have independently emerged over the past decade as basic computational imaging platforms.

optics
GHz Optical Time-Stretch Microscopy by Compressive Sensing

Cheng Lei,Yi Wu,Aswin C. Sankaranarayanan,Shih-Min Chang,Baoshan Guo,Naoto Sasaki,Hirofumi Kobayashi,Chia-Wei Sun,Yasuyuki Ozeki,Keisuke Goda

DOI: https://doi.org/10.1109/jphot.2017.2676349

IF: 2.4

2017-01-01

IEEE Photonics Journal

Abstract:Optical time-stretch microscopy has recently attracted intensive attention for its capability of acquiring images at an ultrahigh frame rate. Unfortunately, its achievable frame rate is limited by the requirement of having no overlap between consecutive frames, which leads to a tradeoff between the frame rate (pulse repetition rate) and the amount of the temporal dispersion used for optical image serialization. In this paper, we demonstrate compressive sensing on the platform of optical time-stretch microscopy to overcome the tradeoff between frame rate and temporal dispersion (time stretch) and achieve 50 times higher frame rate than conventional optical time-stretch microscopy. Specifically, we computationally perform compressed optical time-stretch microscopy with an experimental dataset acquired by conventional optical time-stretch microscopy and demonstrate its effects in terms of spatial resolution and cell classification accuracy. Our results indicate that the spatial resolution and cell classification accuracy reach 780 nm and 95% at a line scan rate of 675 MHz and 6.75 GHz, respectively, which correspond to five times and 50 times higher frame rates than what conventional optical time-stretch microscopy can achieve with the same dispersion amount and digitizer sampling rate.
A Compact and Highly Efficient Compressive Sensing Imaging System Using In-Fiber Grating

P. Shum,Liyang Shao,Rui Min,Huanhuan Liu,Shuming Jiao,Lipeng Sun,Guoqing Wang,Weizhi Wang,E. Du,Zhi-quan Yan,Chao Wang,Fang Zhao,Yuan Zhou

DOI: https://doi.org/10.1109/LPT.2022.3233873

IF: 2.6

2023-02-15

IEEE Photonics Technology Letters

Abstract:Serial time-encoded amplified microscopy can achieve ultrafast imaging speed within varied dynamic regimes. However, it has two challenges: the high-throughput data issue and low-efficiency diffraction issue. Here, we report a compact and highly efficient ultrafast optical imaging system based on compressive sensing and in-fiber grating. Our proposal is confirmed by the proof-of-principle experiment and obtains a minimum data compression ratio of 5% with a continuous ultrafast imaging speed of 10 Mfps at a field of view of 0.5 mm ${}^{\ast} 1.6$ mm. A barcode with a moving speed of 4m/s is also demonstrated for imaging and an imaging speed of 1.25 Mfps is obtained. The proposed optical imaging system overcomes the big data issue, increases energy efficiency, and paves the way for compact and highly efficient ultrafast optical imaging within dynamic scenarios.

Physics,Engineering
Adaptive High-Resolution Imaging Method Based on Compressive Sensing

Zijiao Wang,Yufeng Gao,Xiusheng Duan,Jingya Cao

DOI: https://doi.org/10.3390/s22228848

2022-11-16

Abstract:Compressive sensing (CS) is a signal sampling theory that originated about 16 years ago. It replaces expensive and complex receiving devices with well-designed signal recovery algorithms, thus simplifying the imaging system. Based on the application of CS theory, a single-pixel camera with an array-detection imaging system is established for high-pixel detection. Each detector of the detector array is coupled with a bundle of fibers formed by fusion of four bundles of fibers of different lengths, so that the target area corresponding to one detector is split into four groups of target information arriving at different times. By comparing the total amount of information received by the detector with the threshold set in advance, it can be determined whether the four groups of information are calculated separately. The simulation results show that this new system can not only reduce the number of measurements required to reconstruct high quality images but can also handle situations wherever the target may appear in the field of view without necessitating an increase in the number of detectors.
An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

Wen Pan,Zhaolong Yang,Zhibiao Hao,Changzheng Sun,Bing Xiong,Jian Wang,Yanjun Han,Hongtao Li,Lin Gan,Yi Luo,Lai Wang

DOI: https://doi.org/10.1109/jsen.2024.3506937

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:Modern imaging technology, by exposure and subsequent readout from image sensors, has limited the existing frame rate in real-time scenes. In this article, we present an architecture based on computing in sensor array that can achieve higher frame rates than conventional cameras. This approach fuses the architecture with neural network algorithms for compressed sensing and computational imaging. It achieves a mean squared error of 10 −2 with fewer weights and sampling numbers (10%~40% of original data). It samples lower data to reconstruct images through fast recovery with an elapsed time of hundred microseconds. The feasibility has been verified through the encoded photodetector array chip consisting of 16×16 dual-gate silicon photodiodes. This type of chips represents a highly promising technology for constructing image sensors that delivers high-speed imaging capability of >10000 fps, which may also show potential superiority in terms of noise resistance and dynamic range.
High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Qiang Guo,Hongwei Chen,Yuxi Wang,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1117/12.2249538

2017-01-01

Abstract:In this paper, we present a high-speed single-pixel imaging (SPI) system based on all-optical discrete cosine transform (DCT) and demonstrate its capability to enable noninvasive imaging of flowing cells in a microfluidic channel. Through spectral shaping based on photonic time stretch (PTS) and wavelength-to-space conversion, structured illumination patterns are generated at a rate (tens of MHz) which is three orders of magnitude higher than the switching rate of a digital micromirror device (DMD) used in a conventional single-pixel camera. Using this pattern projector, high-speed image compression based on DCT can be achieved in the optical domain. In our proposed system, a high compression ratio (approximately 10: 1) and a fast image reconstruction procedure are both achieved, which implicates broad applications in industrial quality control and biomedical imaging.
Compressed Sensing Beyond the IID and Static Domains: Theory, Algorithms and Applications

Abbas Kazemipour

DOI: https://doi.org/10.13016/M22Z5T

2018-06-29

Abstract:Sparsity is a ubiquitous feature of many real world signals such as natural images and neural spiking activities. Conventional compressed sensing utilizes sparsity to recover low dimensional signal structures in high ambient dimensions using few measurements, where i.i.d measurements are at disposal. However real world scenarios typically exhibit non i.i.d and dynamic structures and are confined by physical constraints, preventing applicability of the theoretical guarantees of compressed sensing and limiting its applications. In this thesis we develop new theory, algorithms and applications for non i.i.d and dynamic compressed sensing by considering such constraints. In the first part of this thesis we derive new optimal sampling-complexity tradeoffs for two commonly used processes used to model dependent temporal structures: the autoregressive processes and self-exciting generalized linear models. Our theoretical results successfully recovered the temporal dependencies in neural activities, financial data and traffic data. Next, we develop a new framework for studying temporal dynamics by introducing compressible state-space models, which simultaneously utilize spatial and temporal sparsity. We develop a fast algorithm for optimal inference on such models and prove its optimal recovery guarantees. Our algorithm shows significant improvement in detecting sparse events in biological applications such as spindle detection and calcium deconvolution. Finally, we develop a sparse Poisson image reconstruction technique and the first compressive two-photon microscope which uses lines of excitation across the sample at multiple angles. We recovered diffraction-limited images from relatively few incoherently multiplexed measurements, at a rate of 1.5 billion voxels per second.

Statistics Theory

Study of computational sensing using frequency-domain compression

Photonics-enabled Compressive Sensing with Spectral Encoding Using an Incoherent Broadband Source.

Compressive sensing in a photonic link for acquisition of spectrally-sparse wideband signals: Potentials and limitations

Compressive Sensing in A Photonic Link with Optical Integration

A Compressive Sensing Approach for MIMO-OFDM-Based Integrated Sensing and Communication

Compressive Imaging and Spectroscopy – Beyond the Single Pixel Camera

Frequency Scanning Interferometry Based on Compressive Sensing and Frequency Sampling

High-Throughput Photonic Time-Stretch Optical Coherence Tomography with Data Compression

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Ultra-fast Lensless Computational Imaging through 5D Frequency Analysis of Time-resolved Light Transport

Perceptual Compressive Sensing for Image Signals

Advances in Theory of Compressive Sensing and Applications in Communication

Instantaneous frequency measurement based on photonic compressive sensing with sub-Nyquist pseudo-random binary sequences

Compressive Sensing Based High-Speed Time-Stretch Optical Microscopy for Two-Dimensional Image Acquisition

From compressive sampling to compressive tasking: retrieving semantics in compressed domain with low bandwidth

GHz Optical Time-Stretch Microscopy by Compressive Sensing

A Compact and Highly Efficient Compressive Sensing Imaging System Using In-Fiber Grating

Adaptive High-Resolution Imaging Method Based on Compressive Sensing

An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Compressed Sensing Beyond the IID and Static Domains: Theory, Algorithms and Applications