High speed single-pixel imaging via time domain compressive sampling

Hongwei Chen,Zhiliang Weng,Yunhua Liang,Cheng Lei

DOI: https://doi.org/10.1364/cleo_at.2014.jth2a.132

2014-01-01

Abstract:We report a high speed single-pixel microscopic imaging method by compressive sampling accomplished with time-stretch technique. By this method, we demonstrate a single-pixel imaging system with 1000 times faster than the conventional single-pixel cameras.

What problem does this paper attempt to address?

High speed two-dimensional temporal compressive sampling microscopic camera

qiang guo,hongwei chen,minghua chen,zhiliang weng,yunhua liang,fangjian xing,shizhong xie

DOI: https://doi.org/10.1364/cleo_at.2015.atu1m.2

2015-01-01

Abstract:A two-dimensional temporal compressive sampling microscopic camera with a frame rate of 500 kHz is demonstrated in this paper, achieving higher frame rate and lower sampling bandwidth than the conventional compressive sampling cameras.
High-speed Real-Time Single-Pixel Microscopy Based on Fourier Sampling

Qiang Guo,Hongwei Chen,Yuxi Wang,Yong Guo,Peng Liu,Xiurui Zhu,Zheng Cheng,Zhenming Yu,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.48550/arxiv.1606.05200

2016-01-01

Abstract:Single-pixel cameras based on the concepts of compressed sensing (CS) leverage the inherent structure of images to retrieve them with far fewer measurements and operate efficiently over a significantly broader spectral range than conventional silicon-based cameras. Recently, photonic time-stretch (PTS) technique facilitates the emergence of high-speed single-pixel cameras. A significant breakthrough in imaging speed of single-pixel cameras enables observation of fast dynamic phenomena. However, according to CS theory, image reconstruction is an iterative process that consumes enormous amounts of computational time and cannot be performed in real time. To address this challenge, we propose a novel single-pixel imaging technique that can produce high-quality images through rapid acquisition of their effective spatial Fourier spectrum. We employ phase-shifting sinusoidal structured illumination instead of random illumination for spectrum acquisition and apply inverse Fourier transform to the obtained spectrum for image restoration. We evaluate the performance of our prototype system by recognizing quick response (QR) codes and flow cytometric screening of cells. A frame rate of 625 kHz and a compression ratio of 10 recognition rate of the QR code. An imaging flow cytometer enabling high-content screening with an unprecedented throughput of 100,000 cells/s is also demonstrated. For real-time imaging applications, the proposed single-pixel microscope can significantly reduce the time required for image reconstruction by two orders of magnitude, which can be widely applied in industrial quality control and label-free biomedical imaging.
Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Chenning Tao,Huanzheng Zhu,Xucheng Wang,Shuhang Zheng,Qin Xie,Chang Wang,Rengmao Wu,Zhenrong Zheng

DOI: https://doi.org/10.1364/oe.416388

IF: 3.8

2021-01-01

Optics Express

Abstract:Hyperspectral imaging that obtains the spatial-spectral information of a scene has been extensively applied in various fields but usually requires a complex and costly system. A single-pixel detector based hyperspectral system mitigates the complexity problem but simultaneously brings new difficulties on the spectral dispersion device. In this work, we propose a low-cost compressive single-pixel hyperspectral imaging system with RGB sensors. Based on the structured illumination single-pixel imaging configuration, the lens-free system directly captures data by the RGB sensors without dispersion in the spectral dimension. The reconstruction is performed with a pre-trained spatial-spectral dictionary, and the hyperspectral images are obtained through compressive sensing. In addition, the spatial patterns for the structured illumination and the dictionary for the sparse representation are optimized by coherence minimization, which further improve the reconstruction quality. In both spatial and spectral dimensions, the intrinsic sparse properties of the hyperspectral images are made full use of for high sampling efficiency and low reconstruction cost. This work may introduce opportunities for optimization of computational imaging systems and reconstruction algorithms towards high speed, high resolution, and low cost future.
High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Qiang Guo,Hongwei Chen,Yuxi Wang,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1117/12.2249538

2017-01-01

Abstract:In this paper, we present a high-speed single-pixel imaging (SPI) system based on all-optical discrete cosine transform (DCT) and demonstrate its capability to enable noninvasive imaging of flowing cells in a microfluidic channel. Through spectral shaping based on photonic time stretch (PTS) and wavelength-to-space conversion, structured illumination patterns are generated at a rate (tens of MHz) which is three orders of magnitude higher than the switching rate of a digital micromirror device (DMD) used in a conventional single-pixel camera. Using this pattern projector, high-speed image compression based on DCT can be achieved in the optical domain. In our proposed system, a high compression ratio (approximately 10: 1) and a fast image reconstruction procedure are both achieved, which implicates broad applications in industrial quality control and biomedical imaging.
Compressive Sensing Based High-Speed Time-Stretch Optical Microscopy for Two-Dimensional Image Acquisition

Qiang Guo,Hongwei Chen,Zhiliang Weng,Minghua Chen,Sigang Yang,Shizhong Xie

DOI: https://doi.org/10.1364/oe.23.029639

IF: 3.8

2015-01-01

Optics Express

Abstract:In this paper, compressive sensing based high-speed time-stretch optical microscopy for two-dimensional (2D) image acquisition is proposed and experimentally demonstrated for the first time. A section of dispersion compensating fiber (DCF) is used to perform wavelength-to-time conversion and then ultrafast spectral shaping of broadband optical pulses can be achieved via high-speed intensity modulation. A 2D spatial disperser comprising a pair of orthogonally oriented dispersers is employed to produce spatially structured illumination for 2D image acquisition and a section of single mode fiber (SMF) is utilized for pulse compression in the optical domain. In our scheme, a 1.2-GHz photodetector and a 50-MHz analog-to-digital converter (ADC) are used to acquire the energy of the compressed pulses. Image reconstructions are demonstrated at a frame rate of 500 kHz and a sixteen-fold image compression is achieved in our proof-of-concept demonstration.
Fast and High-Quality Single-Pixel Imaging.

Zixin Tang,Tianhang Tang,Xuelei Shi,Jie Chen,Yiguang Liu

DOI: https://doi.org/10.1364/ol.448658

2022-01-01

Abstract:The imaging quality of the conventional single-pixel-imaging (SPI) technique seriously degrades at a low sampling rate. To tackle this problem, we propose an efficient sampling method and a high-quality real-time image reconstruction strategy: first, different from the conventional simple circular path sampling strategy or variable density random sampling technique, the proposed method samples the Fourier spectrum using the spectrum distribution of the image, that is, sampling the significant spectrum coefficients first, which will help to improve the image quality at a relevantly low sampling rate; second, to handle the long image reconstruction time caused by the iterative algorithm, the sparsity of the image and the alternating direction optimization strategy are combined to ameliorate the reconstruction process in the image gradient space. Compared with the state-of-the-art techniques, the proposed method significantly improves the imaging quality and achieves real-time reconstruction on the time scale of milliseconds.
Single-photon compressive imaging with some performance benefits over raster scanning

Wen-Kai Yu,Xue-Feng Liu,Xu-Ri Yao,Chao Wang,Guang-Jie Zhai,Qing Zhao

DOI: https://doi.org/10.1016/j.physleta.2014.09.034

IF: 2.707

2014-01-01

Physics Letters A

Abstract:A single-photon imaging system based on compressed sensing has been developed to image objects under ultra-low illumination. With this system, we have successfully realized imaging at the single-photon level with a single-pixel avalanche photodiode without point-by-point raster scanning. From analysis of the signal-to-noise ratio in the measurement we find that our system has much higher sensitivity than conventional ones based on point-by-point raster scanning, while the measurement time is also reduced.
High-Speed Compressive Microscopy of Flowing Cells Using Sinusoidal Illumination Patterns

Qiang Guo,Hongwei Chen,Yuxi Wang,Yong Guo,Peng Liu,Xiurui Zhu,Zhen Cheng,Zhenming Yu,Sigang Yang,Minghua Chen,Shizhong Xie

DOI: https://doi.org/10.1109/jphot.2016.2644869

IF: 2.4

2017-01-01

IEEE Photonics Journal

Abstract:Single-pixel imaging (SPI) exploits the sparsity structure of natural images and enables image acquisition with far fewer measurements than the number of pixels. However, current SPI devices suffer from low imaging speed and an extremely time-consuming image reconstruction operation. Photonic time-stretch (PTS) technique is demonstrated to enable high-speed structured-illumination pattern generation, which significantly accelerates the imaging speed of conventional SPI devices. Meanwhile, to achieve fast image reconstruction, phase-shifted sinusoidal illumination patterns are used to acquire the Fourier spectrum of images and then a simple inverse fast Fourier transform (IFFT) operation is required for image reconstruction, which is quite computationally efficient. This paper presents a high-speed real-time compressive imaging system and its applications to imaging flow cytometry. Not only is a 625-kHz frame rate demonstrated, which is three orders of magnitude higher than that of a conventional SPI device, but the reconstruction process is remarkably accelerated as well, which enables our prototype system to operate in real time.
Compressed Ultrafast Photography by Multi-Encoding Imaging

Chengshuai Yang,Dalong Qi,Jinyang Liang,Xing Wang,Fengyan Cao,Yilin He,Xiaoping Ouyang,Baoqiang Zhu,Wenlong Wen,Tianqing Jia,Jinshou Tian,Liang Gao,Zhenrong Sun,Shian Zhang,Lihong V. Wang

DOI: https://doi.org/10.1088/1612-202x/aae198

IF: 1.704

2018-01-01

Laser Physics Letters

Abstract:Imaging ultrafast dynamic scenes has been long pursued by scientists. As a two-dimensional dynamic imaging technique, compressed ultrafast photography (CUP) provides the fastest receive-only camera to capture transient events. This technique is based on three-dimensional image reconstruction by combining streak imaging with compressed sensing (CS). However, the image quality and the frame rate of CUP are limited by the CS-based image reconstruction algorithms and the inherent temporal and spatial resolutions of the streak camera. Here, we report a new method to improve the temporal and spatial resolutions of CUP. Our numerical simulation and experimental verification show that by using a multi-encoding imaging method, both the image quality and the frame rate of CUP can be significantly improved beyond the intrinsic technical parameters. Importantly, the temporal resolution by our scheme can break the limitation of the streak camera. Therefore, this new technology has potential benefits in many applications that require the ultrafast dynamic scene image with high temporal and spatial resolutions.
Sinusoidal Sampling Enhanced Compressive Camera for High Speed Imaging

Chao Deng,Yuanlong Zhang,Yifeng Mao,Jingtao Fan,Jinli Suo,Zhili Zhang,Qionghai Dai

DOI: https://doi.org/10.1109/TPAMI.2019.2946567

IF: 23.6

2021-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Compressive sensing technique allows capturing fast phenomena at a much higher frame rate than the camera sensor, by recovering a frame sequence from their encoded combination. However, most conventional compressive video sensing methods limit the achieved frame rate improvement to tenfold and only support low resolution recovery. Making use of the camera's redundant spatial resolution for further frame rate improve, here we report a novel compressive video acquisition technique termed Sinusoidal Sampling Enhanced Compressive Camera (S2EC2) to encode denser frames within a snapshot. Specifically, we decompose the dense frames into groups and apply combinational coding: random codes within each group for compressive acquisition; group specific sinusoidal codes to multiplex different groups onto the high resolution sensor. The sinusoidal codes designed for these groups would shift their frequency components by different offsets in the Fourier domain and staggered the dominant frequencies of the coded measurements of these groups. Correspondingly, the reconstruction successfully separate coded measurements of different groups and recovers frames within each group. Besides, we also solve the implementation problem of insufficient gray scale spatial light modulation speed, and build a prototype achieving 2000 fps reconstruction with a 15.6 fps camera (the actual compression ratio is 0.009). The extensive experiments validate the proposed approach.
64 picosecond time resolved time-correlated single photon counting imaging

Jia-Zhi Yang,An-Ning Zhang,Qing-Yuan Wu,Jian Li,Zhe Meng,Qing Zhao

DOI: https://doi.org/10.1063/5.0174067

IF: 1.6

2024-02-01

Review of Scientific Instruments

Abstract:High-speed imaging of dynamic scenes is a challenging and important task in many applications. However, conventional imaging methods based on charge coupled devices or complementary metal oxide semiconductors have limitations in temporal resolution and photon sensitivity. To address this problem, we propose a novel high-speed imaging scheme that combines single-pixel imaging with single photon detection and time-correlated single photon counting. Our scheme can achieve high-speed imaging with 64 ps resolution by repeating the motion scenes and using binary outputs from single photon detectors. We demonstrate our scheme by reconstructing the switching process of a digital micro-mirror device and a liquid crystal spatial light modulator. Our scheme can be further improved to 1 ps resolution by using a more accurate time-correlated single photon counting system. Moreover, our scheme can adapt to different speed scenes by adjusting the temporal resolution and reducing the sampling time. Our high temporal resolution imaging scheme further expands the application areas of single-pixel imaging and provides solutions for scenes requiring single photon detection and higher temporal resolution, such as reproducible chemical reaction processes imaging, cellular or sub-cellular bio imaging, single-molecule imaging of rotary motors, high-speed equipment inspection, and other periodic high-speed scenes imaging.

instruments & instrumentation,physics, applied
Continuously streaming compressed high-speed photography using time delay integration

Jongchan Park,Liang Gao

DOI: https://doi.org/10.1364/optica.437736

IF: 10.4

2021-12-16

Optica

Abstract:An imaging system capable of acquiring high-resolution data at a high speed is in demand. However, the amount of optical information captured by a modern camera is limited by the data transfer bandwidth of electronics, resulting in a reduced spatial and temporal resolution. To overcome this problem, we developed continuously streaming compressed high-speed photography, which can record a dynamic scene with an unprecedented space-bandwidth-time product. By performing compressed imaging in a time-delay-integration manner, we continuously recorded a 0.85 megapixel video at 200 kHz, corresponding to an information flux of 170 gigapixels per second.

optics
GHz Optical Time-Stretch Microscopy by Compressive Sensing

Cheng Lei,Yi Wu,Aswin C. Sankaranarayanan,Shih-Min Chang,Baoshan Guo,Naoto Sasaki,Hirofumi Kobayashi,Chia-Wei Sun,Yasuyuki Ozeki,Keisuke Goda

DOI: https://doi.org/10.1109/jphot.2017.2676349

IF: 2.4

2017-01-01

IEEE Photonics Journal

Abstract:Optical time-stretch microscopy has recently attracted intensive attention for its capability of acquiring images at an ultrahigh frame rate. Unfortunately, its achievable frame rate is limited by the requirement of having no overlap between consecutive frames, which leads to a tradeoff between the frame rate (pulse repetition rate) and the amount of the temporal dispersion used for optical image serialization. In this paper, we demonstrate compressive sensing on the platform of optical time-stretch microscopy to overcome the tradeoff between frame rate and temporal dispersion (time stretch) and achieve 50 times higher frame rate than conventional optical time-stretch microscopy. Specifically, we computationally perform compressed optical time-stretch microscopy with an experimental dataset acquired by conventional optical time-stretch microscopy and demonstrate its effects in terms of spatial resolution and cell classification accuracy. Our results indicate that the spatial resolution and cell classification accuracy reach 780 nm and 95% at a line scan rate of 675 MHz and 6.75 GHz, respectively, which correspond to five times and 50 times higher frame rates than what conventional optical time-stretch microscopy can achieve with the same dispersion amount and digitizer sampling rate.
High-speed microscopic imaging system with incoherent broadband optical source

hongwei chen

DOI: https://doi.org/10.1109/OECC.2015.7340088

2015-01-01

Abstract:Fast microscopic imaging has greatly potential applications in biology, medical science and environment monitoring. The ability to image specimen at high speed is particularly important for inspecting a large quantity in a short period of time. CCD or CMOS cameras are conventionally used for imaging, but has limited frame rate and data throughput. In this report, time-stretch high-speed microscopic imaging systems based on temporally and spectrally shaped incoherent optical source are proposed and experimentally demonstrated. We significantly reduced the complexity of the light source by applying multi-wavelength source or amplified spontaneous noise emission (ASE) in the time-stretch microscopic imaging system. Further-more, by preprocessing the broadband spectrum, the resolution of the proposed system is better than 35 µm and the effective 1D scan rate could reach 50 MHz to 2GHz.
Ultrafast Time-Stretch Microscopy Based on Dual-Comb Asynchronous Optical Sampling.

Xin Dong,Xi Zhou,Jiqiang Kang,Liao Chen,Zihui Lei,Chi Zhang,Kenneth K. Y. Wong,Xinliang Zhang

DOI: https://doi.org/10.1364/ol.43.002118

IF: 3.6

2018-01-01

Optics Letters

Abstract:The ultrafast time-stretch microscopy based on a single-pixel detector has become a hotspot of the research, owing to its high sensitivity compared to those pixel sensors. However, gigahertz or tens of gigahertz acquisition bandwidth is required for this scheme, resulting in great expense for the whole imaging system and hindering its wide applications. In this Letter, a dual-comb asynchronous optical sampling is applied for the conventional time-stretch microscopy, whose ultrafast temporal axis is magnified by 9200 times. The acquisition bandwidth requirement is thus greatly relaxed, and 320 kHz bandwidth successfully resolves 2.3 μm spatial resolution with tens of kilohertz frame rate.
Progressive compressive imaging by single-pixel imager

Zelong Wang,Jubo Zhu,Fengxia Yan

DOI: https://doi.org/10.1109/ICSPCC.2013.6663919

2013-01-01

Abstract:The progressive compressive imaging by single-pixel imager is presented in this paper. We aim to offer the online control of the tradeoff between the sampling rate and the quality of the recovered image and avoid the need of a priori knowledge of the object sparsity. Moreover, we can implement the proposed approach by the innovation method to reduce the computation complexity and the memory requirements as well as improving the recovery precision. We also show the stopping rule and the finite truncation for the innovation method. The results in the numerical simulations show the feasibility of the proposed method.
A single-pixel terahertz imaging system based on compressed sensing

Wai Lam Chan,Kriti Charan,Dharmpal Takhar,Kevin F. Kelly,Richard G. Baraniuk,Daniel M. Mittleman

DOI: https://doi.org/10.1063/1.2989126

IF: 4

2008-09-22

Applied Physics Letters

Abstract:We describe a terahertz imaging system that uses a single pixel detector in combination with a series of random masks to enable high-speed image acquisition. The image formation is based on the theory of compressed sensing, which permits the reconstruction of a N-by-N pixel image using much fewer than N2 measurements. This approach eliminates the need for raster scanning of the object or the terahertz beam, while maintaining the high sensitivity of a single-element detector. We demonstrate the concept using a pulsed terahertz time-domain system and show the reconstruction of both amplitude and phase-contrast images. The idea of compressed sensing is quite general and could also be implemented with a continuous-wave terahertz source.

physics, applied
A Compact and Highly Efficient Compressive Sensing Imaging System Using In-Fiber Grating

P. Shum,Liyang Shao,Rui Min,Huanhuan Liu,Shuming Jiao,Lipeng Sun,Guoqing Wang,Weizhi Wang,E. Du,Zhi-quan Yan,Chao Wang,Fang Zhao,Yuan Zhou

DOI: https://doi.org/10.1109/LPT.2022.3233873

IF: 2.6

2023-02-15

IEEE Photonics Technology Letters

Abstract:Serial time-encoded amplified microscopy can achieve ultrafast imaging speed within varied dynamic regimes. However, it has two challenges: the high-throughput data issue and low-efficiency diffraction issue. Here, we report a compact and highly efficient ultrafast optical imaging system based on compressive sensing and in-fiber grating. Our proposal is confirmed by the proof-of-principle experiment and obtains a minimum data compression ratio of 5% with a continuous ultrafast imaging speed of 10 Mfps at a field of view of 0.5 mm ${}^{\ast} 1.6$ mm. A barcode with a moving speed of 4m/s is also demonstrated for imaging and an imaging speed of 1.25 Mfps is obtained. The proposed optical imaging system overcomes the big data issue, increases energy efficiency, and paves the way for compact and highly efficient ultrafast optical imaging within dynamic scenarios.

Physics,Engineering
Single-pixel imaging via compressive sampling

J. Laska,M. Davenport,D. Takhar,Ting Sun,Marco F. Duarte,K. Kelly,Richard Baraniuk

DOI: https://doi.org/10.1109/MSP.2007.914730

IF: 15.204

2008-03-01

IEEE Signal Processing Magazine

Abstract:In this article, the authors present a new approach to building simpler, smaller, and cheaper digital cameras that can operate efficiently across a broader spectral range than conventional silicon-based cameras. The approach fuses a new camera architecture based on a digital micromirror device with the new mathematical theory and algorithms of compressive sampling.

Engineering,Computer Science,Physics
Single-pixel High-Speed Imaging Through a Multimode Fiber

Zhoutian Liu,Dan Li,Ping Yan,Mali Gong,Qirong Xiao

DOI: https://doi.org/10.1364/cleo_at.2022.jw3b.56

2022-01-01

Abstract:While traditional high-speed cameras are generally bulky and based on pixel-array detectors, we propose a high-speed imaging scheme based on a multimode fiber using only one pixel. The frame rate of imaging reaches 60.3 Mfps.

High speed single-pixel imaging via time domain compressive sampling

High speed two-dimensional temporal compressive sampling microscopic camera

High-speed Real-Time Single-Pixel Microscopy Based on Fourier Sampling

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

High-Speed Real-Time Image Compression Based on All-Optical Discrete Cosine Transformation

Compressive Sensing Based High-Speed Time-Stretch Optical Microscopy for Two-Dimensional Image Acquisition

Fast and High-Quality Single-Pixel Imaging.

Single-photon compressive imaging with some performance benefits over raster scanning

High-Speed Compressive Microscopy of Flowing Cells Using Sinusoidal Illumination Patterns

Compressed Ultrafast Photography by Multi-Encoding Imaging

Sinusoidal Sampling Enhanced Compressive Camera for High Speed Imaging

64 picosecond time resolved time-correlated single photon counting imaging

Continuously streaming compressed high-speed photography using time delay integration

GHz Optical Time-Stretch Microscopy by Compressive Sensing

High-speed microscopic imaging system with incoherent broadband optical source

Ultrafast Time-Stretch Microscopy Based on Dual-Comb Asynchronous Optical Sampling.

Progressive compressive imaging by single-pixel imager

A single-pixel terahertz imaging system based on compressed sensing

A Compact and Highly Efficient Compressive Sensing Imaging System Using In-Fiber Grating

Single-pixel imaging via compressive sampling

Single-pixel High-Speed Imaging Through a Multimode Fiber