Abstract:Hyperspectrally compressed ultrafast photography (HCUP) based on compressed sensing and the time- and spectrum-to-space mappings can simultaneously realize the temporal and spectral imaging of non-repeatable or difficult-to-repeat transient events passively in a single exposure. It possesses an incredibly high frame rate of tens of trillions of frames per second and a sequence depth of several hundred, and plays a revolutionary role in single-shot ultrafast optical imaging. However, due to the ultra-high data compression ratio induced by the extremely large sequence depth as well as the limited fidelities of traditional reconstruction algorithms over the reconstruction process, HCUP suffers from a poor image reconstruction quality and fails to capture fine structures in complex transient scenes. To overcome these restrictions, we propose a flexible image reconstruction algorithm based on the total variation (TV) and cascaded denoisers (CD) for HCUP, named the TV-CD algorithm. It applies the TV denoising model cascaded with several advanced deep learning-based denoising models in the iterative plug-and-play alternating direction method of multipliers framework, which can preserve the image smoothness while utilizing the deep denoising networks to obtain more priori, and thus solving the common sparsity representation problem in local similarity and motion compensation. Both simulation and experimental results show that the proposed TV-CD algorithm can effectively improve the image reconstruction accuracy and quality of HCUP, and further promote the practical applications of HCUP in capturing high-dimensional complex physical, chemical and biological ultrafast optical scenes.

Improving Image Quality in Compressed Ultrafast Photography with A Space- and Intensity-Constrained Reconstruction Algorithm

Space- and Intensity-Constrained Reconstruction for Compressed Ultrafast Photography.

High-fidelity image reconstruction for compressed ultrafast photography via an augmented-Lagrangian and deep-learning hybrid algorithm

Single-shot Compressed Ultrafast Photography Based on U-net Network

Superpixel-Based Linear Reconstruction Method for Dual-Camera Compressed Hyperspectral Imaging System

Image Reconstruction for Compressed Ultrafast Photography Based on Manifold Learning and Alternating Direction Method of Multipliers

Discrete Illumination-Based Compressed Ultrafast Photography for High-Fidelity Dynamic Imaging

High-performance reconstruction method combining total variation with a video denoiser for compressed ultrafast imaging

Unsupervised reconstruction with a registered time-unsheared image constraint for compressed ultrafast photography

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Adaptive Reconstruction for Coded Aperture Temporal Compressive Imaging.

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Photon Counting Correction Method to Improve the Quality of Reconstructed Images in Single Photon Compressive Imaging Systems.

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

A flexible and accurate total variation and cascaded denoisers-based image reconstruction algorithm for hyperspectrally compressed ultrafast photography

Tutorial on compressed ultrafast photography

Single‐Shot Ultraviolet Compressed Ultrafast Photography

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

10-mega pixel snapshot compressive imaging with a hybrid coded aperture

Compressive Ghost Imaging in Scattering Media Guided by Region of Interest

Ten-mega-pixel snapshot compressive imaging with a hybrid coded aperture