Abstract:Compressed ultrafast photography (CUP) is the fastest single-shot passive ultrafast optical imaging technique, which has shown to be a powerful tool in recording self-luminous or non-repeatable ultrafast phenomena. However, the low fidelity of image reconstruction based on the conventional augmented-Lagrangian (AL) and two-step iterative shrinkage/thresholding (TwIST) algorithms greatly prevents practical applications of CUP, especially for those ultrafast phenomena that need high spatial resolution. Here, we develop a novel AL and deep-learning (DL) hybrid (i.e., <math display="inline"> <mrow> <mi>AL</mi> <mo>+</mo> <mi>DL</mi> </mrow> </math> ) algorithm to realize high-fidelity image reconstruction for CUP. The <math display="inline"> <mrow> <mi>AL</mi> <mo>+</mo> <mi>DL</mi> </mrow> </math> algorithm not only optimizes the sparse domain and relevant iteration parameters via learning the dataset but also simplifies the mathematical architecture, so it greatly improves the image reconstruction accuracy. Our theoretical simulation and experimental results validate the superior performance of the <math display="inline"> <mrow> <mi>AL</mi> <mo>+</mo> <mi>DL</mi> </mrow> </math> algorithm in image fidelity over conventional AL and TwIST algorithms, where the peak signal-to-noise ratio and structural similarity index can be increased at least by 4 dB (9 dB) and 0.1 (0.05) for a complex (simple) dynamic scene, respectively. This study can promote the applications of CUP in related fields, and it will also enable a new strategy for recovering high-dimensional signals from low-dimensional detection.

Single‐Shot Ultraviolet Compressed Ultrafast Photography

Tutorial on compressed ultrafast photography

Discrete Illumination-Based Compressed Ultrafast Photography for High-Fidelity Dynamic Imaging

Single-shot Compressed Ultrafast Photography Based on U-net Network

A Compact Upconversion Single-Photon Imager for Full-Range and Accurate 3-D Imaging

Single-shot polarization-resolved ultrafast mapping photography

Single-shot stereo-polarimetric compressed ultrafast photography for light-speed observation of high-dimensional optical transients with picosecond resolution

Ccd High Speed Videography System With New Concepts And Techniques

Ultrafast Imaging of Light Scattering Dynamics Using Second-Generation Compressed Ultrafast Photography

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Space- and Intensity-Constrained Reconstruction for Compressed Ultrafast Photography.

High-fidelity image reconstruction for compressed ultrafast photography via an augmented-Lagrangian and deep-learning hybrid algorithm

Improving Image Quality in Compressed Ultrafast Photography with A Space- and Intensity-Constrained Reconstruction Algorithm

Toward Unlimited Temporal Resolution: Femtosecond Videography for Atomic and Molecular Dynamics

Ultraviolet photon-counting single-pixel imaging

Discrete Illumination‐Based Compressed Ultrafast Photography for High‐Fidelity Dynamic Imaging (Adv. Sci. 41/2024)

Image Reconstruction for Compressed Ultrafast Photography Based on Manifold Learning and Alternating Direction Method of Multipliers

Single-shot Ultrafast Phase Retrieval Photography.

Unsupervised reconstruction with a registered time-unsheared image constraint for compressed ultrafast photography