Abstract:Snapshot compressive imaging (SCI) aims at efficiently capturing high-dimensional data (e.g., multi-spectral images and videos) using a two-dimensional detector, which is a hardware-friendly data acquisition paradigm. However, because of the complex structure of videos (such as the dynamic background and moving foreground), it is challenging to reconstruct a video from the captured measurement. Existing model-based methods for video SCI reconstruction are inadequate to reconstruct the complex structure of videos, and existing supervised deep learning-based methods are with poor adaptability to videos in real scenarios. Inspired by the physically interpreted video decomposition, we suggest an unsupervised video SCI reconstruction method with tailored deep video prior and affine transformation, namely, FactorDVP-T. Our FactorDVP-T infers the parameters of the neural networks and the underlying structure of the original video from the captured measurement using a non-reference loss function in an unsupervised manner. Under FactorDVP-T, a video is first factorized into the moving foreground and static background. The background is further factorized into temporal bases and spatial coefficients, where each factor can be modeled individually using the designated unsupervised networks in FactorDVP-T. Moreover, to tackle the dynamic background in real scenarios, we integrate the affine transformation into FactorDVP-T. Benefiting from the expressive power of unsupervised networks embedded in the physically interpreted video decomposition framework, our methods can reconstruct the videos more effectively and better adapt to various videos in real scenarios, as compared with the model-based methods and supervised deep learning-based methods respectively. Extensive experiments on various videos show that our FactorDVP-T can better adapt to different videos, compared with the state-of-the-art model-based and supervised deep learning-based SCI reconstruction methods.

Video Retrieval Using Sparse Bayesian Reconstruction

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

Video Compressive Sensing Reconstruction Via Reweighted Residual Sparsity

A Dual Structured-Sparsity Model for Compressive-Sensed Video Reconstruction

A Sparse Representation-Based Approach for Video Copy Detection

Use What You Have: Video Retrieval Using Representations from Collaborative Experts.

Retrieval in Long Surveillance Videos using User Described Motion and Object Attributes

Video compressive sensing via structured Laplacian modelling

Video Compressive Sensing for Spatial Multiplexing Cameras using Motion-Flow Models

EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging

Compressive Sensing Approaches for Autonomous Object Detection in Video Sequences

Video Sequence Processing Based on Spatiotemporal Independent Component Analysis

Incremetal Spatio-Temporal Feature Extraction and Retrieval for Large Video Database

On the Applications of Robust PCA in Image and Video Processing

Query-Aware Sparse Coding for Multi-Video Summarization

Orthogonal Projective Sparse Coding for Image Representation

Block Rls Algorithm For Surveillance Video Processing Based On Image Sparse Representation

Accelerated Event-Based Feature Detection and Compression for Surveillance Video Systems

Snapshot Compressive Imaging Using Domain-Factorized Deep Video Prior

Video SAR Imaging Based on Low-Rank Tensor Recovery

Simultaneous Sparse Approximation and Common Component Extraction using Fast Distributed Compressive Sensing