Abstract:Video snapshot compressive imaging (SCI) uses a low-speed 2D detector to capture high-speed scene, where the dynamic scene is modulated by different masks and then compressed into a snapshot measurement. Following this, a reconstruction algorithm is needed to reconstruct the high-speed video frames. Although state-of-the-art (SOTA) deep learning-based reconstruction algorithms have achieved impressive results, they still face the following challenges due to excessive model complexity and GPU memory limitations: (1) These models need high computational cost, and (2) They are usually unable to reconstruct large-scale video frames at high compression ratios. To address these issues, we develop an efficient network for video SCI by using hierarchical residual-like connections and hybrid CNN-Transformer structure within a single residual block, dubbed EfficientSCI++ . The EfficientSCI++ network can well explore spatial-temporal correlation using convolution in the spatial domain and Transformer in the temporal domain , respectively. We are the first time to demonstrate that a UHD color video ( ) with high compression ratio (40) can be reconstructed from a snapshot 2D measurement using a single end-to-end deep learning model with PSNR above 34 dB. Moreover, a mixed-precision model is trained to further accelerate the video SCI reconstruction process and save memory footprint. Extensive results on both simulation and real data demonstrate that, compared with precious SOTA methods, our proposed EfficientSCI++ and EfficientSCI can achieve comparable reconstruction quality with much cheaper computational cost and better real-time performance. Code is available at https://github.com/mcao92/EfficientSCI-plus-plus.

Using ICA As a Pre-Processor for CNNs to Efficiently Process High-Dynamic Videos.

A New Composite Ica Algorithm and Its Application in Fmri Data Processing

Applications of Independent Component Analysis to Image Feature Extraction

RICA-MD: A Refined ICA Algorithm for Motion Detection

Performance-Driven Ensemble Learning Ica Model For Improved Non-Gaussian Process Monitoring

Nonlinear ICA Using Volume-Preserving Transformations.

Video Sequence Processing Based on Spatiotemporal Independent Component Analysis

&Lt;title>object Extraction in Video Sequences Based on the Spatio-Temporal Independent Component Analysis</title>

Optimizing Ica-Based Spatial Filters For Long-Term Bci Users

Improved ICA for Process Monitoring Based on Ensemble Learning and Bayesian Inference

Video Event Detection using ICA Mixture Hidden Markov Models

Compact Deep Invariant Descriptors for Video Retrieval

Hybrid CNN-Transformer Architecture for Efficient Large-Scale Video Snapshot Compressive Imaging

14.2 A 65nm 24.7µj/frame 12.3mw Activation-Similarity-Aware Convolutional Neural Network Video Processor Using Hybrid Precision, Inter-Frame Data Reuse and Mixed-Bit-Width Difference-Frame Data Codec

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

Procedural Learning with Robust Visual Features Via Low Rank Prior

An ICA Mixture Hidden Markov Model for Video Content Analysis

Application of Fast Independent Component Analysis on Extracting the Information of Remote Sensing Imagery

Ica Feature Extract Ion-Framework and Application

Fast and precise independent component analysis for high field fMRI time series tailored using prior information on spatiotemporal structure

A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding