Abstract:Convolutional Neural Networks (CNNs) dominate image processing but suffer from local inductive bias, which is addressed by the transformer framework with its inherent ability to capture global context through self-attention mechanisms. However, how to inherit and integrate their advantages to improve compressed sensing is still an open issue. This paper proposes CSformer, a hybrid framework to explore the representation capacity of local and global features. The proposed approach is well-designed for end-to-end compressive image sensing, composed of adaptive sampling and recovery. In the sampling module, images are measured block-by-block by the learned sampling matrix. In the reconstruction stage, the measurements are projected into an initialization stem, a CNN stem, and a transformer stem. The initialization stem mimics the traditional reconstruction of compressive sensing but generates the initial reconstruction in a learnable and efficient manner. The CNN stem and transformer stem are concurrent, simultaneously calculating fine-grained and long-range features and efficiently aggregating them. Furthermore, we explore a progressive strategy and window-based transformer block to reduce the parameters and computational complexity. The experimental results demonstrate the effectiveness of the dedicated transformer-based architecture for compressive sensing, which achieves superior performance compared to state-of-the-art methods on different datasets. Our codes is available at: https://github.com/Lineves7/CSformer.

Adaptive and Cascaded Compressive Sensing

AdaCS: Adaptive Compressive Sensing with Restricted Isometry Property-Based Error-clamping

Reconstruction-free Cascaded Adaptive Compressive Sensing

An Adaptive Random Compressive Partial Sampling Method with TV Recovery

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Adaptive High-Resolution Imaging Method Based on Compressive Sensing

Cascaded Reconstruction Network for Compressive image sensing

Block based Adaptive Compressive Sensing with Sampling Rate Control

Content-aware Scalable Deep Compressed Sensing

Adaptive Compressed Sensing with Diffusion-Based Posterior Sampling

On Collaborative Compressive Sensing Systems: The Framework, Design and Algorithm

Avcsr: Adaptive Video Compressive Sensing Using Region-of-Interest Detection in the Compressed Domain

Downward Spatially-Scalable Image Reconstruction Based on Compressed Sensing

Three-stages Hyperspectral Image Compression Sensing with Band Selection

Semantic-Aware Image Compressed Sensing

Robust Deep Compressive Sensing with Recurrent-Residual Structural Constraints

Diffusion adaptation framework for compressive sensing reconstruction

Multi-rate Video Compressive Sensing for Fixed Scene Measurement

CSformer: Bridging Convolution and Transformer for Compressive Sensing