Abstract:The convolutional neural network (CNN)-based reconstruction methods have dominated the compressive sensing (CS) in recent years. However, existing CNN-based approaches show potential restrictions in capturing non-local similarity of images, because of the intrinsic characteristic of convolutional layers, $\mathit{i.e.}$ , locality and weight sharing. In parallel, the emerging Transformer architecture shows fine capacity in modeling long-distance correlations onto embedded tokens for language and images. Yet vanilla Transformer does not exceed CNN-based networks considerably but shows roughly comparable performance, and the culprit can be the missing of sophisticated inductive bias regarding the local image structures. In this article, to eliminate the restrictions of the aforementioned paradigms, we propose a Transformer-based hierarchical framework, dubbed TCS-Net, for compressive image sensing (or image compressive sensing) with a $\mathit{patch-to-pixel}$ manner. Concretely, the proposed TCS-Net consists of an image acquisition module and a reconstruction module (includes two key decoding phases: a patch-wise decoding phase and a pixel-wise decoding phase). The acquisition module can implement data-driven image sampling by jointly learning with the decoding phases. By adjusting the Transformer architecture to the $\mathit{patch-to-pixel}$ multi-stage pattern, our reconstruction module can gradually decode the CS measurements from the patch-wise outlines to the pixel-wise textures, thereby building a high-precision mapping for image reconstruction. Extensive experiments on several datasets verify that the proposed TCS-Net outperforms existing state-of-the-art image CS methods by considerable margins.

An End-to-End Multi-Scale Residual Reconstruction Network for Image Compressive Sensing

EiCSNet: Efficient Iterative Neural Network for Compressed Sensing Reconstruction

IEF-CSNET: Information Enhancement and Fusion Network for Compressed Sensing Reconstruction

Multi-Scale Residual Reconstruction Neural Network with Non-Local Constraint.

Cascaded Reconstruction Network for Compressive image sensing

MS-DRDNet: Optimization-Inspired Deep Compressive Sensing Network for MRI

High-Quality Image Compressed Sensing and Reconstruction with Multi-scale Dilated Convolutional Neural Network

Image Compressed Sensing with Multi-scale Dilated Convolutional Neural Network

Multi-Scale Deep Networks for Image Compressed Sensing

From Patch to Pixel: A Transformer-Based Hierarchical Framework for Compressive Image Sensing.

Multi-image super-resolution based low complexity deep network for image compressive sensing reconstruction

ConvCSNet: A Convolutional Compressive Sensing Framework Based on Deep Learning

AMS-Net: Adaptive Multi-Scale Network for Image Compressive Sensing

Scalable Convolutional Neural Network for Image Compressed Sensing.

A Dictionary Learning Based Unsupervised Neural Network for Single Image Compressed Sensing

CMCS-net: Image Compressed Sensing with Convolutional Measurement Via DCNN.

DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing

S2-CSNet: Scale-Aware Scalable Sampling Network for Image Compressive Sensing

Compressed Sensing MRI via a Multi-scale Dilated Residual Convolution Network

Multi-Channel Deep Networks for Block-Based Image Compressive Sensing

A Two-Branch Convolution Residual Network for Image Compressive Sensing.