Abstract:Recently, deep learning-based compressed sensing (CS) has achieved great success in reducing the sampling and computational cost of sensing systems and improving the reconstruction quality. These approaches, however, largely overlook the issue of the computational cost; they rely on complex structures and task-specific operator designs, resulting in extensive storage and high energy consumption in CS imaging systems. In this paper, we propose a lightweight but effective deep neural network based on recurrent learning to achieve a sustainable CS system; it requires a smaller number of parameters but obtains high-quality reconstructions. Specifically, our proposed network consists of an initial reconstruction sub-network and a residual reconstruction sub-network. While the initial reconstruction sub-network has a hierarchical structure to progressively recover the image, reducing the number of parameters, the residual reconstruction sub-network facilitates recurrent residual feature extraction via recurrent learning to perform both feature fusion and deep reconstructions across different scales. In addition, we also demonstrate that, after the initial reconstruction, feature maps with reduced sizes are sufficient to recover the residual information, and thus we achieved a significant reduction in the amount of memory required. Extensive experiments illustrate that our proposed model can achieve a better reconstruction quality than existing state-of-the-art CS algorithms, and it also has a smaller number of network parameters than these algorithms. Our source codes are available at: <a class="link-external link-https" href="https://github.com/C66YU/CSRN" rel="external noopener nofollow">this https URL</a>.

Residual squeeze CNDS deep learning CNN model for very large scale places image recognition

An Efficient Compressive Convolutional Network for Unified Object Detection and Image Compression

A Survey of Model Compression and Acceleration for Deep Neural Networks.

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Learning Efficient Convolutional Networks Through Network Slimming.

Compression of Deep Neural Networks for Image Instance Retrieval

A Lightweight Recurrent Learning Network for Sustainable Compressed Sensing

Towards Compact CNNs via Collaborative Compression

SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size

SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size

CS-CNN: Enabling Robust and Efficient Convolutional Neural Networks Inference for Internet-of-Things Applications

Compressing Deep Convolutional Networks using Vector Quantization

Compressed sensing MRI via a multi-scale dilated residual convolution network

Refining Architectures of Deep Convolutional Neural Networks

S-Net: a Scalable Convolutional Neural Network for JPEG Compression Artifact Reduction.

Focused Quantization for Sparse CNNs

Compression Supports Spatial Deep Learning

Deep Learning Using Isotroping, Laplacing, Eigenvalues Interpolative Binding, and Convolved Determinants with Normed Mapping for Large-Scale Image Retrieval

DRF-DRC: dynamic receptive field and dense residual connections for model compression

Towards Evolutionary Compression.