Abstract:Recently, deep learning-based image compression has made significant progresses, and has achieved better rate-distortion (R-D) performance than the latest traditional method, H.266/VVC, in both MS-SSIM metric and the more challenging PSNR metric. However, a major problem is that the complexities of many leading learned schemes are too high. In this paper, we propose an efficient and effective image coding framework, which achieves similar R-D performance with lower complexity than the state of the art. First, we develop an improved multi-scale residual block (MSRB) that can expand the receptive field and capture global information more efficiently, which further reduces the spatial correlation of the latent representations. Second, an importance scaling network is introduced to directly scale the latents to achieve content-adaptive bit allocation without sending side information, which is more flexible than previous importance map methods. Third, we apply a post-quantization filter (PQF) to reduce the quantization error, motivated by the Sample Adaptive Offset (SAO) filter in video coding. Moreover, our experiments show that the performance of the system is less sensitive to the complexity of the decoder. Therefore, we design an asymmetric paradigm, in which the encoder employs three stages of MSRBs to improve the learning capacity, whereas the decoder only uses one stage of MSRB, which reduces the decoder complexity and still yields satisfactory performance. Experimental results show that compared to the state-of-the-art method, the encoding and decoding time of the proposed method are about 17 times faster, and the R-D performance is only reduced by about 1% on both Kodak and Tecnick-40 datasets, which is still better than H.266/VVC(4:4:4) and other leading learning-based methods. Our source code is publicly available at https://github.com/fengyurenpingsheng.

Compressive Sensing Based Asymmetric Semantic Image Compression for Resource-Constrained IoT System

Attention-based UNet enabled Lightweight Image Semantic Communication System over Internet of Things

DeepSIC: Deep Semantic Image Compression

Semantic-Oriented Feature Compression for Resource-Constrained Distributed Sensor Networks

Deep Image Semantic Communication Model for Artificial Intelligent Internet of Things

Semantic-assisted image compression

CCD Sensor Based Cameras for Sustainable Streaming IoT Applications With Compressed Sensing

CS-CNN: Enabling Robust and Efficient Convolutional Neural Networks Inference for Internet-of-Things Applications

DNN Model Compression for IoT Domain-Specific Hardware Accelerators

Semantic-Aware Image Compressed Sensing

Supervised Compression for Resource-Constrained Edge Computing Systems

SSSIC: Semantics-to-Signal Scalable Image Coding with Learned Structural Representations.

Semantic Communication Enabling Robust Edge Intelligence for Time-Critical IoT Applications

Deep Residual Learning-Based Enhanced JPEG Compression in the Internet of Things

Collaborative image compression and classification with multi-task learning for visual Internet of Things

Joint Task and Data Oriented Semantic Communications: A Deep Separate Source-channel Coding Scheme

Remote Sensing Image Coding for Machines on Semantic Segmentation via Contrastive Learning

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Communication-Efficient Quantized Deep Compressed Sensing for Edge-Cloud Collaborative Industrial IoT Networks

Optimized Compressed Sensing for IoT: Advanced Algorithms for Efficient Sparse Signal Reconstruction in Edge Devices