Abstract:With the growth of computer vision-based applications, an explosive amount of images have been uploaded to cloud servers that host such online computer vision algorithms, usually in the form of deep learning models. JPEG has been used as the de facto compression and encapsulation method for images. However, standard JPEG configuration does not always perform well for compressing images that are to be processed by a deep learning model—for example, the standard quality level of JPEG leads to 50% of size overhead (compared with the best quality level selection) on ImageNet under the same inference accuracy in popular computer vision models (e.g., InceptionNet and ResNet). Knowing this, designing a better JPEG configuration for online computer vision-based services is still extremely challenging. First, cloud-based computer vision models are usually a black box to end-users; thus, it is challenging to design JPEG configuration without knowing their model structures. Second, the “optimal” JPEG configuration is not fixed; instead, it is determined by confounding factors, including the characteristics of the input images and the model, the expected accuracy and image size, and so forth. In this article, we propose a reinforcement learning (RL)-based adaptive JPEG configuration framework, AdaCompress. In particular, we design an edge (i.e., user-side) RL agent that learns the optimal compression quality level to achieve an expected inference accuracy and upload image size, only from the online inference results, without knowing details of the model structures. Furthermore, we design an explore-exploit mechanism to let the framework fast switch an agent when it detects a performance degradation, mainly due to the input change (e.g., images captured across daytime and night). Our evaluation experiments using real-world online computer vision-based APIs from Amazon Rekognition, Face++, and Baidu Vision show that our approach outperforms existing baselines by reducing the size of images by one-half to one-third while the overall classification accuracy only decreases slightly. Meanwhile, AdaCompress adaptively re-trains or re-loads the RL agent promptly to maintain the performance.

AdaNIC: Towards Practical Neural Image Compression Via Dynamic Transform Routing

Slimmable Compressive Autoencoders for Practical Neural Image Compression

Deep Convolutional AutoEncoder-based Lossy Image Compression

Computationally-Efficient Neural Image Compression with Shallow Decoders

A Unified End-to-End Framework for Efficient Deep Image Compression

A Slimmable Framework for Practical Neural Video Compression

Joint Hierarchical Priors and Adaptive Spatial Resolution for Efficient Neural Image Compression

Content Adaptive Latents and Decoder for Neural Image Compression

Bandwidth-efficient Inference for Neural Image Compression

EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

A Novel Deep Progressive Image Compression Framework

An End-to-End Compression Framework Based on Convolutional Neural Networks

Flexible Neural Image Compression via Code Editing

Layered Image Compression Using Scalable Auto-Encoder

Adaptive Compression for Online Computer Vision: an Edge Reinforcement Learning Approach

A Broad-Spectrum and High-Throughput Compression Engine for Neural Network Processors

Efficient Variable Rate Image Compression With Multi-Scale Decomposition Network

Advancing The Rate-Distortion-Computation Frontier For Neural Image Compression

EVC: Towards Real-Time Neural Image Compression with Mask Decay

Asymmetric Learned Image Compression with Multi-Scale Residual Block, Importance Scaling, and Post-Quantization Filtering

Enlarging Context with Low Cost: Efficient Arithmetic Coding with Trimmed Convolution