Abstract:Image compression emerges as a pivotal tool in the efficient handling and transmission of digital images. Its ability to substantially reduce file size not only facilitates enhanced data storage capacity but also potentially brings advantages to the development of continual machine learning (ML) systems, which learn new knowledge incrementally from sequential data. Continual ML systems often rely on storing representative samples, also known as exemplars, within a limited memory constraint to maintain the performance on previously learned data. These methods are known as memory replay-based algorithms and have proven effective at mitigating the detrimental effects of catastrophic forgetting. Nonetheless, the limited memory buffer size often falls short of adequately representing the entire data distribution. In this paper, we explore the use of image compression as a strategy to enhance the buffer's capacity, thereby increasing exemplar diversity. However, directly using compressed exemplars introduces domain shift during continual ML, marked by a discrepancy between compressed training data and uncompressed testing data. Additionally, it is essential to determine the appropriate compression algorithm and select the most effective rate for continual ML systems to balance the trade-off between exemplar quality and quantity. To this end, we introduce a new framework to incorporate image compression for continual ML including a pre-processing data compression step and an efficient compression rate/algorithm selection method. We conduct extensive experiments on CIFAR-100 and ImageNet datasets and show that our method significantly improves image classification accuracy in continual ML settings.

Image Compression by Learning to Minimize the Total Error

A Unified Active and Semi-Supervised Learning Framework for Image Compression

Image Compression Method Based on Active Learning and Semi-Supervised Learning

Context-Based Lossless Compression of Mosaic Image with Bayer Pattern

Learned Image Compression for Machine Perception

Learned Image Compression with Large Capacity and Low Redundancy of Latent Representation

Color Learning for Image Compression

Learning Content-Weighted Deep Image Compression

Efficient Learned Image Compression with Selective Kernel Residual Module and Channel-Wise Causal Context Model.

Latent-Separated Global Prediction for Learned Image Compression.

Learning End-to-End Lossy Image Compression: A Benchmark

Efficient Learning Based Sub-pixel Image Compression.

Machine Perception-Driven Image Compression: A Layered Generative Approach

Probing Image Compression For Class-Incremental Learning

Dual-stage feedback network for lightweight color image compression artifact reduction

Learning Convolutional Networks for Content-Weighted Image Compression

TinyLIC-High efficiency lossy image compression method

Efficient Learned Lossless JPEG Recompression

Fidelity-preserving Learning-Based Image Compression: Loss Function and Subjective Evaluation Methodology

Multi-Modality Deep Network for Extreme Learned Image Compression

Deep Image Compression via End-to-End Learning