Learned Image Compression with Text Quality Enhancement

Chih-Yu Lai,Dung Tran,Kazuhito Koishida

2024-02-14

Abstract:Learned image compression has gained widespread popularity for their efficiency in achieving ultra-low bit-rates. Yet, images containing substantial textual content, particularly screen-content images (SCI), often suffers from text distortion at such compressed levels. To address this, we propose to minimize a novel text logit loss designed to quantify the disparity in text between the original and reconstructed images, thereby improving the perceptual quality of the reconstructed text. Through rigorous experimentation across diverse datasets and employing state-of-the-art algorithms, our findings reveal significant enhancements in the quality of reconstructed text upon integration of the proposed loss function with appropriate weighting. Notably, we achieve a Bjontegaard delta (BD) rate of -32.64% for Character Error Rate (CER) and -28.03% for Word Error Rate (WER) on average by applying the text logit loss for two screenshot datasets. Additionally, we present quantitative metrics tailored for evaluating text quality in image compression tasks. Our findings underscore the efficacy and potential applicability of our proposed text logit loss function across various text-aware image compression contexts.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the issue of text distortion in compressed images at ultra-low bit rates, especially for screen content images (SCI) that contain a large amount of text content. Traditional image compression methods, while performing well on natural images, often lead to a decline in text quality when dealing with screen content images due to factors such as coding artifacts and histogram distribution differences. To this end, the authors propose a new text logit loss function, aimed at quantifying the text differences between the original and reconstructed images, thereby improving the perceptual quality of the reconstructed text.

Specifically, by introducing this loss function into the image compression model and combining it with appropriate weight adjustments, experimental results show that after applying the text logit loss on two screenshot datasets, the character error rate (CER) and word error rate (WER) were reduced by an average of 32.64% and 28.03%, respectively. Additionally, the authors propose quantitative metrics specifically for evaluating text quality in image compression tasks, further validating the effectiveness and potential application value of the proposed method.