Distribution prediction for image compression: An experimental re-compressor for JPEG images

Maxim Koroteev,Yaroslav Borisov,Pavel Frolov

2023-10-16

Abstract:We propose a new scheme to re-compress JPEG images in a lossless way. Using a JPEG image as an input the algorithm partially decodes the signal to obtain quantized DCT coefficients and then re-compress them in a more effective way.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

JPEG compression history detection based on detail deviation.

Bo Wang,Ya Bin Li,Jian Xiang Zhao,Xue Sui,Xiang Wei Kong

DOI: https://doi.org/10.3934/mbe.2019277

2019-01-01

Mathematical Biosciences and Engineering

Abstract:The authenticity of the image is crucial to many cases. The efficient detection of the JPEG compression history of bitmap image could reveal the possibility of tampering on the image. In this paper, we propose a lightweight but reliable JPEG compression detection method based on image information loss. An efficient feature of the decreasing percentage of zero coefficient is proposed to detect the JPEG compression history of an image, due to the increasing JPEG compression quality factor. In our method, estimated original images are first created. Then the given image and its estimated counterpart are compressed to get the JPEG coefficient. After that, the image information loss will be calculated. Through the analysis, the goal of the compression history detection can be achieved. Extensive experimental results have demonstrated that the proposed method outperforms the existing methods.
Lossless Recompression of JPEG Images Using Transform Domain Intra Prediction

Chentian Sun,Xiaopeng Fan,Debin Zhao

DOI: https://doi.org/10.1109/TIP.2022.3226409

2022-12-07

Abstract:JPEG, which was developed 30 years ago, is the most widely used image coding format, especially favored by the resource-deficient devices, due to its simplicity and efficiency. With the evolution of the Internet and the popularity of mobile devices, a huge amount of user-generated JPEG images are uploaded to social media sites like Facebook and Flickr or stored in personal computers or notebooks, which leads to an increase in storage cost. However, the performance of JPEG is far from the state-of-art coding methods. Therefore, the lossless recompression of JPEG images is urgent to be studied, which will further reduce the storage cost while maintaining the image fidelity. In this paper, a hybrid coding framework for the lossless recompression of JPEG images (LLJPEG) using transform domain intra prediction is proposed, including block partition and intra prediction, transform and quantization, and entropy coding. Specifically, in LLJPEG, intra prediction is first used to obtain a predicted block. Then the predicted block is transformed by DCT and then quantized to obtain the predicted coefficients. After that, the predicted coefficients are subtracted from the original coefficients to get the DCT coefficient residuals. Finally, the DCT residuals are entropy coded. In LLJPEG, some new coding tools are proposed for intra prediction and the entropy coding is redesigned. The experiments show that LLJPEG can reduce the storage space by 29.43% and 26.40% on the Kodak and DIV2K datasets respectively without any loss for JPEG images, while maintaining low decoding complexity.
Learned Lossless Compression for JPEG via Frequency-Domain Prediction

Jixiang Luo,Shaohui Li,Wenrui Dai,Chenglin Li,Junni Zou,Hongkai Xiong

DOI: https://doi.org/10.48550/arXiv.2303.02666

2023-03-05

Abstract:JPEG images can be further compressed to enhance the storage and transmission of large-scale image datasets. Existing learned lossless compressors for RGB images cannot be well transferred to JPEG images due to the distinguishing distribution of DCT coefficients and raw pixels. In this paper, we propose a novel framework for learned lossless compression of JPEG images that achieves end-to-end optimized prediction of the distribution of decoded DCT coefficients. To enable learning in the frequency domain, DCT coefficients are partitioned into groups to utilize implicit local redundancy. An autoencoder-like architecture is designed based on the weight-shared blocks to realize entropy modeling of grouped DCT coefficients and independently compress the priors. We attempt to realize learned lossless compression of JPEG images in the frequency domain. Experimental results demonstrate that the proposed framework achieves superior or comparable performance in comparison to most recent lossless compressors with handcrafted context modeling for JPEG images.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Efficient Learned Lossless JPEG Recompression

Lina Guo,Yuanyuan Wang,Tongda Xu,Jixiang Luo,Dailan He,Zhenjun Ji,Shanshan Wang,Yang Wang,Hongwei Qin

2023-08-25

Abstract:JPEG is one of the most popular image compression methods. It is beneficial to compress those existing JPEG files without introducing additional distortion. In this paper, we propose a deep learning based method to further compress JPEG images losslessly. Specifically, we propose a Multi-Level Parallel Conditional Modeling (ML-PCM) architecture, which enables parallel decoding in different granularities. First, luma and chroma are processed independently to allow parallel coding. Second, we propose pipeline parallel context model (PPCM) and compressed checkerboard context model (CCCM) for the effective conditional modeling and efficient decoding within luma and chroma components. Our method has much lower latency while achieves better compression ratio compared with previous SOTA. After proper software optimization, we can obtain a good throughput of 57 FPS for 1080P images on NVIDIA T4 GPU. Furthermore, combined with quantization, our approach can also act as a lossy JPEG codec which has obvious advantage over SOTA lossy compression methods in high bit rate (bpp$>0.9$).

Image and Video Processing
Unified learning-based lossy and lossless JPEG recompression

Jianghui Zhang,Yuanyuan Wang,Lina Guo,Jixiang Luo,Tongda Xu,Yan Wang,Zhi Wang,Hongwei Qin

DOI: https://doi.org/10.1109/ICIP49359.2023.10222354

2023-12-05

Abstract:JPEG is still the most widely used image compression algorithm. Most image compression algorithms only consider uncompressed original image, while ignoring a large number of already existing JPEG images. Recently, JPEG recompression approaches have been proposed to further reduce the size of JPEG files. However, those methods only consider JPEG lossless recompression, which is just a special case of the rate-distortion theorem. In this paper, we propose a unified lossly and lossless JPEG recompression framework, which consists of learned quantization table and Markovian hierarchical variational autoencoders. Experiments show that our method can achieve arbitrarily low distortion when the bitrate is close to the upper bound, namely the bitrate of the lossless compression model. To the best of our knowledge, this is the first learned method that bridges the gap between lossy and lossless recompression of JPEG images.

Computer Vision and Pattern Recognition,Artificial Intelligence
End-to-End Image Compression with Probabilistic Decoding

Haichuan Ma,Dong Liu,Cunhui Dong,Li,Feng Wu

2021-01-01

Abstract:Lossy image compression is a many-to-one process, thus one bitstream corresponds to multiple possible original images, especially at low bit rates. However, this nature was seldom considered in previous studies on image compression, which usually chose one possible image as reconstruction, e.g. the one with the maximal a posteriori probability. We propose a learned image compression framework to natively support probabilistic decoding. The compressed bitstream is decoded into a series of parameters that instantiate a pre-chosen distribution; then the distribution is used by the decoder to sample and reconstruct images. The decoder may adopt different sampling strategies and produce diverse reconstructions, among which some have higher signal fidelity and some others have better visual quality. The proposed framework is dependent on a revertible neural network-based transform to convert pixels into coefficients that obey the pre-chosen distribution as much as possible. Our code and models will be made publicly available.
Real-Time Adaptive Image Compression

Oren Rippel,Lubomir Bourdev

DOI: https://doi.org/10.48550/arXiv.1705.05823

2017-05-17

Abstract:We present a machine learning-based approach to lossy image compression which outperforms all existing codecs, while running in real-time. Our algorithm typically produces files 2.5 times smaller than JPEG and JPEG 2000, 2 times smaller than WebP, and 1.7 times smaller than BPG on datasets of generic images across all quality levels. At the same time, our codec is designed to be lightweight and deployable: for example, it can encode or decode the Kodak dataset in around 10ms per image on GPU. Our architecture is an autoencoder featuring pyramidal analysis, an adaptive coding module, and regularization of the expected codelength. We also supplement our approach with adversarial training specialized towards use in a compression setting: this enables us to produce visually pleasing reconstructions for very low bitrates.

Machine Learning,Computer Vision and Pattern Recognition
Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Xiao Shu,Xiaolin Wu

DOI: https://doi.org/10.48550/arXiv.1601.01339

2016-01-07

Abstract:Small compression noises, despite being transparent to human eyes, can adversely affect the results of many image restoration processes, if left unaccounted for. Especially, compression noises are highly detrimental to inverse operators of high-boosting (sharpening) nature, such as deblurring and superresolution against a convolution kernel. By incorporating the non-linear DCT quantization mechanism into the formulation for image restoration, we propose a new sparsity-based convex programming approach for joint compression noise removal and image restoration. Experimental results demonstrate significant performance gains of the new approach over existing image restoration methods.

Computer Vision and Pattern Recognition
Hybrid Adaptive Lossless Image Compression Based on Discrete Wavelet Transform

Roman Starosolski

DOI: https://doi.org/10.3390/e22070751

IF: 2.738

2020-07-09

Entropy

Abstract:A new hybrid transform for lossless image compression exploiting a discrete wavelet transform (DWT) and prediction is the main new contribution of this paper. Simple prediction is generally considered ineffective in conjunction with DWT but we applied it to subbands of DWT modified using reversible denoising and lifting steps (RDLSs) with step skipping. The new transform was constructed in an image-adaptive way using heuristics and entropy estimation. For a large and diverse test set consisting of 499 photographic and 247 non-photographic (screen content) images, we found that RDLS with step skipping allowed effectively combining DWT with prediction. Using prediction, we nearly doubled the JPEG 2000 compression ratio improvements that could be obtained using RDLS with step skipping. Because for some images it might be better to apply prediction instead of DWT, we proposed compression schemes with various tradeoffs, which are practical contributions of this study. Compared with unmodified JPEG 2000, one scheme improved the compression ratios of photographic and non-photographic images, on average, by 1.2% and 30.9%, respectively, at the cost of increasing the compression time by 2% and introducing only minimal modifications to JPEG 2000. Greater ratio improvements, exceeding 2% and 32%, respectively, are attainable at a greater cost.

physics, multidisciplinary
Learned Lossless JPEG Transcoding Via Joint Lossy and Residual Compression

Xiaoshuai Fan,Xin Li,Zhibo Chen

DOI: https://doi.org/10.1109/vcip56404.2022.10008809

2022-01-01

Abstract:As a commonly-used image compression format, JPEG has been broadly applied in the transmission and storage of images. To further reduce the compression cost while maintaining the quality of JPEG images, lossless transcoding technology has been proposed to recompress the compressed JPEG image in the DCT domain. Previous works, on the other hand, typically reduce the redundancy of DCT coefficients and optimize the probability prediction of entropy coding in a hand-crafted manner that lacks generalization ability and flexibility. To tackle the above challenge, we propose the learned lossless JPEG transcoding framework via Joint Lossy and Residual Compression. Instead of directly optimizing the entropy estimation, we focus on the redundancy that exists in the DCT coefficients. To the best of our knowledge, we are the first to utilize the learned end-to-end lossy transform coding to reduce the redundancy of DCT coefficients in a compact representational domain. We also introduce residual compression for lossless transcoding, which adaptively learns the distribution of residual DCT coefficients before compressing them using context-based entropy coding. Our proposed transcoding architecture shows significant superiority in the compression of JPEG images thanks to the collaboration of learned lossy transform coding and residual entropy coding. Extensive experiments on multiple datasets have demonstrated that our proposed framework can achieve about 21.49% bits saving in average based on JPEG compression, which outperforms the typical lossless transcoding framework JPEG-XL by 3.51%.
Lossless compression of JPEG coded photo albums

Hao Wu,Xiaoyan Sun,Jingyu Yang,Feng Wu

DOI: https://doi.org/10.1109/VCIP.2014.7051625

2014-01-01

Abstract:The explosion in digital photography poses a significant challenge when it comes to photo storage for both personal devices and the Internet. In this paper, we propose a novel lossless compression method to further reduce the storage size of a set of JPEG coded correlated images. In this method, we propose jointly removing the inter-image redundancy in the feature, spatial, and frequency domains. For each album, we first organize the images into a pseudo video by minimizing the global predictive cost in the feature domain. We then introduce a disparity compensation method to enhance the spatial correlation between images. Finally, the redundancy between the compensated signal and the corresponding target image is adaptively reduced in the frequency domain. Moreover, our proposed scheme is able to losslessly recover not only raw images but also JPEG files. Experimental results demonstrate the efficiency of our proposed lossless compression, which achieves more than 12% bit-saving on average compared with JPEG coded albums.
High efficiency lossless image recompression algorithm with asymmetric numeral systems for real-time mobile application

Qinghua Sheng,Haonan Zhu,Haixiang Sheng,Xiaofang Huang,Jie Jiang,Changcai Lai

DOI: https://doi.org/10.1007/s11554-023-01346-z

IF: 2.293

2023-07-23

Journal of Real-Time Image Processing

Abstract:JPEG images are widely used by individual users, data centers, cloud storages, and network file systems. The huge transmission and storage bandwidth of existing JPEG images is becoming a big challenge due to its low compression efficiency. Some methods such as Google's Brunsli can further compress these JPEG images adequately and restore them back to JPEG format losslessly when needed, but its decoding speed is not fast enough especially for real-time mobile applications. To further reduce its decoding complexity, we proposed three optimizations based on Brunsli, which include using asymmetric numeral systems coding to replace the existing arithmetic coding, designing the joint encoding of multiple symbols and cache-friendly optimizing the data structures. Experimental results demonstrate that compared with Brunsli, the proposed method achieves average 1.86–2.25 times decoding faster on mobile platform with comparable compression efficiency which is really valuable for power sensitive real-time mobile applications.

computer science, artificial intelligence,engineering, electrical & electronic,imaging science & photographic technology
Lossless Compression of JPEG Coded Photo Collections.

Hao Wu,Xiaoyan Sun,Jing-Yu Yang,Wenjun Zeng,Feng Wu

DOI: https://doi.org/10.1109/TIP.2016.2551366

2016-01-01

Abstract:The explosion of digital photos has posed a significant challenge to photo storage and transmission for both personal devices and cloud platforms. In this paper, we propose a novel lossless compression method to further reduce the size of a set of JPEG coded correlated images without any loss of information. The proposed method jointly removes inter/intra image redundancy in the feature, spatial, and frequency domains. For each collection, we first organize the images into a pseudo video by minimizing the global prediction cost in the feature domain. We then present a hybrid disparity compensation method to better exploit both the global and local correlations among the images in the spatial domain. Furthermore, the redundancy between each compensated signal and the corresponding target image is adaptively reduced in the frequency domain. Experimental results demonstrate the effectiveness of the proposed lossless compression method. Compared with the JPEG coded image collections, our method achieves average bit savings of more than 31%.
Pixel-Copy Prediction Based Lossless Reference Frame Compression.

Weizhe Xu,Fangfa Fu,Binglei Lou,Yao Wang,Jinxiang Wang

DOI: https://doi.org/10.1007/978-3-030-00767-6_46

2018-01-01

Abstract:With the increasing demands of high definition and high resolution for video applications, the bandwidth and power consumption of accessing external memory storing reference frames during motion estimation bring serious pressure on practical video coding systems. Lossless reference frame compression is a proper method to decrease memory size and access bandwidth without any quality loss. This paper proposed a pixel-copy prediction based lossless reference frame compression. The method predicts current pixel by copying adjacent reconstructed pixels adaptively based on the estimations of the differences between the original pixel and the left and upper reconstructed samples. Then residuals are encoded by Huffman encoding to generate bit stream. Realized with HEVC reference software HM-16.5, experimental results show that our method achieves averagely 67.45% data reduction ratio (DRR) for luminance component that outperforms pervious works on computation complexity and compression efficiency.
Learned Image Compression for Machine Perception

Felipe Codevilla,Jean Gabriel Simard,Ross Goroshin,Chris Pal

DOI: https://doi.org/10.48550/arXiv.2111.02249

2021-11-03

Abstract:Recent work has shown that learned image compression strategies can outperform standard hand-crafted compression algorithms that have been developed over decades of intensive research on the rate-distortion trade-off. With growing applications of computer vision, high quality image reconstruction from a compressible representation is often a secondary objective. Compression that ensures high accuracy on computer vision tasks such as image segmentation, classification, and detection therefore has the potential for significant impact across a wide variety of settings. In this work, we develop a framework that produces a compression format suitable for both human perception and machine perception. We show that representations can be learned that simultaneously optimize for compression and performance on core vision tasks. Our approach allows models to be trained directly from compressed representations, and this approach yields increased performance on new tasks and in low-shot learning settings. We present results that improve upon segmentation and detection performance compared to standard high quality JPGs, but with representations that are four to ten times smaller in terms of bits per pixel. Further, unlike naive compression methods, at a level ten times smaller than standard JEPGs, segmentation and detection models trained from our format suffer only minor degradation in performance.

Image and Video Processing,Computer Vision and Pattern Recognition
A Cnn-Based Image Compression Scheme Compatible With Jpeg-2000

Haichuan Ma,Dong Liu,Ruiqin Xiong,Feng Wu

DOI: https://doi.org/10.1109/icip.2019.8803835

2019-01-01

Abstract:We propose a convolutional neural network (CNN) based image compression scheme that is compatible with JPEG-2000. Specifically, our scheme reuses the existing JPEG-2000 encoders to achieve bitstream, and features two components in addition to JPEG-2000: bitstream re-compression and decoder-side post-processing. First, we propose an advanced arithmetic codec that adopts CNN-based probability estimation to exploit the correlation between wavelet coefficients within and across subbands. Second, we propose a CNN-based post-processing method to improve the quality of reconstructed images. Experimental results show that the proposed two CNN-based components both help improve the compression efficiency by a significant margin.
Region-Based Prediction for Image Compression in the Cloud

Jean Begaint,Dominique Thoreau,Philippe Guillotel,Christine Guillemot

DOI: https://doi.org/10.1109/TIP.2017.2788192

Abstract:Thanks to the increasing number of images stored in the cloud, external image similarities can be leveraged to efficiently compress images by exploiting inter-images correlations. In this paper, we propose a novel image prediction scheme for cloud storage. Unlike current state-of-the-art methods, we use a semi-local approach to exploit inter-image correlation. The reference image is first segmented into multiple planar regions determined from matched local features and super-pixels. The geometric and photometric disparities between the matched regions of the reference image and the current image are then compensated. Finally, multiple references are generated from the estimated compensation models and organized in a pseudo-sequence to differentially encode the input image using classical video coding tools. Experimental results demonstrate that the proposed approach yields significant rate-distortion performance improvements compared with the current image inter-coding solutions such as high efficiency video coding.
Quantized Decoder in Learned Image Compression for Deterministic Reconstruction

Esin Koyuncu,Timofey Solovyev,Johannes Sauer,Elena Alshina,André Kaup

2024-01-11

Abstract:Learned image compression has a problem of non-bit-exact reconstruction due to different calculations of floating point arithmetic on different devices. This paper shows a method to achieve a deterministic reconstructed image by quantizing only the decoder of the learned image compression model. From the implementation perspective of an image codec, it is beneficial to have the results reproducible when decoded on different devices. In this paper, we study quantization of weights and activations without overflow of accumulator in all decoder subnetworks. We show that the results are bit-exact at the output, and the resulting BD-rate loss of quantization of decoder is 0.5 % in the case of 16-bit weights and 16-bit activations, and 7.9 % in the case of 8-bit weights and 16-bit activations.

Image and Video Processing
Prediction Based JPEG2000 Rate Control Algorithm

ZHAO Binjie,CUI Huijuan,TANG Kun

DOI: https://doi.org/10.16511/j.cnki.qhdxxb.2010.01.016

2010-01-01

Abstract:The conventional post-compression rate-distortion optimization(PCRD-opt) scheme in JPEG2000 does not efficiently use the computational power and working memory when the target bit-rate is low.A prediction based JPEG2000 rate control algorithm is proposed to avoid unnecessary coding pass by predicting the rate-distortion slope with given target bit-rate and stopping block coding in advance.The computations and memory usage is reduced efficiently without sacrificing the image quality therefore.At a bit rate of 0.1 bit per pixel,the computational complexity and working memory of Tier-1 coding is reduced by up to 90% compared with PCRD-opt,with no reduction in the peak signal-to-noise(PSNR).
Probability Prediction Network With Checkerboard Prior for Lossless Remote Sensing Image Compression

Xuxiang Feng,Enjia Gu,Yongshan Zhang,An Li

DOI: https://doi.org/10.1109/jstars.2024.3462948

IF: 4.715

2024-10-16

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:Lossless remote sensing image compression aims to reduce the storage size of images without any information loss, ensuring that the decompressed image is identical to the original one. Most existing methods focus on lossy image compression that reduce the storage cost with certain data loss. It is challenging to perform lossless compression due to the very high-resolution images, long encoding–decoding time, and low compression efficiency. In this article, we propose a lossless compression framework that compresses remote sensing images in a coarse-to-fine manner. Specifically, checkerboard segmentation is applied on each image to generate six subimages from the main diagonal and counter-diagonal of each channel to maximally preserve the detail and structural information. The subimages from the main diagonal are initially compressed by a traditional compression method, while the subimages from the counter-diagonal are compressed channel by channel using our proposed probability prediction network (P2Net) and arithmetic coding with the previously encoded subimages from both the main diagonal and counter-diagonal as prior knowledge. The proposed P2Net consists of a upsampling module, a feature enhancement module, a downsampling module, and a probability prediction module to learn the discrete probability distribution of pixels. Lossless compression is conducted with arithmetic coding on the discrete probability distribution. To the best of our knowledge, this is the first deep learning-based lossless compression framework for three-channel remote sensing images. Experiments demonstrate that our framework outperforms the state-of-the-art methods and requires about 3.4 s to compress a 1024 3 image with 2.9% efficiency improvement compared to JPEG XL.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geography, physical

Distribution prediction for image compression: An experimental re-compressor for JPEG images

JPEG compression history detection based on detail deviation.

Lossless Recompression of JPEG Images Using Transform Domain Intra Prediction

Learned Lossless Compression for JPEG via Frequency-Domain Prediction

Efficient Learned Lossless JPEG Recompression

Unified learning-based lossy and lossless JPEG recompression

End-to-End Image Compression with Probabilistic Decoding

Real-Time Adaptive Image Compression

Quality Adaptive Low-Rank Based JPEG Decoding with Applications

Hybrid Adaptive Lossless Image Compression Based on Discrete Wavelet Transform

Learned Lossless JPEG Transcoding Via Joint Lossy and Residual Compression

Lossless compression of JPEG coded photo albums

High efficiency lossless image recompression algorithm with asymmetric numeral systems for real-time mobile application

Lossless Compression of JPEG Coded Photo Collections.

Pixel-Copy Prediction Based Lossless Reference Frame Compression.

Learned Image Compression for Machine Perception

A Cnn-Based Image Compression Scheme Compatible With Jpeg-2000

Region-Based Prediction for Image Compression in the Cloud

Quantized Decoder in Learned Image Compression for Deterministic Reconstruction

Prediction Based JPEG2000 Rate Control Algorithm

Probability Prediction Network With Checkerboard Prior for Lossless Remote Sensing Image Compression