About some compression algorithms

Orchidea Maria Lecian,Brunello Tirozzi

2023-06-20

Abstract:We use neural network algorithms for finding compression methods of images in the framework of iterated function systems which is a collection of the transformations of the interval $(0, 1)$ satisfying suitable properties.

Image and Video Processing,Machine Learning

What problem does this paper attempt to address?

DISCUSSION ON FRACTAL IMAGE COMPRESSION METHOD BASDE ON ITERATED FUNCTION SYSTEM

Mu YANG,Miao-liang ZHU

1999-01-01

Abstract:We propose a new method of simplifying the set of Domain Blocks in the study of the fractal image compression method based on the iterated function system (IFS). As compared with the traditional algorithm,this method has a less computing complexity.
Breaking the Barriers of One-to-One Usage of Implicit Neural Representation in Image Compression: A Linear Combination Approach with Performance Guarantees

Sai Sanjeet,Seyyedali Hosseinalipour,Jinjun Xiong,Masahiro Fujita,Bibhu Datta Sahoo

2024-09-20

Abstract:In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a transformative approach to image compression. INR leverages the function approximation capabilities of neural networks to represent various types of data. While previous research has employed INR to achieve compression by training small networks to reconstruct large images, this work proposes a novel advancement: representing multiple images with a single network. By modifying the loss function during training, the proposed approach allows a small number of weights to represent a large number of images, even those significantly different from each other. A thorough analytical study of the convergence of this new training method is also carried out, establishing upper bounds that not only confirm the validity of the method but also offer insights into optimal hyperparameter design. The proposed method is evaluated on the Kodak, ImageNet, and CIFAR-10 datasets. Experimental results demonstrate that all 24 images in the Kodak dataset can be represented by linear combinations of two sets of weights, achieving a peak signal-to-noise ratio (PSNR) of 26.5 dB with as low as 0.2 bits per pixel (BPP). The proposed method matches the rate-distortion performance of state-of-the-art image codecs, such as BPG, on the CIFAR-10 dataset. Additionally, the proposed method maintains the fundamental properties of INR, such as arbitrary resolution reconstruction of images.

Image and Video Processing
On Efficient Neural Network Architectures for Image Compression

Yichi Zhang,Zhihao Duan,Fengqing Zhu

2024-06-15

Abstract:Recent advances in learning-based image compression typically come at the cost of high complexity. Designing computationally efficient architectures remains an open challenge. In this paper, we empirically investigate the impact of different network designs in terms of rate-distortion performance and computational complexity. Our experiments involve testing various transforms, including convolutional neural networks and transformers, as well as various context models, including hierarchical, channel-wise, and space-channel context models. Based on the results, we present a series of efficient models, the final model of which has comparable performance to recent best-performing methods but with significantly lower complexity. Extensive experiments provide insights into the design of architectures for learned image compression and potential direction for future research. The code is available at \url{<a class="link-external link-https" href="https://gitlab.com/viper-purdue/efficient-compression" rel="external noopener nofollow">this https URL</a>}.

Image and Video Processing
A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compression

Nora Hofer,Rainer Böhme

2024-10-15

Abstract:Neural compression has the potential to revolutionize lossy image compression. Based on generative models, recent schemes achieve unprecedented compression rates at high perceptual quality but compromise semantic fidelity. Details of decompressed images may appear optically flawless but semantically different from the originals, making compression errors difficult or impossible to detect. We explore the problem space and propose a provisional taxonomy of miscompressions. It defines three types of 'what happens' and has a binary 'high impact' flag indicating miscompressions that alter symbols. We discuss how the taxonomy can facilitate risk communication and research into mitigations.

Cryptography and Security,Computer Vision and Pattern Recognition
Image-Compression Techniques: Classical and "Region-of-Interest-Based" Approaches Presented in Recent Papers

Vlad-Ilie Ungureanu,Paul Negirla,Adrian Korodi

DOI: https://doi.org/10.3390/s24030791

IF: 3.9

2024-01-25

Sensors

Abstract:Image compression is a vital component for domains in which the computational resources are usually scarce such as automotive or telemedicine fields. Also, when discussing real-time systems, the large amount of data that must flow through the system can represent a bottleneck. Therefore, the storage of images, alongside the compression, transmission, and decompression procedures, becomes vital. In recent years, many compression techniques that only preserve the quality of the region of interest of an image have been developed, the other parts being either discarded or compressed with major quality loss. This paper proposes a study of relevant papers from the last decade which are focused on the selection of a region of interest of an image and on the compression techniques that can be applied to that area. To better highlight the novelty of the hybrid methods, classical state-of-the-art approaches are also analyzed. The current work will provide an overview of classical and hybrid compression methods alongside a categorization based on compression ratio and other quality factors such as mean-square error and peak signal-to-noise ratio, structural similarity index measure, and so on. This overview can help researchers to develop a better idea of what compression algorithms are used in certain domains and to find out if the presented performance parameters are of interest for the intended purpose.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Iterative Approach to Image Compression with Noise : Optimizing Spatial and Tonal Data

Zakaria Belhachmi,Thomas Jacumin

DOI: https://doi.org/10.48550/arXiv.2209.14706

2022-09-29

Abstract:We consider some iterative methods for finding the best interpolation data in the images compression with noise. The interpolation data consists of the set of pixels and their grey/color values. The aim in the iterative approach is to allow the change of the data dynamically during the inpainting process for a reconstruction of the image that includes the enhancement and denoising effects. The governing PDE model of this approach is a fully parabolic problem where the set of stored pixels is time dependent. We consider the semi-discrete dynamical system associated to the model which gives rise to an iterative method where the stored data are modified during the iterations for best outcomes. Finding the compression sets follows from a shape-based analysis within the $\Gamma$-convergence tools, in particular well suited topological asymptotic and a ``fat pixels'' approach are considered to obtain an analytic characterization of the optimal sets in the sense of shape optimization theory. We perform the analysis and derive several iterative algorithms that we implement and compare to obtain the most efficient strategies of compression and inpainting for noisy images. Some numerical computations are presented to confirm the theoretical findings. Finally, we propose a modified model that allows the inpainting data to change with the iteration and compare the resulting new method to the ``probabilistic'' ones from the state-of-the-art.

Analysis of PDEs
Taxonomy and Evaluation of Structured Compression of Convolutional Neural Networks

Andrey Kuzmin,Markus Nagel,Saurabh Pitre,Sandeep Pendyam,Tijmen Blankevoort,Max Welling

DOI: https://doi.org/10.48550/arXiv.1912.09802

2019-12-20

Abstract:The success of deep neural networks in many real-world applications is leading to new challenges in building more efficient architectures. One effective way of making networks more efficient is neural network compression. We provide an overview of existing neural network compression methods that can be used to make neural networks more efficient by changing the architecture of the network. First, we introduce a new way to categorize all published compression methods, based on the amount of data and compute needed to make the methods work in practice. These are three 'levels of compression solutions'. Second, we provide a taxonomy of tensor factorization based and probabilistic compression methods. Finally, we perform an extensive evaluation of different compression techniques from the literature for models trained on ImageNet. We show that SVD and probabilistic compression or pruning methods are complementary and give the best results of all the considered methods. We also provide practical ways to combine them.

Machine Learning,Computer Vision and Pattern Recognition
An Introduction to Neural Data Compression

Yibo Yang,Stephan Mandt,Lucas Theis

2023-08-17

Abstract:Neural compression is the application of neural networks and other machine learning methods to data compression. Recent advances in statistical machine learning have opened up new possibilities for data compression, allowing compression algorithms to be learned end-to-end from data using powerful generative models such as normalizing flows, variational autoencoders, diffusion probabilistic models, and generative adversarial networks. The present article aims to introduce this field of research to a broader machine learning audience by reviewing the necessary background in information theory (e.g., entropy coding, rate-distortion theory) and computer vision (e.g., image quality assessment, perceptual metrics), and providing a curated guide through the essential ideas and methods in the literature thus far.

Machine Learning,Information Theory,Image and Video Processing
COIN++: Neural Compression Across Modalities

Emilien Dupont,Hrushikesh Loya,Milad Alizadeh,Adam Goliński,Yee Whye Teh,Arnaud Doucet

DOI: https://doi.org/10.48550/arXiv.2201.12904

2022-12-08

Abstract:Neural compression algorithms are typically based on autoencoders that require specialized encoder and decoder architectures for different data modalities. In this paper, we propose COIN++, a neural compression framework that seamlessly handles a wide range of data modalities. Our approach is based on converting data to implicit neural representations, i.e. neural functions that map coordinates (such as pixel locations) to features (such as RGB values). Then, instead of storing the weights of the implicit neural representation directly, we store modulations applied to a meta-learned base network as a compressed code for the data. We further quantize and entropy code these modulations, leading to large compression gains while reducing encoding time by two orders of magnitude compared to baselines. We empirically demonstrate the feasibility of our method by compressing various data modalities, from images and audio to medical and climate data.

Machine Learning,Computer Vision and Pattern Recognition,Image and Video Processing
Towards Image Understanding from Deep Compression without Decoding

Robert Torfason,Fabian Mentzer,Eirikur Agustsson,Michael Tschannen,Radu Timofte,Luc Van Gool

DOI: https://doi.org/10.48550/arXiv.1803.06131

2018-03-16

Abstract:Motivated by recent work on deep neural network (DNN)-based image compression methods showing potential improvements in image quality, savings in storage, and bandwidth reduction, we propose to perform image understanding tasks such as classification and segmentation directly on the compressed representations produced by these compression methods. Since the encoders and decoders in DNN-based compression methods are neural networks with feature-maps as internal representations of the images, we directly integrate these with architectures for image understanding. This bypasses decoding of the compressed representation into RGB space and reduces computational cost. Our study shows that accuracies comparable to networks that operate on compressed RGB images can be achieved while reducing the computational complexity up to $2\times$. Furthermore, we show that synergies are obtained by jointly training compression networks with classification networks on the compressed representations, improving image quality, classification accuracy, and segmentation performance. We find that inference from compressed representations is particularly advantageous compared to inference from compressed RGB images for aggressive compression rates.

Computer Vision and Pattern Recognition
Streaming Neural Images

Marcos V. Conde,Andy Bigos,Radu Timofte

2024-09-26

Abstract:Implicit Neural Representations (INRs) are a novel paradigm for signal representation that have attracted considerable interest for image compression. INRs offer unprecedented advantages in signal resolution and memory efficiency, enabling new possibilities for compression techniques. However, the existing limitations of INRs for image compression have not been sufficiently addressed in the literature. In this work, we explore the critical yet overlooked limiting factors of INRs, such as computational cost, unstable performance, and robustness. Through extensive experiments and empirical analysis, we provide a deeper and more nuanced understanding of implicit neural image compression methods such as Fourier Feature Networks and Siren. Our work also offers valuable insights for future research in this area.

Computer Vision and Pattern Recognition,Image and Video Processing
The Compression method and applications

Theophilus Agama

2024-04-08

Abstract:In this paper we introduce and develop the method of compression of points in space. We introduce the notion of the mass, the rank, the entropy, the cover and the energy of compression. We leverage this method to prove some class of inequalities related to Diophantine equations. In particular, we show that for each $L<n-1$ and for each $K>n-1$, there exist some $(x_1,x_2,\ldots,x_n)\in \mathbb{N}^n$ with $x_i\neq x_j$ for all $1\leq i<j\leq n$ such that \begin{align}\frac{1}{K^{n}}\ll \prod \limits_{j=1}^{n}\frac{1}{x_j}\ll \frac{\log (\frac{n}{L})}{nL^{n-1}}\nonumber \end{align}and that for each $L>n-1$ there exist some $(x_1,x_2,\ldots,x_n)$ with $x_i\neq x_j$ for all $1\leq i<j\leq n$ and some $s\geq 2$ such that \begin{align}\sum \limits_{j=1}^{n}\frac{1}{x_j^s}\gg s\frac{n}{L^{s-1}}.\nonumber \end{align}

Number Theory
Extreme Compression of Adaptive Neural Images

Leo Hoshikawa,Marcos V. Conde,Takeshi Ohashi,Atsushi Irie

2024-06-05

Abstract:Implicit Neural Representations (INRs) and Neural Fields are a novel paradigm for signal representation, from images and audio to 3D scenes and videos. The fundamental idea is to represent a signal as a continuous and differentiable neural network. This idea offers unprecedented benefits such as continuous resolution and memory efficiency, enabling new compression techniques. However, representing data as neural networks poses new challenges. For instance, given a 2D image as a neural network, how can we further compress such a neural image?. In this work, we present a novel analysis on compressing neural fields, with the focus on images. We also introduce Adaptive Neural Images (ANI), an efficient neural representation that enables adaptation to different inference or transmission requirements. Our proposed method allows to reduce the bits-per-pixel (bpp) of the neural image by 4x, without losing sensitive details or harming fidelity. We achieve this thanks to our successful implementation of 4-bit neural representations. Our work offers a new framework for developing compressed neural fields.

Computer Vision and Pattern Recognition,Artificial Intelligence,Graphics,Multimedia
A novel framework for image-to-image translation and image compression

Fei Yang,Yaxing Wang,Luis Herranz,Yongmei Cheng,Mikhail G. Mozerov

DOI: https://doi.org/10.1016/j.neucom.2022.08.048

IF: 6

2022-10-07

Neurocomputing

Abstract:Data-driven paradigms using machine learning are becoming ubiquitous in image processing and communications. In particular, image-to-image (I2I) translation is a generic and widely used approach to image processing problems, such as image synthesis, style transfer, and image restoration. At the same time, neural image compression has emerged as a data-driven alternative to traditional coding approaches in visual communications. In this paper, we study the combination of these two paradigms into a joint I2I compression and translation framework, focusing on multi-domain image synthesis. We first propose distributed I2I translation by integrating quantization and entropy coding into an I2I translation framework (i.e. I2Icodec). In practice, the image compression functionality (i.e. autoencoding) is also desirable, requiring to deploy alongside I2Icodec a regular image codec. Thus, we further propose a unified framework that allows both translation and autoencoding capabilities in a single codec. Adaptive residual blocks conditioned on the translation/compression mode provide flexible adaptation to the desired functionality. The experiments show promising results in both I2I translation and image compression using a single model.

computer science, artificial intelligence
Implicit Neural Image Field for Biological Microscopy Image Compression

Gaole Dai,Cheng-Ching Tseng,Qingpo Wuwu,Rongyu Zhang,Shaokang Wang,Ming Lu,Tiejun Huang,Yu Zhou,Ali Ata Tuz,Matthias Gunzer,Jianxu Chen,Shanghang Zhang

2024-05-29

Abstract:The rapid pace of innovation in biological microscopy imaging has led to large images, putting pressure on data storage and impeding efficient sharing, management, and visualization. This necessitates the development of efficient compression solutions. Traditional CODEC methods struggle to adapt to the diverse bioimaging data and often suffer from sub-optimal compression. In this study, we propose an adaptive compression workflow based on Implicit Neural Representation (INR). This approach permits application-specific compression objectives, capable of compressing images of any shape and arbitrary pixel-wise decompression. We demonstrated on a wide range of microscopy images from real applications that our workflow not only achieved high, controllable compression ratios (e.g., 512x) but also preserved detailed information critical for downstream analysis.

Artificial Intelligence
Image Compression with Iterated Function Systems, Finite Automata and Zerotrees: Grand Unification

Oleg Kiselyov,Paul Fisher

DOI: https://doi.org/10.1109/DCC.1996.488375

2000-03-16

Abstract:Fractal image compression, Culik's image compression and zerotree prediction coding of wavelet image decomposition coefficients succeed only because typical images being compressed possess a significant degree of self-similarity. Besides the common concept, these methods turn out to be even more tightly related, to the point of algorithmical reducibility of one technique to another. The goal of the present paper is to demonstrate these relations. The paper offers a plain-term interpretation of Culik's image compression, in regular image processing terms, without resorting to finite state machines and similar lofty language. The interpretation is shown to be algorithmically related to an IFS fractal image compression method: an IFS can be exactly transformed into Culik's image code. Using this transformation, we will prove that in a self-similar (part of an) image any zero wavelet coefficient is the root of a zerotree, or its branch. The paper discusses the zerotree coding of (wavelet/projection) coefficients as a common predictor/corrector, applied vertically through different layers of a multiresolutional decomposition, rather than within the same view. This interpretation leads to an insight into the evolution of image compression techniques: from a causal single-layer prediction, to non-causal same-view predictions (wavelet decomposition among others) and to a causal cross-layer prediction (zero-trees, Culik's method).

Computer Vision and Pattern Recognition
A study for Image compression using Re-Pair algorithm

Pasquale De Luca,Vincenzo Maria Russiello,Raffaele Ciro Sannino,Lorenzo Valente

DOI: https://doi.org/10.48550/arXiv.1901.10744

2019-02-13

Abstract:The compression is an important topic in computer science which allows we to storage more amount of data on our data storage. There are several techniques to compress any file. In this manuscript will be described the most important algorithm to compress images such as JPEG and it will be compared with another method to retrieve good reason to not use this method on images. So to compress the text the most encoding technique known is the Huffman Encoding which it will be explained in exhaustive way. In this manuscript will showed how to compute a text compression method on images in particular the method and the reason to choice a determinate image format against the other. The method studied and analyzed in this manuscript is the Re-Pair algorithm which is purely for grammatical context to be compress. At the and it will be showed the good result of this application.

Multimedia,Computer Vision and Pattern Recognition
Compression with Bayesian Implicit Neural Representations

Zongyu Guo,Gergely Flamich,Jiajun He,Zhibo Chen,José Miguel Hernández-Lobato

2023-10-29

Abstract:Many common types of data can be represented as functions that map coordinates to signal values, such as pixel locations to RGB values in the case of an image. Based on this view, data can be compressed by overfitting a compact neural network to its functional representation and then encoding the network weights. However, most current solutions for this are inefficient, as quantization to low-bit precision substantially degrades the reconstruction quality. To address this issue, we propose overfitting variational Bayesian neural networks to the data and compressing an approximate posterior weight sample using relative entropy coding instead of quantizing and entropy coding it. This strategy enables direct optimization of the rate-distortion performance by minimizing the $\beta$-ELBO, and target different rate-distortion trade-offs for a given network architecture by adjusting $\beta$. Moreover, we introduce an iterative algorithm for learning prior weight distributions and employ a progressive refinement process for the variational posterior that significantly enhances performance. Experiments show that our method achieves strong performance on image and audio compression while retaining simplicity.

Machine Learning,Information Theory
Approximately Invertible Neural Network for Learned Image Compression

Yanbo Gao,Meng Fu,Shuai Li,Chong Lv,Xun Cai,Hui Yuan,Mao Ye

2024-08-30

Abstract:Learned image compression have attracted considerable interests in recent years. It typically comprises an analysis transform, a synthesis transform, quantization and an entropy coding model. The analysis transform and synthesis transform are used to encode an image to latent feature and decode the quantized feature to reconstruct the image, and can be regarded as coupled transforms. However, the analysis transform and synthesis transform are designed independently in the existing methods, making them unreliable in high-quality image compression. Inspired by the invertible neural networks in generative modeling, invertible modules are used to construct the coupled analysis and synthesis transforms. Considering the noise introduced in the feature quantization invalidates the invertible process, this paper proposes an Approximately Invertible Neural Network (A-INN) framework for learned image compression. It formulates the rate-distortion optimization in lossy image compression when using INN with quantization, which differentiates from using INN for generative modelling. Generally speaking, A-INN can be used as the theoretical foundation for any INN based lossy compression method. Based on this formulation, A-INN with a progressive denoising module (PDM) is developed to effectively reduce the quantization noise in the decoding. Moreover, a Cascaded Feature Recovery Module (CFRM) is designed to learn high-dimensional feature recovery from low-dimensional ones to further reduce the noise in feature channel compression. In addition, a Frequency-enhanced Decomposition and Synthesis Module (FDSM) is developed by explicitly enhancing the high-frequency components in an image to address the loss of high-frequency information inherent in neural network based image compression. Extensive experiments demonstrate that the proposed A-INN outperforms the existing learned image compression methods.

Image and Video Processing,Computer Vision and Pattern Recognition
Strategies in JPEG compression using Convolutional Neural Network (CNN)

Suman Kunwar

DOI: https://doi.org/10.48550/arXiv.2112.04500

2021-12-06

Abstract:Interests in digital image processing are growing enormously in recent decades. As a result, different data compression techniques have been proposed which are concerned mostly with the minimization of information used for the representation of images. With the advances of deep neural networks, image compression can be achieved to a higher degree. This paper describes an overview of JPEG Compression, Discrete Fourier Transform (DFT), Convolutional Neural Network (CNN), quality metrics to measure the performance of image compression and discuss the advancement of deep learning for image compression mostly focused on JPEG, and suggests that adaptation of model improve the compression.

Image and Video Processing

About some compression algorithms

DISCUSSION ON FRACTAL IMAGE COMPRESSION METHOD BASDE ON ITERATED FUNCTION SYSTEM

Breaking the Barriers of One-to-One Usage of Implicit Neural Representation in Image Compression: A Linear Combination Approach with Performance Guarantees

On Efficient Neural Network Architectures for Image Compression

A Taxonomy of Miscompressions: Preparing Image Forensics for Neural Compression

Image-Compression Techniques: Classical and "Region-of-Interest-Based" Approaches Presented in Recent Papers

Iterative Approach to Image Compression with Noise : Optimizing Spatial and Tonal Data

Taxonomy and Evaluation of Structured Compression of Convolutional Neural Networks

An Introduction to Neural Data Compression

COIN++: Neural Compression Across Modalities

Towards Image Understanding from Deep Compression without Decoding

Streaming Neural Images

The Compression method and applications

Extreme Compression of Adaptive Neural Images

A novel framework for image-to-image translation and image compression

Implicit Neural Image Field for Biological Microscopy Image Compression

Image Compression with Iterated Function Systems, Finite Automata and Zerotrees: Grand Unification

A study for Image compression using Re-Pair algorithm

Compression with Bayesian Implicit Neural Representations

Approximately Invertible Neural Network for Learned Image Compression

Strategies in JPEG compression using Convolutional Neural Network (CNN)