Abstract:In recent years, implicit neural representations (INR) have shown their great potential to solve many computer graphics and computer vision problems. With this technique, signals such as 2D images or 3D shapes can be fit by training multi-layer perceptrons (MLP) on continuous functions, providing many advantages over conventional discrete representations. Despite being considered a promising approach to 2D image encoding and compression, the application of INR to image collections remains a challenge, since the number of parameters needed rapidly grow with the number of images. In this paper, we propose a fully implicit approach to INR which drastically reduces the size of MLP models in multiple image representation tasks. We introduce the concept of implicit coordinate encoder (ICE) and show it can be used to scale INR with the image number; specifically, by learning a common feature space between images. Furthermore, we show that our method is valid not only for image collections but also for large (gigapixel) images by applying a "divide-and-conquer" strategy. We propose an auto-encoder deep neural network architecture, with a single ICE (encoder) and multiple MLP (decoders), which are jointly trained following a multi-task learning strategy. We demonstrate the benefits coming from ICE when it is implemented as a one-dimensional convolutional encoder, including a better performance of the downstream MLP models with an order of magnitude fewer parameters. Our method is the first one to make use of convolutional blocks in INR networks, unlike the conventional approach of using MLP architectures only. We show the benefits of ICE in two experimental scenarios: a collection of twenty-four small ( 768×512 ) images (Kodak dataset), and a single large ( 3072×3072 ) image (dwarf planet Pluto), achieving better quality than previous fully-implicit methods, using up to 50% fewer parameters.

Breaking the Barriers of One-to-One Usage of Implicit Neural Representation in Image Compression: A Linear Combination Approach with Performance Guarantees

RQAT-INR: Improved Implicit Neural Image Compression

Enhanced Quantified Local Implicit Neural Representation for Image Compression

An Efficient Implicit Neural Representation Image Codec Based on Mixed Autoregressive Model for Low-Complexity Decoding

Streaming Neural Images

Quantum Implicit Neural Compression

Dynamic Neural Networks for Adaptive Implicit Image Compression.

A novel framework for image-to-image translation and image compression

Implicit Neural Image Field for Biological Microscopy Image Compression

Region-of-interest and channel attention-based joint optimization of image compression and computer vision

Bandwidth-efficient Inference for Neural Image Compression

Extreme Compression of Adaptive Neural Images

Releasing the Parameter Latency of Neural Representation for High-Efficiency Video Compression

Enhancing Perception Quality in Remote Sensing Image Compression via Invertible Neural Network

Hybrid Implicit Neural Image Compression with Subpixel Context Model and Iterative Pruner

Neural Image Compression Via Attentional Multi-scale Back Projection and Frequency Decomposition

Towards On-demand Transmission: Joint Feature and Image Coding with Reversible Neural Networks

Rate-Distortion-Cognition Controllable Versatile Neural Image Compression

Rapid-INR: Storage Efficient CPU-free DNN Training Using Implicit Neural Representation

Towards Image Understanding from Deep Compression without Decoding

ICE: Implicit Coordinate Encoder for Multiple Image Neural Representation