Abstract:While raw images possess distinct advantages over sRGB images, e.g., linearity and fine-grained quantization levels, they are not widely adopted by general users due to their substantial storage requirements. Very recent studies propose to compress raw images by designing sampling masks within the pixel space of the raw image. However, these approaches often leave space for pursuing more effective image representations and compact metadata. In this work, we propose a novel framework that learns a compact representation in the latent space, serving as metadata, in an end-to-end manner. Compared with lossy image compression, we analyze the intrinsic difference of the raw image reconstruction task caused by rich information from the sRGB image. Based on the analysis, a novel design of the backbone with asymmetric and hybrid spatial feature resolutions is proposed, which significantly improves the rate-distortion performance. Besides, we propose a novel design of the sRGB-guided context model, which can better predict the order masks of encoding/decoding based on both the sRGB image and the the masks of already processed features. Benefited from the better modeling of the correlation between order masks, the already processed information can be better utilized. Moreover, a novel sRGB-guided adaptive quantization precision strategy, which dynamically assigns varying levels of quantization precision to different regions, further enhances the representation ability of the model. Finally, based on the iterative properties of the proposed context model, we propose a novel strategy to achieve variable bit rates using a single model. This strategy allows for the continuous convergence of a wide range of bit rates. We demonstrate how our raw image compression scheme effectively allocates more bits to image regions that hold greater global importance. Extensive experimental results validate the superior performance of the proposed method, achieving high-quality raw image reconstruction with a smaller metadata size, compared with existing SOTA methods.

In-Camera Raw Compression: A New Paradigm from Image Acquisition to Display.

Efficient Visual Computing with Camera RAW Snapshots

An End-to-End Real-World Camera Imaging Pipeline

Metadata-Based RAW Reconstruction Via Implicit Neural Functions.

Implicit Neural Image Field for Biological Microscopy Image Compression

An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

Camera-Aware Multi-Resolution Analysis for Raw Image Sensor Data Compression

Simple Image Signal Processing using Global Context Guidance

Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs

Beyond Learned Metadata-Based Raw Image Reconstruction

ParamISP: Learned Forward and Inverse ISPs using Camera Parameters

LeCA: In-Sensor Learned Compressive Acquisition for Efficient Machine Vision on the Edge.

Universally Achieving Crisp Imaging in Phone Camera with Field-dependent Deconvolution in Raw Format

Dirty Pixels: Towards End-to-End Image Processing and Perception

Compression Ratio Learning and Semantic Communications for Video Imaging

Extreme Compression of Adaptive Neural Images

RBSRICNN: Raw Burst Super-Resolution through Iterative Convolutional Neural Network

Invertible Image Signal Processing

RAW Image Reconstruction Using a Self-contained sRGB–JPEG Image with Small Memory Overhead

A New High Quality Image Compression Method for Digital Image Sensors with Bayer Color Filter Arrays

RAW-Adapter: Adapting Pre-trained Visual Model to Camera RAW Images