Abstract:3D volumetric image processing has attracted increasing attention in the last decades, in which one major research area is to develop efficient lossless volumetric image compression techniques to better store and transmit such images with massive amount of information. In this work, we propose the first end-to-end optimized learning framework for losslessly compressing 3D volumetric data. Our approach builds upon a hierarchical compression scheme by additionally introducing the intra-slice auxiliary features and estimating the entropy model based on both intra-slice and inter-slice latent priors. Specifically, we first extract the hierarchical intra-slice auxiliary features through multi-scale feature extraction modules. Then, an Intra-slice and Inter-slice Conditional Entropy Coding module is proposed to fuse the intra-slice and inter-slice information from different scales as the context information. Based on such context information, we can predict the distributions for both intra-slice auxiliary features and the slice images. To further improve the lossless compression performance, we also introduce two new gating mechanisms called Intra-Gate and Inter-Gate to generate the optimal feature representations for better information fusion. Eventually, we can produce the bitstream for losslessly compressing volumetric images based on the estimated entropy model. Different from the existing lossless volumetric image codecs, our end-to-end optimized framework jointly learns both intra-slice auxiliary features at different scales for each slice and inter-slice latent features from previously encoded slices for better entropy estimation. The extensive experimental results indicate that our framework outperforms the state-of-the-art hand-crafted lossless volumetric image codecs (e.g., JP3D) and the learning-based lossless image compression method on four volumetric image benchmarks for losslessly compressing both 3D Medical Images and Hyper-Spectral Images.

Bilateral Context Modeling for Residual Coding in Lossless 3D Medical Image Compression

Context based medical image coding with contextual set partitioning with improved active contours algorithm

Learning Lossless Compression for High Bit-Depth Volumetric Medical Image

Learning Lossless Compression for High Bit-Depth Medical Imaging

Exploiting Intra-Slice and Inter-Slice Redundancy for Learning-Based Lossless Volumetric Image Compression

Deep Lossy Plus Residual Coding for Lossless and Near-lossless Image Compression

Efficient and Effective Context-Based Convolutional Entropy Modeling for Image Compression.

Context-based, adaptive, lossless image coding

DBVC: an End-to-End 3-D Deep Biomedical Video Coding Framework

Context-Based Lossless Compression of Mosaic Image with Bayer Pattern

Learned Scalable Image Compression with Bidirectional Context Disentanglement Network

Improved Deep Image Compression with Joint Optimization of Cross Channel Context Model and Generalized Loop Filter

An Extended Context-Based Entropy Hybrid Modeling for Image Compression.

Bi-Directional Context Modeling with Combinatorial Structuring for Genome Sequence Compression

Corner-to-Center Long-range Context Model for Efficient Learned Image Compression

Scalable Image Coding for Human and Machines: Based on Partial Channel Context Model

Gated Context Model with Embedded Priors for Deep Image Compression

A Cross Channel Context Model for Latents in Deep Image Compression

Content Adaptive Checkerboard Context Model for Learned Image Compression

Progressive Deep Image Compression for Hybrid Contexts of Image Classification and Reconstruction

3-D Context Entropy Model for Improved Practical Image Compression