Abstract:3D volumetric image processing has attracted increasing attention in the last decades, in which one major research area is to develop efficient lossless volumetric image compression techniques to better store and transmit such images with massive amount of information. In this work, we propose the first end-to-end optimized learning framework for losslessly compressing 3D volumetric data. Our approach builds upon a hierarchical compression scheme by additionally introducing the intra-slice auxiliary features and estimating the entropy model based on both intra-slice and inter-slice latent priors. Specifically, we first extract the hierarchical intra-slice auxiliary features through multi-scale feature extraction modules. Then, an Intra-slice and Inter-slice Conditional Entropy Coding module is proposed to fuse the intra-slice and inter-slice information from different scales as the context information. Based on such context information, we can predict the distributions for both intra-slice auxiliary features and the slice images. To further improve the lossless compression performance, we also introduce two new gating mechanisms called Intra-Gate and Inter-Gate to generate the optimal feature representations for better information fusion. Eventually, we can produce the bitstream for losslessly compressing volumetric images based on the estimated entropy model. Different from the existing lossless volumetric image codecs, our end-to-end optimized framework jointly learns both intra-slice auxiliary features at different scales for each slice and inter-slice latent features from previously encoded slices for better entropy estimation. The extensive experimental results indicate that our framework outperforms the state-of-the-art hand-crafted lossless volumetric image codecs (e.g., JP3D) and the learning-based lossless image compression method on four volumetric image benchmarks for losslessly compressing both 3D Medical Images and Hyper-Spectral Images.

Deep Implicit Volume Compression

3D-DCT Based Volumetric Three-Dimensional Video Data Compression Method

A GPU-Enabled Real-Time Framework for Compressing and Rendering Volumetric Videos

Fast Compressed Segmentation Volumes for Scientific Visualization

3D Compression Using Neural Fields

Volumetric End-to-End Optimized Compression for Brain Images.

DeepCompress: Efficient Point Cloud Geometry Compression

DeepCoder: A Deep Neural Network Based Video Compression

Exploiting Intra-Slice and Inter-Slice Redundancy for Learning-Based Lossless Volumetric Image Compression

NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networks

A Novel Implicit Neural Representation for Volume Data

Deep data compression for approximate ultrasonic image formation

Deep Learning for Visual Data Compression

Ultra High Fidelity Deep Image Decompression With l∞-Constrained Compression

End-to-End Variable-Rate Learning-Based Depth Compression Guided by Deep Correlation Features

Deep Compression for Dense Point Cloud Maps

Efficient Compression of Sparse Accelerator Data Using Implicit Neural Representations and Importance Sampling

A Near Lossless Compression Domain Volume Rendering Algorithm for Floating-Point Time-Varying Volume Data

Learning Lossless Compression for High Bit-Depth Volumetric Medical Image

Efficient Data Compression for 3D Sparse TPC via Bicephalous Convolutional Autoencoder

Patchvvc: A Real-time Compression Framework for Streaming Volumetric Videos.