Abstract:Deep learning-based lossless compression methods offer substantial advantages in compressing medical volumetric images. Nevertheless, many learning-based algorithms encounter a trade-off between practicality and compression performance. This paper introduces a hardware-friendly streaming lossless volumetric compression framework, utilizing merely one-thousandth of the model weights compared to other learning-based compression frameworks. We propose a gated recurrent convolutional neural network that combines diverse convolutional structures and fusion gate mechanisms to capture the inter-slice dependencies in volumetric images. Based on such contextual information, we can predict the pixel-by-pixel distribution for entropy coding. Guided by hardware/software co-design principles, we implement the proposed framework on Field Programmable Gate Array to achieve enhanced real-time performance. Extensive experimental results indicate that our method outperforms traditional lossless volumetric compressors and state-of-the-art learning-based lossless compression methods across various medical image benchmarks. Additionally, our method exhibits robust generalization ability and competitive compression speed
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the lossless compression of medical volumetric images. Specifically, the paper proposes a hardware - friendly streaming lossless volumetric image compression framework, aiming to address the trade - off between compression performance and practical applications in existing learning methods. The following are the main problems of the paper and their backgrounds:
### Background
With the development of medical imaging technology, a large number of high - resolution medical volumetric images, such as computed tomography (CT) and magnetic resonance imaging (MRI), have been generated. These images play a crucial role in clinical diagnosis because they provide detailed anatomical structures. However, high resolution and extended scanning ranges bring huge challenges to storage and transmission. Moreover, due to the special nature of medical images, lossy compression may lead to a decline in the accuracy of analysis tasks, so it is necessary to explore effective lossless compression techniques.
### Limitations of Existing Methods
1. **Transformation - based methods**: Such as JPEG - 2000 and JP3D, rely on hand - designed transformation bases and cannot be optimized according to specific data characteristics, which limits their performance.
2. **Video - based methods**: Such as HEVC and FFV1, although they utilize the correlation in the time dimension, the inter - slice correlation in medical volumetric images is different from the inter - frame correlation in typical videos, resulting in these methods being unable to effectively utilize the redundancy between slices.
3. **Deep - learning - based methods**: Such as PixelCNN++, L3C, VQ - VAE, etc., although they have achieved the state - of - the - art compression ratios, they perform poorly in high - bit - rate scenarios, and most methods use large models with high computational complexity, which limits their hardware portability and compression speed.
### The Method Proposed in the Paper
The paper proposes a lightweight streaming recursive lossless volumetric image compression system (SR - LVC), specifically designed for medical volumetric images. The specific contributions are as follows:
1. **Fusion - gate mechanism**: By combining multiple convolutional structures and the fusion - gate mechanism, the inter - slice dependencies in volumetric images are captured, reducing the computational complexity and being more suitable for streaming implementation.
2. **Fully convolutional network**: Supports full - resolution and high - bit - depth inputs, expanding the application scenarios.
3. **Hardware - friendly**: With only 4,866 model parameters, it is suitable for implementing streaming processing on field - programmable gate arrays (FPGA).
4. **Experimental verification**: Extensive experiments have been carried out on multiple volumetric image datasets, and the results show that the compression performance of this method is better than that of existing lossless volumetric image compression methods, and it has strong generalization ability and competitive compression speed.
### Formulas
The formulas involved in the paper include:
- **Probability distribution prediction**:
\[
p(x_{i,j}) = p(x_{i,j} | x_{i - K,j - K}, \ldots, x_{i,j - 1}), \quad x \in S_t
\]
\[
P(S_t) = \prod_{i,j} p(x_{i,j}) = \prod_{i,j} p(x_{i,j} | x_{i - K,j - K}, \ldots, x_{i,j - 1})
\]
- **Shannon entropy**:
\[
E(S_t) = E_{S_t \sim P}[-\log_2 P(S_t)] = E_{S_t \sim P}\left[-\sum_{i,j} \log_2 p(x_{i,j})\right]
\]
- **Cumulative distribution function (CDF)**:
\[
\text{CDF}_{\hat{p}}(x, \mu, s) = \frac{1}{1 + e^{-(x - \mu)/s}}
\]
- **Discrete log - likelihood function**:
\[
\hat{p}(x, \mu, s) = \text{CDF}_{\hat{p}}(x + 0.5, \mu, s) - \text{CDF}_{\hat{p}}(x - 0.5, \mu, s)
\]
### Conclusion
The paper proposes a lightweight streaming recursive lossless volumetric image compression system (SR - LVC). Through the fusion - gate mechanism and the fully convolutional network, the inter - slice dependencies are effectively captured, achieving high - performance lossless compression. This method has good hardware - friendliness.