FastHDRNet: A new efficient method for SDR-to-HDR Translation

Siyuan Tian,Hao Wang,Yiren Rong,Junhao Wang,Renjie Dai,Zhengxiao He
2024-05-11
Abstract:Modern displays nowadays possess the capability to render video content with a high dynamic range (HDR) and an extensive color gamut .However, the majority of available resources are still in standard dynamic range (SDR). Therefore, we need to identify an effective methodology for this objective.The existing deep neural networks (DNN) based SDR to HDR conversion methods outperforms conventional methods, but they are either too large to implement or generate some terrible artifacts. We propose a neural network for SDR to HDR conversion, termed "FastHDRNet". This network includes two parts, Adaptive Universal Color Transformation (AUCT) and Local Enhancement (LE). The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency. After the experiment, we find that our proposed method achieves state-of-the-art performance in both quantitative comparisons and visual quality with a lightweight structure and a enhanced infer speed.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper attempts to solve several key problems in the conversion from Standard Dynamic Range (SDR) to High Dynamic Range (HDR) images: 1. **Limitations of Existing Methods**: Although existing methods based on Deep Neural Networks (DNN) outperform traditional methods in performance, they have two main problems: - **Over - large Models**: Many existing SDR - to - HDR conversion models are too large and difficult to be deployed on consumer - level devices. - **Generation of Artifacts**: Some methods will produce obvious artifacts during the conversion process, which affects the quality of the final image. 2. **Requirement for Efficient Conversion**: With the development of HDR display technology, the demand for efficient and high - quality SDR - to - HDR conversion methods is increasing day by day. Existing methods are either computationally complex or have poor effects and cannot meet the needs of practical applications. 3. **Design of Light - weight Models**: The paper proposes a new light - weight model - FastHDRNet, aiming to achieve efficient SDR - to - HDR conversion. This model not only reaches the current state - of - the - art level in performance, but also has significant advantages in the number of parameters and inference speed. ### Specific Objectives - **Propose a Light - weight and Efficient SDR - to - HDR Conversion Method**: By designing a two - stage framework including Adaptive Universal Color Transformation (AUCT) and Local Enhancement (LE), high - quality conversion is achieved. - **Improve the Robustness of the Network**: Introduce a new normalization method to improve the stability of the model under different conditions. - **Optimize the Inference Speed**: Ensure that the model has the fastest inference time while maintaining high performance, which is suitable for real - time application scenarios. ### Main Contributions 1. **Propose a Light - weight and Efficient SDR - to - HDR Conversion Method**, which reaches the state - of - the - art level in both quantitative and visual quality. 2. **Experiment with a New Normalization Method**, making the network more robust. 3. **The Method Has the Fastest Inference Time among All the Mentioned Algorithms**, and the number of parameters is also very low. ### Method Overview - **Adaptive Universal Color Transformation (AUCT)**: It is responsible for global color adjustment. Through the cooperation of the base network and the conditional network, the color mapping from SDR to HDR is realized. - **Local Enhancement (LE)**: On the basis of AUCT, it further improves the clarity and contrast of local details, and uses the U - Net architecture for feature refinement. Through these designs, FastHDRNet can significantly reduce the computational complexity and model size while ensuring high - quality conversion, making it more suitable for practical applications.