Efficient Super-Resolution for Compression of Gaming Videos

Yifan Wang,Luka Murn,Luis Herranz,Fei Yang,Marta Mrak,Wei Zhang,Shuai Wan,Marc Górriz Blanch
DOI: https://doi.org/10.1109/icassp49357.2023.10096031
2023-01-01
Abstract:Due to the increasing demand for game-streaming services, efficient compression of computer-generated video is more critical than ever, especially when the available bandwidth is low. This paper proposes a super-resolution framework that improves the coding efficiency of computer-generated gaming videos at low bitrates. Most state-of-the-art super-resolution networks generalize over a variety of RGB inputs and use a unified network architecture for frames of different levels of degradation, leading to high complexity and redundancy. Since games usually consist of a limited number of fixed scenarios, we specialize one model for each scenario and assign appropriate network capacities for different QPs to perform super-resolution under the guidance of reconstructed high-quality luma components. Experimental results show that our framework achieves a superior quality-complexity trade-off compared to the ESRnet baseline, saving at most 93.59% parameters while maintaining comparable performance. The compression efficiency compared to HEVC is also improved by more than 17% BD-rate gain.
What problem does this paper attempt to address?