NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results

Xin Li,Kun Yuan,Yajing Pei,Yiting Lu,Ming Sun,Chao Zhou,Zhibo Chen,Radu Timofte,Wei Sun,Haoning Wu,Zicheng Zhang,Jun Jia,Zhichao Zhang,Linhan Cao,Qiubo Chen,Xiongkuo Min,Weisi Lin,Guangtao Zhai,Jianhui Sun,Tianyi Wang,Lei Li,Han Kong,Wenxuan Wang,Bing Li,Cheng Luo,Haiqiang Wang,Xiangguang Chen,Wenhui Meng,Xiang Pan,Huiying Shi,Han Zhu,Xiaozhong Xu,Lei Sun,Zhenzhong Chen,Shan Liu,Fangyuan Kong,Haotian Fan,Yifang Xu,Haoran Xu,Mengduo Yang,Jie Zhou,Jiaze Li,Shijie Wen,Mai Xu,Da Li,Shunyu Yao,Jiazhi Du,Wangmeng Zuo,Zhibo Li,Shuai He,Anlong Ming,Huiyuan Fu,Huadong Ma,Yong Wu,Fie Xue,Guozhi Zhao,Lina Du,Jie Guo,Yu Zhang,Huimin Zheng,Junhao Chen,Yue Liu,Dulan Zhou,Kele Xu,Qisheng Xu,Tao Sun,Zhixiang Ding,Yuhang Hu

2024-04-17

Abstract:This paper reviews the NTIRE 2024 Challenge on Shortform UGC Video Quality Assessment (S-UGC VQA), where various excellent solutions are submitted and evaluated on the collected dataset KVQ from popular short-form video platform, i.e., Kuaishou/Kwai Platform. The KVQ database is divided into three parts, including 2926 videos for training, 420 videos for validation, and 854 videos for testing. The purpose is to build new benchmarks and advance the development of S-UGC VQA. The competition had 200 participants and 13 teams submitted valid solutions for the final testing phase. The proposed solutions achieved state-of-the-art performances for S-UGC VQA. The project can be found at

Image and Video Processing,Artificial Intelligence

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address the issue of quality assessment for Short-form User-Generated Content (S-UGC) videos. Specifically:

1. **Establishing a New Benchmark**: By collecting a large dataset of short-form UGC videos from the Kuaishou/Kwai platform (KVQ), the paper aims to establish a new quality assessment benchmark.
2. **Advancing Technological Development**: The paper seeks to promote the development of related technologies, enhancing the quality control capabilities for the creation, compression, and processing of short-form UGC videos.
3. **Filling Research Gaps**: This is the first competition focused on the quality assessment of short-form UGC videos, aiming to drive research progress in this field.

By organizing the NTIRE 2024 Short-form UGC Video Quality Assessment Challenge, the paper hopes to foster research in this area and develop a robust benchmark for short-form UGC video quality assessment to support the advancement of related technologies.