VCSL: Video Compressive Sensing with Low-complexity ROI Detection in Compressed Domain

Jian Yang,Haixing Wang,Yibo Fan,Jinjia Zhou

DOI: https://doi.org/10.1109/dcc55655.2023.00057

2023-01-01

Abstract:By exploiting the potential of deep learning, video compressive sensing (CS) has achieved tremendous improvement recently. Due to the video CS is mainly served for the fixed scene in real life. In this paper, we propose a novel video compressive sensing with a low-complexity region-of-interest (ROI) detection method (VCSL). The ROI is located by calculating the difference between the reference frame and the following frames in our framework, which is compact without introducing any additional neural networks and parameters. Subsequently, only the detected ROIs are sampled and transmitted, except for the frame that is regarded as the background. The final re-constructed sequence would be attained by combining the ROIs and the background. Moreover, the proposed reference frame renewal method successfully solves the issue of background changing and achieves more accurate reconstructed results while reducing the sampling rate (SR) further. The specific testing results of VIRAT dataset are shown in Table. 1. We control the SR of our baseline method to be close to the other methods with fixed SR. As shown in Table. 1, our proposed VCSL achieves the best reconstruction performance among algorithms in the comparison while using the lowest average SR. Compared to the state-of-the-art counterparts, extensive experimental results have demonstrated that our proposed methods achieve superior performance while tackling more complex sequences and using a lower sampling rate. We believe that the proposed framework can be integrated into the other existing works to save the data of transmission.