Learning Dynamic Background for Moving Object Detection

Zhijun Zhang,Yi Chang,Sheng Zhong,Luxin Yan,Xu Zou

DOI: https://doi.org/10.2139/ssrn.3988170

2021-01-01

Abstract:Acknowledgment Moving object detection in dynamic scenes is a challenging problem due to the complex variations in the background such as the swaying leaves and rippers. Most of the existing methods usually cast the variation into background or foreground layer, and thus fail to precisely model the dynamic variation in an explicit manner. In this work, we formulate the moving object detection as tensor-based three layers decomposition problem: static background, moving object foreground, and dynamic background to address this issue. Specifically, we additionally introduce a data-driven discriminative prior embedded into the maximum a posterior (MAP) framework to explicitly capture the dynamic background, which can be satisfactorily represented by a two stream spatiotemporal convolutional neural network. As for the static background, we introduce the low-rank tensor prior to model the temporal correlation; For the moving object, we utilize its spatiotemporal continuity via the Markov random field. Compared with previous matrix-based methods, each term in our method is tensor-based which could better preserve the intrinsic spatiotemporal structure correlation in the video. In addition, our model could be further improved by involving a semantic prior as an adaptive attention. The proposed method is extensively evaluated on several benchmarks, and significantly outperforms state-of-the-art methods.