Abstract:Background subtraction is a fundamental task in computer vision with numerous real-world applications, ranging from object tracking to video surveillance. Dynamic backgrounds poses a significant challenge here. Supervised deep learning-based techniques are currently considered state-of-the-art for this task. However, these methods require pixel-wise ground-truth labels, which can be time-consuming and expensive. In this work, we propose a weakly supervised framework that can perform background subtraction without requiring per-pixel ground-truth labels. Our framework is trained on a moving object-free sequence of images and comprises two networks. The first network is an autoencoder that generates background images and prepares dynamic background images for training the second network. The dynamic background images are obtained by thresholding the background-subtracted images. The second network is a U-Net that uses the same object-free video for training and the dynamic background images as pixel-wise ground-truth labels. During the test phase, the input images are processed by the autoencoder and U-Net, which generate background and dynamic background images, respectively. The dynamic background image helps remove dynamic motion from the background-subtracted image, enabling us to obtain a foreground image that is free of dynamic artifacts. To demonstrate the effectiveness of our method, we conducted experiments on selected categories of the CDnet 2014 dataset and the I2R dataset. Our method outperformed all top-ranked unsupervised methods. We also achieved better results than one of the two existing weakly supervised methods, and our performance was similar to the other. Our proposed method is online, real-time, efficient, and requires minimal frame-level annotation, making it suitable for a wide range of real-world applications.

A Noisy Videos Background Subtraction Algorithm Based on Dictionary Learning

Background Subtraction Based on Nonparametric Bayesian Estimation.

Background Subtraction with Dynamic Noise Sampling and Complementary Learning

Online background subtraction based on sufficient statistics

An IR Strong Clutter Background Suppression Algorithm Based on Sparse Kernel Method

Background Subtraction Using Incremental Subspace Learning

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

Adaptive Difference Modelling for Background Subtraction.

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Motion-Based Background Subtraction

Weakly Supervised Realtime Dynamic Background Subtraction

Dynamic Background Subtraction Using Spatial-Color Binary Patterns

Background subtraction for video sequence using deep neural network

Background Subtraction Using Dual-Class Backgrounds

Background Subtraction Through Multiple Life Span Modeling

A covariance-based method for dynamic background subtraction

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Background Subtraction Based on Modified Pulse Coupled Neural Network in Compressive Domain

A Novel Probability Model for Background Maintenance and Subtraction

Panchromatic image based dictionary learning for hyperspectral imagery denoising

Crystallization and preliminary X-ray analysis of bacteriophage T4 deoxynucleotide kinase.