Abstract:Class imbalance refers to the instance where the number of training samples for the majority classes is far more than that of the minority classes (relative imbalance), and the quality of training samples for the minority classes is inferior to that of the majority classes (absolute imbalance), which are further complicated by other imbalance factors, e.g., data overlapping. Video background subtraction aims to classify each pixel into two classes: foreground and background. This paper first reveals that background subtraction is a class imbalance problem, where the foreground and background are the minority and majority classes, respectively. By exploring spatial and temporal correlation inherent in video data, we present an imbalance compensation framework for background subtraction, which consists of two sequential modules, imbalance-compensated bilayer modeling, and imbalance-compensated Bayesian classification. In the first module, spatio-temporal oversampling (SOS) and selective downsampling (SDS) are proposed to compensate the imbalance at data level. SOS attempts to synthesize representative samples appended to the minority sample set, while SDS selectively deletes a number of majority samples in data overlapping areas. The rebalanced samples are then used to learn a bilayer model. In the second module, novel cost functions are proposed to compensate the effect of class imbalance at algorithm level. The cost functions are based on imbalance measurement, and used to construct the prior term in the Bayesian classification scheme. Experiments are conducted on public databases to demonstrate the effectiveness of the proposed method.

Statistical background subtraction based on imbalanced learning

An Imbalance Compensation Framework for Background Subtraction

Background Subtraction Based on Nonparametric Bayesian Estimation.

Online background subtraction based on sufficient statistics

An IR Strong Clutter Background Suppression Algorithm Based on Sparse Kernel Method

Background Subtraction Using Spatio-Temporal Group Sparsity Recovery.

Background Subtraction with Dynamic Noise Sampling and Complementary Learning

Motion-Based Background Subtraction

Spatial-temporal Nonparametric Background Subtraction in Dynamic Scenes

Background Subtraction Using Incremental Subspace Learning

Adaptive Difference Modelling for Background Subtraction.

Background subtraction based on low-rank and structured sparse decomposition.

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

A universal sample-based background subtraction method for traffic surveillance videos

Background Subtraction Via 3D Convolutional Neural Networks

Background subtraction in dynamic scenes with adaptive spatial fusing.

Background modeling by subspace learning on spatio-temporal patches

Background subtraction in real applications: Challenges, current models and future directions

A Refinement Framework for Background Subtraction Based on Color and Depth Data

Background Subtraction under Sudden Illumination Changes

Hierarchical Background Subtraction Using Local Pixel Clustering