Abstract:Recently, several spatial-temporal memory-based methods have verified that storing intermediate frames and their masks as memory are helpful to segment target objects in videos. However, they mainly focus on better matching between the current frame and the memory frames without explicitly paying attention to the quality of the memory. Therefore, frames with poor segmentation masks are prone to be memorized, which leads to a segmentation mask error accumulation problem and further affect the segmentation performance. In addition, the linear increase of memory frames with the growth of frame number also limits the ability of the models to handle long videos. To this end, we propose a Quality-aware Dynamic Memory Network (QDMN) to evaluate the segmentation quality of each frame, allowing the memory bank to selectively store accurately segmented frames to prevent the error accumulation problem. Then, we combine the segmentation quality with temporal consistency to dynamically update the memory bank to improve the practicability of the models. Without any bells and whistles, our QDMN achieves new state-of-the-art performance on both DAVIS and YouTube-VOS benchmarks. Moreover, extensive experiments demonstrate that the proposed Quality Assessment Module (QAM) can be applied to memory-based methods as generic plugins and significantly improves performance. Our source code is available at https://github.com/workforai/QDMN.

Memory-Based Gaussian Mixture Modeling for Moving Object Detection in Indoor Scene with Sudden Partial Changes

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

Background modeling using mixture of Gaussians and Laplacian pyramid decomposition.

Vision-Based Moving Objects Detection with Background Modeling

VMM: Viewpoint-based Memory Mechanism for Object Detection of Moving Sensors

Shape Prior Based Moving Object Detection

Multi-Channel Adaptive Mixture Background Model for Real-time Tracking.

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

A MOVING DETECTION METHOD COMBINING FRAME DIFFERENCE AND GAUSSIAN MIXTURE MODEL

An Improved Gaussian Mixture Modeling Algorithm Combining Foreground Matching and Short-Term Stability Measure for Motion Detection

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

Learning Quality-aware Dynamic Memory for Video Object Segmentation

Adaptive moving target detection algorithm based on Gaussian mixture model

Dual Gaussian mixture model with pixel history for background suppression

Efficient video object segmentation based on Gaussian mixture model and Markov random field

Multi-view Aggregation for Real-Time Accurate Object Detection of a Moving Camera

Motion Detection with Uniform Mixture Model

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Research on Information Technology with Moving Object Segmentation Based on Memory Matrix and Kalman Filter

Optimization of Gaussian mixture model motion detection algorithm

RESEARCH ON MOVING TARGET DETECTION IN AN ENVIRONMENT OF SUDDEN LIGHT CHANGING