Abstract:Unsupervised video object segmentation aims to automatically segment moving objects over an unconstrained video without any user annotation. So far, only few unsupervised online methods have been reported in the literature, and their performance is still far from satisfactory because the complementary information from future frames cannot be processed under online setting. To solve this challenging problem, in this paper, we propose a novel unsupervised online video object segmentation (UOVOS) framework by construing the motion property to mean moving in concurrence with a generic object for segmented regions. By incorporating the salient motion detection and the object proposal, a pixel-wise fusion strategy is developed to effectively remove detection noises, such as dynamic background and stationary objects. Furthermore, by leveraging the obtained segmentation from immediately preceding frames, a forward propagation algorithm is employed to deal with unreliable motion detection and object proposals. Experimental results on several benchmark datasets demonstrate the efficacy of the proposed method. Compared to state-of-the-art unsupervised online segmentation algorithms, the proposed method achieves an absolute gain of 6.2%. Moreover, our method achieves better performance than the best unsupervised offline algorithm on the DAVIS-2016 benchmark dataset. Our code is available on the project website: https://www.github.com/visiontao/uovos.

Activity Analysis in Video Scenes Using an Unsupervised Learning Approach

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Unsupervised Categorization of Human Motion Sequences

Analyzing Motion Patterns in Crowded Scenes Via Automatic Tracklets Clustering

Unsupervised Video Action Clustering Via Motion-Scene Interaction Constraint

Unsupervised Sports Video Scene Clustering And Its Applications To Story Units Detection

Unsupervised Motion Pattern Mining for Crowded Scenes Analysis.

Automatic And Robust Classification Of Independent Motions In Video Sequences

Learning Semantic Scene Models by Object Classification and Trajectory Clustering

Unsupervised Online Video Object Segmentation with Motion Property Understanding

Video Sensor-Based Complex Scene Analysis with Granger Causality.

Toward Dynamic Scene Understanding by Hierarchical Motion Pattern Mining

Spatial-temporal activity interactions detection in video survalliance

Extracting Story Units in Sports Video Based on Unsupervised Video Scene Clustering

Unsupervised anomalous behavior detection using spatial-temporal interest points

Unsupervised Analysis Of Human Gestures

Motion-inductive Self-supervised Object Discovery in Videos

Latent Dirichlet Allocation for Unsupervised Activity Analysis on an Autonomous Mobile Robot

Learning realistic human actions from movies.

Video Scene Analysis: A Machine Learning Perspective

Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences