Abstract:In scenes with collectively moving objects, to disregard the individual objects and take the entire group into consideration for motion characterization is a promising approach with wide application prospects. In contrast to studies on the segmentation of independently moving objects, our purpose is to construct a segmentation of these objects to characterize their motions at a macroscopic level. In general, the collectively moving objects in a group have very similar motion behavior with their neighbors and appear as a kind of global collective motion. This paper presents a joint segmentation approach for these collectively moving objects. In our model, we extract these macroscopic movement patterns based on optical flow field sequences. Specifically, a group of collectively moving objects correspond to a region where the optical flow field has high magnitude and high local direction coherence. As a result, our problem can be addressed by identifying these coherent optical flow field regions. The segmentation is performed through the minimization of a variational energy functional derived from the Bayes classification rule. Specifically, we use a bag-of-words model to generate a codebook as a collection of prototypical optical flow patterns, and the class-conditional probability density functions for different regions are determined based on these patterns. Finally, the minimization of our proposed energy functional results in the gradient descent evolution of segmentation boundaries which are implicitly represented through level sets. The application of our proposed approach is to segment and track multiple groups of collectively moving objects in a large variety of real-world scenes.

Multiple Motion and Occlusion Segmentation with a Multiphase Level Set Method.

Motion Objects Segmentation Using a New Level Set Based Method

A variational level set method of multiphase segmentation for piecewise smooth images

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

Object Based Segmentation of Video Using Variational Level Sets

Multiphase Soft Segmentation with Total Variation and H1 Regularization

Contour Based Automatic Scene Segmentation in Image Sequences

Mixed-motion Segmentation Using Helmholtz Decomposition

Detecting and segmenting multiple moving objects using level-set method

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Multiresolution Convex Variational Model for Multiphase Image Segmentation

3D Video Based Segmentation and Motion Estimation with Active Surface Evolution

A Multiphase Image Segmentation Method Based on Fuzzy Region Competition

A Spatiotemporal Multiple Moving Objects Segmentation and Tracking with Level Set

Motion Segmentation from a Moving Monocular Camera

Robust Multi-Body Motion Segmentation Based on Fuzzy K-Subspace Clustering

Joint segmentation of collectively moving objects using a bag-of-words model and level set evolution

Multiple motion object segmentation based on homogenous region merging

Motion Segmentation in the Presence of Outlying, Incomplete, or Corrupted Trajectories

Interactively Multiphase Image Segmentation Based on Variational Formulation and Graph Cuts

Multi-Instance Object Segmentation With Occlusion Handling