Abstract:Motion object detection (MOD) with freely moving cameras is a challenging task in computer vision. To extract moving objects, most studies have focused on the difference in motion features between foreground and background, which works well for dynamic scenes with relatively regular movements and variations. However, abrupt illumination changes and occlusions often occur in real-world scenes, and the camera may also pan, tilt, rotate, and jitter, etc., resulting in local irregular variations and global discontinuities in motion features. Such complex and changing scenes bring great difficulty in detecting moving objects. To solve this problem, this paper proposes a new MOD method that effectively leverages local and global visual information for foreground/background segmentation. Specifically, on the global side, to support a wider range of camera motion, the relative inter-frame transformations are optimized to absolute transformations referenced to intermediate frames in a global form after enriching the inter-frame matching pairs. The global transformation is fine-tuned using the spatial transformer network (STN). On the local side, to address the problem of dynamic background scenes, foreground object detection is optimized by utilizing the pixel differences between the current frame and the local background model, as well as the consistency of local spatial variations. Then, the spatial information is combined using optical flow segmentation methods, enhancing the precision of the object information. The experimental results show that our method achieves a detection accuracy improvement of over 1.5% compared with the state-of-the-art methods on the datasets of CDNET2014, FBMS-59, and CBD. It demonstrates significant effectiveness in challenging scenarios such as shadows, abrupt changes in illumination, camera jitter, occlusion, and moving backgrounds.

Beyond Dominant Plane Assumption: Moving Objects Detection in Severe Dynamic Scenes with Multi-Classes RANSAC

Detecting and Tracking Dynamic Objects in Complex Environments

Detecting Moving Objects from Dynamic Background Combining Subspace Learning with Mixed Norm Approach

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

2-Entity RANSAC for Robust Visual Localization in Changing Environment

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Vision-Based Moving Objects Detection with Background Modeling

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Moving Object Extraction with a Hand-held Camera

Camera Pose Estimation in Dynamic Scenes with Background Tracking

Background Modeling under Free Moving Camera Environment

Moving Object Detection of Dynamic Scenes Using Spatio-Temporal Context and Background Modeling

Robust Monocular SLAM in Dynamic Environments

Automatic And Robust Classification Of Independent Motions In Video Sequences

Moving Object Detection in Freely Moving Camera via Global Motion Compensation and Local Spatial Information Fusion

Robust Video Background Identification by Dominant Rigid Motion Estimation

Moving objects detection using adaptive region-based background model in dynamic scenes

Semantic Plane-Structure Based Motion Detection with a Nonstationary Camera

Background Modeling from a Free-Moving Camera by Multi-Layer Homography Algorithm.

Moving Object Detection Based on Incremental Learning Low Rank Representation and Spatial Constraint.

Detecting moving objects under a moving camera in complex environments