Abstract:Motion object detection (MOD) with freely moving cameras is a challenging task in computer vision. To extract moving objects, most studies have focused on the difference in motion features between foreground and background, which works well for dynamic scenes with relatively regular movements and variations. However, abrupt illumination changes and occlusions often occur in real-world scenes, and the camera may also pan, tilt, rotate, and jitter, etc., resulting in local irregular variations and global discontinuities in motion features. Such complex and changing scenes bring great difficulty in detecting moving objects. To solve this problem, this paper proposes a new MOD method that effectively leverages local and global visual information for foreground/background segmentation. Specifically, on the global side, to support a wider range of camera motion, the relative inter-frame transformations are optimized to absolute transformations referenced to intermediate frames in a global form after enriching the inter-frame matching pairs. The global transformation is fine-tuned using the spatial transformer network (STN). On the local side, to address the problem of dynamic background scenes, foreground object detection is optimized by utilizing the pixel differences between the current frame and the local background model, as well as the consistency of local spatial variations. Then, the spatial information is combined using optical flow segmentation methods, enhancing the precision of the object information. The experimental results show that our method achieves a detection accuracy improvement of over 1.5% compared with the state-of-the-art methods on the datasets of CDNET2014, FBMS-59, and CBD. It demonstrates significant effectiveness in challenging scenarios such as shadows, abrupt changes in illumination, camera jitter, occlusion, and moving backgrounds.

Detection of Moving Object Using a Fusion Method Based on Segmentation of Optical Flow Field and Edge Extracted by Canny's Operator

Motionobject segmentation algorithm based on spatial-temporal information

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

Spatiotemporal Image Edge Analysis Method for Motion Detection under the Pan-Tilt Camera

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Optical Flow Based Obstacle Detection in Static Environment

Motion Object Detection Based on Optical Flow Field and Level Set

An effective motion object detection method using optical flow estimation under a moving camera

A Novel Moving Object Detection Algorithm Based on Robust Image Feature Threshold Segmentation with Improved Optical Flow Estimation

Motion Objects Segmentation Using a New Level Set Based Method

Detecting moving objects under a moving camera in complex environments

Automatic Segmentation of Moving Objects in Video Sequences Using Multifeature

Extracting Moving Objects Based on Morphological Motion Filter

Moving Object Extraction with a Hand-held Camera

Research on Information Technology with Moving Object Segmentation Based on Memory Matrix and Kalman Filter

Moving object detection method based on complex fuzzy logic system

A Fast and Accurate Moving Object Extraction Scheme in the MPEG Compressed Domain

Optical Flow Based Real-time Moving Object Detection in Unconstrained Scenes.

Moving Object Detection in Freely Moving Camera via Global Motion Compensation and Local Spatial Information Fusion