Abstract:Motion object detection (MOD) with freely moving cameras is a challenging task in computer vision. To extract moving objects, most studies have focused on the difference in motion features between foreground and background, which works well for dynamic scenes with relatively regular movements and variations. However, abrupt illumination changes and occlusions often occur in real-world scenes, and the camera may also pan, tilt, rotate, and jitter, etc., resulting in local irregular variations and global discontinuities in motion features. Such complex and changing scenes bring great difficulty in detecting moving objects. To solve this problem, this paper proposes a new MOD method that effectively leverages local and global visual information for foreground/background segmentation. Specifically, on the global side, to support a wider range of camera motion, the relative inter-frame transformations are optimized to absolute transformations referenced to intermediate frames in a global form after enriching the inter-frame matching pairs. The global transformation is fine-tuned using the spatial transformer network (STN). On the local side, to address the problem of dynamic background scenes, foreground object detection is optimized by utilizing the pixel differences between the current frame and the local background model, as well as the consistency of local spatial variations. Then, the spatial information is combined using optical flow segmentation methods, enhancing the precision of the object information. The experimental results show that our method achieves a detection accuracy improvement of over 1.5% compared with the state-of-the-art methods on the datasets of CDNET2014, FBMS-59, and CBD. It demonstrates significant effectiveness in challenging scenarios such as shadows, abrupt changes in illumination, camera jitter, occlusion, and moving backgrounds.

Fusion of texture variation and on-line color sampling for moving object detection under varying chromatic illumination

An improved mean shift tracking algorithm based on color and texture feature

Moving object tracking under varying illumination conditions

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

A Human Movement Detection Algorithm on Mobile Phone Platform

Colour-Invariant Motion Detection under Fast Illumination Changes

Robust Moving Object Detection under Complex Background

Illumination-Invariant Motion Detection Using Colour Mixture Models

Moving shadow detection based on color ratio and texture invariance

A Robust Mean Shift Tracking Method Under Varying Illumination

A Fuzzy Background Model For Moving Object Detection

RESEARCH ON MOVING TARGET DETECTION IN AN ENVIRONMENT OF SUDDEN LIGHT CHANGING

Moving Object Detection in Freely Moving Camera via Global Motion Compensation and Local Spatial Information Fusion

Moving Object Detection and Shadow Removing under Changing Illumination Condition

Moving shadow detection using fusion of multiple features

A MOVING DETECTION METHOD COMBINING FRAME DIFFERENCE AND GAUSSIAN MIXTURE MODEL

Vision-Based Moving Objects Detection with Background Modeling

Video object matching across multiple non-overlapping camera views based on multi-feature fusion and incremental learning.

On illumination invariance in color object recognition

Robust Motion Detection with Color-texture Feature Fuzzy Approach