Abstract:Motion object detection (MOD) with freely moving cameras is a challenging task in computer vision. To extract moving objects, most studies have focused on the difference in motion features between foreground and background, which works well for dynamic scenes with relatively regular movements and variations. However, abrupt illumination changes and occlusions often occur in real-world scenes, and the camera may also pan, tilt, rotate, and jitter, etc., resulting in local irregular variations and global discontinuities in motion features. Such complex and changing scenes bring great difficulty in detecting moving objects. To solve this problem, this paper proposes a new MOD method that effectively leverages local and global visual information for foreground/background segmentation. Specifically, on the global side, to support a wider range of camera motion, the relative inter-frame transformations are optimized to absolute transformations referenced to intermediate frames in a global form after enriching the inter-frame matching pairs. The global transformation is fine-tuned using the spatial transformer network (STN). On the local side, to address the problem of dynamic background scenes, foreground object detection is optimized by utilizing the pixel differences between the current frame and the local background model, as well as the consistency of local spatial variations. Then, the spatial information is combined using optical flow segmentation methods, enhancing the precision of the object information. The experimental results show that our method achieves a detection accuracy improvement of over 1.5% compared with the state-of-the-art methods on the datasets of CDNET2014, FBMS-59, and CBD. It demonstrates significant effectiveness in challenging scenarios such as shadows, abrupt changes in illumination, camera jitter, occlusion, and moving backgrounds.

Moving Object Detection Based on Sub-Block Motion Compensation

Moving Object Detection Using an In-Vehicle Fish-Eye Camera

Real-time Digital Image Stabilization Method Based on Projection Algorithm and Block Matching

A New Detection and Tracking Algorithm for Moving Objects

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

Vehicles Detection and Tracking Based on the Sub-Feature

Motion deblurring based on local temporal compressive sensing for remote sensing image

Optical Correlator Based System For Displacement Auto Detection

Real time motion compensation technology based on least square support vector machine prediction

Detecting moving objects under a moving camera in complex environments

Fish-eye image correction method and technique based on geometrical imaging model

Real-time Detection, Tracking, and Classification of Moving and Stationary Objects using Multiple Fisheye Images

Moving Object Detection in Freely Moving Camera via Global Motion Compensation and Local Spatial Information Fusion

Moving object detection method based on complex fuzzy logic system

FisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Driving

Independent Moving Object Detection Based on a Vehicle Mounted Binocular Camera

A Detection and Tracking System for Fisheye Videos from Traffic Intersections

Semantic Plane-Structure Based Motion Detection with a Nonstationary Camera

Automatic Moving Object Detecting and Tracking from Astronomical CCD Image Sequences

Image motion compensation method on reflector multi degree of freedom of aerial cameras