Abstract:Stereo videos for the dynamic scenes often show unpleasant blurred effects due to the camera motion and the multiple moving objects with large depth variations. Given consecutive blurred stereo video frames, we aim to recover the latent clean images, estimate the 3D scene flow and segment the multiple moving objects. These three tasks have been previously addressed separately, which fail to exploit the internal connections among these tasks and cannot achieve optimality. In this paper, we propose to jointly solve these three tasks in a unified framework by exploiting their intrinsic connections. To this end, we represent the dynamic scenes with the piece-wise planar model, which exploits the local structure of the scene and expresses various dynamic scenes. Under our model, these three tasks are naturally connected and expressed as the parameter estimation of 3D scene structure and camera motion (structure and motion for the dynamic scenes). By exploiting the blur model constraint, the moving objects and the 3D scene structure, we reach an energy minimization formulation for joint deblurring, scene flow and segmentation. We evaluate our approach extensively on both synthetic datasets and publicly available real datasets with fast-moving objects, camera motion, uncontrolled lighting conditions and shadows. Experimental results demonstrate that our method can achieve significant improvement in stereo video deblurring, scene flow estimation and moving object segmentation, over state-of-the-art methods.

Two-View Motion Segmentation by Gaussian Blurring Mean Shift with Fitness Measure

Motionobject segmentation algorithm based on spatial-temporal information

A New Approach for Real-Time Segmenting Moving Objects under Cluttered Background

A Divided-And-Conquer Algorithm Based On Guided Selection For Two-View Motion Segmentation

Contour Based Automatic Scene Segmentation in Image Sequences

Two-view Motion Segmentation by Divided-and-Conquer Algorithm with Guided-Selection

Automatic And Robust Classification Of Independent Motions In Video Sequences

A biologically inspired method for estimating 2D high-speed translational motion

A New Approach To Two-View Motion Segmentation Using Global Dimension Minimization

Moving Vehicles Segmentation Based on Bayesian Framework for Gaussian Motion Model

Moving Vehicles Segmentation Based On Gaussian Motion Model

Human body motion tracking based on Bayesian segmentation and grey prediction

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

A Unified Algebraic Approach to 2-D and 3-D Motion Segmentation and Estimation

A New Improvement on Mean-Shift Algorithm

Joint Stereo Video Deblurring, Scene Flow Estimation and Moving Object Segmentation

Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction

Human motion tracking and 3D motion track detection technology based on visual information features and machine learning

Motion Segmentation from a Moving Monocular Camera

Point-State Segmentation for Dynamic Scenes via Probability Model and Orientation Consistency

A Spatial-Motion-Segmentation Algorithm by Fusing EDPA and Motion Compensation.