Abstract:Structure-from-Motion (SfM) aims to recover 3D scene structures and camera poses based on the correspondences between input images, and thus the ambiguity caused by duplicate structures (i.e., different structures with strong visual resemblance) always results in incorrect camera poses and 3D structures. To deal with the ambiguity, most existing studies resort to additional constraint information or implicit inference by analyzing two-view geometries or feature points. In this paper, we propose to exploit high-level information in the scene, i.e., the spatial contextual information of local regions, to guide the reconstruction. Specifically, a novel structure is proposed, namely, track-community, in which each community consists of a group of tracks and represents a local segment in the scene. A community detection algorithm is performed on the track-graph to partition the scene into segments. Then, the potential ambiguous segments are detected by analyzing the neighborhood of tracks and corrected by checking the pose consistency. Finally, we perform partial reconstruction on each segment and align them with a novel bidirectional consistency cost function which considers both 3D-3D correspondences and pairwise relative camera poses. Experimental results demonstrate that our approach can robustly alleviate reconstruction failure resulting from visually indistinguishable structures and accurately merge the partial reconstructions.

Qualitative estimations of range and motion using spatio-temporal textural images

Motion energy model for estimating range and motion using spatio-temporal textural images

Stereo Camera Motion Estimation Based on Euclidean Reconstruction

TC-SfM: Robust Track-Community-Based Structure-from-Motion

A Variational Method for Recovering 3D Structure of Purely Rotational Object from Image Sequence

Robust Camera Motion Estimation in Video Sequences

State-space Analysis of Cardiac Motion with Biomechanical Constraints.

Visual Odometry in dynamical scenes

Optical Flow Estimation Based on Texture Constraints and Parametric Motion Model

Mobile Robot Pose Estimation by Qualitative Scan Matching with 2d Range Scans

Visualizing and Quantifying Small and Nonstationary Structural Motions in Video Measurement.

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

Three-dimensional motion estimation by straight-line and endpoint optical flow

Estimating small structural motions based on sparsity enforcement

A target-free video structural motion estimation method based on multi-path optimization

Efficient Non-Consecutive Feature Tracking for Robust Structure-From-Motion

Vision-based automatic structural motion estimation in presence of 3D camera motion effects

Estimating Structural Motions in Extreme Environmental Conditions——a Dynamic Correlation Filter Based Computer Vision Approach

Multi-view Target-Free Video Structural Motion Estimation: A Self-adaptive Co-calibration Model

Joint direct estimation of 3D geometry and 3D motion using spatio temporal gradients