Abstract:Scene flow estimation is one of the most crucial components of many scene understanding tasks, which represents the complete 3D motion of objects in dynamic scene. Most of existing scene flow estimation approaches are usually based on joint learning framework, which cast the problem of scene flow estimation to dense prediction of optical flow and stereo matching. However, these approaches need to reconstruct 3D motion from optical flow and disparity using 2D stereo image pairs, which leads the estimation process to be indirect. Recently, FlowNet3D attempts to learn scene flow from 3D point clouds, which adopts element-wise max-pooling to aggregate features from different points. Nevertheless, max-pooling operation only can obtain the strongest activation on features across a local or global region, which may increase the loss of some useful detailed and contextual. Specifically, for dense estimation task, the ability to transfer information gradually from coarse to fine layers is important. To address this problem, we investigate a new deep architecture, 3D point convolutional network, to learn scene flow from 3D point clouds. This specific architecture uses multi-layer perceptron (MLP) to approximate the weight function and applies a density scale to re-weight the learned weight functions for each convolutional filter, which can make the network permutation-invariant and translation invariant on 3D space which is beneficial for feature aggregation. Extensive experimental results are conducted on FlyingThings3D and KITTI scene flow datasets and show the effectiveness of our proposed approach. Our algorithm can achieve state-of-the-art performance on FlyingThings3D and KITTI datasets.

GloFP-MSF: Monocular Scene Flow Estimation with Global Feature Perception

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

GMSF: Global Matching Scene Flow

EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity

SSRFlow: Semantic-aware Fusion with Spatial Temporal Re-embedding for Real-world Scene Flow

3D Point Convolutional Network for Dense Scene Flow Estimation

GMFlow: Learning Optical Flow Via Global Matching

GCA-Net: A Global Context Aggregation Network for Effective Optical Flow

Self-Supervised Scene Flow Estimation with Point-Voxel Fusion and Surface Representation

SS-SF: Piecewise 3D Scene Flow Estimation With Semantic Segmentation

FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimation

Fast Multi-frame Stereo Scene Flow with Motion Segmentation

RAFT-MSF: Self-Supervised Monocular Scene Flow Using Recurrent Optimizer

CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoning

Self-Supervised Monocular Scene Flow Estimation

Semantic Flow: Learning Semantic Field of Dynamic Scenes from Monocular Videos

Monocular Scene Flow Estimation with Convolution Vision Transformer

MRDFlow: Unsupervised Optical Flow Estimation Network With Multi-Scale Recurrent Decoder

What Matters for 3D Scene Flow Network.

Optical Flow Estimation Using Channel Attention Mechanism and Dilated Convolutional Neural Networks.

Dense scene flow based on depth and multi-channel bilateral filter