Abstract:Key-point-based scene understanding is fundamental for autonomous driving applications. At the same time, optical flow plays an important role in many vision tasks. However, due to the implicit bias of equal attention on all points, classic data-driven optical flow estimation methods yield less satisfactory performance on key points, limiting their implementations in key-point-critical safety-relevant scenarios. To address these issues, we introduce a points-based modeling method that requires the model to learn key-point-related priors explicitly. Based on the modeling method, we present FocusFlow, a framework consisting of 1) a mix loss function combined with a classic photometric loss function and our proposed Conditional Point Control Loss (CPCL) function for diverse point-wise supervision; 2) a conditioned controlling model which substitutes the conventional feature encoder by our proposed Condition Control Encoder (CCE). CCE incorporates a Frame Feature Encoder (FFE) that extracts features from frames, a Condition Feature Encoder (CFE) that learns to control the feature extraction behavior of FFE from input masks containing information of key points, and fusion modules that transfer the controlling information between FFE and CFE. Our FocusFlow framework shows outstanding performance with up to +44.5% precision improvement on various key points such as ORB, SIFT, and even learning-based SiLK, along with exceptional scalability for most existing data-driven optical flow methods like PWC-Net, RAFT, and FlowFormer. Notably, FocusFlow yields competitive or superior performances rivaling the original models on the whole frame. The source code will be available at <a class="link-external link-https" href="https://github.com/ZhonghuaYi/FocusFlow_official" rel="external noopener nofollow">this https URL</a>.

Brain-like position measurement method based on improved optical flow algorithm

An Improved Optical Flow Algorithm Based on Mask-R-CNN and K-Means for Velocity Calculation

Doppler Velocity-Based Algorithm for Clustering and Velocity Estimation of Moving Objects

Gray Consistency Optical Flow Algorithm Based on Mask-R-cnn and a Spatial Filter for Velocity Calculation

MOP-SLAM: A real time SLAM system based on multi-head optical flow estimation network

Integrated Velocity Measurement Algorithm Based on Optical Flow and Scale-Invariant Feature Transform

Efficient LiDAR Odometry for Autonomous Driving.

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Video-Based Vehicle Speed Measurement Using Recurrent All-Pairs Field Transforms for Optical Flow

Optical Flow Matters: an Empirical Comparative Study on Fusing Monocular Extracted Modalities for Better Steering

Position and Vector Detection of Blind Spot motion with the Horn-Schunck Optical Flow

Freespace Optical Flow Modeling for Automated Driving

Motion Estimation Using Region-Level Segmentation and Extended Kalman Filter for Autonomous Driving

Dynamic Scene's Laser Localization by NeuroIV-Based Moving Objects Detection and LiDAR Points Evaluation

Synthetic Velocity Measurement Algorithm of Monocular Vision Based on Square-Root Cubature Kalman Filter

A Novel Tracking Method Based on Improved FAST Corner Detection and Pyramid LK Optical Flow

Vehicle Tracking and Speed Estimation using Optical Flow Method

Brain-Like Navigation Scheme Based on MEMS-INS and Place Recognition

A fast coarse-to-fine point cloud registration based on optical flow for autonomous vehicles

Non-metric navigation for mobile robot using optical flow

FocusFlow: Boosting Key-Points Optical Flow Estimation for Autonomous Driving