Abstract:Vehicle-to-Vehicle (V2V) cooperative perception has become increasingly popular in the field of autonomous driving, effectively overcoming the inherent limitations of single-vehicle perception systems, such as limited range and susceptibility to occlusions. In a V2V system, vehicles in close proximity can share perception data. To fuse this data, which is collected from different viewpoints by each vehicle, accurate pose information (including position and heading direction) is essential to transform the received data to the receiving vehicle's viewpoint. However, pose errors, often caused by measurement noise or sensor failures, can lead to severe misalignment during data fusion, resulting in incorrect object detections and potentially hazardous decisions in autonomous driving systems. To address this challenge, we present BB-Align, a lightweight pose recovery framework that utilizes Lidar Bird's-eye View (BV) images and object bounding Boxes for relative pose estimation. Designed as a plug-and-play solution, the proposed method requires no additional model training, enabling effortless integration into existing V2V systems. Our approach uses Lidar-derived BV images with a Log-Gabor filter-based feature map for effective image matching despite image sparsity. To reduce errors from self-motion distortion, we also integrate object bounding boxes for finer alignment. The proposed method is rigorously evaluated on the V2V4Real dataset-currently the only real-world V2V dataset. Our approach demonstrates high pose estimation accuracy, outperforming an existing graph-matching method. It achieves translation and rotation errors of less than 1 m and 1., respectively, in 80% of cases within a 70 m range between vehicles. Furthermore, by integrating the proposed framework into cooperative object detection models under serious pose error, the result shows up to a 2x increase in Average Precision (AP) compared to those without pose recovery, with more pronounced improvements in the short range.

DeepKalPose: An enhanced deep‐learning Kalman filter for temporally consistent monocular vehicle pose estimation

DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation

BB-Align: A Lightweight Pose Recovery Framework for Vehicle-to-Vehicle Cooperative Perception

Stereo Visual-Inertial Odometry with Multiple Kalman Filters Ensemble

Unsupervised Cycle Optimization Learning for Single-View Depth and Camera Pose with Kalman Filter

Filter-Based Secure Dynamic Pose Estimation for Autonomous Vehicles

ACK-MSCKF: Tightly-Coupled Ackermann Multi-State Constraint Kalman Filter for Autonomous Vehicle Localization

FlexKalmanNet: A Modular AI-Enhanced Kalman Filter Framework Applied to Spacecraft Motion Estimation

Back to the Future: Joint Aware Temporal Deep Learning 3D Human Pose Estimation

Depth-aware Imbalance Learning for Monocular 6dof Vehicle Pose Estimation

MuDeepNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose Using Multi-view Consistency Loss

DeepAVO: Efficient Pose Refining with Feature Distilling for Deep Visual Odometry

TLIO: Tight Learned Inertial Odometry

KARNet: Kalman Filter Augmented Recurrent Neural Network for Learning World Models in Autonomous Driving Tasks

Learning Visual-Inertial Odometry With Robocentric Iterated Extended Kalman Filter

DeepVO: A Deep Learning approach for Monocular Visual Odometry

Kalman filter-based deep fused architecture for knee angle estimation

Learning Vehicle Trajectory Uncertainty

Multi-level Deep Learning Kalman Filter

Multi-vehicle Detection and Tracking Based on Kalman Filter and Data Association

Leveraging Deep Learning for Visual Odometry Using Optical Flow