Abstract:Vehicle-to-Vehicle (V2V) cooperative perception has become increasingly popular in the field of autonomous driving, effectively overcoming the inherent limitations of single-vehicle perception systems, such as limited range and susceptibility to occlusions. In a V2V system, vehicles in close proximity can share perception data. To fuse this data, which is collected from different viewpoints by each vehicle, accurate pose information (including position and heading direction) is essential to transform the received data to the receiving vehicle's viewpoint. However, pose errors, often caused by measurement noise or sensor failures, can lead to severe misalignment during data fusion, resulting in incorrect object detections and potentially hazardous decisions in autonomous driving systems. To address this challenge, we present BB-Align, a lightweight pose recovery framework that utilizes Lidar Bird's-eye View (BV) images and object bounding Boxes for relative pose estimation. Designed as a plug-and-play solution, the proposed method requires no additional model training, enabling effortless integration into existing V2V systems. Our approach uses Lidar-derived BV images with a Log-Gabor filter-based feature map for effective image matching despite image sparsity. To reduce errors from self-motion distortion, we also integrate object bounding boxes for finer alignment. The proposed method is rigorously evaluated on the V2V4Real dataset-currently the only real-world V2V dataset. Our approach demonstrates high pose estimation accuracy, outperforming an existing graph-matching method. It achieves translation and rotation errors of less than 1 m and 1., respectively, in 80% of cases within a 70 m range between vehicles. Furthermore, by integrating the proposed framework into cooperative object detection models under serious pose error, the result shows up to a 2x increase in Average Precision (AP) compared to those without pose recovery, with more pronounced improvements in the short range.

Recognizing the Formations of CVBG Based on Shape Context Using Electronic Reconnaissance Data

Learning Visual Context for Group Activity Recognition.

BB-Align: A Lightweight Pose Recovery Framework for Vehicle-to-Vehicle Cooperative Perception

Shape Representation and Recognition in High Dimensional Feature Space

Vision-Based Formation Control for a Heterogeneous Multi-Robot System

Vision-Based Formation Control Of A Heterogeneous Unmanned System

Modeling of Fleet Air Defense Simulation and an Model for Suspicious Object Identification

Ship Target Detection in Optical Remote Sensing Images Based on Spatial and Frequency Features

BVMatch: Lidar-based Place Recognition Using Bird's-eye View Images

Ship Formation Identification with Spatial Features and Deep Learning for HFSWR

A Shape Recognition Method Based on Graph- and Line-Contexts

A multi-source information fusion method for ship target recognition based on Bayesian inference and evidence theory

Robust Visual Place Recognition Based on Context Information

Shape Recognition Using Complex Nonlinear Exponential Autoregressive Model

GNSS Measurement-Based Context Recognition for Vehicle Navigation using Gated Recurrent Unit

Space Target Recognition Based on Gramian Angular Field Representation and Attention Mechanism

Real-time Recognition Method of The Ship Object Based on Video Image

Dynamic Screening Strategy Based on Feature Graphs for UAV Object and Group Re-Identification

Fast Recognition and Pose Estimation Algorithm for Space Cooperative Target via Mono-vision

A Viewpoint Adaptation Ensemble Contrastive Learning framework for vessel type recognition with limited data

Space Target Recognition Based on Radar Network Systems With BiGRU-Transformer and Dual Graph Fusion Network