Abstract:The paper addresses the vehicle-to-X (V2X) data fusion for cooperative or collective perception (CP). This emerging and promising intelligent transportation systems (ITS) technology has enormous potential for improving efficiency and safety of road transportation. Recent advances in V2X communication primarily address the definition of V2X messages and data dissemination amongst ITS stations (ITS-Ss) in a traffic environment. Yet, a largely unsolved problem is how a connected vehicle (CV) can efficiently and consistently fuse its local perception information with the data received from other ITS-Ss. In this paper, we present a novel data fusion framework to fuse the local and V2X perception data for CP that considers the presence of cross-correlation. The proposed approach is validated through comprehensive results obtained from numerical simulation, CARLA simulation, and real-world experimentation that incorporates V2X-enabled intelligent platforms. The real-world experiment includes a CV, a connected and automated vehicle (CAV), and an intelligent roadside unit (IRSU) retrofitted with vision and lidar sensors. We also demonstrate how the fused CP information can improve the awareness of vulnerable road users (VRU) for CV/CAV, and how this information can be considered in path planning/decision making within the CAV to facilitate safe interactions.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to efficiently and consistently fuse the local perception information of vehicles with the data received from other Intelligent Transportation System Stations (ITS - Ss) through V2X communication in the Vehicle - to - Everything (V2X) environment, so as to achieve Cooperative Perception (CP). Specifically, the paper focuses on how to deal with the cross - correlation problem among perception data from different sources to ensure that the fused information is both safe and reliable. ### Problem Background In recent years, V2X technology has made remarkable progress in the field of Intelligent Transportation Systems (ITS), especially in defining V2X messages and data dissemination. However, a key unresolved problem is: **How to effectively fuse the local perception information of Connected Vehicles (CV) with the data received from other ITS - Ss**. Most of the existing data fusion methods assume that the perception information received from other ITS - Ss is an independent object observation, thus ignoring the estimation dependence, which may lead to inaccurate or inconsistent fusion results. ### Specific Problems 1. **Cross - Correlation Problem**: When multiple ITS - Ss share the trajectories of perception objects, there may be cross - correlations among these trajectories. If this correlation is ignored during the fusion process, the uncertainty of the estimation result will be underestimated, which in turn will affect the safety of the system. 2. **Limitations of Perception Range and Quality**: The perception range and field of view of on - board sensors are limited and are easily affected by obstructions (such as buildings, trees, and other road users) in the urban environment. Therefore, an effective data fusion method is required to expand the perception range and improve the perception quality. 3. **Limitations of Existing Methods**: Most of the existing data fusion methods assume that the perception information is independent and do not fully consider the advantages of cross - platform sensor fusion. For example, some methods treat the received perception data as pre - processed but independent sensing measurements and do not require track - level fusion, which limits the fusion effect. ### Solutions The paper proposes a new probabilistic V2X data fusion framework to solve the above problems. The main contributions of this framework include: 1. **Joint Fusion of Different Types of Perception Information**: Support the joint fusion of local perception data, independent object observations, and object trajectories received from other cooperative ITS - Ss through V2X communication in a host CV. 2. **Probabilistic Track Fusion Scheme Based on Covariance Intersection (CI)**: Adopt the CI algorithm to achieve safe and consistent multi - source perception information fusion without knowing any cross - correlation information. The CI algorithm can handle the estimation fusion of unknown cross - correlations and ensure the consistency and reliability of the estimation results. 3. **Enhance the Safety of Cooperative Perception**: Demonstrate the crucial role of cooperative perception in improving the operational safety of Connected and Autonomous Vehicles (CAV), especially in cases of visual occlusion or perception sensor failure. CAV can use the fused V2X perception information for path planning and decision - making to ensure safe interactions with Vulnerable Road Users (VRU). ### Verification and Application This framework has been verified through numerical simulation, CARLA simulation, and real - world experiments, proving its effectiveness in reducing estimation uncertainty, improving perception quality, and safety. The experimental results show that by fusing the perception data of more ITS - Ss, the estimated uncertainty can be significantly reduced, and the perception ability of surrounding road users can be improved. ### Summary The core objective of the paper is to develop a V2X data fusion framework that can handle cross - correlations and effectively fuse multi - source perception information, thereby enhancing the efficiency and safety of intelligent transportation systems.

A Novel Probabilistic V2X Data Fusion Framework for Cooperative Perception

Slim-FCP: Lightweight-Feature-Based Cooperative Perception for Connected Automated Vehicles

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

V2X Cooperative Perception for Autonomous Driving: Recent Advances and Challenges

Cooperative Perception With Learning-Based V2V Communications

Enhancing Track Management Systems with Vehicle-To-Vehicle Enabled Sensor Fusion

V2X-AHD:Vehicle-to-Everything Cooperation Perception via Asymmetric Heterogenous Distillation Network

Unified End-to-End V2X Cooperative Autonomous Driving

Demonstrations of Cooperative Perception: Safety and Robustness in Connected and Automated Vehicle Operations

Consensus-Based Distributed Cooperative Perception for Connected and Automated Vehicles

Cooperative Sensing and Heterogeneous Information Fusion in VCPS: A Multi-agent Deep Reinforcement Learning Approach

An Efficient Key Distribution System for Data Fusion in V2X Heterogeneous Networks

Cooperative Perception Technology of Autonomous Driving in the Internet of Vehicles Environment: A Review

Dynamic V2X Autonomous Perception from Road-to-Vehicle Vision

Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Clouds

A Cooperative Perception Environment for Traffic Operations and Control

Multi-sensor fusion algorithm in cooperative vehicle-infrastructure system for blind spot warning

V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer

PACP: Priority-Aware Collaborative Perception for Connected and Autonomous Vehicles

OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication