Abstract:Although deep learning techniques have potential in vehicle behavior prediction, it is difficult to integrate traffic rules and environmental information. Moreover, its black-box nature leads to an opaque and difficult-to-interpret prediction process, limiting its acceptance in practical applications. In contrast, ontology reasoning, which can utilize human domain knowledge and mimic human reasoning, can provide reliable explanations for the speculative results. To address the limitations of the above deep learning methods in the field of vehicle behavior prediction, this paper proposes a front vehicle behavior prediction method that combines deep learning techniques with ontology reasoning. Specifically, YOLOv5s is first selected as the base model for recognizing the brake light status of vehicles. In order to further enhance the performance of the model in complex scenes and small target recognition, the Convolutional Block Attention Module (CBAM) is introduced. In addition, so as to balance the feature information of different scales more efficiently, a weighted bi-directional feature pyramid network (BIFPN) is introduced to replace the original PANet structure in YOLOv5s. Next, using a four-lane intersection as an application scenario, multiple factors affecting vehicle behavior are analyzed. Based on these factors, an ontology model for predicting front vehicle behavior is constructed. Finally, for the purpose of validating the effectiveness of the proposed method, we make our own brake light detection dataset. The accuracy and mAP@0.5 of the improved model on the self-made dataset are 3.9% and 2.5% higher than that of the original model, respectively. Afterwards, representative validation scenarios were selected for inference experiments. The ontology model created in this paper accurately reasoned out the behavior that the target vehicle would slow down until stopping and turning left. The reasonableness and practicality of the front vehicle behavior prediction method constructed in this paper are verified.

Image-based Structured Vehicle Behavior Analysis Inspired by Interactive Cognition

Vehicle Interaction Behavior Prediction with Self-Attention

Predicting Vehicle Behaviors Over An Extended Horizon Using Behavior Interaction Network

A General Framework of Learning Multi-Vehicle Interaction Patterns from Video

Vehicle Driving Behavior Analysis and Unified Modeling in Urban Road Scenarios

A Cognition‐inspired Trajectory Prediction Method for Vehicles in Interactive Scenarios

Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

Vehicle Feature Point Trajectory Clustering and Vehicle Behavior Analysis in Complex Traffic Scenes.

An Ontology-Based Vehicle Behavior Prediction Method Incorporating Vehicle Light Signal Detection

Multi-vehicle trajectory prediction and control at intersections using state and intention information

Vehicle Motion State Prediction Method Integrating Point Cloud Time Series Multiview Features and Multitarget Interactive Information

Safe, Efficient and Socially-Compatible Decision of Automated Vehicles: a Case Study of Unsignalized Intersection Driving

Game-Theoretic Modeling of Multi-Vehicle Interactions at Uncontrolled Intersections

An Integrated Architecture for Intelligence Evaluation of Automated Vehicles.

Modeling vehicle U-turning behavior near intersections: A deep learning approach based on TCN and multi-head attention

Self-Learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections

VTSIM: Attention‐Based Recurrent Neural Network for Intersection Vehicle Trajectory Simulation

Collision Avoidance Predictive Motion Planning Based on Integrated Perception and V2V Communication

Reward-Driven Automated Curriculum Learning for Interaction-Aware Self-Driving at Unsignalized Intersections

Trajectory-Based Conflict Investigations Involving Two-Wheelers and Cars at Non-Signalized Intersections with Computer Vision

Vehicle behavior analysis using reconstructed 3D parameters for road safety