Abstract:Although deep learning techniques have potential in vehicle behavior prediction, it is difficult to integrate traffic rules and environmental information. Moreover, its black-box nature leads to an opaque and difficult-to-interpret prediction process, limiting its acceptance in practical applications. In contrast, ontology reasoning, which can utilize human domain knowledge and mimic human reasoning, can provide reliable explanations for the speculative results. To address the limitations of the above deep learning methods in the field of vehicle behavior prediction, this paper proposes a front vehicle behavior prediction method that combines deep learning techniques with ontology reasoning. Specifically, YOLOv5s is first selected as the base model for recognizing the brake light status of vehicles. In order to further enhance the performance of the model in complex scenes and small target recognition, the Convolutional Block Attention Module (CBAM) is introduced. In addition, so as to balance the feature information of different scales more efficiently, a weighted bi-directional feature pyramid network (BIFPN) is introduced to replace the original PANet structure in YOLOv5s. Next, using a four-lane intersection as an application scenario, multiple factors affecting vehicle behavior are analyzed. Based on these factors, an ontology model for predicting front vehicle behavior is constructed. Finally, for the purpose of validating the effectiveness of the proposed method, we make our own brake light detection dataset. The accuracy and mAP@0.5 of the improved model on the self-made dataset are 3.9% and 2.5% higher than that of the original model, respectively. Afterwards, representative validation scenarios were selected for inference experiments. The ontology model created in this paper accurately reasoned out the behavior that the target vehicle would slow down until stopping and turning left. The reasonableness and practicality of the front vehicle behavior prediction method constructed in this paper are verified.

Behavior selector for autonomous vehicles using neural networks

Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

Behavior Decision-making Method for Autonomous Vehicle

Behavior Cloning for Mini Autonomous Car Path Following

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

A Reinforcement Learning Approach for Enacting Cautious Behaviours in Autonomous Driving System: Safe Speed Choice in the Interaction With Distracted Pedestrians

Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis

Vision Based Obstacle Detection and Navigation of an Autonomous Vehicle

An Ontology-Based Vehicle Behavior Prediction Method Incorporating Vehicle Light Signal Detection

Autonomous Driving Implementation in an Experimental Environment

Autonomous driving in traffic with end-to-end vision-based deep learning

Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review

An R–A dual network detection model for abnormal behavior of running vehicles

Object Detection with Deep Neural Networks for Reinforcement Learning in the Task of Autonomous Vehicles Path Planning at the Intersection

Design and Implementation of Deep Neural Network-Based Control for Automatic Parking Maneuver Process

ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles

Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach

A high-speed human-like collision avoidance controller based on a neural network under different road adhesion coefficients

Driving Behavior Recognition Algorithm Combining Attention Mechanism and Lightweight Network

A Novel Model-Based Driving Behavior Recognition System Using Motion Sensors.

On-Board Unit (OBU)-Supported Longitudinal Driving Behavior Monitoring Using Machine Learning Approaches