Abstract:Vehicular networks are exposed to various threats resulting from malicious attacks. These threats compromise the security and reliability of communications among road users, thereby jeopardizing road and traffic safety. One of the main vectors of these attacks within vehicular networks is misbehaving vehicles. To address this challenge, we propose deploying a pretrained Large Language Model (LLM)-empowered Misbehavior Detection System (MDS) within an edge-cloud detection framework. Specifically, we fine-tune Mistral-7B, a state-of-the-art LLM, as the edge component to enable real-time detection, whereas a larger LLM deployed in the cloud can conduct a more comprehensive analysis. Our experiments conducted on the extended VeReMi dataset demonstrate Mistral-7B's superior performance, achieving 98\% accuracy compared to other LLMs such as LLAMA2-7B and RoBERTa. Additionally, we investigate the impact of window size on computational costs to optimize deployment efficiency. Leveraging LLMs in MDS shows interesting results in improving the detection of vehicle misbehavior, consequently strengthening vehicular network security to ensure the safety of road users.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to detect malicious behavior in vehicle networks. Specifically, vehicle - to - everything (V2X) networks face various threats from malicious attacks, which can undermine the communication security and reliability among road users and, in turn, endanger road and traffic safety. One of the main attack vectors is abnormally - behaving vehicles, which can launch denial - of - service (DoS) attacks, interfere with communication between vehicles, and lead to traffic disruptions or safety accidents. Therefore, detecting abnormal behavior of vehicles is crucial for ensuring the security of vehicle communication systems. However, due to the dynamics of the traffic environment and the diversity of abnormal behavior forms, this challenge is very complex. In addition, the large amount of data generated by vehicles increases the difficulty of real - time analysis.
To address this challenge, the paper proposes a behavior detection system (MDS) based on pre - trained large - language models (LLMs) and deploys it in an edge - cloud detection framework. Specifically, the researchers fine - tuned Mistral - 7B, a state - of - the - art LLM, as an edge component to achieve real - time detection, while larger LLMs are deployed in the cloud for more comprehensive analysis. In this way, the capabilities of LLMs are utilized to extract insights from the text data of vehicle communications, and language features that may represent abnormal behavior patterns are identified through semantic analysis and context understanding, thereby enhancing the security of vehicle networks and ensuring the safety of road users.
The main contributions of the paper include:
- Using Mistral - 7B for abnormal behavior detection based on observed basic safety messages (BSMs).
- Transforming the vehicle abnormal behavior detection task into a sequence classification task, that is, converting a series of BSMs sent by a specific vehicle into text prompts for classification by the language model.
- Fine - tuning Mistral - 7B so that it can evaluate the nature of vehicle behavior through a series of broadcast BSMs, thus forming MistralBSM.
- Evaluating the performance of Mistral - 7B and other well - known open - source LLMs (such as LLAMA2 - 7B and the BERT architecture) in MDS and demonstrating its superior results.
Through these methods, the paper aims to improve the accuracy of abnormal behavior detection in vehicle networks, while optimizing deployment efficiency and ensuring data privacy.