AccidentGPT: A V2X Environmental Perception Multi-modal Large Model for Accident Analysis and Prevention
Lening Wang,Yilong Ren,Han Jiang,Pinlong Cai,Daocheng Fu,Tianqi Wang,Zhiyong Cui,Haiyang Yu,Xuesong Wang,Hanchu Zhou,Helai Huang,Yinhai Wang
DOI: https://doi.org/10.1109/iv55156.2024.10588374
2024-01-01
Abstract:Traffic accidents are a significant factor leading to injuries and property losses, prompting extensive research in the field of traffic safety. However, previous studies, whether focused on static environment assessment, dynamic driving analysis, pre-accident prediction, or post-accident rule checks, have often been conducted independently. Our introduces V2X Environmental Perception Multi-modal Large Model AccidentGPT for accident analysis and prevention. AccidentGPT establishes a multi-modal information interaction framework based on multisensory perception. It adopts a holistic approach to address traffic safety issues, providing environmental perception for autonomous vehicles to avoid collisions and maintain control. In human-driven vehicles, it offers proactive safety warnings, blind spot alerts, and driving suggestions through human-machine dialogue. Additionally, it aids traffic police and management agencies in considering factors such as pedestrians, vehicles, roads, and the environment for intelligent real-time analysis of traffic safety. The system also conducts a thorough analysis of accident causes and post-accident liabilities, making it the first large-scale model to integrate comprehensive scene understanding into traffic safety research. Project page: https://accidentgpt.github.io
What problem does this paper attempt to address?