Abstract:The railway system is a prime example of a safety-critical system. Predicting the causes of railway accidents holds immense significance in enhancing railway transportation safety. Previous approaches to railway causation analysis have encountered huge challenges regarding data processing and analytical capabilities. To address this concern, this paper proposes an innovative deep model framework based on the Transformer architecture that utilizes historical data on railway equipment accidents to predict the causes behind such incidents. Firstly, this paper proposes the utilization of Convolutional Block Attention in the domain of text processing, serving as a lexical encoder to augment word semantics acquisition in accident texts. Subsequently, in order to address the deficiency of traditional Transformers that lack positional representation information, we propose incorporating a BiGRU (Bidirectional Gated Recurrent Unit) as a contextual positional information encoder to capture contextual positional information in railway accident data effectively. Finally, considering that accident data reports are discrete tabular data, this study suggests employing cue word techniques for preprocessing accident data to alleviate the model's learning burden. We applied the proposed model to the FRA (Federal Railroad Administration) dataset. The results demonstrate that our model surpasses the current state-of-the-art language models, exhibiting superior performance compared to the optimal model with a notable improvement of 3.56%, 0.42%, and 0.76% in Precision, Recall, and F1-score, respectively. Furthermore, our model accurately predicts accident categories prone to misjudgment even when trained on limited data, outperforming existing language models. The study findings will contribute to the prevention and management of railway accidents.

TransCrimeNet: A Transformer-Based Model for Text-Based Crime Prediction in Criminal Networks

DeepOffense: a Recurrent Network Based Approach for Crime Prediction

CrimeGraphNet: Link Prediction in Criminal Networks with Graph Convolutional Networks

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

CrimeGAT: Leveraging Graph Attention Networks for Enhanced Predictive Policing in Criminal Networks

CrimeGNN: Harnessing the Power of Graph Neural Networks for Community Detection in Criminal Networks

GATR: A Road Network Traffic Violation Prediction Method Based on Graph Attention Network

Spatial-Temporal Sequential Hypergraph Network for Crime Prediction with Dynamic Multiplex Relation Learning

Deep Learning Criminal Networks

Uncertainty-Aware Crime Prediction With Spatial Temporal Multivariate Graph Neural Networks

Railway Accident Causation Prediction with Improved Transformer Model Based on Lexical Information and Contextual Relationships

Exploring Transfer Learning for Crime Prediction

HDM-GNN: A Heterogeneous Dynamic Multi-view Graph Neural Network for Crime Prediction

Crime prediction using a hybrid sentiment analysis approach based on the bidirectional encoder representations from transformers

CrimeNet: Neural Structured Learning using Vision Transformer for violence detection

An imbalanced learning method based on graph tran-smote for fraud detection

Social Network Forensics Analysis Model Based on Network Representation Learning

CrimeTensor : Fine-Scale Crime Prediction via Tensor Learning with Spatiotemporal Consistency

Credit Card Fraud Detection Using Advanced Transformer Model

Network-Based Transfer Learning Helps Improve Short-Term Crime Prediction Accuracy

TRGCN: A Prediction Model for Information Diffusion Based on Transformer and Relational Graph Convolutional Network