Abstract:Collision accidents involving construction vehicles and workers frequently occur at construction sites. Computer vision (CV) technology presents an efficient solution for collision-risk pre-warning. However, CV-based methods are still relatively rare and need an enhancement of their performance. Therefore, a novel three-stage collision-risk pre-warning model for construction vehicles and workers is proposed in this paper. This model consists of an object-sensing module (OSM), a trajectory prediction module (TPM), and a collision-risk assessment module (CRAM). In the OSM, the YOLOv5 algorithm is applied to identify and locate construction vehicles and workers; meanwhile, the DeepSORT algorithm is applied to the real-time tracking of the construction vehicles and workers. As a result, the historical trajectories of vehicles and workers are sensed. The original coordinates of the data are transformed to common real-world coordinate systems for convenient subsequent data acquisition, comparison, and analysis. Subsequently, the data are provided to a second stage (TPM). In the TPM, the optimized transformer algorithm is used for a real-time trajectory prediction of the construction vehicles and workers. In this paper, we enhance the reliability of the general object detection and trajectory prediction methods in the construction environments. With the assistance afforded by the optimization of the model’s hyperparameters, the prediction horizon is extended, and this gives the workers more time to take preventive measures. Finally, the prediction module indicates the possible trajectories of the vehicles and workers in the future and provides these trajectories to the CRAM. In the CRAM, the worker’s collision-risk level is assessed by a multi-factor-based collision-risk assessment rule, which is innovatively proposed in the present work. The multi-factor-based assessment rule is quantitatively involved in three critical risk factors, i.e., velocity, hazardous zones, and proximity. Experiments are performed within two different construction site scenarios to evaluate the effectiveness of the collision-risk pre-warning model. The research results show that the proposed collision pre-warning model can accurately predict the collision-risk level of workers at construction sites, with good tracking and predicting effect and an efficient collision-risk pre-warning strategy. Compared to the classical models, such as social-GAN and social-LSTM, the transformer-based trajectory prediction model demonstrates a superior accuracy, with an average displacement error of 0.53 m on the construction sites. Additionally, the optimized transformer model is capable of predicting six additional time steps, which equates to approximately 1.8 s. The collision pre-warning model proposed in this paper can help improve the safety of construction vehicles and workers.

A digital twin-based motion forecasting framework for preemptive risk monitoring

Environment-Aware Worker Trajectory Prediction Using Surveillance Camera in Modular Construction Facilities

Environment-aware Worker Trajectory Prediction Using Surveillance Camera on Modular Construction Sites

Vision and Trajectory–Based Dynamic Collision Prewarning Mechanism for Tower Cranes

Deep learning-based activity-aware 3D human motion trajectory prediction in construction

Digital Twin-based Driver Risk-Aware Intelligent Mobility Analytics for Urban Transportation Management

A Novel Three-Stage Collision-Risk Pre-Warning Model for Construction Vehicles and Workers

Research on industrial risk early warning algorithms based on edge computing and multimodal data

Future Motion Dynamic Modeling Via Hybrid Supervision for Multi-Person Motion Prediction Uncertainty Reduction

DE-TGN: Uncertainty-Aware Human Motion Forecasting using Deep Ensembles

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Online Trajectory Prediction for Metropolitan Scale Mobility Digital Twin

ATDS: Adaptive Temporal and Dual Spatial Encoders for Motion Forecasting

EDRF: Enhanced Driving Risk Field Based on Multimodal Trajectory Prediction and Its Applications

Multi-Angle Fusion-Based Safety Status Analysis of Construction Workers.

Digital Twin-Based Risk Control during Prefabricated Building Hoisting Operations

A Deep Learning Method to Mitigate the Impact of Subjective Factors in Risk Estimation for Machinery Safety

A framework and method for Human-Robot cooperative safe control based on digital twin

Towards Online Risk Assessment for Human-Robot Interaction: A Data-Driven Hamilton-Jacobi-Isaacs Reachability Approach

An Integrating Comprehensive Trajectory Prediction with Risk Potential Field Method for Autonomous Driving

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion