Abstract:Abstract Earthwork excavator, as an all-terrain and high-efficiency earthwork excavation equipment, has been widely used in earthwork sites. It is very necessary to analyze the work of earthmoving excavator by means of machine vision. In this paper, the action segmentation method based on long video was applied to the analysis and recogniton of the excavator’s action, and compared with other two current best action segmentation models using the real construction site video. Firstly, the sequence features of the excavator’s work video obtained at the cnstruction site was extracted through 3D convolution method, and then two differernt networks with the extracted sequence features were trained and tested. The experimental results showed that the average frame accuracy of MS-TCN model and ASRF model in excavator action segmentation were 82.6490% and 86.1042% respectively. However, for the recognition task under different working environment, the performance of the two models is quite different. The experimental results manifest that the motion segmentation model based on long video reached good results in excavator motion recognition in earthmoving operation. And it is helpful to analyze the long video working behavior sequence of excavator. This research contributes to the identification of critical elements that explains serial action and to the development of a new application scenario for vision-based behavior segmentation network. Additionally, the results of this study were helpful to automatically analyze the working efficiency and monitor the productivity of earthmoving excavators. Using this kind of data-driven decision can improve the work efficiency of earthmoving excavator and promote the project progress.

Using Temporal Convolutional Networks to Enable Action Recognition for Construction Equipment.

A Deep Learning-Based Approach to Enable Action Recognition for Construction Equipment

A Channel-Wise Spatial-Temporal Aggregation Network for Action Recognition

Vision-Based Action Recognition Of Construction Workers Using Dense Trajectories

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Long Video-Based Action Segmentation for Earthmoving Excavators Using Improved Temporal Convolutional Network Models

Automatic Recognition of Construction Worker Activities Using Dense Trajectories

Temporal Distinct Representation Learning for Action Recognition

Temporal Segment Networks: Towards Good Practices for Deep Action Recognition

Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network.

STCA: an action recognition network with spatio-temporal convolution and attention

Spatio-Temporal Adaptive Network with Bidirectional Temporal Difference for Action Recognition

Temporal Transformer Networks with Self-Supervision for Action Recognition.

Dual attention-based deep learning for construction equipment activity recognition considering transition activities and imbalanced dataset

T-C3D: Temporal Convolutional 3D Network for Real-Time Action Recognition

Temporal Action Detection Based on Temporal Convolutional Network with Coarse-Grained Clips Construction

NAS-TC: Neural Architecture Search on Temporal Convolutions for Complex Action Recognition

A Deep Learning Network for Action Recognition Incorporating Temporal Attention Mechanism

Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition

3D convolutional neural network‐based one‐stage model for real‐time action detection in video of construction equipment

Long-term 3D Convolutional Fusion Network for Action Recognition