Abstract:Among the numerous work-related risk factors, construction workers are often exposed to awkward working postures that may lead them to develop work-related musculoskeletal disorders (WMSDs). To mitigate WMSDs among construction workers, awkward working posture recognition is the first step in proactive WMSD prevention. Several researchers have proposed wearable sensor-based systems and machine learning classifiers for awkward posture recognition. However, these wearable sensor-based systems (e.g., surface electromyography) are either intrusive or require attaching multiple sensors on workers' bodies, which may lead to workers' discomfort and systemic instability, thus, limiting their application on construction sites. In addition, machine learning classifiers are limited to human-specific shallow features which influence model performance. To address these limitations, this study proposes a novel approach by using wearable insole pressure system and recurrent neural network (RNN) models, which automate feature extraction and are widely used for sequential data classification. Therefore, the research objective is to automatically recognize and classify different types of awkward working postures in construction by using deep learning-based networks and wearable insole sensor data. The classification performance of three RNN-based deep learning models, namely: (1) long-short term memory (LSTM), (2) bidirectional LSTM (Bi-LSTM), and (3) gated recurrent units (GRU), was evaluated using plantar pressure data captured by a wearable insole system from workers on construction sites. The experimental results show that GRU model outperforms the other RNN-based deep learning models with a high accuracy of 99.01% and F1-score between 93.19% and 99.39%. These results demonstrate that GRU models can be employed to learn sequential plantar pressure patterns captured by a wearable insole system to recognize and classify different types of awkward working postures. The findings of this study contribute to wearable sensor-based posture-related recognition and classification, thus, enhancing construction workers' health and safety.

Lightweight Deep Learning Framework for Recognizing Construction Workers' Activities Based on Simplified Node Combinations

Direct activation of calcium-activated, phospholipid-dependent protein kinase by tumor-promoting phorbol esters.

A Skeleton-Based Assembly Action Recognition Method with Feature Fusion for Human-Robot Collaborative Assembly

Deep learning-based recognition of construction activities in real construction site environment

Recognizing workers' construction activities on a reinforcement processing area through the position relationship of objects detected by faster R-CNN

ANN-based automated scaffold builder activity recognition through wearable EMG and IMU sensors

Construction worker's awkward posture recognition through supervised motion tensor decomposition

Deep learning framework with Local Sparse Transformer for construction worker detection in 3D with LiDAR

Multiple-input Streams Attention (MISA) Network for Skeleton-Based Construction Workers' Action Recognition Using Body-Segment Representation Strategies

Skeleton-Based Activity Recognition for Process-Based Quality Control of Concealed Work via Spatial–Temporal Graph Convolutional Networks

A Lightweight Attentional Shift Graph Convolutional Network for Skeleton-Based Action Recognition

A light-weight skeleton human action recognition model with knowledge distillation for edge intelligent surveillance applications

Motion Recognition Method for Construction Workers Using Selective Depth Inspection and Optimal Inertial Measurement Unit Sensors

Lighter and faster: A multi-scale adaptive graph convolutional network for skeleton-based action recognition

Construction Motion Data Library: an Integrated Motion Dataset for On-Site Activity Recognition

A lightweight graph convolutional network for skeleton-based action recognition

A Human Activity Recognition System Based on Dynamic Clustering of Skeleton Data

An Efficient Human Activity Recognition Framework Based on Graph Convolutional Network for Human-Robot Collaboration

Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data

Human-Robot Collaboration Through a Multi-Scale Graph Convolution Neural Network With Temporal Attention

Leveraging Digital Perceptual Technologies for Remote Perception and Analysis of Human Biomechanical Processes: A Contactless Approach for Workload and Joint Force Assessment