Abstract:Gait phase prediction is important in controlling assistive robotic devices such as exoskeletons, where the control unit must differentiate between gait phases to provide the necessary assistance when the user is wearing the exoskeleton. To achieve the objective of precisely identifying the gait phase of users for the accurate control of the exoskeleton, this study proposes Auto-Correlation and Channel Attention enhanced Deep Graph Convolutional Networks (ACCA-DGCN) for gait phase prediction, and a gait phase prediction model based on multiple inertial measurement units (IMUs) and skeleton graph was established, in order to fully utilize the dependency among joints, and enhance accuracy and reliability of gait phase prediction. First, a human lower limb gait data acquisition equipment was developed, and the gait data of human walking were collected. The skeleton graph of the human lower limb was constructed through the natural connection relationship of joints in the human skeleton. After that, the ACCA-DGCN-based gait phase prediction model was constructed by using the gait data of human walking. Auto-Correlation (AC) and Efficient Channel Attention (ECA) were introduced to effectively capture periodic features of gait data and focus on the channels with high contributions to gait phase prediction. Finally, the effect of the window size on the performance of the ACCA-DGCN model was explored, and the proposed algorithm was compared with the other five deep learning algorithms: CNN, RNN, TCN, LSTM, and DGCN. The experimental results show that the average accuracy of gait phase prediction model based on ACCA-DGCN reaches up to 92.26% and 97.21% in user-independent and user-dependent experiments, respectively, which is superior to the other five algorithms. This study provides a new method for gait phase prediction, which is useful for improving the control of exoskeleton robots.

Spatial and temporal attention embedded spatial temporal graph convolutional networks for skeleton based gait recognition with multiple IMUs

A Multi-Head Pseudo Nodes Based Spatial–temporal Graph Convolutional Network for Emotion Perception from GAIT

Multi-scale Spatio-Temporal Network for Skeleton-Based Gait Recognition.

Gait Recognition Algorithm Based on Spatial-temporal Graph Neural Network

Spatiotemporal smoothing aggregation enhanced multi-scale residual deep graph convolutional networks for skeleton-based gait recognition

Dynamic long short-term memory network for skeleton-based gait recognition

Gait Recognition Based on 3D Skeleton Data and Graph Convolutional Network

JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping

Skeleton-based abnormal gait recognition with spatio-temporal attention enhanced gait-structural graph convolutional networks

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Auto-Correlation and Channel Attention Enhanced Deep Graph Convolution Networks for Gait Phase Prediction Based on Multi-IMU System

Spatial Transformer Network on Skeleton‐based Gait Recognition

Condition-Adaptive Graph Convolution Learning for Skeleton-Based Gait Recognition

Gait Neural Network for Human-Exoskeleton Interaction

SkeletonGait: Gait Recognition Using Skeleton Maps

Human Gait Phases Recognition Based on Multi-Source Data Fusion and BILSTM Attention Neural Network

Gait Recognition with Multiple-Temporal-Scale 3D Convolutional Neural Network

Enhancing human behavior recognition with spatiotemporal graph convolutional neural networks and skeleton sequences

Learning Temporal Attention Based Keypoint-Guided Embedding for Gait Recognition

Gait Identification under Surveillance Environment based on Human Skeleton

Gait pattern recognition based on electroencephalogram signals with common spatial pattern and graph attention networks