Abstract:Gait analysis is an essential technique in treating patients with lower limb dysfunctions. Traditional methods often rely on expensive and complex equipment, such as wearable body sensors and a multi-camera with marker tracking system. Aiming for a more cost-effective yet accurate alternative, this paper introduces GaitFormer, a novel approach that leverages Vision Transformer (ViT) for gait analysis using minimal, non-invasive equipment, i.e. a single low-cost RGB camera. Initially, a unique dataset using a multi-camera system with marker tracking, comprising 6 walking patterns gathered from 80 volunteers is developed. The ViT-based GaitFormer is then proposed to automatically recognize human walking patterns through a single RGB camera. GaitFormer comprises hybrid networks for each step, including: (i) a cascaded convolutional 2D human key points estimation network; (ii) a ViT-based dual-stream spatial–temporal network extending the information of human key points into 3D; (iii) leveraging specific lower limb key joints' angle features for clinical gait analysis, capturing the geometric, kinematic, and physical attributes of human motion; (iv) employing a pure self-attention-based classification network to recognize clinical human walking patterns. The experiments are designed to comprehensively validate each step against various related baseline methods and multi-camera tracking syetem, with results demonstrating the promising performance of GaitFormer as an affordable, precise, and integrated solution. To the best of our knowledge, GaitFormer is the first hybrid CNN- and ViT-based end-to-end solution via low-cost device for clinically valuable gait analysis.

Low cost human gait on-line detection system

Development of low cost human gait analysis system

The Identification Method for the Lower Limb Posture Based on the Identification and Trace of Image

Flexible, Wireless, Multifunctional Integrated Electronic System for Daily Wearable Gait Detection

Real-time Analysis System of Human Motion Image

Development of a new low-cost computer vision system for human gait analysis: A case study

[Human Motion Analysis System Based on Common Video-Camera].

Human Wearable Gait Recognition System Based on Flexible and Distributed Pressure Sensor

LaserShoes: Low-Cost Ground Surface Detection Using Laser Speckle Imaging.

The flexible and distributed pressure sensor with 64 units for on-line gait recognition analysis

A New Approach for Human Gait Non-contact Detecting System Based on Continuous-wave Bio-radar

Monocular 3D Human Pose Markerless Systems for Gait Assessment

Development of a Low-Cost and Portable Walker-Based Human Motion Estimation System

A Low-Cost Instrumented Shoe System for Gait Phase Detection Based on Foot Plantar Pressure Data

[A Gait Analysis System Based on Digital Video and Digital Image Processing].

A Low-Cost End-to-End Semg-Based Gait Sub-Phase Recognition System.

A Fully Wireless Wearable Motion Tracking System with 3D Human Model for Gait Analysis

Human Posture Detection Method Based on Wearable Devices

Multifunctional Human-Computer Interaction System Based on Deep Learning-Assisted Strain Sensing Array

GaitFormer: Leveraging dual-stream spatial-temporal Vision Transformer via a single low-cost RGB camera for clinical gait analysis

Human Gait Acquisition and Handling Based on Image Processing