Abstract:Recent technological advancements in artificial intelligence and computer vision have enabled gait analysis on portable devices such as cell phones. However, most state-of-the-art vision-based systems still impose numerous constraints for capturing a patient's video, such as using a static camera and maintaining a specific distance from it. While these constraints are manageable under professional observation, they pose challenges in home settings. Another issue with most vision-based systems is their output, typically a classification label and confidence value, whose reliability is often questioned by medical professionals. This paper addresses these challenges by presenting a novel system for gait analysis robust to camera movements and providing explanations for its output. The study utilizes a dataset comprising videos of subjects wearing two types of Knee Ankle Foot Orthosis (KAFO), namely "Locked Knee" and "Semi-flexion," for mobility, along with metadata and ground truth for explanations. The ground truth highlights the statistical significance of seven features captured using motion capture systems to differentiate between the two gaits. To address camera movement challenges, the proposed system employs super-resolution and pose estimation during pre-processing. It then identifies the seven features - Stride Length, Step Length and Duration of single support of orthotic and non-orthotic leg, Cadence, and Speed - using the skeletal output of pose estimation. These features train a multi-layer perceptron, with its output explained by highlighting the features' contribution to classification. While most state-of-the-art systems struggle with processing the video or training on the proposed dataset, our system achieves an average accuracy of 94%. The model's explainability is validated using ground truth and can be considered reliable.

BigFoot: Analysis, monitoring, tracking and sharing of bio-medical features of human appendages using consumer-grade home and office based imaging devices

Ankle Foot Motion Recognition Based on Wireless Wearable Semg and Acceleration Sensors for Smart AFO

3D Foot Reconstruction Based on Mobile Phone Photographing

Fast Tool to Evaluate 3D Movements of the Foot-Ankle Complex Using Multi-View Depth Sensors

Low Computational-Cost Footprint Deformities Diagnosis Sensor through Angles, Dimensions Analysis and Image Processing Techniques

A hybrid statistical morphometry free-form deformation approach to 3D personalized foot-ankle models

Image Processing Techniques in 3-D Foot Shape Measurement System

Measurement System for 3-D Foot Shapes under Different Loads

Software Based Higher Order Structural Foot Abnormality Detection Using Image Processing

Feature Based Framework to Detect Diseases, Tumor, and Bleeding in Wireless Capsule Endoscopy

Leveraging Digital Perceptual Technologies for Remote Perception and Analysis of Human Biomechanical Processes: A Contactless Approach for Workload and Joint Force Assessment

4D Feet: Registering Walking Foot Shapes Using Attention Enhanced Dynamic-Synchronized Graph Convolutional LSTM Network

Development and Application of 3-D Foot-Shape Measurement System under Different Loads

The Gait Analysis System Based on the First-Person Video for Applications on Home Health Care

A Multi-Camera Motion Capture System for Remote Healthcare Monitoring

Development of a system to profile foot temperatures of the plantar and the periphery

Dynamic 3D shape of the plantar surface of the foot using coded structured light: a technical report

XAI-based gait analysis of patients walking with Knee-Ankle-Foot orthosis using video cameras

Single snapshot spatial frequency domain imaging for risk stratification of diabetes and diabetic foot

A three-dimensional finite element foot-ankle model and its personalisation methods analysis

An exploratory study of dynamic foot shape measurements with 4D scanning system