Abstract:Background: Although deep neural networks (DNNs) are showing state of the art performance in clinical gait analysis, they are considered to be black-box algorithms. In other words, there is a lack of direct understanding of a DNN's ability to identify relevant features, hindering clinical acceptance. Interpretability methods have been developed to ameliorate this concern by providing a way to explain DNN predictions. Methods: This paper proposes the use of an interpretability method to explain DNN decisions for classifying the movement that precedes freezing of gait (FOG), one of the most debilitating symptoms of Parkinson's disease (PD). The proposed two-stage pipeline consists of (1) a convolutional neural network (CNN) to model the reduction of movement present before a FOG episode, and (2) layer-wise relevance propagation (LRP) to visualize the underlying features that the CNN perceives as important to model the pathology. The CNN was trained with the sagittal plane kinematics from a motion capture dataset of fourteen PD patients with FOG. The robustness of the model predictions and learned features was further assessed on fourteen PD patients without FOG and fourteen age-matched healthy controls. Results: The CNN proved highly accurate in modelling the movement that precedes FOG, with 86.8% of the strides being correctly identified. However, the CNN model was unable to model the movement for one of the seven patients that froze during the protocol. The LRP interpretability case study shows that (1) the kinematic features perceived as most relevant by the CNN are the reduced peak knee flexion and the fixed ankle dorsiflexion during the swing phase, (2) very little relevance for FOG is observed in the PD patients without FOG and the healthy control subjects, and (3) the poor predictive performance of one subject is attributed to the patient's unique and severely flexed gait signature. Conclusions: The proposed pipeline can aid clinicians in explaining DNN decisions in clinical gait analysis and aid machine learning practitioners in assessing the generalization of their models by ensuring that the predictions are based on meaningful kinematic features.

Causality-Enhanced Multiple Instance Learning With Graph Convolutional Networks for Parkinsonian Freezing-of-Gait Assessment

A Causality-Driven Graph Convolutional Network for Postural Abnormality Diagnosis in Parkinsonians.

Recognition of Freezing of Gait in Parkinson's Disease Based on Machine Vision

Automatic Detection and Assessment of Freezing of Gait Manifestations

Prediction of Freezing of Gait in Parkinson's disease based on multi-channel time-series neural network

Video-Based Detection of Freezing of Gait in Daily Clinical Practice in Patients With Parkinsonism

Modelling and identification of characteristic kinematic features preceding freezing of gait with convolutional neural networks and layer-wise relevance propagation

Topological Descriptors of Gait Nonlinear Dynamics Toward Freezing-of-Gait Episodes Recognition in Parkinson’s Disease

Feature-Set-Engineering for Detecting Freezing of Gait in Parkinson's Disease using Deep Recurrent Neural Networks

A causal counterfactual graph neural network for arising-from-chair abnormality detection in parkinsonians

Multimodal Freezing of Gait Detection: Analyzing the Benefits of Physiological Data

Freezing of Gait Prediction From Accelerometer Data Using a Simple 1D-Convolutional Neural Network -- 8th Place Solution for Kaggle's Parkinson's Freezing of Gait Prediction Competition

Sensoring and Application of Multimodal Data for the Detection of Freezing of Gait in Parkinson's Disease

Machine learning approach for predicting state transitions via shank acceleration data during freezing of gait in Parkinson's disease

A Multi-Modal Analysis of the Freezing of Gait Phenomenon in Parkinson's Disease

Deep learning-based detection of affected body parts in Parkinson's disease and freezing of gait using time-series imaging

Video Based Shuffling Step Detection for Parkinsonian Patients Using 3D Convolution.

Intelligent diagnosis system based on artificial intelligence models for predicting freezing of gait in Parkinson’s disease

AiCarePWP: Deep learning-based novel research for Freezing of Gait forecasting in Parkinson

DeepFoG: An IMU-Based Detection of Freezing of Gait Episodes in Parkinson’s Disease Patients via Deep Learning

A Validation Study of Freezing of Gait (FoG) Detection and Machine-Learning-Based FoG Prediction Using Estimated Gait Characteristics with a Wearable Accelerometer