Abstract:Background Sustained engagement is essential for the success of telerehabilitation programs. However, patients’ lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science–based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR). Objective This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert. Methods In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users’ range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software’s response to their movements. During calibration, the time series of the users’ movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements. Results The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%). Conclusions Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation.

An Ensemble Model using Face and Pose Tracking for Engagement Detection in Game-based Rehabilitation

Influence of Complementing a Robotic Upper Limb Rehabilitation System with Video Games on the Engagement of the Participants: a Study Focusing on Muscle Activities.

Implementation and Validation of Engagement Monitoring in an Engagement Enhancing Rehabilitation System

Development of Engagement Evaluation Method and Learning Mechanism in an Engagement Enhancing Rehabilitation System

Automatic rehabilitation exercise task assessment of stroke patients based on wearable sensors with a lightweight multichannel 1D-CNN model

VRInsole: an Unobtrusive and Immersive Mobility Training System for Stroke Rehabilitation

Full-body pose reconstruction and correction in virtual reality for rehabilitation training

Data-Driven Classification of Human Movements in Virtual Reality–Based Serious Games: Preclinical Rehabilitation Study in Citizen Science

Action recognition in rehabilitation: combining 3D convolution and LSTM with spatiotemporal attention

ReHabgame A non-immersive virtual reality rehabilitation system with applications in neuroscience

Optimizing Patients' Engagement by a Cyber-Physical Rehabilitation System.

Improved spatial-temporal graph convolutional networks for upper limb rehabilitation assessment based on precise posture measurement

Towards data-driven stroke rehabilitation via wearable sensors and deep learning

A Kinect-based system for cognitive rehabilitation exercises monitoring

Motion intention prediction of upper limb in stroke survivors using sEMG signal and attention mechanism

Designing compact features for remote stroke rehabilitation monitoring using wearable accelerometers

A Control and Posture Recognition Strategy for Upper-Limb Rehabilitation of Stroke Patients

A Vision-based Compensation Detection Approach During Robotic Stroke Rehabilitation Therapy

Rehabilitation Assessment System for Stroke Patients Based on Fusion-Type Optoelectronic Plethysmography Device and Multi-Modality Fusion Model: Design and Validation

An Unobtrusive Upper-Limb Activity Recognition System Based on Deep Neural Network Fusion for Stroke Survivors.

Enhancing Engagement During Robot-Assisted Rehabilitation Integrated with Motor Imagery Task