Abstract:BACKGROUND AND OBJECTIVE:Interactive systems for rehabilitation have been widely investigated for motivational purposes. However, more attention should be given to the manner in which user movements are recognized and categorized. This paper aims to evaluate the efficacy of using a clinically-related gesture recognition tool, based on the international biomechanical standards (ISB) for the reporting of human joint motion, for the development of an interactive augmented reality (AR) rehabilitation system -mirrARbilitation.METHODS:This work presents an AR rehabilitation system based on ISB standards, which enables the system to interact and to be configured according to therapeutic needs. The Kinect(TM) skeleton tracking technology was exploited and a new movement recognition method was developed to recognize and classify biomechanical movements. Further, our mirrARbilitation system provides exercise instructions while simultaneously motivating the patient. The system was evaluated on a cohort of 33 patients, physiotherapists, and software developers when performing shoulder abduction therapy exercises. Tests were performed in three moments: (i) users performed the exercise until they feel tired without the help of the system, (ii) the same however using the mirrARbilitation for motivation and guidance, and (iii) users performed the exercise again without the system. Users performing the movement without the help of the system worked as baseline reference.RESULTS:We demonstrated that the percentage of correct exercises, measured by the movement analysis method we developed, improved from 69.02% to 93.73% when users interacted with the mirrARbilitation. The number of exercise repetitions also improved from 34.06 to 66.09 signifying that our system increased motivation of the users. The system also prevented the users from performing the exercises in a completely wrong manner. Finally, with the help of our system the users' worst result was performing 73.68% of the rehabilitation movements correctly. Besides the engagement, these results suggest that the use of biomechanical standards to recognize movements is valuable in guiding users during rehabilitation exercises.CONCLUSION:The proposed system proved to be efficient by improving the user engagement and exercise performance outcomes. The results also suggest that the use of biomechanical standards to recognize movements is valuable in guiding users during rehabilitation exercises.

ARMIA: A Sensorized Arm Wearable for Motor Rehabilitation

A Projected AR Serious Game for Shoulder Rehabilitation Using Hand-Finger Tracking and Performance Metrics: A Preliminary Study on Healthy Subjects

sEMG based Real-Time Motion Classification using Virtual Reality and Artificial Neural Networks

MirrARbilitation: A Clinically-Related Gesture Recognition Interactive Tool for an AR Rehabilitation System

Automated Variable Resistance System for Upper Limb Rehabilitation

An Approach to Physical Rehabilitation Using State-of-the-art Virtual Reality and Motion Tracking Technologies

An Augmented Reality Environment to Provide Visual Feedback to Amputees During sEMG Data Acquisitions

Serious Game Platform with Haptic Feedback and EMG Monitoring for Upper Limb Rehabilitation and Smoothness Quantification on Spinal Cord Injury Patients

Robot-Assisted Rehabilitation Architecture Supported by a Distributed Data Acquisition System

Virtual Therapy Exergame for Upper Extremity Rehabilitation Using Smart Wearable Sensors

Characterizing the Sensing Response of Carbon Nanocomposite-Based Wearable Sensors on Elbow Joint Using an End Point Robot and Virtual Reality

Connected Elbow Exoskeleton System for Rehabilitation Training Based on Virtual Reality and Context-Aware

Immersive Virtual Reality and Robotics for Upper Extremity Rehabilitation

sEMG-controlled forearm bracelet and serious game-based rehabilitation for training manual dexterity in people with multiple sclerosis: a randomised controlled trial

Design, Development, and Testing of an Intelligent Wearable Robotic Exoskeleton Prototype for Upper Limb Rehabilitation

Cleverarm: A Novel Exoskeleton For Rehabilitation Of Upper Limb Impairments

NeuroSuitUp: System Architecture and Validation of a Motor Rehabilitation Wearable Robotics and Serious Game Platform

A low cost wearable wireless sensing system for upper limb home rehabilitation

An Interactive Therapy System for Arm and Hand Rehabilitation

Virtual Hand Training Platform Controlled Through Online Recognition of Motion Intention

Self-directed arm therapy at home after stroke with a sensor-based virtual reality training system