Abstract:Exoskeletons for rehabilitation can help enhance motor recovery in individuals suffering from neurological disorders. Precision in movement execution, especially in arm rehabilitation, is crucial to prevent maladaptive plasticity. However, current exoskeletons, while providing arm support, often lack the necessary 3D feedback capabilities to show how well rehabilitation exercises are being performed. This reduces therapist acceptance and patients' performance. Augmented Reality technologies offer promising solutions for feedback and gaming systems in rehabilitation. In this work, we leverage HoloLens 2 with its advanced hand-tracking system to develop an application for personalized rehabilitation. Our application generates custom holographic trajectories based on existing databases or therapists' demonstrations, represented as 3D tunnels. Such trajectories can be superimposed on the real training environment. They serve as a guide to the users and, thanks to colour-coded real-time feedback, indicate their performance. To assess the efficacy of the application in improving kinematic precision, we tested it with 15 healthy subjects. Comparing user tracking capabilities with and without the use of our feedback system in executing 4 different exercises, we observed significant differences, demonstrating that our application leads to improved kinematic performance. 12 clinicians tested our system and positively evaluated its usability (System Usability Scale score of 67.7) and acceptability (4.4 out of 5 in the 'Willingness to Use' category in the relative Technology Acceptance Model). The results from the tests on healthy participants and the feedback from clinicians encourage further exploration of our framework, to verify its potential in supporting arm rehabilitation for individuals with neurological disorders.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve the problem of insufficient motion execution accuracy during upper - limb rehabilitation, especially the lack of necessary three - dimensional feedback capabilities when using exoskeleton devices. Specifically, the research focuses on the following aspects: 1. **Improve the accuracy of motion execution**: In upper - limb rehabilitation, accurate motion execution is crucial for avoiding maladaptive plasticity. However, although existing exoskeleton devices can provide arm support, they often lack real - time three - dimensional feedback functions, which limits their effectiveness. 2. **Enhance patient participation and therapist acceptance**: Due to the lack of an effective feedback mechanism, patients may deviate when performing rehabilitation training, and therapists also find it difficult to accurately assess patients' motion performance. This not only affects the rehabilitation effect but also reduces therapists' acceptance of these technologies. 3. **Introduce augmented reality (AR) technology to provide real - time feedback**: To solve the above problems, researchers have developed a personalized rehabilitation application using the advanced hand - tracking system of HoloLens 2. This application generates customized holographic trajectories and superimposes them on the real training environment to provide users with precise guidance. At the same time, through color - coded real - time feedback, users can intuitively understand their own motion performance. 4. **Verify the effectiveness and feasibility of the system**: To evaluate the effectiveness of this system, researchers conducted experiments to test the performance of 15 healthy subjects performing four different motions with and without the AR feedback system. The results show that using the AR system significantly improves the accuracy of motion execution. In addition, 12 clinicians evaluated the usability and acceptability of this system, and the results show that they have a relatively high recognition of this system (the System Usability Scale score is 67.7, and the willingness to use score is 4.4/5). ### Summary The main goal of this paper is to introduce augmented reality technology to provide a new and more effective feedback mechanism for upper - limb rehabilitation, thereby improving the effectiveness of rehabilitation training, enhancing patient participation, and increasing therapists' acceptance of related technologies.

Augmented reality for upper limb rehabilitation: real-time kinematic feedback with HoloLens 2

An Augmented Reality Environment to Provide Visual Feedback to Amputees During sEMG Data Acquisitions

Assessment of gamified mixed reality environments for upper limb robotic rehabilitation: pilot study on healthy adults

Augmented Reality Prosthesis Training Setup for Motor Skill Enhancement

Variable Admittance Control of a Hand Exoskeleton for Virtual Reality-Based Rehabilitation Tasks

Compensation or Restoration: Closed-Loop Feedback of Movement Quality for Assisted Reach-to-Grasp Exercises with a Multi-Joint Arm Exoskeleton

A Common Prosthetic Rehabilitation Platform Based On Modular Design

Therapists and patients perceptions of a mixed reality system designed to improve trunk control and upper extremity function

How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens

Vision-Based Pose Estimation for Robot-Mediated Hand Telerehabilitation

Exploring the bases for a mixed reality stroke rehabilitation system, Part II: design of interactive feedback for upper limb rehabilitation

VR-based body tracking to stimulate musculoskeletal training

Mixed Reality-Based Smart Occupational Therapy Personalized Protocol for Cerebellar Ataxic Patients

Exergames as a rehabilitation tool to enhance the upper limbs functionality and performance in chronic stroke survivors: a preliminary study

Proof of Concept for the Use of Immersive Virtual Reality in Upper Limb Rehabilitation of Multiple Sclerosis Patients

Immersive augmented reality system for the training of pattern classification control with a myoelectric prosthesis

Advanced visualization of ergonomic assessment data through industrial Augmented Reality

Immersive Virtual Reality and Robotics for Upper Extremity Rehabilitation

An Approach to Physical Rehabilitation Using State-of-the-art Virtual Reality and Motion Tracking Technologies

A Kinaesthetic Hand Exoskeleton System Toward Robot-augmented Rehabilitation Therapies in the Health 4.0 era

Using Capability Maps Tailored to Arm Range of Motion in VR Exergames for Rehabilitation