Abstract:The rehabilitation treatment helps to heal minor sports and occupational injuries. In a traditional rehabilitation process, a therapist will assign certain actions to a patient to perform in between hospital visits, and it will rely on the patient to remember actions correctly and the schedule to perform them. Unfortunately, many patients forget to perform actions or fail to recall actions in detail. As a consequence, the rehabilitation treatment is hampered or, in the worst case, the patient may suffer from additional injury caused by performing incorrect actions. To resolve these issues, we propose a HRNet-based rehabilitation monitoring system, which can remind a patient when to perform the actions and display the actions for the patient to follow via the patient's smartphone. In addition, it helps the therapist to monitor the progress of the rehabilitation for the patient. Our system consists of an iOS app and several components at the server side. The app is in charge of displaying and collecting action videos. The server computes the similarity score between the therapist's actions and the patient's in the videos to keep track of the number of repetitions of each action. Theses stats will be shown to both of the patient and therapist. The extensive experiments show that the F1-Score of the similarity calculation is as high as 0.9 and the soft accuracy of the number of repetitions is higher than 90%.

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the issue of patients forgetting to perform actions or performing actions incorrectly during rehabilitation therapy. In traditional rehabilitation processes, therapists arrange for patients to perform specific exercises between hospital visits and rely on patients to correctly remember these actions and their schedules. However, many patients forget to perform these actions or cannot accurately recall the details of the actions, which not only hinders the rehabilitation process but may also lead to additional injuries due to incorrect execution. To solve these problems, the authors propose a rehabilitation monitoring system based on HRNet (High-Resolution Network). This system reminds patients when to perform actions via a smartphone and shows the correct actions for patients to follow. Additionally, the system helps therapists monitor the patients' rehabilitation progress. ### Main Functions of the System 1. **Remind patients to perform actions**: The system will remind patients to perform specific actions at appropriate times. 2. **Show correct actions**: The system displays correct action videos to patients via a smartphone, ensuring they can accurately mimic the actions. 3. **Monitor patient actions**: The system records videos of patients performing actions and calculates the similarity to the standard actions provided by the therapist. 4. **Count repetitions**: The system calculates the number of repetitions for each action performed by the patient and displays this data to both the patient and the therapist. ### System Components - **Client application**: Responsible for displaying and collecting action videos. - **Server-side**: Includes multiple modules responsible for storing videos, calculating similarity, and counting repetitions. - **HRNet-based action monitoring module**: The core part, responsible for extracting pose features from videos, preprocessing data, and calculating similarity. ### Experimental Results - **F1 score for similarity calculation**: Up to 0.9. - **Soft accuracy for repetition counting**: Over 90%. ### Summary This study proposes a rehabilitation monitoring system based on HRNet, effectively solving the problem of patients forgetting or incorrectly performing actions during rehabilitation, thereby improving the effectiveness and safety of rehabilitation therapy.

A HRNet-based Rehabilitation Monitoring System

A Novel Mobile-Computing Based Assistive Approach For Knee Injury Telerehabilitation - A Preliminary Study

Trainer: a motion-based interactive game for balance rehabilitation training.

A Portable and Cost-Effective Upper Extremity Rehabilitation System for Individuals with Upper Limb Motor Deficits

Automatic rehabilitation exercise task assessment of stroke patients based on wearable sensors with a lightweight multichannel 1D-CNN model

A Home-based Tele-rehabilitation System With Enhanced Therapist-patient Remote Interaction: A Feasibility Study

Validation of Consumer-grade Digital Camera-based Human Activity Evaluation for Upper Limb Exercises and Development of a Therapist-guided, Automated Telerehabilitation Framework and Platform for Stroke Rehabilitation

Monitoring and Assessment of Rehabilitation Progress on Range of Motion After Total Knee Replacement by Sensor-Based System

Real-time Monitoring System for Heart Rate and Movement During Rehabilitation Exercises

An IoT-Based Injury Prediction and Sports Rehabilitation for Martial Art Students in Colleges Using RNN Model

Home-Based Rehabilitation System for Stroke Survivors: A Clinical Evaluation

An Intelligent and Comprehensive Monitoring System for Health and Rehabilitation Center

An Upper Limb Rehabilitation Exercise Status Identification System Based on Machine Learning and IoT

Automatic Assessment of Upper Extremity Function and Mobile Application for Self-Administered Stroke Rehabilitation

Construction and Evaluation of Sports Rehabilitation Training Model under Intelligent Health Monitoring

Design, Development, and Evaluation of an Interactive Personalized Social Robot to Monitor and Coach Post-Stroke Rehabilitation Exercises

Development of Wearable Devices for Collecting Digital Rehabilitation/Fitness Data from Lower Limbs

A New Method of Quantitative Rehabilitation Rating in Robot-Assisted Recovery System

A Novel Remote Rehabilitation System with the Fusion of Noninvasive Wearable Device and Motion Sensing for Pulmonary Patients

Automated Movement Assessment in Stroke Rehabilitation

A Monitoring System for Walking Rehabilitation after THR or TKR Surgeries.