Abstract:Objective: Functional movement assessments are routinely used to evaluate and track changes in mobility. The objective of this study was to evaluate a multimodal movement monitoring system developed for autonomous, home-based, functional movement assessment. Methods: Fifty frail and prefrail adults were recruited from the Brigham and Women's Hospital at Home program to evaluate the feasibility and accuracy of applying the multimodal movement monitoring system to autonomously recognize and score functional activities collected in the home. Study subjects completed sit-to-stand, standing balance (Romberg, semitandem, and tandem), and walking test activities in likeness to the Short Physical Performance Battery. Test activities were identified and scored manually and by the multimodal movement monitoring system's activity recognition and scoring algorithms, which were previously trained on lab-based biomechanical data to integrate wearable inertial measurement unit (IMU) and external red-blue-green-depth vision data. Feasibility was quantified as the proportion of completed tests that were analyzable. Accuracy was quantified as the degree of agreement between the actual and system-identified activities. In an exploratory analysis of a subset of functional activity data, the accuracy of a preliminary activity-scoring algorithm was also evaluated. Results: Activity recognition by the IMU-vision system had good feasibility and high accuracy. Of 271 test activities collected in the home, 217 (80%) were analyzable by the activity-recognition algorithm, which overall correctly identified 206 (95%) of the analyzable activities: 100% of walking, 97% of balance, and 82% of sit-to-stand activities (χ2(2) = 19.9). In the subset of 152 tests suitable for activity scoring, automatic and manual scores showed substantial agreement (Kw = 0.76 [0.69, 0.83]). Conclusions: Autonomous recognition and scoring of home-based functional activities is enabled by a multimodal movement monitoring system that integrates inertial measurement unit and vision data. Further algorithm training with ecologically valid data and a kitted system that is independently usable by patients are needed before fully autonomous, functional movement assessment is realizable. Impact: Functional movement assessments that can be administered in the home without a clinician present have the potential to democratize these evaluations and improve care access.

Wearable Sensors Based Automatic Box and Block Test System.

Can Wearable Devices and Machine Learning Techniques Be Used for Recognizing and Segmenting Modified Physical Performance Test Items?

Automatic Assessment System Based on IMUs and Machine Learning for Predicting Berg Balance Scale

Image-recognition-based System for Precise Hand Function Evaluation

Synergy through integration of digital cognitive tests and wearable devices for mild cognitive impairment screening

Automatic Upper-Limb Brunnstrom Recovery Stage Evaluation via Daily Activity Monitoring

A multi-source behavioral and physiological recording system for cognitive assessment

System Development and Evaluation of Human–Computer Interaction Approach for Assessing Functional Impairment for People with Mild Cognitive Impairment: A Pilot Study

Automatic rehabilitation exercise task assessment of stroke patients based on wearable sensors with a lightweight multichannel 1D-CNN model

Automation of Functional Mobility Assessments at Home Using a Multimodal Sensor System Integrating Inertial Measurement Units and Computer Vision (IMU-Vision)

A Novel Automated RGB-D Sensor-Based Measurement of Voluntary Items of the Fugl-Meyer Assessment for Upper Extremity: A Feasibility Study

A Wearable-Sensor System with AI Technology for Real-Time Biomechanical Feedback Training in Hammer Throw

Wearable-Sensor-Based Weakly Supervised Parkinson's Disease Assessment with Data Augmentation

A Multi-Sensor Wearable System for the Quantitative Assessment of Parkinson’s Disease

A Fine-Grained Analysis of Post-Stroke Motor Function Using Wearable Motion Sensors

Unearthing Subtle Cognitive Variations: A Digital Screening Tool for Detecting and Monitoring Mild Cognitive Impairment

Ai-based next-generation sensors for enhanced rehabilitation monitoring and analysis

Designing compact features for remote stroke rehabilitation monitoring using wearable accelerometers

Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

Design of a Wireless Multiple-Mode Human Behavior Evaluation System.

A Household Multimodal Physiological Signals Monitoring System