Abstract:Objective: Functional movement assessments are routinely used to evaluate and track changes in mobility. The objective of this study was to evaluate a multimodal movement monitoring system developed for autonomous, home-based, functional movement assessment. Methods: Fifty frail and prefrail adults were recruited from the Brigham and Women's Hospital at Home program to evaluate the feasibility and accuracy of applying the multimodal movement monitoring system to autonomously recognize and score functional activities collected in the home. Study subjects completed sit-to-stand, standing balance (Romberg, semitandem, and tandem), and walking test activities in likeness to the Short Physical Performance Battery. Test activities were identified and scored manually and by the multimodal movement monitoring system's activity recognition and scoring algorithms, which were previously trained on lab-based biomechanical data to integrate wearable inertial measurement unit (IMU) and external red-blue-green-depth vision data. Feasibility was quantified as the proportion of completed tests that were analyzable. Accuracy was quantified as the degree of agreement between the actual and system-identified activities. In an exploratory analysis of a subset of functional activity data, the accuracy of a preliminary activity-scoring algorithm was also evaluated. Results: Activity recognition by the IMU-vision system had good feasibility and high accuracy. Of 271 test activities collected in the home, 217 (80%) were analyzable by the activity-recognition algorithm, which overall correctly identified 206 (95%) of the analyzable activities: 100% of walking, 97% of balance, and 82% of sit-to-stand activities (χ2(2) = 19.9). In the subset of 152 tests suitable for activity scoring, automatic and manual scores showed substantial agreement (Kw = 0.76 [0.69, 0.83]). Conclusions: Autonomous recognition and scoring of home-based functional activities is enabled by a multimodal movement monitoring system that integrates inertial measurement unit and vision data. Further algorithm training with ecologically valid data and a kitted system that is independently usable by patients are needed before fully autonomous, functional movement assessment is realizable. Impact: Functional movement assessments that can be administered in the home without a clinician present have the potential to democratize these evaluations and improve care access.

Towards balance assessment using Openpose

Optimization of Center-of-Pressure-Based Indices for Assessing Balance Ability

Measuring the Local and Global Variabilities in Body Sway by Nonlinear Poincaré Technology

Standing Balance Assessment by Measurement of Body Center of Gravity Using Smartphones

A New Kinematic Dataset of Lower Limbs Action for Balance Testing

Construction and Analysis of Balance Ability Test Model Based on Multi-modal Parameters

Agreement between a markerless and a marker-based motion capture systems for balance related quantities

Clinical gait analysis using video-based pose estimation: Multiple perspectives, clinical populations, and measuring change

Predicting losses of balance during upright stance: evaluation of a novel approach based on wearable accelerometers

MusculoSkeletal Modeling Using Kinect Data For Telerehabilitation

Reliability and Validity of Kinect RGB-D Sensor for Assessing Standing Balance

Evaluation of postural stability based on a force plate and inertial sensor during static balance measurements

Maintaining Balance when Looking at a Virtual Reality Three-Dimensional Display of a Field of Moving Dots or at a Virtual Reality Scene

Methods of Balance Capacity Assessment Based on Multi-modal Information

A Novel Single Step Balance Assessment Method Based On Swing Foot Chasing Capture Point

The Required Spatial Resolution to Assess Imbalance using Plantar Pressure Mapping

Automation of Functional Mobility Assessments at Home Using a Multimodal Sensor System Integrating Inertial Measurement Units and Computer Vision (IMU-Vision)

Exercise quantification from single camera view markerless 3D pose estimation

Characterization of Human Balance through a Reinforcement Learning-based Muscle Controller

Automatically Evaluating Balance: A Machine Learning Approach

Leg movement tracking in automatic video-based one-leg stance evaluation