Abstract:In the formulation of strategies for walking rehabilitation, achieving precise identification of the current state and making rational predictions about the future state are crucial but often unrealized. To tackle this challenge, our study introduces a unified framework that integrates a novel 3D walking motion capture method using multi-source image fusion and a walking rehabilitation simulation approach based on multi-agent reinforcement learning. We found that, (i) the proposal achieved an accurate 3D walking motion capture and outperforms other advanced methods. Experimental evidence indicates that, compared to similar visual skeleton tracking methods, the proposed approach yields results with higher Pearson correlation (r=0.93), intra-class correlation coefficient (ICC(2,1)=0.91), and narrower confidence intervals ([0.90,0.95] for r, [0.88,0.94] for ICC(2,1)) when compared to standard results. The outcomes of the proposed approach also exhibit commendable correlation and concurrence with those obtained through the IMU-based skeleton tracking method in the assessment of gait parameters ([0.85,0.89] for r, [0.75,0.81] for ICC(2,1)); (ii) multi-agent reinforcement learning has the potential to be used to solve the simulation task of gait rehabilitation. In mimicry experiment, our proposed simulation method for gait rehabilitation not only enables the intelligent agent to converge from the initial state to the target state, but also observes evolutionary patterns similar to those observed in clinical practice through motor state resolution. This study offers valuable contributions to walking rehabilitation, enabling precise assessment and simulation-based interventions, with potential implications for clinical practice and patient outcomes.

Modelling Human Kinetics and Kinematics during Walking using Reinforcement Learning

Three-Dimensional Human Modeling and Dynamics Simulation Based on ADAMS

Learning Speed-Adaptive Walking Agent Using Imitation Learning with Physics-Informed Simulation

Simulation of Assisted Human Walking Using Musculoskeletal Model Coupled with Exoskeleton Via Deep Reinforcement Learning

Demonstrating A Walk in the Park: Learning to Walk in 20 Minutes With Model-Free Reinforcement Learning

Walking representation and simulation based on multi-source image fusion and multi-agent reinforcement learning for gait rehabilitation

Learning Human-like Locomotion Based on Biological Actuation and Rewards

Creation and Evaluation of Human Models with Varied Walking Ability from Motion Capture for Assistive Device Development

Hybrid Zero Dynamics Inspired Feedback Control Policy Design for 3D Bipedal Locomotion using Reinforcement Learning

Inertia-Constrained Reinforcement Learning to Enhance Human Motor Control Modeling

Learning to Walk from Three Minutes of Real-World Data with Semi-structured Dynamics Models

Robust biped locomotion using deep reinforcement learning on top of an analytical control approach

Learning to Walk With Deep Reinforcement Learning: Forward Dynamic Simulation of a Physics-Based Musculoskeletal Model of an Osseointegrated Transfemoral Amputee

DeepWalk: Omnidirectional Bipedal Gait by Deep Reinforcement Learning

Learning 3D Bipedal Walking with Planned Footsteps and Fourier Series Periodic Gait Planning

Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotion

Personalised 3D Human Digital Twin with Soft-Body Feet for Walking Simulation

Bipedal Walking Robot using Deep Deterministic Policy Gradient

Learning Bipedal Walking for Humanoids with Current Feedback

Dynamic Bipedal Maneuvers through Sim-to-Real Reinforcement Learning