Abstract:Powered exoskeletons are promising devices to improve the walking patterns of people with neurological impairments. Providing personalized external assistance though is challenging due to uncertainties and the time-varying nature of human-robot interaction. Recently, human-in-the-loop (HIL) optimization has been investigated for providing assistance to minimize energetic expenditure, usually quantified by metabolic cost. However, this full-body global effect evaluation may not directly reflect the local functions of the targeted joint(s). This makes it difficult to assess the direct effect when robotic assistance is provided. In addition, the HIL optimization method usually does not take into account local joint trajectories, a consideration that is important in imposing healthy joint movements and gait patterns for individuals with lower limb motor deficits. In this paper, we propose a model-free reinforcement learning (RL)-based control framework to achieve a normative range of motion and gait pattern of the hip joint during walking. Our RL-based control provides personalized assistance torque profile by heuristically manipulating three control parameters for hip flexion and extension, respectively, during walking. A least square policy iteration was devised to optimize a cost function associated with control efforts and hip joint trajectory errors by tuning the control parameters. To evaluate the performance of the design approach, a compression sleeve was used to constrain the hip joint of unimpaired human participants to simulate motor deficits. The proposed RL control successfully achieved the desired goal of enlarging the hip joint's range of motion in three participants walking on a treadmill.

Design and Experimental Verification of a Hip Exoskeleton Based on Human-Machine Dynamics for Walking Assistance

Mechanical Design and Experimental Verification of a Parallel Hip Exoskeleton with Virtual Rotation Center

Design and Experimental Verification of a Parallel Hip Exoskeleton System for Full-Gait-Cycle Rehabilitation

Design and Experimental Verification of Hip Exoskeleton with Balance Capacities for Walking Assistance

Design and Control of a Powered Hip Exoskeleton for Walking Assistance

Design and Verification of Parallel Hip Exoskeleton Considering Output Torque Anisotropy

Design and Control of a Soft Hip Exoskeleton for Assisting Human Locomotion.

A Unified Active Assistance Control Framework of Hip Exoskeleton for Walking and Balance Assistance

Design of an anthropomorphic lower extremity exoskeleton with compatible joints

[Structure Design of Hip Joint Parallel Rehabilitation Exoskeleton]

Design, Control, and Analysis of a 3-Degree-of-Freedom Kinematic–Biologically Matched Hip Joint Structure for Lower Limb Exoskeleton

Design and Preliminary Evaluation of a Lightweight, Cable-Driven Hip Exoskeleton for Walking Assistance

Hip–Knee Coupling Exoskeleton with Offset Theory for Walking Assistance

Development and Validation of a Self-Aligning Knee Exoskeleton With Hip Rotation Capability

Design and analysis of a novel 12-DOF self-balancing lower extremity exoskeleton for walking assistance

Human-in-the-Loop Control of a Wearable Lower Limb Exoskeleton for Stable Dynamic Walking

A Cable-Driven Parallel Hip Exoskeleton for High-Performance Walking Assistance

Imposing Healthy Hip Motion Pattern and Range by Exoskeleton Control for Individualized Assistance

On the Kinematic Design of Anthropomorphic Lower Limb Exoskeletons and Their Matching Movement

Walking Assist Strategy of a Hip Exoskeleton Based on Upper and Lower Limb Synergy Law

Design and Optimization of Lower Limb Rehabilitation Exoskeleton with a Multiaxial Knee Joint