Abstract:Human-powered lower exoskeletons have received considerable interests from both academia and industry over the past decades, and encountered increasing applications in human locomotion assistance and strength augmentation. One of the most important aspects in those applications is to achieve robust control of lower exoskeletons, which, in the first place, requires the proactive modeling of human movement trajectories through physical human-robot interaction (pHRI). As a powerful representative tool for motion trajectories, dynamic movement primitives (DMP) have been used to model human movement trajectories. However, canonical DMP only offers a general representation of human movement trajectory and may neglects the interactive term, therefore it cannot be directly applied to lower exoskeletons which need to track human joint trajectories online, because different pilots have different trajectories and even same pilot might change his/her motion during walking. This paper presents a novel coupled cooperative primitive (CCP) strategy, which aims at modeling the motion trajectories online. Besides maintaining canonical motion primitives, we model the interaction term between the pilot and exoskeletons through impedance models, and propose a reinforcement learning method based on policy improvement and path integrals (PI2) to learn the parameters online. Experimental results on both a single degree-of-freedom platform and a HUman-powered Augmentation Note to Practitioners - This paper was motivated by the problem of lower exoskeleton when it interacts with different pilots. In both military and industrial applications of lower exoskeleton for strength augmentation, a most challenge problem is how to deal with the pHRI caused by different pilots. This paper suggests a new learning-based strategy, which modeled the pilot's motion with movement primitives and update through the pHRI between the pilot and the lower exoskeleton with online reinforcement learning method. In order to employ the proposed CCP into the real-time application, we also combine the CCP with a hierarchical control framework, and applied on a lower exoskeleton system which we built for strength augmentation application (which named as HUALEX). In the experiments of this paper, we validate the proposed CCP on different pilots with HUALEX system, the proposed CCP also achieve a good performance on the online learning and adaptation of the pilot's gait. In the future, we will extend this algorithm for adapting complex environment in both industrial and military applications, such as in different terrains, stairs, and slopes scenarios, and so on.

Hierarchical Human Machine Interaction Learning for a Lower Extremity Augmentation Device.

Hierarchical Interactive Learning for a HUman-Powered Augmentation Lower EXoskeleton

Non-linear Sliding Mode Control of the Lower Extremity Exoskeleton Based on Human–robot Cooperation

Cascade Force Control of Lower Limb Hydraulic Exoskeleton for Human Performance Augmentation

A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human-Robot Cooperative Manipulation.

Hierarchical Learning Control with Physical Human-Exoskeleton Interaction.

Learning Physical Human–Robot Interaction with Coupled Cooperative Primitives for a Lower Exoskeleton

Single-input adaptive fuzzy sliding mode control of the lower extremity exoskeleton based on human–robot interaction:

Adaptive robust backstepping force control of 1-dof joint exoskeleton for human performance augmentation

Design of Human-Machine Collaborative Control Algorithm for Lower Limb Exoskeleton

Interaction Learning Control with Movement Primitives for Lower Limb Exoskeleton.

Design and analysis of a lower limb assistive exoskeleton robot

Learning to Assist Different Wearers in Multitasks: Efficient and Individualized Human-in-the-Loop Adaptation Framework for Lower-Limb Exoskeleton

Learning-based Walking Assistance Control Strategy for a Lower Limb Exoskeleton with Hemiplegia Patients

A Hierarchical Control Scheme for Active Power-assist Lower-limb Exoskeletons

Learning to Assist Different Wearers in Multitasks: Efficient and Individualized Human-In-the-Loop Adaption Framework for Exoskeleton Robots

Reinforcement Learning and Control of a Lower Extremity Exoskeleton for Squat Assistance

Learning Cooperative Primitives With Physical Human-Robot Interaction For A Human-Powered Lower Exoskeleton

Model Predictive Control for Human-Centred Lower Limb Robotic Assistance

High Precision Data-driven Force Control of Compact Elastic Module for a Lower Extremity Augmentation Device

A Modular Lower Limb Exoskeleton System with RL Based Walking Assistance Control