Abstract:The lack of intuitive controllability remains a primary challenge in enabling transhumeral amputees to control a prosthesis for arm reaching with residual limb kinematics. Recent advancements in prosthetic arm control have focused on leveraging the predictive capabilities of artificial neural networks (ANNs) to automate elbow joint motion and wrist pronation-supination during target reaching tasks. However, large quantities of human motion data collected from different subjects for various activities of daily living (ADL) tasks are required to train these ANNs. For example, the reaching motion can be altered when the height of the desk is changed; however, it is cumbersome to conduct human experiments for all conditions. This paper proposes a framework for cloning motion datasets using deep reinforcement learning (DRL) to cater to training data requirements. DRL algorithms have been demonstrated to create human-like synergistic motion in humanoid agents to handle redundancy and optimize movements. In our study, we collected real motion data from six individuals performing multi-directional arm reaching tasks in the horizontal plane. We generated synthetic motion data that mimicked similar arm reaching tasks by utilizing a physics simulation and DRL-based arm manipulation. We then trained a CNN-LSTM network with different configurations of training motion data, including DRL, real, and hybrid datasets, to test the efficacy of the cloned motion data. The results of our evaluation showcase the effectiveness of the cloned motion data in training the ANN to predict natural elbow motion accurately across multiple subjects. Furthermore, motion data augmentation through combining real and cloned motion datasets has demonstrated the enhanced robustness of the ANN by supplementing and diversifying the limited training data. These findings have significant implications for creating synthetic dataset resources for various arm movements and fostering strategies for automatized prosthetic elbow motion.

Generative Tracking of Human Motion by Sequential Clonal Selection Algorithm

Generative tracking of 3D human motion in latent space by sequential clonal selection algorithm

An improved clonal selection algorithm for articulated human motion tracking

Articulated Human Motion Tracking Using Sequential Immune Genetic Algorithm

Articulated Human Motion Tracking by Sequential Annealed Particle Swarm Optimization.

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

A Top-down Approach to Articulated Human Pose Estimation and Tracking

Human motion tracking by temporal-spatial local gaussian process experts

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Vision-Based Hand Motion Capture Using Genetic Algorithm

Motion Mamba: Efficient and Long Sequence Motion Generation

Model-based 3D human motion tracking and voxel reconstruction from sparse views

Subject-Specific Human Modeling for Human Pose Estimation

Skeleton Cluster Tracking for robust multi-view multi-person 3D human pose estimation

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Tracking Generic Human Motion Via Fusion of Low- and High-Dimensional Approaches

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

Coupling Top-down and Bottom-up Methods for 3D Human Pose and Shape Estimation from Monocular Image Sequences

3D Skeletal Gesture Recognition Via Hidden States Exploration

Transhumeral Arm Reaching Motion Prediction through Deep Reinforcement Learning-Based Synthetic Motion Cloning

Multi-Person Pose Tracking With Sparse Key-Point Flow Estimation and Hierarchical Graph Distance Minimization