Note: Rapid Genotyping of Human ERCC1 Exon 4 Polymorphism with Fluorescence Analysis Using Fluorophore-Labeled Hybridization Probes and a LightCycler

Jiaoyang Yin,M. Hedayati,L. Grossman,L. Bolund,B. Nexø

DOI: https://doi.org/10.1023/A:1015117623590

2002-04-01

Biochemical Genetics

Abstract:

What problem does this paper attempt to address?

Dynamic Movement Primitive Based Motion Retargeting for Dual-Arm Sign Language Motions

Yuwei Liang,Weijie Li,Yue Wang,Rong Xiong,Yichao Mao,Jiafan Zhang

DOI: https://doi.org/10.1109/icra48506.2021.9561120

2021-01-01

Abstract:We aim to develop an efficient programming method for equipping service robots with the skill of performing sign language motions. This paper addresses the problem of transferring complex dual-arm sign language motions characterized by the coordination among arms and hands from human to robot, which is seldom considered in previous studies of motion retargeting techniques. In this paper, we propose a novel motion retargeting method that leverages graph optimization and Dynamic Movement Primitives (DMPs) for this problem. We employ DMPs in a leader-follower manner to parameterize the original trajectories while preserving motion rhythm and relative movements between human body parts, and adopt a three-step optimization procedure to find deformed trajectories for robot motion planning while ensuring feasibility for robot execution. Experimental results of several Chinese Sign Language (CSL) motions have been successfully performed on ABB's YuMi dual-arm collaborative robot (14-DOF) with two 6-DOF Inspire-Robotics' multi-fingered hands, a system with 26 DOFs in total.
Learning Efficient Robot Arm Reaching

Tao Zhang,Weiming Qu,Yudi Zou,Dingsheng Luo

DOI: https://doi.org/10.1109/icicsp55539.2022.10050666

2022-01-01

Abstract:Arm reaching is a fundamental skill for robots to finish other tasks like grasping, assembly and so on, which require highly precise control. Therefore, robot reaching via relative positioning is discussed in order to reduce the influence of sensing errors. However, these works only consider Cartesian space without any constraint of joint space, which results in the unnecessary movements and energy wasting. In this paper, we propose to use a reinforcement learning (RL) algorithm to add constraints of joint space in robot reaching based on relative positioning. With our method, some unnecessary movements of joints in robot reaching are prevented. Besides, as for sample efficiency in RL, we propose to train a forward model for generating synthetic data to accelerate learning. The experimental results show the effectiveness of the proposed methods.
Human Demonstration Trajectory Refinement for Redundant Manipulators.

Longbin Shen,Rong Xiong,Jian Chu

DOI: https://doi.org/10.3182/20130902-3-CN-3020.00038

2013-01-01

IFAC Proceedings Volumes

Abstract:Motion planning for robotic manipulators is a fundamental work in the research on brain-machine interface (BMI), as well as a key research issue in robotics community. Recently, algorithms for trajectory planning of end effector by learning from human demonstrations are reported, which could reduce the workload on coding for different manipulation actions. However, current approaches have at least one of the following drawbacks: (1) the generated trajectories usually are discontinuous; (2) physical limits of actuation system are not considered; (3) trajectory executive time is not optimal. This paper describes a novel method based on affine trajectory deformation to refine demonstration trajectory within manipulator's physical constraints and optimize the executive time. In the proposed method, the affine trajectory deformation is employed in joint space as an optimization problem to minimize the revision and time under the constraints on the physical limits of actuation system. The feasibility of our approach is demonstrated on the humanoid robot arm, which learned a table tennis strike and reproduced same motion as fast as possible.
Developing Robot Reaching Skill Via Look-ahead Planning

Tianlin Liu,Mengxi Nie,Xihong Wu,Dingsheng Luo

DOI: https://doi.org/10.1109/wrc-sara.2019.8931964

2019-01-01

Abstract:Reaching is a basic ability of robots and the basis for many complex manipulation tasks. It is an indispensable ability for robots to enter the human family. Previous methods mostly rely on an accurate model such as inverse kinematics model to solve this problem. However, in practice, the model is often inaccurate due to errors caused by measurements and calculations. In this paper, we present a multi-stage approach to develop robot reaching skill based on an internal model and look-ahead planning. We do not assume that the internal model is absolutely accurate. In fact, the inadequacy caused by the inaccuracy of the model can be compensated by the iterative planning in the fine tuning process. In the first stage, the robot collects training data through self-exploration. In the second stage, the robot uses the training data to build an internal model that establishes the relationship between proprioception and spatial position. In the final stage, the robot will reach the goal through coarse tuning and fine tuning. It first gets a rough action (joint movement) through the internal model and then performs the action. Then it will use a planning method to continually fine-tune the action until it finally reaches the goal. The effectiveness and the efficiency of the proposed method have been verified in experiments with the humanoid robot platform Baxter.
Learning Arm Movements Of Target Reaching For Humanoid Robot

zhan liu,fan hu,dingsheng luo,xihong wu

DOI: https://doi.org/10.1109/ICInfA.2015.7279377

2015-01-01

Abstract:The autonomous motor skill learning is crucial for the humanoid robot to adapt to various tasks in complex environments and develop human-like behaviors. In this paper a method of autonomously learning arm movements for target reaching is proposed. To model the dynamics of arm joint trajectories during reaching, the dynamical movement primitives (DMP) model is employed. Based on the DMP representation, reinforcement learning based methods are adopted to learn DMP shape and goal parameters, aiming at not only deriving suitable arm joint trajectories satisfying certain constraints such as energy-saving and collision-free, but also enabling the robot to find goal configurations without complicated inverse kinematics calculations. Furthermore, an adaptive exploration strategy is proposed, which accelerates and improves the arm movements learning. The robot experiments demonstrate the effectiveness of the proposed method.
Optimizing Robot Arm Reaching Ability with Different Joints Functionality

Jiawen Wang,Tao Zhang,Yi Wang,Dingsheng Luo

DOI: https://doi.org/10.1109/RO-MAN57019.2023.10309549

2023-01-01

Abstract:During the process of reaching a target, a robotic arm may generate a large number of redundant movements due to the stochastic nature of planning algorithms. We think that each joint of the robotic arm has a unique functionality towards the arm's end effector. Therefore, during motion planning, we optimized the weights of each joint based on its individual functionality. We introduce the human arm operation mechanism - When a person is reaching for a distant target, the shoulder-near joints take on more actions. We proposed an advanced auxiliary loss function. By utilizing this function, we can filter out multiple solutions from the inverse model, thus reducing the amount of joint change and redundant movements. We conducted comprehensive comparative experiments on the UR3 robotic arm, and the results showed that our approach achieved better efficiency and outcomes.
Robot Arm Configuration Self-Awareness Via Interacting with Environment

Wenfei Hu,Yifan Yuan,Yi Wang,Dingsheng Luo

DOI: https://doi.org/10.1109/icma57826.2023.10215841

2023-01-01

Abstract:Controlling robotic arm reaching is a highly challenging research topic. Since sampling is time-consuming and cumbersome, a stream of work has resorted to utilizing forward kinematic models to provide data for training arm control models. However, existing forward models and control models are fraught with difficulties once the configuration of a robotic arm significantly changes, requiring either the re-measurement or large-scale data collection to retrain the network. Consequently, Self-awareness of the current arm configuration is of vital importance, especially after changes in the arm configurations. To swiftly obtain a high-precision forward model following arm configuration changes, we present a framework to construct the forward model based on Denavit-Hartenberg (D-H) model. Distinct from precious methods that build a forward model using a neural network, the linear relationship between the position of the end-effector and the D-H parameters of the robot arm is employed to construct the forward kinematic model. Through interacting with the environment, the robot is capable of adapting to its current state in real-time and generating a large amount of training data for control models. Extensive experimentation on the humanoid robot PKU-HR6.0 validates the efficacy of the proposed framework.
Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Yinjie Lin,Zheng Chen,Bin Yao

DOI: https://doi.org/10.1109/tmech.2021.3081594

2021-01-01

Abstract:With the developments of intelligent and autonomous robotic technology, robots are usually designed to confront sophisticated tasks such as automated assembly, which requires both high-speed positioning capabilities and compliance with unknown contact environments. As we know, a high-performance motion tracking control in free space can achieve efficient and accurate positioning, while impedance or force control shows superior performance in terms of sensitive force and compliance with unknown contact environments. However, it is still challenging to achieve both high-performance motion tracking and compliance within one single control framework, especially in unknown contact environments. To this end, in this article, a unified motion/force/impedance approach for unknown contact environments is proposed by robust model-reaching control with dynamic trajectory adaptation. Specifically, the overall control scheme includes two loops: the outer loop replans the trajectories of motion and force in real time to meet the environmental constraints, which are estimated by the recursive least squares estimation law; in the inner loop, the robust model-reaching control law is proposed to realize a target model, which is designed to establish a dynamic relationship between the motion and force tracking errors of the replanned trajectories. Then, by changing the matrices of the target model, the compromise between motion tracking and force tracking can be achieved, as well as different control objectives. Experiments are conducted on a seven-degree-of-freedom manipulator to validate the advantages of the proposed scheme.
Developing Robot Reaching Skill with Relative-Location Based Approximating

Dingsheng Luo,Mengxi Nie,Tao Zhang,Xihong Wu

DOI: https://doi.org/10.1109/devlrn.2018.8761018

2018-01-01

Abstract:Robot reaching is a fundamental skill for knowing about the environment through interacting with objects and completing complex manipulation tasks. The topic has been studied widely for decades. In the paper, with reference to the relevant mechanism of human, a novel strategy for developing robot reaching skill is proposed, in which the whole process is divided into two stages including rough reaching and iterative adjustment. Generally in the process of obtaining spatial information of target object, the accuracy of the absolute positioning might be severely affected due to inevitable errors derived from sensing means (e.g. camera) in real world scenario. On the contrary, the accuracy of relative positioning will be much better, in which we only require answering the relative location between the target and the end-effector. Under this view, the proposed method, called the relative-location based approximating strategy (RLA), firstly attempts to move the end-effector to the target roughly with a simple inverse model, and then gradually approximates to the target according to the information of the relative location, i.e. the direction of the target relative to the end-effector. To accomplish such an approximating process, an internal model regarding to base directions is developed, where the motor babbling is involved under the inspiration of infants development mechanism. The approach was experimentally validated using the child-sized physical humanoid robot PKU-HR6.0II in a completely autonomous style and the results illustrate the effectiveness and superiority of the proposed strategy.
How Does a Robot Develop Its Reaching Ability Like Human Infants Do?

Dingsheng Luo,Fan Hu,Tao Zhang,Yian Deng,Xihong Wu

DOI: https://doi.org/10.1109/tcds.2018.2861893

IF: 4.546

2018-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:In this paper, we address the issue robots developing a reaching ability, as human infants do. Specifically, a novel infant-inspired framework is proposed based on recent findings that the emergence of reaching is the product of a deeply embodied process. The methodology behind our framework is to develop proprioception, fixation, and internal models (including both the forward and inverse models) in three sequential phases, with the whole developing process being driven by self-produced motor babbling. In the first phase, an autoencoder-based proprioception model is proposed. In the second phase, a simplified strategy for imitating the function of fixation is developed. In the third phase, a new forward model and two new inverse models are further proposed. We evaluated our framework and associated models with the PKU-HR6.0II physical robot and two simulated robots. Experiments confirm that the PKU-HR6.0II could successfully develop its reaching ability in a manner similar to that of human infants through our proposed framework. Better performance and adaptability are also demonstrated in comparison to existing benchmarks. It is also shown that the proposed framework has the potential to achieve other manipulation abilities such as grasping and placing.
An Infant-Inspired Model for Robot Developing Its Reaching Ability

Dingsheng Luo,Fan Hu,Yian Deng,Wentao Liu,Xihong Wu

DOI: https://doi.org/10.1109/devlrn.2016.7846840

2016-01-01

Abstract:In robotics community, inspiration from human development theory offers a promising way for robots to efficiently achieve many abilities. Humanoid robot reaching, as an essential ability which forms the foundation of grasping and manipulation, is also possible to take advantages from human. For human infants, reaching is emerging around 3–5 months of age, which is also a fundamental skill for the development and refinement of future high level motion or cognitive behaviors. The issue of how infant reaching is developed has been investigated for decades and several views were established and discussed. Recently, Corbetta et al. proposed that the emergence of reaching is the product of a deeply embodied process, in which infants first learn how to direct their movement in space using proprioceptive and haptic feedback and then map the visual attention onto these bodily centered experiences. With this new sight, this paper addresses the problem of how a robot develops its reaching ability autonomously, and a novel infant-inspired model is proposed. The model is composed of several blocks so that to closely capture the inherent mechanisms of infants in the process of developing the reaching skill. To evaluate the proposed model, a child-sized physical humanoid robot PKU-HR6.0 is employed. Just like an early infant, the robot is assumed without any other abilities. It is only equipped with the proposed model with random initialized parameters. The reaching ability is expected to be developed all by the robot itself. Through iteratively babbling arm motions in its workspace, the robot firstly acquire a reliable sense of its body and movement in space, and then map the sense of the vision onto the proprioception when contingencies happen. Experimental results show that the robot equipped with the proposed model achieves the reaching ability effectively and successfully in a completely autonomous style. The robot is able to reach the objects in different real environments with a high performance, and can even grasp the objects with an average successful rate of 82.50%. Our experimental results also verify that the movement of one joint may induce another, and some sepecific joint may play dominant role in certain category of movements.
A Novel Meta Control Framework for Robot Arm Reaching with Changeable Configuration

Wenfei Hu,Yifan Yuan,Yi Wang,Dingsheng Luo

DOI: https://doi.org/10.1109/ro-man57019.2023.10309594

2023-01-01

Abstract:When deploying a robot to real-world environments, it is crucial to execute tasks amidst constantly changing surroundings. The conventional kinematics control of robot arms is primarily reliant on the inverse kinematics model. Unfortunately, due to the lack of adaptability, high-precision control models often falter when the robot utilizes tools of varying lengths or when the robot arm is worn out. This work aims to address this issue by proposing a meta-learning-based control framework. We achieve rapid and seamless online adaptation by updating control models when the robot arm’s configuration changes. The control framework comprises an Adaptive Global Inverse Model (Adaptive GIM) and an Adaptive Local Inverse Model (Adaptive LIM). The Adaptive GIM employs configuration-independent meta-learning, which allows the control model to swiftly adapt to different arm configurations. The Adaptive LIM adopts a meta-learning approach for location-independent training, enabling the robot to adapt to diverse local positions. As the Adaptive GIM suffers from the adverse effects stemming from the multiple solutions of inverse kinematics, utilizing the Adaptive LIM with relative position as input can alleviate this issue and enable more precise reaching towards the target. Extensive validation conducted on PKUHR6.0 demonstrates that the proposed approach significantly enhances online adaptation speed and precision compared to existing methods
Transhumeral Arm Reaching Motion Prediction through Deep Reinforcement Learning-Based Synthetic Motion Cloning

Muhammad Hannan Ahmed,Kyo Kutsuzawa,Mitsuhiro Hayashibe

DOI: https://doi.org/10.3390/biomimetics8040367

2023-08-15

Abstract:The lack of intuitive controllability remains a primary challenge in enabling transhumeral amputees to control a prosthesis for arm reaching with residual limb kinematics. Recent advancements in prosthetic arm control have focused on leveraging the predictive capabilities of artificial neural networks (ANNs) to automate elbow joint motion and wrist pronation-supination during target reaching tasks. However, large quantities of human motion data collected from different subjects for various activities of daily living (ADL) tasks are required to train these ANNs. For example, the reaching motion can be altered when the height of the desk is changed; however, it is cumbersome to conduct human experiments for all conditions. This paper proposes a framework for cloning motion datasets using deep reinforcement learning (DRL) to cater to training data requirements. DRL algorithms have been demonstrated to create human-like synergistic motion in humanoid agents to handle redundancy and optimize movements. In our study, we collected real motion data from six individuals performing multi-directional arm reaching tasks in the horizontal plane. We generated synthetic motion data that mimicked similar arm reaching tasks by utilizing a physics simulation and DRL-based arm manipulation. We then trained a CNN-LSTM network with different configurations of training motion data, including DRL, real, and hybrid datasets, to test the efficacy of the cloned motion data. The results of our evaluation showcase the effectiveness of the cloned motion data in training the ANN to predict natural elbow motion accurately across multiple subjects. Furthermore, motion data augmentation through combining real and cloned motion datasets has demonstrated the enhanced robustness of the ANN by supplementing and diversifying the limited training data. These findings have significant implications for creating synthetic dataset resources for various arm movements and fostering strategies for automatized prosthetic elbow motion.
Self-developing Proprioception-Based Robot Internal Models

Tao Zhang,Fan Hu,Yian Deng,Mengxi Nie,Tianlin Liu,Xihong Wu,Dingsheng Luo

DOI: https://doi.org/10.1007/978-3-030-01313-4_34

2018-01-01

Abstract:Research in cognitive science reveals that human central nervous system internally simulates dynamic behavior of the motor system using internal models (forward model and inverse model). Being inspired, the question of how a robot develops its internal models for arm motion control is discussed. Considering that human proprioception plays an important role for the development of internal models, we propose to use autoencoder neural networks to establish robot proprioception, and then based on which the robot develops its internal models. All the models are learned in a developmental manner through robot motor babbling like human infants. To evaluate the proprioception-based internal models, we conduct experiments on our PKU-HR6.0 humanoid robots, and the results illustrate the effectiveness of the proposed approach. Additionally, a framework integrating internal models is further proposed for robot arm motion control (reaching, grasping and placing) and its effectiveness is also demonstrated.
Anthropomorphic Reaching Movement Generating Method for Human-Like Upper Limb Robot

Chang He,Xiao-Wei Xu,Xiong-Fei Zheng,Cai-Hua Xiong,Quan-Lin Li,Wen-Bin Chen,Bai-Yang Sun

DOI: https://doi.org/10.1109/tcyb.2021.3107341

IF: 11.8

2021-01-01

IEEE Transactions on Cybernetics

Abstract:How to generate anthropomorphic reaching movement remains a challenging problem in service robots and human motor function repair/reconstruction equipment. However, there is no universally accepted computational model in the literature for reproducing the motion of the human upper limb. In response to the problem, this article presents a computational framework for generating reaching movement endowed with human motion characteristics that imitated the mechanism in the control and realization of human upper limb motions. This article first establishes the experimental paradigm of human upper limb functional movements and proposes the characterization of human upper limb movement characteristics and feature movement clustering methods in the joint space. Then, according to the specific task requirements of the upper limb, combined with the human sensorimotor model, the estimation method of the human upper limb natural postures was established. Next, a continuous task parametric model matching the characteristic motion class is established by using the Gaussian mixture regression method. The anthropomorphic motion generation method with the characteristics of the smooth trajectory and the ability of natural obstacle avoidance is proposed. Finally, the anthropomorphic motion generation method proposed in this article is verified by a human-like robot. The measurement index of the human-likeness degree of the trajectory is given. The experimental results show that for all four tested tasks, the human-likeness degrees were greater than 90.8%, and the trajectories' jerk generated by this method is very similar to the trajectories' jerk of humans, which validates the proposed method.

automation & control systems,computer science, cybernetics, artificial intelligence
Neuromechanics-Based Neural Feedback Controller for Planar Arm Reaching Movements

Yongkun Zhao,Mingquan Zhang,Haijun Wu,Xiangkun He,Masahiro Todoh

DOI: https://doi.org/10.3390/bioengineering10040436

IF: 5.046

2023-03-30

Bioengineering

Abstract:Based on the principles of neuromechanics, human arm movements result from the dynamic interaction between the nervous, muscular, and skeletal systems. To develop an effective neural feedback controller for neuro-rehabilitation training, it is important to consider both the effects of muscles and skeletons. In this study, we designed a neuromechanics-based neural feedback controller for arm reaching movements. To achieve this, we first constructed a musculoskeletal arm model based on the actual biomechanical structure of the human arm. Subsequently, a hybrid neural feedback controller was developed that mimics the multifunctional areas of the human arm. The performance of this controller was then validated through numerical simulation experiments. The simulation results demonstrated a bell-shaped movement trajectory, consistent with the natural motion of human arm movements. Furthermore, the experiment testing the tracking ability of the controller revealed real-time errors within one millimeter, with the tensile force generated by the controller’s muscles being stable and maintained at a low value, thereby avoiding the issue of muscle strain that can occur due to excessive excitation during the neurorehabilitation process.
Stage-Wise Learning of Reaching Using Little Prior Knowledge

François de La Bourdonnaye,Céline Teulière,Jochen Triesch,Thierry Chateau

DOI: https://doi.org/10.3389/frobt.2018.00110

2018-10-01

Abstract:In some manipulation robotics environments, because of the difficulty of precisely modeling dynamics and computing features which describe well the variety of scene appearances, hand-programming a robot behavior is often intractable. Deep reinforcement learning methods partially alleviate this problem in that they can dispense with hand-crafted features for the state representation and do not need pre-computed dynamics. However, they often use prior information in the task definition in the form of shaping rewards which guide the robot toward goal state areas but require engineering or human supervision and can lead to sub-optimal behavior. In this work we consider a complex robot reaching task with a large range of initial object positions and initial arm positions and propose a new learning approach with minimal supervision. Inspired by developmental robotics, our method consists of a weakly-supervised stage-wise procedure of three tasks. First, the robot learns to fixate the object with a 2-camera system. Second, it learns hand-eye coordination by learning to fixate its end-effector. Third, using the knowledge acquired in the previous steps, it learns to reach the object at different positions and from a large set of initial robot joint angles. Experiments in a simulated environment show that our stage-wise framework yields similar reaching performances, compared with a supervised setting without using kinematic models, hand-crafted features, calibration parameters or supervised visual modules.
Hierarchical Control of Visually-Guided Movements in a 3D-Printed Robot Arm

Adam Matić,Pavle Valerjev,Alex Gomez-Marin

DOI: https://doi.org/10.3389/fnbot.2021.755723

IF: 3.493

2021-10-29

Frontiers in Neurorobotics

Abstract:The control architecture guiding simple movements such as reaching toward a visual target remains an open problem. The nervous system needs to integrate different sensory modalities and coordinate multiple degrees of freedom in the human arm to achieve that goal. The challenge increases due to noise and transport delays in neural signals, non-linear and fatigable muscles as actuators, and unpredictable environmental disturbances. Here we examined the capabilities of hierarchical feedback control models proposed by W. T. Powers, so far only tested in silico . We built a robot arm system with four degrees of freedom, including a visual system for locating the planar position of the hand, joint angle proprioception, and pressure sensing in one point of contact. We subjected the robot to various human-inspired reaching and tracking tasks and found features of biological movement, such as isochrony and bell-shaped velocity profiles in straight-line movements, and the speed-curvature power law in curved movements. These behavioral properties emerge without trajectory planning or explicit optimization algorithms. We then applied static structural perturbations to the robot: we blocked the wrist joint, tilted the writing surface, extended the hand with a tool, and rotated the visual system. For all of them, we found that the arm in machina adapts its behavior without being reprogrammed. In sum, while limited in speed and precision (by the nature of the do-it-yourself inexpensive components we used to build the robot from scratch), when faced with the noise, delays, non-linearities, and unpredictable disturbances of the real world, the embodied control architecture shown here balances biological realism with design simplicity.

robotics,computer science, artificial intelligence,neurosciences
Validation of a Control Algorithm for Human-like Reaching Motion using 7-DOF Arm and 19-DOF Hand-Arm Systems

Tapomayukh Bhattacharjee,Yonghwan Oh,Sang-Rok Oh

DOI: https://doi.org/10.48550/arXiv.1311.0959

IF: 3.7

2013-11-05

Robotics

Abstract:This technical report gives an overview of our work on control algorithms dealing with redundant robot systems for achieving human-like motion characteristics. Previously, we developed a novel control law to exhibit human-motion characteristics in redundant robot arm systems as well as arm-trunk systems for reaching tasks [1], [2]. This newly developed method nullifies the need for the computation of pseudo-inverse of Jacobian while the formulation and optimization of any artificial performance index is not necessary. The time-varying properties of the muscle stiffness and damping as well as the low-pass filter characteristics of human muscles have been modeled by the proposed control law to generate human-motion characteristics for reaching motion like quasi-straight line trajectory of the end-effector and symmetric bell shaped velocity profile. This report focuses on the experiments performed using a 7-DOF redundant robot-arm system which proved the effectiveness of this algorithm in imitating human-like motion characteristics. In addition, we extended this algorithm to a 19-DOF Hand-Arm System for a reach-to-grasp task. Simulations using the 19-DOF Hand-Arm System show the effectiveness of the proposed scheme for effective human-like hand-arm coordination in reach-to-grasp tasks for pinch and envelope grasps on objects of different shapes such as a box, a cylinder, and a sphere.
Robotic arm reinforcement learning control method based on autonomous visual perception

HU Chunyang,WANG Heng,SHI Haobin,Chunyang HU,Heng WANG,Haobin SHI

DOI: https://doi.org/10.1051/jnwpu/20213951057

2021-10-01

Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University

Abstract:The traditional robotic arm control methods are often based on artificially preset fixed trajectories to control them to complete specific tasks, which rely on accurate environmental models, and the control process lacks the ability of self-adaptability. Aiming at the above problems, we proposed an end-to-end robotic arm intelligent control method based on the combination of machine vision and reinforcement learning. The visual perception uses the YOLO algorithm, and the strategy control module uses the DDPG reinforcement learning algorithm, which enables the robotic arm to learn autonomous control strategies in a complex environment. Otherwise, we used imitation learning and hindsight experience replay algorithm during the training process, which accelerated the learning process of the robotic arm. The experimental results show that the algorithm can converge in a shorter time, and it has excellent performance in autonomously perceiving the target position and overall strategy control in the simulation environment.

Note: Rapid Genotyping of Human ERCC1 Exon 4 Polymorphism with Fluorescence Analysis Using Fluorophore-Labeled Hybridization Probes and a LightCycler

Dynamic Movement Primitive Based Motion Retargeting for Dual-Arm Sign Language Motions

Learning Efficient Robot Arm Reaching

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Developing Robot Reaching Skill Via Look-ahead Planning

Learning Arm Movements Of Target Reaching For Humanoid Robot

Optimizing Robot Arm Reaching Ability with Different Joints Functionality

Robot Arm Configuration Self-Awareness Via Interacting with Environment

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Developing Robot Reaching Skill with Relative-Location Based Approximating

How Does a Robot Develop Its Reaching Ability Like Human Infants Do?

An Infant-Inspired Model for Robot Developing Its Reaching Ability

A Novel Meta Control Framework for Robot Arm Reaching with Changeable Configuration

Transhumeral Arm Reaching Motion Prediction through Deep Reinforcement Learning-Based Synthetic Motion Cloning

Self-developing Proprioception-Based Robot Internal Models

Anthropomorphic Reaching Movement Generating Method for Human-Like Upper Limb Robot

Neuromechanics-Based Neural Feedback Controller for Planar Arm Reaching Movements

Stage-Wise Learning of Reaching Using Little Prior Knowledge

Hierarchical Control of Visually-Guided Movements in a 3D-Printed Robot Arm

Validation of a Control Algorithm for Human-like Reaching Motion using 7-DOF Arm and 19-DOF Hand-Arm Systems

Robotic arm reinforcement learning control method based on autonomous visual perception