Abstract:One of the biggest challenges hindering a table tennis robot to play as well as a professional player is the ball's accurate motion control, which depends on various factors such as the incoming ball's position, linear, spin velocity and so forth. Unfortunately, some factors are almost impossible to be directly measured in real practice, such as the ball's spin velocity, which is difficult to be estimated from vision due to the little texture on the ball's surface. To perform accurate motion control in table tennis, this study proposes to learn a ball stroke strategy to guarantee desirable "target landing location" and the "over-net height" which are two key indicators to evaluate the quality of a stroke. To overcome the spin velocity challenge, a deep reinforcement learning (DRL) based stroke approach is developed with the spin velocity estimation capability, through which the system can predict the relative spin velocity of the ball and stroke it back accurately by iteratively learning from the robot-environment interactions. To pre-train the DRL-based strategy effectively, this paper develops a virtual table tennis playing environment, through which various simulated data can be collected. For the real table tennis robot implementation, experimental results demonstrate the superior performance of the proposed control strategy compared to that of the traditional aerodynamics-based method with an average landing error around 80mm and the landing-within-table probability higher than 70%.

A research of an improved R-Learning used in the training of RoboCup

An optimal strategy learning for RoboCup in continuous state space

Research of RoboCup Pass Strategy Based on Improved Q-Learning

An Improved Reinforcement Q-Learning Method with BP Neural Networks in Robot Soccer

An Improved Tentative Q Learning Algorithm for Robot Learning.

Reinforcement learning based on multi-agent in robocup

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Research On Actor-Critic Reinforcement Learning In Robocup

Hybrid Reinforcement Learning Based on Human Preference and Advice for Efficient Robot Skill Learning

Application of Reinforcement Learning to Basic Action Learning of Soccer Robot

Application of reinforcement learning in robot soccer

An Improved Reinforcement Learning Algorithm for Cooperative Behaviors of Mobile Robots

Application of multi-agent reinforcement learning to RoboCup

Multiple rewards fuzzy reinforcement learning algorithm in RoboCup environment

ROLE DIVERSITY IN ROBOT SOCCER BASED ON REINFORCEMENT LEARNING

An Adaptive Strategy Selection Method With Reinforcement Learning for Robotic Soccer Games.

Ball Motion Control in the Table Tennis Robot System Using Time-Series Deep Reinforcement Learning

A Study of Reinforcement Learning in a New Multiagent Domain

Robotic Arm Motion Planning Based on Curriculum Reinforcement Learning

Reinforcement Learning for Robotic Time-optimal Path Tracking Using Prior Knowledge

Study and Application of Reinforcement Learning in Cooperative Strategy of the Robot Soccer Based on BDI Model