Abstract:RoboCup is one of the greatest human endeavors to operationalize research in the field of robotics and artificial intelligence. RoboCup soccer simulation 3D (RoboCup3D) competition provide a great opportunity to work with humanoid robots without the need for hardware. One of the most important goals of the teams participating in RoboCup3D league is the ability to increase the number of shoots. The reason for this importance is that superiority over the opponent requires a powerful and precise shoot. The methods introduced for shooting so far are mostly based on Inverse Kinematics (IK) and point analysis. The assumption of these methods is that the positions of the robot and the ball is fixed. However, this is not always the case for shooting. In this paper, a shooting strategy is presented for situations where the robot is walking. Here, a curved path is designed to movement the robot towards the ball so that the robot will eventually have an optimal position to shoot. In general, the vision preceptor in RoboCup3D has noise. Hence, robot movement parameters such as speed and angle are more precisely adjusted by the Q-learning algorithm. Finally, when the robot is in the optimal position relative to the ball and the goal, the IK module is applied to the shooting strategy. Simulations and experiments prove the superiority of the proposed algorithm compared to most teams in RoboCupSoccer and Iran’s Open RoboCup3D leagues.

Research of RoboCup Pass Strategy Based on Improved Q-Learning

Towards a cooperative soccer team in RoboCup

A research of an improved R-Learning used in the training of RoboCup

Research and Application about Defensive Strategy Based on Q Learning

An Improved Reinforcement Q-Learning Method with BP Neural Networks in Robot Soccer

Reinforcement learning based on multi-agent in robocup

Multi-Agent Coordination Method Based On Fuzzy Q-Learning

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

An optimal strategy learning for RoboCup in continuous state space

Cooperative Strategy Learning in Multi-Agent Environment with Continuous State Space

An Improved Q-learning Algorithm Based on Exploration Region Expansion Strategy

Application of multi-agent reinforcement learning to RoboCup

Research on Improvement of Q-Learning and Its Simulation Experiments

Research about Offensive Strategy Based on Dynamic Goal-Driven in RoboCup

Q-learning with fuzzy priori knowledge and application in Robot Soccer

Realization of Pass Ball Strategy in RoboCup

Generation a shooting on the walking for soccer simulation 3D league using Q-learning algorithm

An Adaptive Strategy Selection Method With Reinforcement Learning for Robotic Soccer Games.

Multi-agent Cooperative Strategy Learning Method Based on Transfer Learning.

Learning Competition In Robot Soccer Game Based On An Adapted Neuro-Fuzzy Inference System

Agent Behavior Strategy Based on Fuzzy Evaluation and Inference in Robocupsoccer