Generation a shooting on the walking for soccer simulation 3D league using Q-learning algorithm
Yun Li,Yibin Song,Amin Rezaeipanah
DOI: https://doi.org/10.1007/s12652-021-03551-9
IF: 3.662
2021-11-05
Journal of Ambient Intelligence and Humanized Computing
Abstract:RoboCup is one of the greatest human endeavors to operationalize research in the field of robotics and artificial intelligence. RoboCup soccer simulation 3D (RoboCup3D) competition provide a great opportunity to work with humanoid robots without the need for hardware. One of the most important goals of the teams participating in RoboCup3D league is the ability to increase the number of shoots. The reason for this importance is that superiority over the opponent requires a powerful and precise shoot. The methods introduced for shooting so far are mostly based on Inverse Kinematics (IK) and point analysis. The assumption of these methods is that the positions of the robot and the ball is fixed. However, this is not always the case for shooting. In this paper, a shooting strategy is presented for situations where the robot is walking. Here, a curved path is designed to movement the robot towards the ball so that the robot will eventually have an optimal position to shoot. In general, the vision preceptor in RoboCup3D has noise. Hence, robot movement parameters such as speed and angle are more precisely adjusted by the Q-learning algorithm. Finally, when the robot is in the optimal position relative to the ball and the goal, the IK module is applied to the shooting strategy. Simulations and experiments prove the superiority of the proposed algorithm compared to most teams in RoboCupSoccer and Iran’s Open RoboCup3D leagues.
computer science, information systems,telecommunications, artificial intelligence