Abstract:Introduction: In the realm of basketball, refining shooting skills and decision-making levels using intelligent agents has garnered significant interest. This study addresses the challenge by introducing an innovative framework that combines multi-modal perception and deep reinforcement learning. The goal is to create basketball robots capable of executing precise shots and informed choices by effectively integrating sensory inputs and learned strategies. Methods: The proposed approach consists of three main components: multi-modal perception, deep reinforcement learning, and end-to-end architecture. Multi-modal perception leverages the multi-head attention mechanism (MATT) to merge visual, motion, and distance cues for a holistic perception of the basketball scenario. The deep reinforcement learning framework utilizes the Deep Q-Network (DQN) algorithm, enabling the robots to learn optimal shooting strategies over iterative interactions with the environment. The end-to-end architecture connects these components, allowing seamless integration of perception and decision-making processes. Results: The experiments conducted demonstrate the effectiveness of the proposed approach. Basketball robots equipped with multi-modal perception and deep reinforcement learning exhibit improved shooting accuracy and enhanced decision-making abilities. The multi-head attention mechanism enhances the robots' perception of complex scenes, leading to more accurate shooting decisions. The application of the DQN algorithm results in gradual skill improvement and strategic optimization through interaction with the environment. Discussion: The integration of multi-modal perception and deep reinforcement learning within an end-to-end architecture presents a promising avenue for advancing basketball robot training and performance. The ability to fuse diverse sensory inputs and learned strategies empowers robots to make informed decisions and execute accurate shots. The research not only contributes to the field of robotics but also has potential implications for human basketball training and coaching methodologies.

On the Development of an Autonomous Agent for a 3D First-Person Shooter Game Using Deep Reinforcement Learning

Playing FPS Games with Deep Reinforcement Learning

Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review

Adaptive Shooting for Bots in First Person Shooter Games Using Reinforcement Learning

Training Interactive Agent in Large FPS Game Map with Rule-enhanced Reinforcement Learning

Using VizDoom Research Platform Scenarios for Benchmarking Reinforcement Learning Algorithms in First-Person Shooter Games

Playing First-Person-Shooter Games with A3C-Anticipator Network Based Agents Using Reinforcement Learning.

Implementing First-Person Shooter Game AI in WILD-SCAV with Rule-Enhanced Deep Reinforcement Learning

Learning to Shoot in First Person Shooter Games by Stabilizing Actions and Clustering Rewards for Reinforcement Learning

Deep Reinforcement Learning for Doom using Unsupervised Auxiliary Tasks

Arnold: An Autonomous Agent to Play FPS Games

Combo-Action: Training Agent for FPS Game with Auxiliary Tasks.

Playing FPS Games with Environment-Aware Hierarchical Reinforcement Learning

DRE-Bot: A Hierarchical First Person Shooter Bot Using Multiple Sarsa(λ) Reinforcement Learners

Evaluating reinforcement learning algorithms in first-person shooter games using VizDoom

Deep Reinforcement Learning for a Humanoid Robot Basketball Player

Autonomous Agent for Beyond Visual Range Air Combat: A Deep Reinforcement Learning Approach

Playing a FPS Doom Video Game with Deep Visual Reinforcement Learning

Design of Artificial Intelligence Agents for Games using Deep Reinforcement Learning

Research on deep reinforcement learning basketball robot shooting skills improvement based on end to end architecture and multi-modal perception

Coordination and Machine Learning in Multi-Robot Systems: Applications in Robotic Soccer