Abstract:In the dynamic and rapid tactic involvements of turn-based sports, badminton stands out as an intrinsic paradigm that requires alter-dependent decision-making of players. While the advancement of learning from offline expert data in sequential decision-making has been witnessed in various domains, how to rally-wise imitate the behaviors of human players from offline badminton matches has remained underexplored. Replicating opponents' behavior benefits players by allowing them to undergo strategic development with direction before matches. However, directly applying existing methods suffers from the inherent hierarchy of the match and the compounding effect due to the turn-based nature of players alternatively taking actions. In this paper, we propose RallyNet, a novel hierarchical offline imitation learning model for badminton player behaviors: (i) RallyNet captures players' decision dependencies by modeling decision-making processes as a contextual Markov decision process. (ii) RallyNet leverages the experience to generate context as the agent's intent in the rally. (iii) To generate more realistic behavior, RallyNet leverages Geometric Brownian Motion (GBM) to model the interactions between players by introducing a valuable inductive bias for learning player behaviors. In this manner, RallyNet links player intents with interaction models with GBM, providing an understanding of interactions for sports analytics. We extensively validate RallyNet with the largest available real-world badminton dataset consisting of men's and women's singles, demonstrating its ability to imitate player behaviors. Results reveal RallyNet's superiority over offline imitation learning methods and state-of-the-art turn-based approaches, outperforming them by at least 16% in mean rule-based agent normalization score. Furthermore, we discuss various practical use cases to highlight RallyNet's applicability.

The CoachAI Badminton Environment: A Novel Reinforcement Learning Environment with Realistic Opponents (Student Abstract)

The CoachAI Badminton Environment: Bridging the Gap between a Reinforcement Learning Environment and Real-World Badminton Games

A Reinforcement Learning Badminton Environment for Simulating Player Tactics (Student Abstract)

Self-play Reinforcement Learning with Comprehensive Critic in Computer Games

Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motion

Deep Reinforcement Learning in a Racket Sport for Player Evaluation With Technical and Tactical Contexts

RobocupGym: A challenging continuous control benchmark in Robocup

RELIABLE: Offline Reinforcement Learning for Tactical Strategies in Professional Basketball Games

Eden: A Unified Environment Framework for Booming Reinforcement Learning Algorithms

Google Research Football: A Novel Reinforcement Learning Environment

An All Deep System for Badminton Game Analysis

CoachAI: A Project for Microscopic Badminton Match Data Collection and Tactical Analysis

Development of a Simulation Environment for Robot Soccer Game with Deep Reinforcement Learning and Role Assignment

Reinforcement Learning Agents for Ubisoft's Roller Champions

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Honor of Kings Arena: an Environment for Generalization in Competitive Reinforcement Learning

An Optical Control Environment for Benchmarking Reinforcement Learning Algorithms

AI coach for badminton

Deep Q-Network for AI Soccer

Programmatic Modeling and Generation of Real-Time Strategic Soccer Environments for Reinforcement Learning

Fever Basketball: A Complex, Flexible, and Asynchronized Sports Game Environment for Multi-agent Reinforcement Learning