Abstract:Chess has long been a testbed for AI's quest to match human intelligence, and in recent years, chess AI systems have surpassed the strongest humans at the game. However, these systems are not human-aligned; they are unable to match the skill levels of all human partners or model human-like behaviors beyond piece movement. In this paper, we introduce Allie, a chess-playing AI designed to bridge the gap between artificial and human intelligence in this classic game. Allie is trained on log sequences of real chess games to model the behaviors of human chess players across the skill spectrum, including non-move behaviors such as pondering times and resignations In offline evaluations, we find that Allie exhibits humanlike behavior: it outperforms the existing state-of-the-art in human chess move prediction and "ponders" at critical positions. The model learns to reliably assign reward at each game state, which can be used at inference as a reward function in a novel time-adaptive Monte-Carlo tree search (MCTS) procedure, where the amount of search depends on how long humans would think in the same positions. Adaptive search enables remarkable skill calibration; in a large-scale online evaluation against players with ratings from 1000 to 2600 Elo, our adaptive search method leads to a skill gap of only 49 Elo on average, substantially outperforming search-free and standard MCTS baselines. Against grandmaster-level (2500 Elo) opponents, Allie with adaptive search exhibits the strength of a fellow grandmaster, all while learning exclusively from humans.

Creating Adjustable Human-like AI Behavior in a 3D Tennis Game with Monte-Carlo Tree Search

Towards High Level Skill Learning: Learn to Return Table Tennis Ball Using Monte-Carlo Based Policy Gradient Method.

Match Point AI: A Novel AI Framework for Evaluating Data-Driven Tennis Strategies

Belief-state Monte-Carlo Tree Search for Phantom Games

Development of Rehabilitation System (ReHabgame) through Monte-Carlo Tree Search Algorithm

Hybrid fighting game AI using a genetic algorithm and Monte Carlo tree search

Learning Physically Simulated Tennis Skills from Broadcast Videos

To Create Neuro-Controlled Game Opponent from UCT-created Data

Achieving Human Level Competitive Robot Table Tennis

Predicting Game Difficulty and Engagement Using AI Players

Strategy and Skill Learning for Physics-based Table Tennis Animation

Dual Monte Carlo Tree Search

To Create Adaptive Game Opponent by Using UCT

Improvement of Monte Carlo Tree Search Algorithm in Two-person Game Problem

Mimicking Playstyle by Adapting Parameterized Behavior Trees in RTS Games

Modeling Opponent Actions for Table-Tennis Playing Robot.

Deep Reinforcement Learning in a Racket Sport for Player Evaluation With Technical and Tactical Contexts

Learning to Move Like Professional Counter-Strike Players

Beating humans in a penny-matching game by leveraging cognitive hierarchy theory and Bayesian learning

Human-aligned Chess with a Bit of Search

Adaptive Motion Gaming AI for Health Promotion