Abstract:Mastering games is a hard task, as games can be extremely complex, and still fundamentally different in structure from one another. While the AlphaZero algorithm has demonstrated an impressive ability to learn the rules and strategy of a large variety of games, ranging from Go and Chess, to Atari games, its reliance on extensive computational resources and rigid Convolutional Neural Network (CNN) architecture limits its adaptability and scalability. A model trained to play on a $19\times 19$ Go board cannot be used to play on a smaller $13\times 13$ board, despite the similarity between the two Go variants. In this paper, we focus on Chess, and explore using a more generic Graph-based Representation of a game state, rather than a grid-based one, to introduce a more general architecture based on Graph Neural Networks (GNN). We also expand the classical Graph Attention Network (GAT) layer to incorporate edge-features, to naturally provide a generic policy output format. Our experiments, performed on smaller networks than the initial AlphaZero paper, show that this new architecture outperforms previous architectures with a similar number of parameters, being able to increase playing strength an order of magnitude faster. We also show that the model, when trained on a smaller $5\times 5$ variant of chess, is able to be quickly fine-tuned to play on regular $8\times 8$ chess, suggesting that this approach yields promising generalization abilities. Our code is available at <a class="link-external link-https" href="https://github.com/akulen/AlphaGateau" rel="external noopener nofollow">this https URL</a>.

Representation Matters for Mastering Chess: Improved Feature Representation in AlphaZero Outperforms Switching to Transformers

Mastering Chess with a Transformer Model

Enhancing Chess Reinforcement Learning with Graph Representation

AlphaViT: A Flexible Game-Playing AI for Multiple Games and Variable Board Sizes

Mastering NIM and Impartial Games with Weak Neural Networks: An AlphaZero-inspired Multi-Frame Approach

ResTNet: Defense against Adversarial Policies via Transformer in Computer Go

Reimagining chess with AlphaZero

Acquisition of chess knowledge in AlphaZero

Mastering Chinese Chess AI (Xiangqi) Without Search

Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm

Amortized Planning with Large-Scale Transformers: A Case Study on Chess

Assessing Game Balance with AlphaZero: Exploring Alternative Rule Sets in Chess

Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex

Information based explanation methods for deep learning agents -- with applications on large open-source chess models

Information based explanation methods for deep learning agents-with applications on large open-source chess models

Mastering Atari, Go, chess and shogi by planning with a learned model

Application And Challenges of Alphazero Algorithm in Chinese Chess

Neural Networks for Chess

Efficient Learning for AlphaZero via Path Consistency.