Abstract:Mastering games is a hard task, as games can be extremely complex, and still fundamentally different in structure from one another. While the AlphaZero algorithm has demonstrated an impressive ability to learn the rules and strategy of a large variety of games, ranging from Go and Chess, to Atari games, its reliance on extensive computational resources and rigid Convolutional Neural Network (CNN) architecture limits its adaptability and scalability. A model trained to play on a $19\times 19$ Go board cannot be used to play on a smaller $13\times 13$ board, despite the similarity between the two Go variants. In this paper, we focus on Chess, and explore using a more generic Graph-based Representation of a game state, rather than a grid-based one, to introduce a more general architecture based on Graph Neural Networks (GNN). We also expand the classical Graph Attention Network (GAT) layer to incorporate edge-features, to naturally provide a generic policy output format. Our experiments, performed on smaller networks than the initial AlphaZero paper, show that this new architecture outperforms previous architectures with a similar number of parameters, being able to increase playing strength an order of magnitude faster. We also show that the model, when trained on a smaller $5\times 5$ variant of chess, is able to be quickly fine-tuned to play on regular $8\times 8$ chess, suggesting that this approach yields promising generalization abilities. Our code is available at <a class="link-external link-https" href="https://github.com/akulen/AlphaGateau" rel="external noopener nofollow">this https URL</a>.

Chess2vec: Learning Vector Representations for Chess

You shall know a piece by the company it keeps. Chess plays as a data for word2vec models

LiveChess2FEN: a Framework for Classifying Chess Pieces based on CNNs

Determining Chess Game State from an Image

Bike2Vec: Vector Embedding Representations of Road Cycling Riders and Races

code2vec: Learning Distributed Representations of Code

DeepChess: End-to-End Deep Neural Network for Automatic Learning in Chess

Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models

Machine Learning Algorithms to Predict Chess960 Result and Develop Opening Themes

End-to-End Chess Recognition

Enhancing Chess Reinforcement Learning with Graph Representation

Learning Chess With Language Models and Transformers

SentiMATE: Learning to play Chess through Natural Language Processing

Contrastive Sparse Autoencoders for Interpreting Planning of Chess-Playing Agents

Chess Game Concepts Emerge under Weak Supervision: A Case Study of Tic-tac-toe

Voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data.

Voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data

Mastering Chess with a Transformer Model

Chess as a Testbed for Language Model State Tracking

Representation Matters for Mastering Chess: Improved Feature Representation in AlphaZero Outperforms Switching to Transformers

Import2vec - Learning Embeddings for Software Libraries