Abstract:Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation rather than brute search of millions of future nteractions. In this paper, we propose a computer Go system that follows experts way of thinking and playing. Our system consists of two parts. The first part is a novel deep alternative neural network (DANN) used to generate candidates of next move. Compared with existing deep convolutional neural network (DCNN), DANN inserts recurrent layer after each convolutional layer and stacks them in an alternative manner. We show such setting can preserve more contexts of local features and its evolutions which are beneficial for move prediction. The second part is a long-term evaluation (LTE) module used to provide a reliable evaluation of candidates rather than a single probability from move predictor. This is consistent with human experts nature of playing since they can foresee tens of steps to give an accurate estimation of candidates. In our system, for each candidate, LTE calculates a cumulative reward after several future interactions when local variations are settled. Combining criteria from the two parts, our system determines the optimal choice of next move. For more comprehensive experiments, we introduce a new professional Go dataset (PGD), consisting of 253233 professional records. Experiments on GoGoD and PGD datasets show the DANN can substantially improve performance of move prediction over pure DCNN. When combining LTE, our system outperforms most relevant approaches and open engines based on MCTS.

Aggregating consistent endgame knowledge in Chinese Chess

Endgame Knowledge Inference Machine in Computer Chinese Chess

EK-Chess: Chess Learning System Based on Top-Level Chess Expert Knowledge Graph

Mastering Chinese Chess AI (Xiangqi) Without Search

Construction, observation and knowledge abstraction for go endgames on small boards

Towards Understanding Chinese Checkers with Heuristics, Monte Carlo Tree Search, and Deep Reinforcement Learning

Key Technologies Analysis of Chinese Chess Computer Game

A New Representation of Chinese Chess Board

Parallel Intelligent Command Decision-Making Technology Based on Combat Prior Knowledge and Reinforcement Learning Algorithm

Implementation of Adaptive Genetic Algorithm of Evaluation Function in Chinese Chess Computer Game System

Hash table in Chinese chess

Adaptive Genetic Algorithm'S Implement On Evaluation Function In Computer Chinese Chess

On the complexity of Dark Chinese Chess

Building Endgame Data Set to Improve Opponent Modeling Approach.

An Efficient AI-based Method to Play the Mahjong Game with the Knowledge and Game-Tree Searching Strategy.

Bridging the Gap between Expert and Language Models: Concept-guided Chess Commentary Generation and Evaluation

Applying determinized MCTS in Chinese Military Chess

Human-aligned Chess with a Bit of Search

A method to construct knowledge table-base in k-in-a-row games.

Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentary

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation