Abstract:Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation rather than brute search of millions of future nteractions. In this paper, we propose a computer Go system that follows experts way of thinking and playing. Our system consists of two parts. The first part is a novel deep alternative neural network (DANN) used to generate candidates of next move. Compared with existing deep convolutional neural network (DCNN), DANN inserts recurrent layer after each convolutional layer and stacks them in an alternative manner. We show such setting can preserve more contexts of local features and its evolutions which are beneficial for move prediction. The second part is a long-term evaluation (LTE) module used to provide a reliable evaluation of candidates rather than a single probability from move predictor. This is consistent with human experts nature of playing since they can foresee tens of steps to give an accurate estimation of candidates. In our system, for each candidate, LTE calculates a cumulative reward after several future interactions when local variations are settled. Combining criteria from the two parts, our system determines the optimal choice of next move. For more comprehensive experiments, we introduce a new professional Go dataset (PGD), consisting of 253233 professional records. Experiments on GoGoD and PGD datasets show the DANN can substantially improve performance of move prediction over pure DCNN. When combining LTE, our system outperforms most relevant approaches and open engines based on MCTS.

Playing With Monte-Carlo Tree Search [AI-eXplained]

Belief-state Monte-Carlo Tree Search for Phantom Games

Monte-Carlo Tree Search with Epsilon-Greedy for Game of Amazons

Monte Carlo Tree Search as a Tool for Self-Learning and Teaching People to Play Complete Information Board Games

Monte Carlo Tree Search: a review of recent modifications and applications

Monte-Carlo Graph Search for AlphaZero

A Survey of Monte Carlo Tree Search Methods

Monte Carlo Search Algorithms Discovering Monte Carlo Tree Search Exploration Terms

Lookahead Pathology in Monte-Carlo Tree Search

Elastic Monte Carlo Tree Search with State Abstraction for Strategy Game Playing

Towards a Characterisation of Monte-Carlo Tree Search Performance in Different Games

Beyond games: a systematic review of neural Monte Carlo tree search applications

Dual Monte Carlo Tree Search

THE GAME TREE SEARCH ALGORITHM BASED ON OPTIMIZED ITERATIVE DEEPENING

Backpropagation Modification in Monte-Carlo Game Tree Search

Applying Genetic Algorithms to Game Search Trees

Evaluation of Monte Carlo tree search and the application to Go

Proof Number Based Monte-Carlo Tree Search

Playing Carcassonne with Monte Carlo Tree Search

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

An Efficient Dynamic Sampling Policy for Monte Carlo Tree Search.