Abstract:Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation rather than brute search of millions of future nteractions. In this paper, we propose a computer Go system that follows experts way of thinking and playing. Our system consists of two parts. The first part is a novel deep alternative neural network (DANN) used to generate candidates of next move. Compared with existing deep convolutional neural network (DCNN), DANN inserts recurrent layer after each convolutional layer and stacks them in an alternative manner. We show such setting can preserve more contexts of local features and its evolutions which are beneficial for move prediction. The second part is a long-term evaluation (LTE) module used to provide a reliable evaluation of candidates rather than a single probability from move predictor. This is consistent with human experts nature of playing since they can foresee tens of steps to give an accurate estimation of candidates. In our system, for each candidate, LTE calculates a cumulative reward after several future interactions when local variations are settled. Combining criteria from the two parts, our system determines the optimal choice of next move. For more comprehensive experiments, we introduce a new professional Go dataset (PGD), consisting of 253233 professional records. Experiments on GoGoD and PGD datasets show the DANN can substantially improve performance of move prediction over pure DCNN. When combining LTE, our system outperforms most relevant approaches and open engines based on MCTS.

Uct Based Search In Phantom Go

Belief-state Monte-Carlo Tree Search for Phantom Games

Technique Analysis and Designing of Program with UCT Algorithm for NoGo

UCT Algorithm in Amazons Human-Computer Games

Evaluation of Monte Carlo tree search and the application to Go

Heuristic Sensing: an Uncertainty Exploration Method in Imperfect Information Games

Analysis of UCT Algorithm Policies in Imperfect Information Game.

A Middle Game Search Algorithm Applicable to Low-Cost Personal Computer for Go

Modified UCT algorithm with risk dominance methods in imperfect information game

Lookahead Pathology in Monte-Carlo Tree Search

Proof Number Based Monte-Carlo Tree Search

A Modified UCT Algorithm Basd on Risk Estimation Methods

Amazon Chess Based on UCT-PVS Hybrid Algorithm

A Multi-modal Searching Algorithm in Computer Go Based on Test

Monte Carlo Neural Fictitious Self-Play: Achieve Approximate Nash equilibrium of Imperfect-Information Games.

A phased game algorithm combining deep reinforcement learning and UCT for Tibetan Jiu chess

A Survey of Monte Carlo Tree Search Methods

Watch the Unobserved: A Simple Approach to Parallelizing Monte Carlo Tree Search

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

Competing in a Complex Hidden Role Game with Information Set Monte Carlo Tree Search

Distributed Monte Carlo Tree Search: A Novel Technique and its Application to Computer Go