Abstract:Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation rather than brute search of millions of future nteractions. In this paper, we propose a computer Go system that follows experts way of thinking and playing. Our system consists of two parts. The first part is a novel deep alternative neural network (DANN) used to generate candidates of next move. Compared with existing deep convolutional neural network (DCNN), DANN inserts recurrent layer after each convolutional layer and stacks them in an alternative manner. We show such setting can preserve more contexts of local features and its evolutions which are beneficial for move prediction. The second part is a long-term evaluation (LTE) module used to provide a reliable evaluation of candidates rather than a single probability from move predictor. This is consistent with human experts nature of playing since they can foresee tens of steps to give an accurate estimation of candidates. In our system, for each candidate, LTE calculates a cumulative reward after several future interactions when local variations are settled. Combining criteria from the two parts, our system determines the optimal choice of next move. For more comprehensive experiments, we introduce a new professional Go dataset (PGD), consisting of 253233 professional records. Experiments on GoGoD and PGD datasets show the DANN can substantially improve performance of move prediction over pure DCNN. When combining LTE, our system outperforms most relevant approaches and open engines based on MCTS.

A Machine Learning Method of Joseki Database for Computer Go

Evaluation of Monte Carlo tree search and the application to Go

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

Playing Go without Game Tree Search Using Convolutional Neural Networks

AlphaZero Gomoku

Construction, observation and knowledge abstraction for go endgames on small boards

Learning the Game of Go by Scalable Network Without Prior Knowledge of Komi

Building a Computer Mahjong Player via Deep Convolutional Neural Networks

AlphaGomoku: An AlphaGo-based Gomoku Artificial Intelligence using Curriculum Learning

Teaching Deep Convolutional Neural Networks to Play Go

Mastering the game of Go without human knowledge

Mastering the game of Go with deep neural networks and tree search

A GFML-based Robot Agent for Human and Machine Cooperative Learning on Game of Go

Belief-state Monte-Carlo Tree Search for Phantom Games

When Doctors Meet with AlphaGo: Potential Application of Machine Learning to Clinical Medicine.

Gomoku: analysis of the game and of the player Wine

Uct Based Search In Phantom Go

The application of chessboard game based on integrated learning and UCT algorithm in mental health and emotional regulation

Monte Carlo Tree Search as a Tool for Self-Learning and Teaching People to Play Complete Information Board Games

Deep Reinforcement Learning for 5*5 Multiplayer Go

THE GAME TREE SEARCH ALGORITHM BASED ON OPTIMIZED ITERATIVE DEEPENING