Abstract:We have developed a high-performance Chinese Chess AI that operates without reliance on search algorithms. This AI has demonstrated the capability to compete at a level commensurate with the top 0.1\% of human players. By eliminating the search process typically associated with such systems, this AI achieves a Queries Per Second (QPS) rate that exceeds those of systems based on the Monte Carlo Tree Search (MCTS) algorithm by over a thousandfold and surpasses those based on the AlphaBeta pruning algorithm by more than a hundredfold. The AI training system consists of two parts: supervised learning and reinforcement learning. Supervised learning provides an initial human-like Chinese chess AI, while reinforcement learning, based on supervised learning, elevates the strength of the entire AI to a new level. Based on this training system, we carried out enough ablation experiments and discovered that 1. The same parameter amount of Transformer architecture has a higher performance than CNN on Chinese chess; 2. Possible moves of both sides as features can greatly improve the training process; 3. Selective opponent pool, compared to pure self-play training, results in a faster improvement curve and a higher strength limit. 4. Value Estimation with Cutoff(VECT) improves the original PPO algorithm training process and we will give the explanation.

Chinese chess algorithm design and implementation in the computer games

Design and improvement of the pruning algorithm of the Chinese chess in the computer games

Key Technologies Analysis of Chinese Chess Computer Game

Design and Application of Computer Games Algorithm of Checkers

Design and Improvement of the Parallel Algorithm in the Computer Games System

Principle and Methodology of Computer Games of Chinese Chess

Design and Implementation of Chinese Chess Based on Manipulator

Design And Application Of Machine Learning Algorithm Computer In Connect6 Of Computer Games System

Design and Implementation of Intelligent Chinese Chess System Device

THE GAME TREE SEARCH ALGORITHM BASED ON OPTIMIZED ITERATIVE DEEPENING

Application And Design Of Computer Games System In Phantom Go

Application And Design Of Attack And Defense Algorithms In Wtn Chess Of Computer Games

The construction of Chinese chess computer game platform

Application of Q-Learning and RBF Network in Chinese Chess Game System

Design and Analysis of the Chinese-Chess Robot in Real Time Environment

Research On The Algorithm Of Computer Static Gaming For No Go

Mastering Chinese Chess AI (Xiangqi) Without Search

The application of artificial intelligence in board games

Implementation of Adaptive Genetic Algorithm of Evaluation Function in Chinese Chess Computer Game System

Design and implementation of a military chess game algorithm based on knowledge experience

Design of Game Circuit System Based on Horn Chess