Abstract:Contemporary neural networks frequently encounter the challenge of catastrophic forgetting, wherein newly acquired learning can overwrite and erase previously learned information. The paradigm of continual learning offers a promising solution by enabling intelligent systems to retain and build upon their acquired knowledge over time. This paper introduces a novel approach within the continual learning framework, employing deep reinforcement learning agents that process unprocessed pixel data and interact with microcircuit-like components. These agents autonomously advance through a series of learning stages, culminating in the development of a sophisticated neural network system optimized for predictive performance in the game of tic-tac-toe. Structured to operate in sequential order, each agent is tasked with achieving forward-looking objectives based on Bellman's principles of reinforcement learning. Knowledge retention is facilitated through the integration of specific microcircuits, which securely store the insights gained by each agent. During the training phase, these microcircuits work in concert, employing high-energy, sparse encoding techniques to enhance learning efficiency and effectiveness. The core contribution of this paper is the establishment of an artificial neural network system capable of accurately predicting tic-tac-toe moves, akin to the observational strategies employed by humans. Our experimental results demonstrate that after approximately 5000 cycles of backpropagation, the system significantly reduced the training loss to , thereby increasing the expected cumulative reward. This advancement in training efficiency translates into superior predictive capabilities, enabling the system to secure consistent victories by anticipating up to four moves ahead.

Systematic n-Tuple Networks for Othello Position Evaluation

Multi-Stage Temporal Difference Learning for 2048-like Games

Reinforcement Learning: Playing Tic-Tac-Toe

Logic-based AI for Interpretable Board Game Winner Prediction with Tsetlin Machine

Towards Learning Rubik's Cube with N-tuple-based Reinforcement Learning

Learning to Identify Top Elo Ratings: A Dueling Bandits Approach

Statistical Feature Combination for the Evaluation of Game Positions

AlphaZero-Inspired Game Learning: Faster Training by Using MCTS Only at Test Time

Continual learning, deep reinforcement learning, and microcircuits: a novel method for clever game playing

From Images to Connections: Can DQN with GNNs learn the Strategic Game of Hex?

Benchmarking Large Language Model (LLM) Performance for Game Playing via Tic-Tac-Toe

An Integrated Expert System with a Supervised Machine Learning based Probabilistic Approach to Play Tic-Tac-Toe

Operator Splitting for Learning to Predict Equilibria in Convex Games

Measuring the Non-Transitivity in Chess

Modeling and optimization of networked evolutionary game based on incomplete information with switched topologies

Creation and implementation of a set of game strategies based on training neural networks with reinforcement learning

Learning to play Tic-tac-toe

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

An Efficient Training Strategy for a Temporal Difference Learning Based Tic-Tac-Toe Automatic Player

Word Play for Playing Othello (Reverses)