The Neural Basis of Intuitive Best Next-Move Generation in Board Game Experts

Xiaohong Wan,Hironori Nakatani,Kenichi Ueno,Takeshi Asamizuya,Kang Cheng,Keiji Tanaka

DOI: https://doi.org/10.1126/science.1194732

IF: 56.9

2011-01-21

Science

Abstract:Compared with amateurs, expert shogi players show specific brain activation patterns.

multidisciplinary sciences

What problem does this paper attempt to address?

Game Experts The Neural Basis of Intuitive Best Next-Move Generation in Board

Xiaohong Wan,Hironori Nakatani,Kenichi Ueno,Takeshi Asamizuya,Kang Cheng,Keiji Tanaka

2013-01-01

Abstract:clicking here. colleagues, clients, or customers by , you can order high-quality copies for your If you wish to distribute this article to others here. following the guidelines can be obtained by Permission to republish or repurpose articles or portions of articles ): July 11, 2013 www.sciencemag.org (this information is current as of The following resources related to this article are available online at
Beyond Domain-Specific Expertise: Neural Signatures of Face and Spatial Working Memory in Baduk (Go Game) Experts

Wi Hoon Jung,Tae Young Lee,Youngwoo B Yoon,Chi-Hoon Choi,Jun Soo Kwon

DOI: https://doi.org/10.3389/fnhum.2018.00319

2018-08-07

Abstract:Recent advances of neuroimaging methodology and artificial intelligence have resulted in renewed interest in board games like chess and Baduk (called Go game in the West) and have provided clues as to the mechanisms behind the games. However, an interesting question that remains to be answered is whether the board game expertise as one of cognitive skills goes beyond just being good at the trained game and how it maps on networks associated with cognitive abilities that are not directly trained. To address this issue, we examined functional activity and connectivity in Baduk experts, compared to novices, while performing a visual n-back working memory (WM) task. We found that experts, compared to novices, had greater activation in superior parietal cortex during face WM, though there were no group differences in behavioral performances. Using a data-driven, whole-brain multivariate approach, we also found significant group differences in the multivariate pattern of connectivity in frontal pole and inferior parietal cortex, further showing greater connectivity between frontal and parietal regions and between frontal and temporal regions in experts. Our findings suggest that long-term trained Baduk experts have the reorganization of functional interactions between brain regions even for untrained cognitive ability.
Changes in Cognitive Processes upon Learning Mini-Shogi.

Takeshi Ito,Daisuke Takano,Xiaohong Wan,Keiji Tanaka

2012-01-01

Abstract:Changes in Cognitive Processes upon Learning Mini-Shogi Takeshi Ito (ito@cs.uec.ac.jp) Department of Communication Engineering and Informatics The University of Electro-Communications, 1-5-1 Chofugaoka, Chofu, Tokyo, JAPAN Daisuke Takeno (takano@minerva.cs.uec.ac.jp) Department of Communication Engineering and Informatics The University of Electro-Communications, 1-5-1 Chofugaoka, Chofu, Tokyo, 182-8585, JAPAN Xiaohong Wan (xhwan@brain.riken.jp) Laboratory for Cognitive Brain Mapping RIKEN Brain Science Institute, Hirosawa 2-1, Wako_shi, Saitama, 351-0198, JAPAN Keiji Tanaka (keiji@riken.jp) Laboratory for Cognitive Brain Mapping RIKEN Brain Science Institute, Hirosawa 2-1, Wako_shi, Saitama, 351-0198, JAPAN Abstract In this research, we investigated cognitive processes while playing Mini-Shogi through fMRI and cognitive experiments. Mini-Shogi is a Japanese chess-like game that uses a small board. In our cognitive experiment, the group of stronger Mini-Shogi players the stronger group’s total thinking time shortened and their total number of eye movements decreased. However, our investigation of search depth revealed different results from those of past research. The results of our fMRI experiment revealed that after learning, activity in the caudate nucleus increased among stronger players. The results of our experiments suggested that intuitive ability and the capacity for careful consideration are not independent. Simon showed that stronger players have bigger chunks of chess knowledge than do weaker players. Ito and others have observed cognitive differences between experts and beginners in Shogi (Japanese chess) as a follow-up to research on chess (Ito, Reijer and Matsubara, 2004). In that research, they compared the thought processes of beginners, club players, and experts during the next move task. The results are shown in the following table (Table 1). The results suggested that there were not only spatial clusters (spatial chunks) but time clusters (time chunks) involved in the experiments on chess. Table 1: The results of cognitive research on Shogi Club Beginners Experts players Recognition of a slow fast very fast position Area of eye very wide narrow movements narrow Thought time short long short Generation of a a few many a few candidate move Depth of search shallow deep more deep Keywords: Expertise; Mini-Shogi; Intuition; fMRI; Eye movement. Introduction Since developments in measurement apparatus have recently made it easier for physiological data to be measured more correctly (and in greater detail), the amount of research comparing cognitive data with physiological data is increasing. One type of such research, research on learning, not only clarifies the mechanism of intelligence but will also be useful for education. In the field of cognitive science, research examining the difference between beginners and experts using chess and puzzles has been executed. In chess, the most famous cognitive experiments have involved memorizing positions and were performed by de Groot (de Groot, 1965; de Groot & Gobet, 1996). The results of those experiments revealed that experts can memorize more chess pieces of a position quickly than beginners. As a follow-up to de Groot’s work, Chase and Simon introduced the theory of chunking to explain why expert game players perform so well in memory tasks (Chase & Simon, 1973). Chunking is the process of dividing a chess position into smaller parts that have meanings. Chase and This topic has also been researched in the field of brain science. With technological progress, measurement of brain activity came to be accomplished less via PET (positron emission tomography) and more via fMRI (functional magnetic resonance imaging). Paolo and others measured the active parts of the brain by using PET while subjects were solving chess-related problems (Paolo et al., 1994). The frontal lobes, the occipital lobes, and the left premotor area were activated when chess-related problems were considered. Atherton, Chen, and others measured which parts of the brain were activated by solving problems in chess and Go using fMRI (Atherton et al., 2003; Chen et al., 2003). The
Developing Intuition: Neural Correlates of Cognitive-Skill Learning in Caudate Nucleus.

Xiaohong Wan,Daisuke Takano,Takeshi Asamizuya,Chisato Suzuki,Kenichi Ueno,Kang Cheng,Takeshi Ito,Keiji Tanaka

DOI: https://doi.org/10.1523/jneurosci.2312-12.2012

2012-01-01

Abstract:The superior capability of cognitive experts largely depends on automatic, quick information processing, which is often referred to as intuition. Intuition develops following extensive long-term training. There are many cognitive models on intuition development, but its neural basis is not known. Here we trained novices for 15 weeks to learn a simple board game and measured their brain activities in early and end phases of the training while they quickly generated the best next-move to a given board pattern. We found that the activation in the head of caudate nucleus developed over the course of training, in parallel to the development of the capability to quickly generate the best next-move, and the magnitude of the caudate activity was correlated with the subject's performance. In contrast, cortical activations, which already appeared in the early phase of training, did not further change. Thus, neural activation in the caudate head, but not those in cortical areas, tracked the development of capability to quickly generate the best next-move, indicating that circuitries including the caudate head may automate cognitive computations.
Neural correlates of intuitive judgment in professional shogi players

Xiaohong Wan,Hironori Nakatani,Takeshi Asamizuya,Kenichi Ueno,Kang Cheng,Keiji Tanaka

DOI: https://doi.org/10.1016/j.neures.2009.09.160

IF: 2.904

2009-01-01

Neuroscience Research

Abstract:It is known that besides the membership function and rule sets, scaling factors are also very important to be considered in designing a fuzzy logic controller. If they are not chosen properly, the system may become unstable, oscillate or stable but with a large overshoot and slow response time. However, finding the optimal scaling factors is not a trivial task for complex, partially unknown or nonlinear systems. Furthermore, the traditional trial-and-error methods of finding a proper scaling factors is experience-based, time-consuming and do not always guarantee good response.In this paper, a Genetic Algorithm(GA)-based tuning and optimization method for scaling factors is proposed. In order to show the generality of this method, the proposed GA search for optimal scaling factors is tested on two different types of systems: a third order linear open-loop stable system and an open-loop unstable system (ball and beam system). Simulation results verify that the fuzzy logic controller whose scaling factors are optimized by GA achieve better performance.
Neural Encoding of Opposing Strategy Values in Anterior and Posterior Cingulate Cortex

Xiaohong Wan,Kang Cheng,Keiji Tanaka

DOI: https://doi.org/10.1038/nn.3999

IF: 25

2015-01-01

Nature Neuroscience

Abstract:Humans, and animals, often encounter ambiguous situations that require a decision on whether to take an offense or a defense strategy. Behavioral studies suggest that a strategy decision is frequently made before concrete options are evaluated. It remains enigmatic, however, how a strategy is determined without exploration of options. Here we investigated neural correlates of quick offense-versus-defense strategy decision in a board game, shogi. We found that the rostral anterior cingulate cortex and the posterior cingulate cortex complementally encoded the defense and attack strategy values, respectively. The dorsolateral prefrontal cortex compared the two strategy values. Several brain regions were activated during decision of concrete moves under an instructed strategy, whereas none of them showed correlation with defense or attack strategy values in their activities during strategy decision. These findings suggest that values of alternative strategies represented in different parts of the cingulate cortex have essential roles in intuitive strategy decision-making.
Large-scale brain networks in board game experts: insights from a domain-related task and task-free resting state

Xujun Duan,Wei Liao,Dongmei Liang,Lihua Qiu,Qing Gao,Chengyi Liu,Qiyong Gong,Huafu Chen

DOI: https://doi.org/10.1371/journal.pone.0032532

IF: 3.7

PLoS ONE

Abstract:Cognitive performance relies on the coordination of large-scale networks of brain regions that are not only temporally correlated during different tasks, but also networks that show highly correlated spontaneous activity during a task-free state. Both task-related and task-free network activity has been associated with individual differences in cognitive performance. Therefore, we aimed to examine the influence of cognitive expertise on four networks associated with cognitive task performance: the default mode network (DMN) and three other cognitive networks (central-executive network, dorsal attention network, and salience network). During fMRI scanning, fifteen grandmaster and master level Chinese chess players (GM/M) and fifteen novice players carried out a Chinese chess task and a task-free resting state. Modulations of network activity during task were assessed, as well as resting-state functional connectivity of those networks. Relative to novices, GM/Ms showed a broader task-induced deactivation of DMN in the chess problem-solving task, and intrinsic functional connectivity of DMN was increased with a connectivity pattern associated with the caudate nucleus in GM/Ms. The three other cognitive networks did not exhibit any difference in task-evoked activation or intrinsic functional connectivity between the two groups. These findings demonstrate the effect of long-term learning and practice in cognitive expertise on large-scale brain networks, suggesting the important role of DMN deactivation in expert performance and enhanced functional integration of spontaneous activity within widely distributed DMN-caudate circuitry, which might better support high-level cognitive control of behavior.
Brain Mechanisms of Intuitive Problem Solving in Board Game Experts

Keiji Tanaka,Xiaohong Wan,Kang Cheng

DOI: https://doi.org/10.1016/j.ijpsycho.2014.08.707

IF: 2.903

2014-01-01

International Journal of Psychophysiology

Abstract:Fluid reasoning is considered central to general intelligence. How its psychometric structure relates to brain function remains poorly understood. For instance, what is the dynamic composition of ability-specific processes underlying fluid reasoning? We investigated whether distinct fluid reasoning abilities could be differentiated by electroencephalography (EEG) microstate profiles. EEG microstates specifically capture rapidly altering activity of distributed cortical networks with a high temporal resolution as scalp potential topographies that dynamically vary over time in an organized manner. EEG was recorded simultaneously with functional magnetic resonance imaging (fMRI) in twenty healthy adult participants during cognitively distinct fluid reasoning tasks: induction, spatial relationships and visualization. Microstate parameters successfully discriminated between fluid reasoning and visuomotor control tasks as well as between the fluid reasoning tasks. Mainly, microstate B coverage was significantly higher during spatial relationships and visualization, compared to induction, while microstate C coverage was significantly decreased during spatial relationships and visualization, compared to induction. Additionally, microstate D coverage was highest during spatial relationships and microstate A coverage was most strongly reduced during the same condition. Consistently, multivariate analysis with a leave-one-out cross-validation procedure accurately classified the fluid reasoning tasks based on the coverage parameter. These EEG data and their correlation with fMRI data suggest that especially the tasks most strongly relying on visuospatial processing modulated visual and default mode network activity. We propose that EEG microstates can provide valuable information about neural activity patterns with a dynamic and complex temporal structure during fluid reasoning, suggesting cognitive ability-specific interplays between multiple brain networks.
Expertise increases planning depth in human gameplay

Bas van Opheusden,Ionatan Kuperwajs,Gianni Galbiati,Zahy Bnaya,Yunqi Li,Wei Ji Ma

DOI: https://doi.org/10.1038/s41586-023-06124-2

IF: 64.8

2023-05-31

Nature

Abstract:A hallmark of human intelligence is the ability to plan multiple steps into the future1,2. Despite decades of research3–5, it is still debated whether skilled decision-makers plan more steps ahead than novices6–8. Traditionally, the study of expertise in planning has used board games such as chess, but the complexity of these games poses a barrier to quantitative estimates of planning depth. Conversely, common planning tasks in cognitive science often have a lower complexity9,10 and impose a ceiling for the depth to which any player can plan. Here we investigate expertise in a complex board game that offers ample opportunity for skilled players to plan deeply. We use model fitting methods to show that human behaviour can be captured using a computational cognitive model based on heuristic search. To validate this model, we predict human choices, response times and eye movements. We also perform a Turing test and a reconstruction experiment. Using the model, we find robust evidence for increased planning depth with expertise in both laboratory and large-scale mobile data. Experts memorize and reconstruct board features more accurately. Using complex tasks combined with precise behavioural modelling might expand our understanding of human planning and help to bridge the gap with progress in artificial intelligence.

multidisciplinary sciences
Inter-Brain Network Underlying Turn-Based Cooperation and Competition: A Hyperscanning Study Using Near-Infrared Spectroscopy

Tao Liu,Godai Saito,Chenhui Lin,Hirofumi Saito

DOI: https://doi.org/10.1038/s41598-017-09226-w

IF: 4.6

2017-01-01

Scientific Reports

Abstract:The present study examined neural substrates underlying turn-based cooperation and competition in a real two-person situation. We simultaneously measured pairs of participants' activations in their bilateral frontal, temporal, and parietal regions using a 96-channel near-infrared spectroscopy (NIRS) system, when participants played a turn-taking disk-game on a computer. NIRS data demonstrated significant inter-brain neural synchronization (INS) across participant pairs' right posterior superior temporal sulcus (pSTS) in both the cooperation and competition conditions, and the competition condition also involved significant INS in the right inferior parietal lobule (IPL). In addition, competitive dyads' INS in the bilateral inferior frontal gyrus (IFG) may play as a role of mediation in relationship between their empathy score and disk-manipulation latency, but cooperative dyads' INS did not. These results suggest that first the right pSTS may be commonly involved in both cooperation and competition due to task demands of joint attention and intention understanding, while the right IPL may be more important for competition due to additional requirements of mentalizing resources in competing contexts. Second, participants' empathy may promote INS in the bilateral IFG across competitors, and in turn affect their competitive performance.
Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

Jinzhuo Wang,Wenmin Wang,Ronggang Wang,Wen Gao

DOI: https://doi.org/10.48550/arXiv.1706.04052

IF: 14.4

2017-06-13

Artificial Intelligence

Abstract:Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation rather than brute search of millions of future nteractions. In this paper, we propose a computer Go system that follows experts way of thinking and playing. Our system consists of two parts. The first part is a novel deep alternative neural network (DANN) used to generate candidates of next move. Compared with existing deep convolutional neural network (DCNN), DANN inserts recurrent layer after each convolutional layer and stacks them in an alternative manner. We show such setting can preserve more contexts of local features and its evolutions which are beneficial for move prediction. The second part is a long-term evaluation (LTE) module used to provide a reliable evaluation of candidates rather than a single probability from move predictor. This is consistent with human experts nature of playing since they can foresee tens of steps to give an accurate estimation of candidates. In our system, for each candidate, LTE calculates a cumulative reward after several future interactions when local variations are settled. Combining criteria from the two parts, our system determines the optimal choice of next move. For more comprehensive experiments, we introduce a new professional Go dataset (PGD), consisting of 253233 professional records. Experiments on GoGoD and PGD datasets show the DANN can substantially improve performance of move prediction over pure DCNN. When combining LTE, our system outperforms most relevant approaches and open engines based on MCTS.
Modeling of Agent Cognition in Extensive Games via Artificial Neural Networks

Chanjuan Liu,Enqiang Zhu,Qiang Zhang,Xiaopeng Wei

DOI: https://doi.org/10.1109/TNNLS.2017.2782266

Abstract:The decision-making process, which is regarded as cognitive and ubiquitous, has been exploited in diverse fields, such as psychology, economics, and artificial intelligence. This paper considers the problem of modeling agent cognition in a class of game-theoretic decision-making scenarios called extensive games. We present a novel framework in which artificial neural networks are incorporated to simulate agent cognition regarding the structure of the underlying game and the goodness of the game situations therein. An algorithmic procedure is investigated to describe the process for solving games with cognition, and then, a new equilibrium concept is proposed as a refinement of the classical one-subgame perfect equilibrium-by involving players' cognitive reasoning. Moreover, a series of results concerning the computational complexity, soundness, and completeness of the algorithm, as well as the existence of an equilibrium solution, is obtained. This framework, which is shown to be general enough to model the way in which AlphaGo plays Go, may offer a means for bridging the gap between theoretical models and practical problem-solving.
Mastering the game of Go with deep neural networks and tree search

David Silver,Aja Huang,Chris J. Maddison,Arthur Guez,Laurent Sifre,George van den Driessche,Julian Schrittwieser,Ioannis Antonoglou,Veda Panneershelvam,Marc Lanctot,Sander Dieleman,Dominik Grewe,John Nham,Nal Kalchbrenner,Ilya Sutskever,Timothy Lillicrap,Madeleine Leach,Koray Kavukcuoglu,Thore Graepel,Demis Hassabis

DOI: https://doi.org/10.1038/nature16961

IF: 64.8

2016-01-27

Nature

Abstract:The game of Go has long been viewed as the most challenging of classic games for artificial intelligence owing to its enormous search space and the difficulty of evaluating board positions and moves. Here we introduce a new approach to computer Go that uses ‘value networks’ to evaluate board positions and ‘policy networks’ to select moves. These deep neural networks are trained by a novel combination of supervised learning from human expert games, and reinforcement learning from games of self-play. Without any lookahead search, the neural networks play Go at the level of state-of-the-art Monte Carlo tree search programs that simulate thousands of random games of self-play. We also introduce a new search algorithm that combines Monte Carlo simulation with value and policy networks. Using this search algorithm, our program AlphaGo achieved a 99.8% winning rate against other Go programs, and defeated the human European Go champion by 5 games to 0. This is the first time that a computer program has defeated a human professional player in the full-sized game of Go, a feat previously thought to be at least a decade away.

multidisciplinary sciences
Searching for answers: expert pattern recognition and planning

Fernand Gobet,Andrew J Waters

DOI: https://doi.org/10.1016/j.tics.2023.07.006

Abstract:Does expertise mostly stem from pattern recognition or look-ahead search? van Opheusden et al. contribute to this important debate in cognitive psychology and artificial intelligence (AI) with a multi-method, multi-experiment study and a new model. Using a novel, relatively simple board game, they show that players increase depth of search when improving their skill.
Characteristics of brain activation in high-level football players at different stages of decision-making tasks off the ball: an fMRI study

Ming-Hao Huang,Jian Lang,Ju Li,Zhe Qin,Ya-Ping Cao

DOI: https://doi.org/10.3389/fnhum.2023.1189841

IF: 3.473

2023-08-28

Frontiers in Human Neuroscience

Abstract:Objective: This study aimed to examine the neural mechanisms underlying the decision-making process of off-ball movements among high-level football players and ordinary college students, as well as the effect of long-term skill training on these neural mechanisms using functional magnetic resonance imaging (fMRI). Methods: The study recruited 20 professional college football players as the expert group (EG) and 20 novice football players with no background in sports-related disciplines as the novice group (NG). The participants performed the motor video observation and button-decision-making tasks, and fMRI data were acquired, pre-processed, and analyzed. Results: During the decision-making process regarding running without the ball, whole-brain fMRI scans were conducted on both the EG and NG. The analysis of these scans revealed noteworthy disparities in brain activity between the two groups. These disparities were observed during tasks involving motor video observation and button-based decision-making. According to the behavioral data, the EG made more correct decisions than the NG ( p < 0.05); however, there was no significant difference in their reaction speed ( p > 0.05). During video observation, both the EG and NG exhibited simultaneous activation in the frontoparietal cognitive area, primary somatosensory cortex, visual cortex, and insula. However, there were no significant differences between the two groups in terms of activated brain regions [false discovery rate (FDR) corrected to p < 0.05]. Regarding button-press decisions, the areas of the brain that were commonly activated in both the NG and EG were primarily located in the frontoparietal cognitive area, temporal cortex, and cuneus cortex. Notably, the left superior temporal gyrus, left inferior temporal gyrus, and left middle occipital gyrus exhibited greater activation in the NG compared to those in the EG (FDR corrected to p < 0.05). Conclusion: This study demonstrated that during motor video observation, the EG's sports experience and professional knowledge can help them achieve better visual information processing strategies in specific areas of sports. During button decision-making, the EG was more economical, whereas the NG required more brain function activity to process visual information, confirming the "neural efficiency" hypothesis.

psychology,neurosciences
Neurocomputations of strategic behavior: From iterated to novel interactions

Yaomin Jiang,Hai-Tao Wu,Qingtian Mi,Lusha Zhu

DOI: https://doi.org/10.1002/wcs.1598

Abstract:Strategic interactions, where an individual's payoff depends on the decisions of multiple intelligent agents, are ubiquitous among social animals. They span a variety of important social behaviors such as competition, cooperation, coordination, and communication, and often involve complex, intertwining cognitive operations ranging from basic reward processing to higher-order mentalization. Here, we review the progress and challenges in probing the neural and cognitive mechanisms of strategic behavior of interacting individuals, drawing an analogy to recent developments in studies of reward-seeking behavior, in particular, how research focuses in the field of strategic behavior have been expanded from adaptive behavior based on trial-and-error to flexible decisions based on limited prior experience. We highlight two important research questions in the field of strategic behavior: (i) How does the brain exploit past experience for learning to behave strategically? and (ii) How does the brain decide what to do in novel strategic situations in the absence of direct experience? For the former, we discuss the utility of learning models that have effectively connected various types of neural data with strategic learning behavior and helped elucidate the interplay among multiple learning processes. For the latter, we review the recent evidence and propose a neural generative mechanism by which the brain makes novel strategic choices through simulating others' goal-directed actions according to rational or bounded-rational principles obtained through indirect social knowledge. This article is categorized under: Economics > Interactive Decision-Making Psychology > Reasoning and Decision Making Neuroscience > Cognition.
Capturing the Complexity of Human Strategic Decision-Making with Machine Learning

Jian-Qiao Zhu,Joshua C. Peterson,Benjamin Enke,Thomas L. Griffiths

2024-08-15

Abstract:Understanding how people behave in strategic settings--where they make decisions based on their expectations about the behavior of others--is a long-standing problem in the behavioral sciences. We conduct the largest study to date of strategic decision-making in the context of initial play in two-player matrix games, analyzing over 90,000 human decisions across more than 2,400 procedurally generated games that span a much wider space than previous datasets. We show that a deep neural network trained on these data predicts people's choices better than leading theories of strategic behavior, indicating that there is systematic variation that is not explained by those theories. We then modify the network to produce a new, interpretable behavioral model, revealing what the original network learned about people: their ability to optimally respond and their capacity to reason about others are dependent on the complexity of individual games. This context-dependence is critical in explaining deviations from the rational Nash equilibrium, response times, and uncertainty in strategic decisions. More broadly, our results demonstrate how machine learning can be applied beyond prediction to further help generate novel explanations of complex human behavior.

General Economics,Computer Science and Game Theory,Machine Learning
Influence Of Cognitive-Motor Expertise On Brain Dynamics Of Anticipatory-Based Outcome Processing

Yingzhi Lu,Tiantian Yang,Bradley D. Hatfield,Fengyu Cong,Chenglin Zhou

DOI: https://doi.org/10.1111/psyp.13477

2020-01-01

Psychophysiology

Abstract:Motor experience plays an important role in the ability to anticipate action outcomes, but little is known about the brain processes through which it modulates the preparation for unexpected events. To address this issue, EEG was employed while table tennis players and novices observed videos of serves in order to predict the expected ball direction based on the kinematics of a model's movement. Furthermore, we manipulated the congruency between the model's body kinematics and the subsequent ball trajectory while assessing the cerebral cortical activity of novices and experts to understand how experts respond to unexpected outcomes. Experts were more accurate in predicting the ball trajectories than novices and were further differentiated from novices in the cortical dynamics just prior to ball contact and during the period of observation of the ball trajectories. Consistent with the predicted response-outcome model, experts exhibited elevated theta oscillations during the incongruent relative to the congruent trajectories, while no such differences were observed in the novices. Source estimation for theta activity revealed stronger activation in the middle frontal gyrus for the experts in response to the incongruent trajectories. Collectively, the observed differences in cortical dynamics between the groups suggest that motor experience promotes central neural system adaptations that facilitate preparation for anticipated outcomes and contributes to adaptive cognitive-motor responses in the face of uncertainty.
Research report A functional MRI study of high-level cognition II. The game of GO

Xiangchuan Chen,Daren Zhang,Xiaochu Zhang,Zhihao Li,Xiaomei Meng,Sheng He,Xiaoping Hu

DOI: https://doi.org/10.1016/s0926-6410(02)00206-9

2003-01-01

Cognitive Brain Research

Abstract:GO is a board game thought to be different from chess in many aspects, most significantly in that GO emphasizes global strategy more than local battle, a property very difficult for computer programs to emulate. To investigate the neural basis of GO, functional magnetic resonance imaging (fMRI) was used to measure brain activities of subjects engaged in playing GO. Enhanced activations were observed in many cortical areas, such as dorsal prefrontal, parietal, occipital, posterior temporal, and primary somatosensory and motor areas. Quantitative analysis indicated a modest degree of stronger activation in right parietal area than in left. This type of right hemisphere lateralization differs from the modest left hemisphere lateralization observed during chess playing.  2002 Elsevier Science B.V. All rights reserved.
AlphaZero Gomoku

Wen Liang,Chao Yu,Brian Whiteaker,Inyoung Huh,Hua Shao,Youzhi Liang

DOI: https://doi.org/10.48550/arXiv.2309.01294

IF: 14.4

2023-09-04

Artificial Intelligence

Abstract:In the past few years, AlphaZero's exceptional capability in mastering intricate board games has garnered considerable interest. Initially designed for the game of Go, this revolutionary algorithm merges deep learning techniques with the Monte Carlo tree search (MCTS) to surpass earlier top-tier methods. In our study, we broaden the use of AlphaZero to Gomoku, an age-old tactical board game also referred to as "Five in a Row." Intriguingly, Gomoku has innate challenges due to a bias towards the initial player, who has a theoretical advantage. To add value, we strive for a balanced game-play. Our tests demonstrate AlphaZero's versatility in adapting to games other than Go. MCTS has become a predominant algorithm for decision processes in intricate scenarios, especially board games. MCTS creates a search tree by examining potential future actions and uses random sampling to predict possible results. By leveraging the best of both worlds, the AlphaZero technique fuses deep learning from Reinforcement Learning with the balancing act of MCTS, establishing a fresh standard in game-playing AI. Its triumph is notably evident in board games such as Go, chess, and shogi.

The Neural Basis of Intuitive Best Next-Move Generation in Board Game Experts

Game Experts The Neural Basis of Intuitive Best Next-Move Generation in Board

Beyond Domain-Specific Expertise: Neural Signatures of Face and Spatial Working Memory in Baduk (Go Game) Experts

Changes in Cognitive Processes upon Learning Mini-Shogi.

Developing Intuition: Neural Correlates of Cognitive-Skill Learning in Caudate Nucleus.

Neural correlates of intuitive judgment in professional shogi players

Neural Encoding of Opposing Strategy Values in Anterior and Posterior Cingulate Cortex

Large-scale brain networks in board game experts: insights from a domain-related task and task-free resting state

Brain Mechanisms of Intuitive Problem Solving in Board Game Experts

Expertise increases planning depth in human gameplay

Inter-Brain Network Underlying Turn-Based Cooperation and Competition: A Hyperscanning Study Using Near-Infrared Spectroscopy

Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative Neural Network and Long-Term Evaluation

Modeling of Agent Cognition in Extensive Games via Artificial Neural Networks

Mastering the game of Go with deep neural networks and tree search

Searching for answers: expert pattern recognition and planning

Characteristics of brain activation in high-level football players at different stages of decision-making tasks off the ball: an fMRI study

Neurocomputations of strategic behavior: From iterated to novel interactions

Capturing the Complexity of Human Strategic Decision-Making with Machine Learning

Influence Of Cognitive-Motor Expertise On Brain Dynamics Of Anticipatory-Based Outcome Processing

Research report A functional MRI study of high-level cognition II. The game of GO

AlphaZero Gomoku