How your brain detects patterns in the everyday: without conscious thought

Miryam Naddaf

DOI: https://doi.org/10.1038/d41586-024-03116-8

IF: 64.8

2024-09-26

Nature

Abstract:Neurons in certain brain areas integrate 'what' and 'when' information to discern hidden order in events in real time. Neurons in certain brain areas integrate 'what' and 'when' information to discern hidden order in events in real time.

multidisciplinary sciences

What problem does this paper attempt to address?

The emergence of identity, agency and consciousness from the temporal dynamics of neural elaboration

Riccardo Fesce

DOI: https://doi.org/10.3389/fnetp.2024.1292388

2024-04-02

Abstract:Identity-differentiating self from external reality-and agency-being the author of one's acts-are generally considered intrinsic properties of awareness and looked at as mental constructs generated by consciousness. Here a different view is proposed. All physiological systems display complex time-dependent regulations to adapt or anticipate external changes. To interact with rapid changes, an animal needs a nervous system capable of modelling and predicting (not simply representing) it. Different algorithms must be employed to predict the momentary location of an object based on sensory information (received with a delay), or to design in advance and direct the trajectory of movement. Thus, the temporal dynamics of external events and action must be handled in differential ways, thereby generating the distinction between self and non-self ("identity") as an intrinsic computational construct in neuronal elaboration. Handling time is not what neurons are designed for. Neuronal circuits are based on parallel processing: each bit of information diverges on many neurons, each of which combines it with many other data. Spike firing reports the likelihood that the specific pattern the neuron is designed to respond to is present in the incoming data. This organization seems designed to process synchronous datasets. However, since neural networks can introduce delays in processing, time sequences can be transformed into simultaneous patterns and analysed as such. This way predictive algorithms can be implemented, and continually improved through neuronal plasticity. To successfully interact with the external reality, the nervous system must model and predict, but also differentially handle perceptual functions or motor activity, by putting in register information that becomes available at different time moments. Also, to learn through positive/negative reinforcement, modelling must establish a causal relation between motor control and its consequences: the contrast between phase lag in perception and phase lead (and control) in motor programming produces the emergence of identity (discerning self from surrounding) and agency (control on actions) as necessary computational constructs to model reality. This does not require any form of awareness. In a brain, capable of producing awareness, these constructs may evolve from mere computational requirements into mental (conscious) constructs.
Pattern activation/recognition theory of mind

Bertrand du Castel

DOI: https://doi.org/10.3389/fncom.2015.00090

2015-07-15

Abstract:In his 2012 book How to Create a Mind, Ray Kurzweil defines a "Pattern Recognition Theory of Mind" that states that the brain uses millions of pattern recognizers, plus modules to check, organize, and augment them. In this article, I further the theory to go beyond pattern recognition and include also pattern activation, thus encompassing both sensory and motor functions. In addition, I treat checking, organizing, and augmentation as patterns of patterns instead of separate modules, therefore handling them the same as patterns in general. Henceforth I put forward a unified theory I call "Pattern Activation/Recognition Theory of Mind." While the original theory was based on hierarchical hidden Markov models, this evolution is based on their precursor: stochastic grammars. I demonstrate that a class of self-describing stochastic grammars allows for unifying pattern activation, recognition, organization, consistency checking, metaphor, and learning, into a single theory that expresses patterns throughout. I have implemented the model as a probabilistic programming language specialized in activation/recognition grammatical and neural operations. I use this prototype to compute and present diagrams for each stochastic grammar and corresponding neural circuit. I then discuss the theory as it relates to artificial network developments, common coding, neural reuse, and unity of mind, concluding by proposing potential paths to validation.
How the 'mind's eye' calls up visual memories from the brain

Julian Nowogrodzki

DOI: https://doi.org/10.1038/d41586-024-01757-3

IF: 64.8

2024-06-16

Nature

Abstract:Different patterns of brain activity help to distinguish between images recalled from memory and the sight of physical objects. Different patterns of brain activity help to distinguish between images recalled from memory and the sight of physical objects.

multidisciplinary sciences
Information And Control: Insights from within the brain

Birgitta Dresp-Langley

DOI: https://doi.org/10.48550/arXiv.2206.04400

IF: 3.7

2022-06-09

Robotics

Abstract:The neural networks of the brain are capable of learning statistical input regularities on the basis of synaptic learning, functional integration into increasingly larger, interconnected neural assemblies, and self organization. This self organizing ability has implications for biologically inspired control structures in robotics. On the basis of signal input from vision, sound, smell, touch and proprioception, multisensory representations for action are generated on the basis of physically specified input from the environment. The somatosensory cortex is a brain hub that delivers a choice example of integration for multifunctional representation and control. All sensory information is in a first instance topologically represented in the biological brain, and thereafter integrated in somatosensory neural networks for multimodal and multifunctional control of complex behaviors. Multisignal input triggers interactions between visual, auditory, tactile, olfactive, and proprioceptive mechanisms, which cooperate or compete during learning, and contribute to the formation of integrated representations for action, reflection, and communication between the agent and the outside world. Interaction fuels complex behavioral strategy deployment and further learning for increasingly coherent representation of intrinsically ambiguous physical environments.
Finding Pattern in the Noise: Persistent Implicit Statistical Knowledge Impacts the Processing of Unpredictable Stimuli

Andrea Kóbor,Karolina Janacsek,Petra Hermann,Zsófia Zavecz,Vera Varga,Valéria Csépe,Zoltán Vidnyánszky,Gyula Kovács,Dezso Nemeth

DOI: https://doi.org/10.1162/jocn_a_02173

2024-04-25

Journal of Cognitive Neuroscience

Abstract:Abstract Humans can extract statistical regularities of the environment to predict upcoming events. Previous research recognized that implicitly acquired statistical knowledge remained persistent and continued to influence behavior even when the regularities were no longer present in the environment. Here, in an fMRI experiment, we investigated how the persistence of statistical knowledge is represented in the brain. Participants (n = 32) completed a visual, four-choice, RT task consisting of statistical regularities. Two types of blocks constantly alternated with one another throughout the task: predictable statistical regularities in one block type and unpredictable ones in the other. Participants were unaware of the statistical regularities and their changing distribution across the blocks. Yet, they acquired the statistical regularities and showed significant statistical knowledge at the behavioral level not only in the predictable blocks but also in the unpredictable ones, albeit to a smaller extent. Brain activity in a range of cortical and subcortical areas, including early visual cortex, the insula, the right inferior frontal gyrus, and the right globus pallidus/putamen contributed to the acquisition of statistical regularities. The right insula, inferior frontal gyrus, and hippocampus as well as the bilateral angular gyrus seemed to play a role in maintaining this statistical knowledge. The results altogether suggest that statistical knowledge could be exploited in a relevant, predictable context as well as transmitted to and retrieved in an irrelevant context without a predictable structure.

psychology, experimental,neurosciences
Human hippocampal and entorhinal neurons encode the temporal structure of experience

Pawel Tacikowski,Güldamla Kalender,Davide Ciliberti,Itzhak Fried

DOI: https://doi.org/10.1038/s41586-024-07973-1

IF: 64.8

2024-09-26

Nature

Abstract:Extracting the underlying temporal structure of experience is a fundamental aspect of learning and memory that allows us to predict what is likely to happen next. Current knowledge about the neural underpinnings of this cognitive process in humans stems from functional neuroimaging research 1,2,3,4,5 . As these methods lack direct access to the neuronal level, it remains unknown how this process is computed by neurons in the human brain. Here we record from single neurons in individuals who have been implanted with intracranial electrodes for clinical reasons, and show that human hippocampal and entorhinal neurons gradually modify their activity to encode the temporal structure of a complex image presentation sequence. This representation was formed rapidly, without providing specific instructions to the participants, and persisted when the prescribed experience was no longer present. Furthermore, the structure recovered from the population activity of hippocampal–entorhinal neurons closely resembled the structural graph defining the sequence, but at the same time, also reflected the probability of upcoming stimuli. Finally, learning of the sequence graph was related to spontaneous, time-compressed replay of individual neurons' activity corresponding to previously experienced graph trajectories. These findings demonstrate that neurons in the hippocampus and entorhinal cortex integrate the 'what' and 'when' information to extract durable and predictive representations of the temporal structure of human experience.

multidisciplinary sciences
The neural correlates of ongoing conscious thought

Jonathan Smallwood,Adam Turnbull,Hao-ting Wang,Nerissa S.P. Ho,Giulia L. Poerio,Theodoros Karapanagiotidis,Delali Konu,Brontë Mckeown,Meichao Zhang,Charlotte Murphy,Deniz Vatansever,Danilo Bzdok,Mahiko Konishi,Robert Leech,Paul Seli,Jonathan W. Schooler,Boris Bernhardt,Daniel S. Margulies,Elizabeth Jefferies

DOI: https://doi.org/10.1016/j.isci.2021.102132

IF: 5.8

2021-03-01

iScience

Abstract:A core goal in cognitive neuroscience is identifying the physical substrates of the patterns of thought that occupy our daily lives. Contemporary views suggest that the landscape of ongoing experience is heterogeneous and can be influenced by features of both the person and the context. This perspective piece considers recent work that explicitly accounts for both the heterogeneity of the experience and context dependence of patterns of ongoing thought. These studies reveal that systems linked to attention and control are important for organizing experience in response to changing environmental demands. These studies also establish a role of the default mode network beyond task-negative or purely episodic content, for example, implicating it in the level of vivid detail in experience in both task contexts and in spontaneous self-generated experiential states. Together, this work demonstrates that the landscape of ongoing thought is reflected in the activity of multiple neural systems, and it is important to distinguish between processes contributing to how the experience unfolds from those linked to how these experiences are regulated.

multidisciplinary sciences
Information Representation , Processing , and Storage in the Brain : Analysis at the Single Neuron Level

E. T. Rolls

2007-01-01

Abstract:The ways in which information is represented, processed, and stored in the nervous system of primates as shown by recording from single neurons are considered. 1) Individual stimuli, objects, or responses (termed events) are coded as the pattern of firing across a population of neurons. That is. ensemble encoding rather than "grandmother cell" encoding is used. Evidence for this from recordings in temporal cortical areas involved in face recognition is presented. 2) In order to clarify how the nervous system would function with such ensemble encoding, and to clarify how single neurons might respond in such a system, a theoretical analysis of information representation and storage in matrix memories formed by neuronal networks is presented. It is shown that such distributed information processing and storage has a number of advantages, including completion of an incomplete pattern, generalization, graceful degradation when the system is damaged or incomplete, and speed. It is also shown that these properties arise only if ensemble coding for information across subpopulations of neurons is used. It is further noted that the tuning of neurons, which is graded differentially to different events rather than being so specific that it occurs only to one event, is advantageous in making many fine discriminations. Also, it is shown that such neuronal networks allow any pattern of firing to be interfaced to any other pattern of firing, providing a basis for information transmission from sensory input through to motor output with no special "homunculus" required. 3) Through the connected stages of a processing system the representation of information becomes more sharply differentiated between events, as shown by the fineness of tuning of single neurons in different stages of the taste system and in temporal lobe visual areas.
Patterning, From Conifers to Consciousness: Turing's Theory and Order From Fluctuations

Thurston C Lacalli

DOI: https://doi.org/10.3389/fcell.2022.871950

2022-05-03

Abstract:This is a brief account of Turing's ideas on biological pattern and the events that led to their wider acceptance by biologists as a valid way to investigate developmental pattern, and of the value of theory more generally in biology. Periodic patterns have played a key role in this process, especially 2D arrays of oriented stripes, which proved a disappointment in theoretical terms in the case of Drosophila segmentation, but a boost to theory as applied to skin patterns in fish and model chemical reactions. The concept of "order from fluctuations" is a key component of Turing's theory, wherein pattern arises by selective amplification of spatial components concealed in the random disorder of molecular and/or cellular processes. For biological examples, a crucial point from an analytical standpoint is knowing the nature of the fluctuations, where the amplifier resides, and the timescale over which selective amplification occurs. The answer clarifies the difference between "inelegant" examples such as Drosophila segmentation, which is perhaps better understood as a programmatic assembly process, and "elegant" ones expressible in equations like Turing's: that the fluctuations and selection process occur predominantly in evolutionary time for the former, but in real time for the latter, and likewise for error suppression, which for Drosophila is historical, in being lodged firmly in past evolutionary events. The prospects for a further extension of Turing's ideas to the complexities of brain development and consciousness is discussed, where a case can be made that it could well be in neuroscience that his ideas find their most important application.
Contiguity in perception: origins in cellular associative computations

Christian Hansel

DOI: https://doi.org/10.1016/j.tins.2024.01.001

2024-02-04

Trends in Neurosciences

Abstract:Our brains are good at detecting and learning associative structures; according to some linguistic theories, this capacity even constitutes a prerequisite for the development of syntax and compositionality in language and verbalized thought. I will argue that the search for associative motifs in input patterns is an evolutionary old brain function that enables contiguity in sensory perception and orientation in time and space. It has its origins in an elementary material property of cells that is particularly evident at chemical synapses: input-assigned calcium influx that activates calcium sensor proteins involved in memory storage. This machinery for the detection and learning of associative motifs generates knowledge about input relationships and integrates this knowledge into existing networks through updates in connectivity patterns.

neurosciences
Consciousness In Neural Networks?

Et Rolls

DOI: https://doi.org/10.1016/S0893-6080(97)00049-X

IF: 7.8

1997-01-01

Neural Networks

Abstract:A combined neurophysiological and computational approach is reviewed that leads to a proposal for how neural networks in the temporal cortical visual areas of primates could function to produce invariant object representation and identification A similar approach is then reviewed which lends to a theory of how the hippocampus could rapidly store memories, especially episodic memories including spatial context, and how later recall of the information to the neocortex could occur. Third, it is argued that the visual and memory mechanisms described could operate without consciousness, and that a different type of processing is related to consciousness. It is suggested that the type of processing related to consciousness involves higher-order thoughts (''thoughts about thoughts''), and evolved to allow plans, formulated in a language, with many steps,to be corrected. It is suggested that it would feel like something to be a system that can think linguistically (using syntax) about its own thoughts, and that the subjective or phenomenal aspects of consciousness arise in this way. It is further suggested that ''raw sensory feels'' arise in evolution because once some types of processing feel like something by virtue of a system capable of higher-order thoughts, if is then parsimonious to postulate that sensory and related processing, which has to be taken into account in that processing system, should feel like something. It is suggested that it is this type of processing, which must be implemented in neural networks, which is related to consciousness. (C) 1997 Elsevier Science Ltd.
A cellular basis for mapping behavioural structure

Mohamady El-Gaby,Adam Loyd Harris,James C. R. Whittington,William Dorrell,Arya Bhomick,Mark E. Walton,Thomas Akam,Timothy E. J. Behrens

DOI: https://doi.org/10.1038/s41586-024-08145-x

IF: 64.8

2024-11-07

Nature

Abstract:To flexibly adapt to new situations, our brains must understand the regularities in the world, as well as those in our own patterns of behaviour. A wealth of findings is beginning to reveal the algorithms that we use to map the outside world 1,2,3,4,5,6 . However, the biological algorithms that map the complex structured behaviours that we compose to reach our goals remain unknown. Here we reveal a neuronal implementation of an algorithm for mapping abstract behavioural structure and transferring it to new scenarios. We trained mice on many tasks that shared a common structure (organizing a sequence of goals) but differed in the specific goal locations. The mice discovered the underlying task structure, enabling zero-shot inferences on the first trial of new tasks. The activity of most neurons in the medial frontal cortex tiled progress to goal, akin to how place cells map physical space. These 'goal-progress cells' generalized, stretching and compressing their tiling to accommodate different goal distances. By contrast, progress along the overall sequence of goals was not encoded explicitly. Instead, a subset of goal-progress cells was further tuned such that individual neurons fired with a fixed task lag from a particular behavioural step. Together, these cells acted as task-structured memory buffers, implementing an algorithm that instantaneously encoded the entire sequence of future behavioural steps, and whose dynamics automatically computed the appropriate action at each step. These dynamics mirrored the abstract task structure both on-task and during offline sleep. Our findings suggest that schemata of complex behavioural structures can be generated by sculpting progress-to-goal tuning into task-structured buffers of individual behavioural steps.

multidisciplinary sciences
When Abstract Becomes Concrete: Naturalistic Encoding of Concepts in the Brain

Viktor Nikolaus Kewenig,Gabriella Vigliocco,Jeremy I Skipper

DOI: https://doi.org/10.1101/2022.09.08.506944

2024-05-19

Abstract:Language is acquired and processed in complex and dynamic naturalistic contexts, involving simultaneous processing of connected speech, faces, bodies, objects, etc.. How words and their associated concepts are encoded in the brain during real-world processing is still unknown. Here, the representational structure of concrete and abstract concepts was investigated during movie watching to address the extent to which brain responses dynamically change depending on contextual information. First, across contexts, concrete and abstract concepts are shown to encode different experience-based information in separable sets of brain regions. However, these differences are reduced when multimodal context is considered. Specifically, the response profile of abstract words becomes more concrete-like when these are processed in visual scenes highly related to their meaning. Conversely, when the visual context is unrelated to a given concrete word, the activation pattern resembles more that of abstract conceptual processing. These results suggest that while concepts generally encode habitual experiences, the underlying neurobiological organisation is not fixed but depends dynamically on available contextual information.

Neuroscience
Emergent complex neural dynamics

Dante R. Chialvo

DOI: https://doi.org/10.48550/arXiv.1010.2530

2010-10-12

Neurons and Cognition

Abstract:A large repertoire of spatiotemporal activity patterns in the brain is the basis for adaptive behaviour. Understanding the mechanism by which the brain's hundred billion neurons and hundred trillion synapses manage to produce such a range of cortical configurations in a flexible manner remains a fundamental problem in neuroscience. One plausible solution is the involvement of universal mechanisms of emergent complex phenomena evident in dynamical systems poised near a critical point of a second-order phase transition. We review recent theoretical and empirical results supporting the notion that the brain is naturally poised near criticality, as well as its implications for better understanding of the brain.
Pattern Association in the Brain: Amygdala and Orbitofrontal Cortex

Edmund T. Rolls,Alessandro Treves

DOI: https://doi.org/10.1093/acprof:oso/9780198524328.003.0007

1997-01-01

Abstract:This chapter examines the location of pattern association neural networks in the brain, their role in the systems-level operation of the brain, and evidence on how they actually operate in the brain. It evaluates evidence suggesting that pattern association is involved in learning associations between sensory representation and reward or punishment and investigates the role of pattern association in backprojections in the cerebral cortex. It also describes pattern association within the hippocampus.
Neural Networks, Artificial Intelligence and the Computational Brain

Martin C. Nwadiugwu

DOI: https://doi.org/10.48550/arXiv.2101.08635

2020-12-25

Neurons and Cognition

Abstract:In recent years, several studies have provided insight on the functioning of the brain which consists of neurons and form networks via interconnection among them by synapses. Neural networks are formed by interconnected systems of neurons, and are of two types, namely, the Artificial Neural Network (ANNs) and Biological Neural Network (interconnected nerve cells). The ANNs are computationally influenced by human neurons and are used in modelling neural systems. The reasoning foundations of ANNs have been useful in anomaly detection, in areas of medicine such as instant physician, electronic noses, pattern recognition, and modelling biological systems. Advancing research in artificial intelligence using the architecture of the human brain seeks to model systems by studying the brain rather than looking to technology for brain models. This study explores the concept of ANNs as a simulator of the biological neuron, and its area of applications. It also explores why brain-like intelligence is needed and how it differs from computational framework by comparing neural networks to contemporary computers and their modern day implementation.
Spatiotemporal Patterns in Neurobiology: An Overview for Future Artificial Intelligence

Navjot Singh

DOI: https://doi.org/10.31234/osf.io/cpmre

2022-04-13

Abstract:In recent years, there has been increasing interest in developing models and tools to address the complex patterns of connectivity found in brain tissue. Specifically, this is due to a need to understand how emergent properties emerge from these network structures at multiple spatiotemporal scales. We argue that computational models are key tools for elucidating the possible functionalities that can emerge from interactions of heterogeneous neurons connected by complex networks on multi-scale temporal and spatial domains. Here we review several classes of models including spiking neurons, integrate-and-fire neurons with short term plasticity (STP), conductance based integrate-and-fire models with STP, and population density neural field (PDNF) models using simple examples with emphasis on neuroscience applications while also providing some potential future research directions for AI. These computational approaches allow us to explore the impact of changing underlying mechanisms on resulting network function both experimentally as well as theoretically. Thus we hope these studies will inform future developments in artificial intelligence algorithms as well as help validate our understanding of brain processes based on experiments in animals or humans.
When sensory input meets spontaneous brain activity

Natalia Zaretskaya

DOI: https://doi.org/10.1016/j.tins.2024.08.010

Abstract:A recent study by Wu, Podvalny, and colleagues investigated how ongoing spontaneous brain activity interacts with sensory input and shapes conscious perception. It reports diverse effects of prestimulus activity in several key networks, revealing new roles of the prefrontal cortex and the default mode network in perception and consciousness.
Human consciousness is supported by dynamic complex patterns of brain signal coordination

A Demertzi,E Tagliazucchi,S Dehaene,G Deco,P Barttfeld,F Raimondo,C Martial,D Fernández-Espejo,B Rohaut,H U Voss,N D Schiff,A M Owen,S Laureys,L Naccache,J D Sitt,A. Demertzi,E. Tagliazucchi,S. Dehaene,G. Deco,P. Barttfeld,F. Raimondo,C. Martial,D. Fernández-Espejo,B. Rohaut,H. U. Voss,N. D. Schiff,A. M. Owen,S. Laureys,L. Naccache,J. D. Sitt

DOI: https://doi.org/10.1126/sciadv.aat7603

IF: 13.6

2019-02-01

Science Advances

Abstract:Dynamic patterns of brain activity at rest distinguish conscious and unconscious states in humans.

multidisciplinary sciences
Formation of brain-wide neural geometry during visual item recognition in monkeys

He Chen,Jun Kunimatsu,Tomomichi Oya,Yuri Imaizumi,Yukiko Hori,Masayuki Matsumoto,Yasuhiro Tsubo,Okihide Hikosaka,Takafumi Minamimoto,Yuji Naya,Hiroshi Yamada

DOI: https://doi.org/10.1101/2024.08.05.604527

2024-08-11

Abstract:Neural dynamics reflect canonical computations that relay and transform information in the brain. Previous studies have identified the neural population dynamics in many individual brain regions as a trajectory geometry in a low-dimensional neural space. However, whether these populations share particular geometric patterns across brain-wide neural populations remains unclear. Here, by mapping neural dynamics widely across temporal/frontal/limbic regions in the cortical and subcortical structures of monkeys, we show that 10 neural populations, including 2,500 neurons, propagate visual item information in a stochastic manner. We found that the visual inputs predominantly evoked rotational dynamics in the higher-order visual area, the TE and its downstream striatum tail, while curvy/straight dynamics appeared more frequently downstream in the orbitofrontal/hippocampal network. These geometric changes were not deterministic but rather stochastic according to their respective emergence rates. These results indicated that visual information propagates as a heterogeneous mixture of stochastic neural population signals in the brain.

Neuroscience

How your brain detects patterns in the everyday: without conscious thought

The emergence of identity, agency and consciousness from the temporal dynamics of neural elaboration

Pattern activation/recognition theory of mind

How the 'mind's eye' calls up visual memories from the brain

Information And Control: Insights from within the brain

Finding Pattern in the Noise: Persistent Implicit Statistical Knowledge Impacts the Processing of Unpredictable Stimuli

Human hippocampal and entorhinal neurons encode the temporal structure of experience

The neural correlates of ongoing conscious thought

Information Representation , Processing , and Storage in the Brain : Analysis at the Single Neuron Level

Patterning, From Conifers to Consciousness: Turing's Theory and Order From Fluctuations

Contiguity in perception: origins in cellular associative computations

Consciousness In Neural Networks?

A cellular basis for mapping behavioural structure

When Abstract Becomes Concrete: Naturalistic Encoding of Concepts in the Brain

Emergent complex neural dynamics

Pattern Association in the Brain: Amygdala and Orbitofrontal Cortex

Neural Networks, Artificial Intelligence and the Computational Brain

Spatiotemporal Patterns in Neurobiology: An Overview for Future Artificial Intelligence

When sensory input meets spontaneous brain activity

Human consciousness is supported by dynamic complex patterns of brain signal coordination

Formation of brain-wide neural geometry during visual item recognition in monkeys