Neuronal encoding, and information theory

Edmund T. Rolls

2023-01-01

Abstract:Subject Cognition and Behavioural Neuroscience Collection: Oxford Scholarship Online

What problem does this paper attempt to address?

The Neuronal Encoding of Information in the Brain

Edmund T. Rolls,Alessandro Treves

DOI: https://doi.org/10.1016/j.pneurobio.2011.08.002

IF: 10.885

2011-01-01

Progress in Neurobiology

Abstract:We describe the results of quantitative information theoretic analyses of neural encoding, particularly in the primate visual, olfactory, taste, hippocampal, and orbitofrontal cortex. Most of the information turns out to be encoded by the firing rates of the neurons, that is by the number of spikes in a short time window. This has been shown to be a robust code, for the firing rate representations of different neurons are close to independent for small populations of neurons. Moreover, the information can be read fast from such encoding, in as little as 20 ms. In quantitative information theoretic studies, only a little additional information is available in temporal encoding involving stimulus-dependent synchronization of different neurons, or the timing of spikes within the spike train of a single neuron. Feature binding appears to be solved by feature combination neurons rather than by temporal synchrony. The code is sparse distributed, with the spike firing rate distributions close to exponential or gamma. A feature of the code is that it can be read by neurons that take a synaptically weighted sum of their inputs. This dot product decoding is biologically plausible. Understanding the neural code is fundamental to understanding not only how the cortex represents, but also processes, information.
The Neuronal Representation of Information in the Human Brain

Edmund T. Rolls

DOI: https://doi.org/10.1093/brain/awv242

IF: 14.5

2015-01-01

Brain

Abstract:The responses of single neurons provide evidence that is essential to understanding what information is encoded in a brain area, and how it is encoded, for the information conveyed by a single neuron is almost independent of that conveyed by others in the same population. The differences in the firing rate response profiles of single neurons to a set of stimuli or events encode most of the information about that stimulus or event. The representation is sparsely distributed, with neurons often having an approximately exponential firing rate distribution, with high firing rates to a few stimuli, and smaller and smaller responses to other stimuli in the set, and no response to most of the stimuli. It is in this way that information about particular stimuli is represented. For example, in the inferior temporal visual cortex, neurons encode in this manner which particular face or object is being shown (Rolls and Treves, 2011). Evidence of this type is crucial to understanding the operation of the brain, for by reading the code from different connected brain areas, it is possible to start to understand what is being performed (or computed) by each brain region. This in turn is important for understanding neurological and psychiatric disorders and their symptoms, and for suggesting treatments based on what each brain region is performing, and developing hypotheses about how each cortical area operates (Rolls, 2008, 2016). Much of the evidence on what is represented in different cortical areas comes from single neuron studies in macaques, including concepts about the roles of cortical areas that correspond to those in humans. The book Single Neuron Studies of the Human Brain - Probing Cognition edited by Fried, Rutishauser, Cerf and Kreiman is therefore important, for it reviews what is now being discovered from recordings from single …
Information Representation , Processing , and Storage in the Brain : Analysis at the Single Neuron Level

E. T. Rolls

2007-01-01

Abstract:The ways in which information is represented, processed, and stored in the nervous system of primates as shown by recording from single neurons are considered. 1) Individual stimuli, objects, or responses (termed events) are coded as the pattern of firing across a population of neurons. That is. ensemble encoding rather than "grandmother cell" encoding is used. Evidence for this from recordings in temporal cortical areas involved in face recognition is presented. 2) In order to clarify how the nervous system would function with such ensemble encoding, and to clarify how single neurons might respond in such a system, a theoretical analysis of information representation and storage in matrix memories formed by neuronal networks is presented. It is shown that such distributed information processing and storage has a number of advantages, including completion of an incomplete pattern, generalization, graceful degradation when the system is damaged or incomplete, and speed. It is also shown that these properties arise only if ensemble coding for information across subpopulations of neurons is used. It is further noted that the tuning of neurons, which is graded differentially to different events rather than being so specific that it occurs only to one event, is advantageous in making many fine discriminations. Also, it is shown that such neuronal networks allow any pattern of firing to be interfaced to any other pattern of firing, providing a basis for information transmission from sensory input through to motor output with no special "homunculus" required. 3) Through the connected stages of a processing system the representation of information becomes more sharply differentiated between events, as shown by the fineness of tuning of single neurons in different stages of the taste system and in temporal lobe visual areas.
Information Encoding in the Inferior Temporal Visual Cortex: Contributions of the Firing Rates and the Correlations Between the Firing of Neurons

NC Aggelopoulos,Edmund T. Rolls,Leonardo Franco

DOI: https://doi.org/10.1167/2.7.425

2010-01-01

Journal of Vision

Abstract:An important issue in visual neuroscience is the extent to which the neural code utilizes the numbers of spikes each neuron emits, or the relative time of firing of different neurons, which might reflect stimulus-dependent synchronization and thus could encode information. We analyzed the extent to which populations of primate inferior temporal visual cortex (IT) neurons utilize these different types of encoding by using a quantitative information-theoretic approach that compares the information encoded in these different ways (Panzeri et al, 1999). The formula quantifies the corrections to the instantaneous information rate which result from correlations in spike emission between pairs of neurons. The responses of small sets of neurons were simultaneously recorded with multiple single neuron microelectrodes while a rhesus macaque performed a visual fixation task and was shown 20 images effective for different IT neurons such as objects and faces. It was shown that almost all the information was present in the number of spikes emitted by each neuron, with stimulus-dependent synchronization effects adding for most sets of simultaneously recorded neurons almost no additional information. It was also found that the redundancy between the small sets of simultaneously recorded neurons was low, in the region of 4–10%. In addition, it was shown with a decoding procedure for measuring the information, that for the whole population of 20 neurons analysed, the information increased linearly with the number of neurons in the sample. The overall conclusion is that IT neurons convey information that is almost independent, with little redundancy; and that stimulus-dependent synchronization contributes very little to the code. The encoding is thus in an appropriate form for readout by receiving areas in which the neurons compute a dot product between the numbers of spikes received from different neurons and their synaptic weight vectors (see Rolls ET and Deco G, 2002, Computational Neuroscience of Vision, Oxford University Press; Panzeri S, Schultz SR, Treves A and Rolls,E.T., 1999, Correlations and the encoding of information in the nervous system. Proceedings of the Royal Society B 266: 1001–1012).
Correlations and the Encoding of Information in the Nervous System

S Panzeri,SR Schultz,A Treves,ET Rolls

DOI: https://doi.org/10.1098/rspb.1999.0736

1999-01-01

Abstract:Is the information transmitted by an ensemble of neurons determined solely by the number of spikes fired by each cell, or do correlations in the emission of action potentials also play a significant role? We derive a simple formula which enables this question to be answered rigorously for short time-scales. The formula quantifies the corrections to the instantaneous information rate which result from correlations in spike emission between pairs of neurons. The mutual information that the ensemble of neurons conveys about external stimuli can thus be broken down into firing rate and correlation components. This analysis provides fundamental constraints upon the nature of information coding, showing that over short time-scales correlations cannot dominate information representation, that stimulus-independent correlations may lead to synergy (where the neurons together convey more information than they would if they were considered independently), but that only certain combinations of the different sources of correlation result in significant synergy rather than in redundancy or in negligible effects. This analysis leads to a new quantification procedure which is directly applicable to simultaneous multiple neuron recordings.
Applications of Information Theory to Analysis of Neural Data

Simon R. Schultz,Robin A. A. Ince,Stefano Panzeri

DOI: https://doi.org/10.1007/978-1-4614-7320-6_280-1

2015-01-08

Abstract:Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying information flow in the nervous system. It has a number of useful properties: it is a general measure sensitive to any relationship, not only linear effects; it has meaningful units which in many cases allow direct comparison between different experiments; and it can be used to study how much information can be gained by observing neural responses in single trials, rather than in averages over multiple trials. A variety of information theoretic quantities are commonly used in neuroscience - (see entry "Definitions of Information-Theoretic Quantities"). In this entry we review some applications of information theory in neuroscience to study encoding of information in both single neurons and neuronal populations.

Neurons and Cognition
Introduction to linear algebra for neural networks

Edmund T. Rolls

2023-01-01

Abstract:Subject Cognition and Behavioural Neuroscience Collection: Oxford Scholarship Online
An Introductory Review of Information Theory in the Context of Computational Neuroscience

Mark D. McDonnell,Shiro Ikeda,Jonathan H. Manton

DOI: https://doi.org/10.48550/arXiv.1107.2984

2011-07-15

Information Theory

Abstract:This paper introduces several fundamental concepts in information theory from the perspective of their origins in engineering. Understanding such concepts is important in neuroscience for two reasons. Simply applying formulae from information theory without understanding the assumptions behind their definitions can lead to erroneous results and conclusions. Furthermore, this century will see a convergence of information theory and neuroscience; information theory will expand its foundations to incorporate more comprehensively biological processes thereby helping reveal how neuronal networks achieve their remarkable information processing abilities.
Neural stochastic codes, encoding and decoding

Hugo Gabriel Eyherabide

DOI: https://doi.org/10.48550/arXiv.1611.05080

2017-01-13

Abstract:Understanding brain function, constructing computational models and engineering neural prosthetics require assessing two problems, namely encoding and decoding, but their relation remains controversial. For decades, the encoding problem has been shown to provide insight into the decoding problem, for example, by upper bounding the decoded information. However, here we show that this need not be the case when studying response aspects beyond noise correlations, and trace back the actual causes of this major departure from traditional views. To that end, we reformulate the encoding and decoding problems from the observer or organism perspective. In addition, we study the role of spike-time precision and response discrimination, among other response aspects, using stochastic transformations of the neural responses, here called stochastic codes. Our results show that stochastic codes may cause different information losses when used to describe neural responses and when employed to train optimal decoders. Therefore, we conclude that response aspects beyond noise correlations may play different roles in encoding and decoding. In practice, our results show for the first time that decoders constructed low-quality descriptions of response aspects may operate optimally on high-quality descriptions and vice versa, thereby potentially yielding experimental and computational savings, as well as new opportunities for simplifying the design of computational brain models and neural prosthetics.

Neurons and Cognition,Information Theory,Quantitative Methods,Applications
Efficiency turns the table on neural encoding, decoding and noise

Sophie Deneve,Matthew Chalk

DOI: https://doi.org/10.1016/j.conb.2016.03.002

IF: 7.07

2016-04-01

Current Opinion in Neurobiology

Abstract:Sensory neurons are usually described with an encoding model, for example, a function that predicts their response from the sensory stimulus using a receptive field (RF) or a tuning curve. However, central to theories of sensory processing is the notion of 'efficient coding'. We argue here that efficient coding implies a completely different neural coding strategy. Instead of a fixed encoding model, neural populations would be described by a fixed decoding model (i.e. a model reconstructing the stimulus from the neural responses). Because the population solves a global optimization problem, individual neurons are variable, but not noisy, and have no truly invariant tuning curve or receptive field. We review recent experimental evidence and implications for neural noise correlations, robustness and adaptation.

neurosciences
Natural Encoding of Information through Interacting Impulses

Vladimir S. Lerner

DOI: https://doi.org/10.48550/arXiv.1701.04863

2019-07-29

Abstract:How to artificially encode observer in universal information coding structure like DNA ? It requires naturally creating information Bits and natural encoding triplet code enables recognizing other encoded information. These Bits become standard units of different information languages in modern communications. Fundamental interactions build structure of Universe. Numerous multilevel inter-species interactions selforganize biosystems. Human interactions unify these and many others. Physical reality is only interactions identified or not yet. Each interaction is elementary yes-no action of impulse which models a natural Bit. Natural interactive process, transferring Bits, models information process. Information is universal physical substance a phenomenon of interaction which not only originates information but transfers it sequentially. Mutually interacting processes enable creating new elements like chemical chain reactions. The elements enclosing components of reaction memorize the interactive yes-no result similar to encoding. Energy quantity and quality of specific interaction determine sequence of transferring information, its encoding, and limit the code length. The introduced formalism of natural emergence information and its encoding also shows advantage over non-natural encoding. The impulse sequential natural encoding merges memory with the time of memorizing information and compensates the cost by running time intervals of encoding. Information process binds the encoding impulse reversible microprocesses in multiple impulses macroprocess of information irreversible dynamics establishing interactive integrated information dynamics. The encoding process integrates geometrical triplet coding structure rotating double helix of sequencing cells Bits, which commands cognition, intelligence including conscience. The results validate computer simulation, and experiments.

General Physics
Optimal Encoding in Stochastic Latent-Variable Models

Michael E. Rule,Martino Sorbaro,Matthias H. Hennig

DOI: https://doi.org/10.3390/e22070714

IF: 2.738

2020-06-28

Entropy

Abstract:In this work we explore encoding strategies learned by statistical models of sensory coding in noisy spiking networks. Early stages of sensory communication in neural systems can be viewed as encoding channels in the information-theoretic sense. However, neural populations face constraints not commonly considered in communications theory. Using restricted Boltzmann machines as a model of sensory encoding, we find that networks with sufficient capacity learn to balance precision and noise-robustness in order to adaptively communicate stimuli with varying information content. Mirroring variability suppression observed in sensory systems, informative stimuli are encoded with high precision, at the cost of more variable responses to frequent, hence less informative stimuli. Curiously, we also find that statistical criticality in the neural population code emerges at model sizes where the input statistics are well captured. These phenomena have well-defined thermodynamic interpretations, and we discuss their connection to prevailing theories of coding and statistical criticality in neural populations.

physics, multidisciplinary
An Information Theoretic Approach to the Contributions of the Firing Rates and the Correlations Between the Firing of Neurons.

ET Rolls,L Franco,NC Aggelopoulos,S Reece

DOI: https://doi.org/10.1152/jn.01070.2002

2003-01-01

Journal of Neurophysiology

Abstract:To analyze the extent to which populations of neurons encode information in the numbers of spikes each neuron emits or in the relative time of firing of the different neurons that might reflect synchronization, we developed and analyzed the performance of an information theoretic approach. The formula quantifies the corrections to the instantaneous information rate that result from correlations in spike emission between pairs of neurons. We showed how these cross-cell terms can be separated from the correlations that occur between the spikes emitted by each neuron, the auto-cell terms in the information rate expansion. We also described a method to test whether the estimate of the amount of information contributed by stimulus-dependent synchronization is significant. With simulated data, we show that the approach can separate information arising from the number of spikes emitted by each neuron from the redundancy that can arise if neurons have common inputs and from the synergy that can arise if cells have stimulus-dependent synchronization. The usefulness of the approach is also demonstrated by showing how it helps to interpret the encoding shown by neurons in the primate inferior temporal visual cortex. When applied to a sample dataset of simultaneously recorded inferior temporal cortex neurons, the algorithm showed that most of the information is available in the number of spikes emitted by each cell; that there is typically just a small degree (approximately 12%) of redundancy between simultaneously recorded inferior temporal cortex (IT) neurons; and that there is very little gain of information that arises from stimulus-dependent synchronization effects in these neurons.
The Relative Advantages of Sparse Versus Distributed Encoding for Associative Neuronal Networks in the Brain

Edmund T. Rolls,Alessandro Treves

DOI: https://doi.org/10.1088/0954-898x_1_4_002

1990-01-01

Network

Abstract:In some neuronal networks in the brain which are thought to operate as associative memories, a sparse coding of information can enhance the storage capacity. The extent to which this statement is valid in general is discussed here, by considering some simple formal models of associative memory which include different neurobiological constraints. In nets of linear neurons, trained with either a Hebbian (purely incremental) or a Stanton and Sejnowski learning rule, sparse coding increases the number of independent associations that can be stored. When neurons are nonlinear, for a diversity of learning rules, sparse coding may result in an increase in the number of patterns that can be discriminated. The analysis is then used to help interpret recent evidence on the encoding of information in the taste and visual systems, as obtained from recordings in primates. Following the taste pathway, it is found that the breadth of tuning of individual neurons becomes progressively finer, consistent with the idea that sparser representations become advantageous as the taste information is eventually associated with that coming from other sensory modalities. In the visual system, considering a population of neurons in the temporal cortex that respond preferentially to faces, it is argued that their breadth of tuning represents a compromise between fully distributed encoding, and a grandmother cell type of encoding, which would result in a given neuron responding only to an individual face.
Networks for Memory, Perception, and Decision-Making, and Beyond to How the Syntax for Language Might Be Implemented in the Brain.

Edmund T. Rolls,Gustavo Deco

DOI: https://doi.org/10.1016/j.brainres.2014.09.021

IF: 3.61

2015-01-01

Brain Research

Abstract:Neural principles that provide a foundation for memory, perception, and decision-making include place coding with sparse distributed representations, associative synaptic modification, and attractor networks in which the storage capacity is in the order of the number of associatively modifiable recurrent synapses on any one neuron. Based on those and further principles of cortical computation, hypotheses are explored in which syntax is encoded in the cortex using sparse distributed place coding. Each cortical module 2-3 mm in diameter is proposed to be formed of a local attractor neuronal network with a capacity in the order of 10,000 words (e.g. subjects, verbs or objects depending on the module). Such a system may form a deep language-of-thought layer. For the information to be communicated to other people, the modules in which the neurons are firing which encode the syntactic role, as well as which neurons are firing to specify the words, must be communicated. It is proposed that one solution to this (used in English) is temporal order encoding, for example subject-verb-object. It is shown with integrate-and-fire simulations that this order encoding could be implemented by weakly forward-coupled subject-verb-object modules. A related system can decode a temporal sequence. This approach based on known principles of cortical computation needs to be extended to investigate further whether it could form a biological foundation for the implementation of language in the brain. This article is part of a Special Issue entitled SI: Brain and Memory.
Bayesian encoding and decoding as distinct perspectives on neural coding

Richard D. Lange,Sabyasachi Shivkumar,Ankani Chattoraj,Ralf M. Haefner

DOI: https://doi.org/10.1038/s41593-023-01458-6

IF: 25

2023-11-23

Nature Neuroscience

Abstract:The Bayesian brain hypothesis is one of the most influential ideas in neuroscience. However, unstated differences in how Bayesian ideas are operationalized make it difficult to draw general conclusions about how Bayesian computations map onto neural circuits. Here, we identify one such unstated difference: some theories ask how neural circuits could recover information about the world from sensory neural activity (Bayesian decoding), whereas others ask how neural circuits could implement inference in an internal model (Bayesian encoding). These two approaches require profoundly different assumptions and lead to different interpretations of empirical data. We contrast them in terms of motivations, empirical support and relationship to neural data. We also use a simple model to argue that encoding and decoding models are complementary rather than competing. Appreciating the distinction between Bayesian encoding and Bayesian decoding will help to organize future work and enable stronger empirical tests about the nature of inference in the brain.

neurosciences
Information Confusion Reveals an Innate Limit of the Information Processing by Neurons

Yang Tian,Justin L. Gardner,Guoqi Li,Pei Sun

DOI: https://doi.org/10.1101/2020.10.19.345249

2020-01-01

Abstract:Information experiences complex transformation processes in the brain, involving various errors. A daunting and critical challenge in neuroscience is to understand the origin of these errors and their effects on neural information processing. While previous efforts have made substantial progresses in studying the information errors in bounded, unreliable and noisy transformation cases, it still remains elusive whether the neural system is inherently error-free under an ideal and noise-free condition. This work brings the controversy to an end with a negative answer. We propose a novel neural information confusion theory, indicating the widespread presence of information confusion phenomenon after the end of transmission process, which originates from innate neuron characteristics rather than external noises. Then, we reformulate the definition of zero-error capacity under the context of neuroscience, presenting an optimal upper bound of the zero-error transformation rates determined by the tuning properties of neurons. By applying this theory to neural coding analysis, we unveil the multi-dimensional impacts of information confusion on neural coding. Although it reduces the variability of neural responses and limits mutual information, it controls the stimulus-irrelevant neural activities and improves the interpretability of neural responses based on stimuli. Together, the present study discovers an inherent and ubiquitous precision limitation of neural information transformation, which shapes the coding process by neural ensembles. These discoveries reveal that the neural system is intrinsically error-prone in information processing even in the most ideal cases. Author summary One of the most central challenges in neuroscience is to understand the information processing capacity of the neural system. Decades of efforts have identified various errors in nonideal neural information processing cases, indicating that the neural system is not optimal in information processing because of the widespread presences of external noises and limitations. These incredible progresses, however, can not address the problem about whether the neural system is essentially error-free and optimal under ideal information processing conditions, leading to extensive controversies in neuroscience. Our work brings this well-known controversy to an end with a negative answer. We demonstrate that the neural system is intrinsically error-prone in information processing even in the most ideal cases, challenging the conventional ideas about the superior neural information processing capacity. We further indicate that the neural coding process is shaped by this innate limit, revealing how the characteristics of neural information functions and further cognitive functions are determined by the inherent limitation of the neural system.
Information encoding and the responses of single neurons in the primate temporal visual cortex.

M. J. TOVEE,E. T. ROLLS,A. TREVES,R. P. BELLIS

DOI: https://doi.org/10.1152/jn.1993.70.2.640

1993-01-01

Journal of Neurophysiology

Abstract:1. The possibility of temporal encoding in the spike trains of single neurons recorded in the temporal lobe visual cortical areas of rhesus macaques was analyzed with the use of principal compo- nent and information theory analyses of smoothed spike trains. The neurons analyzed had responses selective for faces. 2. Provided that a correction was applied to earlier methods of principal component analysis used for neuronal spike trains, it was shown that the first principal component provides by a great extent the most information, with the second and third adding only small proportions (on average 18.8 and 8.4%, respectively). 3. It was shown that the magnitude of the second and higher principal components is even smaller if the spike train analysis is started after the onset of the neuronal response, instead of before the neuronal response has started. This suggests that variations in response latency are at least a part of what is reflected by the second and higher principal components. 4. The first principal component was correlated with the mean firing rate of the neurons. The second and higher principal compo- nents reflected at least partly the onset properties of the neuronal responses, such as response latency differences between the stimuli. 5. A considerable proportion of the information available from principal components l-3 is available in the firing rate of the neuron. 6. Periods of the firing rate of as little as 50 or even 20 ms are sufficient to give a reasonable estimate of the firing rate of the neuron. 7. Information theory analysis showed that in short epochs (e.g., 50 ms) the information available from the firing rate can be as high, on average, as 84.4% of that available from the firing rate calculated over 400 ms, and 52.0% of that available from principal components l-3 in the 400-ms period. It was also found that 44.0% of the information calculated from the first three principal components is available in the firing rates calculated over epochs as short as 20 ms. 8. More information was available near the start of the neuro- nal response, and the information available from short epochs became less later in the neuronal response. 9. Taken together, these analyses provide evidence that a short period of firing taken close to the start of the neuronal response provides a reasonable proportion of the total information that would be available if a long period of neuronal firing (e.g., 400 ms) were utilized to extract it, even if temporal encoding were used. The implications of these and related findings are that, at least for rapid object recognition, each cortical stage provides information to the next in a short period of 20-50 ms, does not utilize temporal encoding, and completes sufficient computation to provide an output to the next stage in this same 20- to 50-ms period.
Encoding and Decoding Models in Cognitive Electrophysiology

Christopher R. Holdgraf,Jochem W. Rieger,Cristiano Micheli,Stephanie Martin,Robert T. Knight,Frederic E. Theunissen

DOI: https://doi.org/10.3389/fnsys.2017.00061

2017-09-26

Frontiers in Systems Neuroscience

Abstract:Cognitive neuroscience has seen rapid growth in the size and complexity of data recorded from the human brain as well as in the computational tools available to analyze this data. This data explosion has resulted in an increased use of multivariate, model-based methods for asking neuroscience questions, allowing scientists to investigate multiple hypotheses with a single dataset, to use complex, time-varying stimuli, and to study the human brain under more naturalistic conditions. These tools come in the form of "Encoding" models, in which stimulus features are used to model brain activity, and "Decoding" models, in which neural features are used to generated a stimulus output. Here we review the current state of encoding and decoding models in cognitive electrophysiology and provide a practical guide toward conducting experiments and analyses in this emerging field. Our examples focus on using linear models in the study of human language and audition. We show how to calculate auditory receptive fields from natural sounds as well as how to decode neural recordings to predict speech. The paper aims to be a useful tutorial to these approaches, and a practical introduction to using machine learning and applied statistics to build models of neural activity. The data analytic approaches we discuss may also be applied to other sensory modalities, motor systems, and cognitive systems, and we cover some examples in these areas. In addition, a collection of <i>Jupyter</i> notebooks is publicly available as a complement to the material covered in this paper, providing code examples and tutorials for predictive modeling in python. The aim is to provide a practical understanding of predictive modeling of human brain data and to propose best-practices in conducting these analyses.

neurosciences
Neuronal Networks in the Brain

Edmund Rolls,Alessandro Traves

DOI: https://doi.org/10.1088/2058-7058/3/5/21

1990-01-01

Physics World

Abstract:Recent advances in neuroscience are making it possible to describe the architecture and properties of some of the networks of neurones (brain cells) in brain structures, while neuronal network theory, including approaches related to the statistical mechanics of spin glasses, is becoming helpful in analysing the computational properties of these networks. These developments are illuminating processes of information storage in the brain, and this is illustrated in the case of one brain structure considered here, the hippocampus.

Neuronal encoding, and information theory

The Neuronal Encoding of Information in the Brain

The Neuronal Representation of Information in the Human Brain

Information Representation , Processing , and Storage in the Brain : Analysis at the Single Neuron Level

Information Encoding in the Inferior Temporal Visual Cortex: Contributions of the Firing Rates and the Correlations Between the Firing of Neurons

Correlations and the Encoding of Information in the Nervous System

Applications of Information Theory to Analysis of Neural Data

Introduction to linear algebra for neural networks

An Introductory Review of Information Theory in the Context of Computational Neuroscience

Neural stochastic codes, encoding and decoding

Efficiency turns the table on neural encoding, decoding and noise

Natural Encoding of Information through Interacting Impulses

Optimal Encoding in Stochastic Latent-Variable Models

An Information Theoretic Approach to the Contributions of the Firing Rates and the Correlations Between the Firing of Neurons.

The Relative Advantages of Sparse Versus Distributed Encoding for Associative Neuronal Networks in the Brain

Networks for Memory, Perception, and Decision-Making, and Beyond to How the Syntax for Language Might Be Implemented in the Brain.

Bayesian encoding and decoding as distinct perspectives on neural coding

Information Confusion Reveals an Innate Limit of the Information Processing by Neurons

Information encoding and the responses of single neurons in the primate temporal visual cortex.

Encoding and Decoding Models in Cognitive Electrophysiology

Neuronal Networks in the Brain