Neuronal Models with Masked Signals

Jianfeng Feng

2002-01-01

Abstract:Suppose that a neuron receive two signals masked by random noise. We ask after neuronal transformation whether the masked signals will become more separable or more mixed. We prove that with positive correlations between input singles, the output will be more separable. The critical value at which the total probability of misclassification is zero is analytically obtained.

What problem does this paper attempt to address?

Correlated Neuronal Computation

JF Feng

DOI: https://doi.org/10.1063/1.1584893

2003-01-01

AIP Conference Proceedings

Abstract:Correlation between neuron activity, a form of noise, is of vital importance for the nervous system to carry out computation. Here we present a concrete example to demonstrate the advantages of correlated neuronal computation. Suppose that a neuron receives two signals masked by random noise. After neuronal transformation, will the masked signals become more separable or more mixed? We prove that with positive correlations between input singles, the output becomes more separable. The critical value at which the total probability of misclassification is zero is analytically obtained and is independent of model parameters.
Neuronal Discrimination Capacity

YC Deng,P Williams,F Liu,JF Feng

DOI: https://doi.org/10.1088/0305-4470/36/50/003

2003-01-01

Abstract:We explore neuronal mechanisms of discriminating between masked signals. It is found that when the correlation between input signals is zero, the output signals are separable if and only if input signals are separable. With positively (negatively) correlated signals, the output signals are separable (mixed) even when input signals are mixed (separable). Exact values of discrimination capacity are obtained for two most interesting cases: the exactly balanced inhibitory and excitatory input case and the uncorrelated input case. Interestingly, the discrimination capacity obtained in these cases is independent of model parameters, input distribution and is universal. Our results also suggest a functional role of inhibitory inputs and correlated inputs or, more generally, the large variability of efferent spike trains observed in in vivo experiments: the larger the variability of efferent spike trains, the easier it is to discriminate between masked input signals.
Stochastic Resonance Enhancing Detectability Of Weak Signal By Neuronal Networks Model For Receiver

Jun Liu,Jian Wu,Zhengguo Lou,Guang Li

DOI: https://doi.org/10.1007/11759966_3

2006-01-01

Abstract:Stochastic resonance phenomenon in a biological sensory system has been Studied through signal detection theories and psychophysical experiments. There is a conflict between the real experiments and the traditional signal detection theory for stochastic resonance because the latter treats the receiver as linear model. This paper presents a two-layer summing network of Hodgkin-Huxley (HH) neurons and a summing network of threshold devices to model the receiver, respectively. The simulation results indicate that the relevant index of signal delectability exhibit the stochastic resonance characteristics.
Symmetrical uncertainty based neural selection in motor cortex brain-machine interfaces

Juncheng Li,Weidong Chen,Ting Zhao,Shaomin Zhang,Xiaoxiang Zheng

DOI: https://doi.org/10.1007/978-3-642-29305-4_406

2013-01-01

Abstract:In Brain-Machine Interfaces, the redudancy among neuron activities can decrease the generalization of a decoding model and increase computation complexity. This study proposes a novel algorithm based on symmetrical uncertainty that optimally selects neurons to decode kinetic variables. In this algorithm, both relevance and redundancy are considered. We tested the method by decoding spike train data recorded from a monkey using support vector regression. The results of extensive experiments show that only 15% of the recorded neurons can achieve a decoding performance comparable to using all neurons. The generalization of the selected neurons is no worse than using all neurons either. In addition, we have also compared our method with the traditional mutual information method and shown that the neurons selected by our method are less redundant. © 2013 Springer-Verlag.
Impact of Spatially Correlated Noise on Neuronal Firing

S Wang,F Liu,W Wang,YG Yu

DOI: https://doi.org/10.1103/physreve.69.011909

IF: 2.707

2004-01-01

Physical Review E

Abstract:We explore the impact of spatially correlated noise on neuronal firing when uncoupled Hodgkin-Huxley model neurons are subjected to a common subthreshold signal. Noise can play a positive role in optimizing neuronal behavior. Although the output signal-to-noise ratio decreases with enhanced noise correlation, both the degree of synchronization among neurons and the spike timing precision are improved. This suggests that there can exist precisely synchronized firings in the presence of correlated noise and that the nervous system can exploit temporal patterns of neural activity to convey more information than just using rate codes. The mechanisms underlying these noise-induced effects are also discussed in detail.
A modelling study on discrimination tasks.

Jianfeng Feng,Feng Liu

DOI: https://doi.org/10.1016/S0303-2647(02)00064-3

IF: 1.957

2002-01-01

Biosystems

Abstract:We investigate the discrimination capacity of a single neuron model including the integrate-and-fire (IF) model and the IF-FHN model [Neural Networks, 14 (2001) 955], both theoretically and numerically. Both magnitude and frequency discrimination tasks are considered. It is found that for the magnitude discrimination task, with a small fraction of coherent inputs, an IF model and an IF-FHN model with inhibitory inputs can tell one input from the other. The total probability of misclassifications (TPM) is considerably reduced with the increasing of inhibitory inputs. However, the IF model and the IF-FHN model are incapable of performing the frequency discrimination task.
Conditional Finite Mixtures of Poisson Distributions for Context-Dependent Neural Correlations

Sacha Sokoloski,Ruben Coen-Cagli

DOI: https://doi.org/10.48550/arXiv.1908.00637

IF: 5.414

2019-08-01

Machine Learning

Abstract:Parallel recordings of neural spike counts have revealed the existence of context-dependent noise correlations in neural populations. Theories of population coding have also shown that such correlations can impact the information encoded by neural populations about external stimuli. Although studies have shown that these correlations often have a low-dimensional structure, it has proven difficult to capture this structure in a model that is compatible with theories of rate coding in correlated populations. To address this difficulty we develop a novel model based on conditional finite mixtures of independent Poisson distributions. The model can be conditioned on context variables (e.g. stimuli or task variables), and the number of mixture components in the model can be cross-validated to estimate the dimensionality of the target correlations. We derive an expectation-maximization algorithm to efficiently fit the model to realistic amounts of data from large neural populations. We then demonstrate that the model successfully captures stimulus-dependent correlations in the responses of macaque V1 neurons to oriented gratings. Our model incorporates arbitrary nonlinear context-dependence, and can thus be applied to improve predictions of neural activity based on deep neural networks.
Some Fractional Stochastic Models for Neuronal Activity with Different Time-Scales and Correlated Inputs

Enrica Pirozzi

DOI: https://doi.org/10.3390/fractalfract8010057

IF: 3.577

2024-01-16

Fractal and Fractional

Abstract:In order to describe neuronal dynamics on different time-scales, we propose a stochastic model based on two coupled fractional stochastic differential equations, with different fractional orders. For the specified choice of involved functions and parameters, we provide three specific models, with/without leakage, with fractional/non-fractional correlated inputs. We give explicit expressions of the process representing the voltage variation in the neuronal membrane. Expectation values and covariances are given and compared. Numerical evaluations of the average behaviors of involved processes are presented and discussed.

mathematics, interdisciplinary applications
Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons

Ulisse Ferrari,Stephane Deny,Matthew Chalk,Gasper Tkacik,Olivier Marre,Thierry Mora

DOI: https://doi.org/10.1103/PhysRevE.98.042410

2018-02-22

Abstract:Correlations in sensory neural networks have both extrinsic and intrinsic origins. Extrinsic or stimulus correlations arise from shared inputs to the network, and thus depend strongly on the stimulus ensemble. Intrinsic or noise correlations reflect biophysical mechanisms of interactions between neurons, which are expected to be robust to changes of the stimulus ensemble. Despite the importance of this distinction for understanding how sensory networks encode information collectively, no method exists to reliably separate intrinsic interactions from extrinsic correlations in neural activity data, limiting our ability to build predictive models of the network response. In this paper we introduce a general strategy to infer {population models of interacting neurons that collectively encode stimulus information}. The key to disentangling intrinsic from extrinsic correlations is to infer the {couplings between neurons} separately from the encoding model, and to combine the two using corrections calculated in a mean-field approximation. We demonstrate the effectiveness of this approach on retinal recordings. The same coupling network is inferred from responses to radically different stimulus ensembles, showing that these couplings indeed reflect stimulus-independent interactions between neurons. The inferred model predicts accurately the collective response of retinal ganglion cell populations as a function of the stimulus.

Neurons and Cognition,Disordered Systems and Neural Networks
Noise and signal: A model-based study of stochastic effects in neural systems

Yang LiJian,Yu Dong,Wu Yong,Li TianYu,Ding QianMing,Jia Ya

DOI: https://doi.org/10.1360/SSPMA-2023-0106

2023-01-01

Abstract:Noise is widespread at all levels of the nervous system, affecting the generation, transmission, and response of neural signals. However, significant challenges remain in effectively separating signal and noise experimentally; at the same time, a growing number of modeling studies suggest that noise is not always harmful and exhibits many positive effects on the nervous system. This paper first reviews the main sources and properties of noise in the nervous system, as well as the physiological basis for modulating factors such as temperature, channel blocking, time delay, and electromagnetic effects that are often considered in conjunction with noise. Secondly, based on different neural models, various nonlinear effects induced by noise at different levels, such as neurons and neural networks, are explored. Nonlinear physical phenomena such as resonance, synchronization, and signal transmission promotion fully demonstrate the positive role of noise in the response and transmission of neural signals. Finally, the stochastic effects in neuronal systems are summarized, and potential applications are proposed.
Estimating a Separably-Markov Random Field (SMuRF) from Binary Observations

Yingzhuo Zhang,Noa Malem-Shinitski,Stephen A Allsop,Kay Tye,Demba Ba

DOI: https://doi.org/10.48550/arXiv.1709.09723

2017-09-28

Abstract:A fundamental problem in neuroscience is to characterize the dynamics of spiking from the neurons in a circuit that is involved in learning about a stimulus or a contingency. A key limitation of current methods to analyze neural spiking data is the need to collapse neural activity over time or trials, which may cause the loss of information pertinent to understanding the function of a neuron or circuit. We introduce a new method that can determine not only the trial-to-trial dynamics that accompany the learning of a contingency by a neuron, but also the latency of this learning with respect to the onset of a conditioned stimulus. The backbone of the method is a separable two-dimensional (2D) random field (RF) model of neural spike rasters, in which the joint conditional intensity function of a neuron over time and trials depends on two latent Markovian state sequences that evolve separately but in parallel. Classical tools to estimate state-space models cannot be applied readily to our 2D separable RF model. We develop efficient statistical and computational tools to estimate the parameters of the separable 2D RF model. We apply these to data collected from neurons in the pre-frontal cortex (PFC) in an experiment designed to characterize the neural underpinnings of the associative learning of fear in mice. Overall, the separable 2D RF model provides a detailed, interpretable, characterization of the dynamics of neural spiking that accompany the learning of a contingency.

Methodology,Computational Engineering, Finance, and Science
Common-input models for multiple neural spike-train data

Jayant E. Kulkarni,Liam Paninski

DOI: https://doi.org/10.1080/09548980701625173

2007-01-01

Abstract:Recent developments in multi-electrode recordings enable the simultaneous measurement of the spiking activity of many neurons. Analysis of such multineuronal data is one of the key challenge in computational neuroscience today. In this work, we develop a multivariate point-process model in which the observed activity of a network of neurons depends on three terms: (1) the experimentally-controlled stimulus; (2) the spiking history of the observed neurons; and (3) a hidden term that corresponds, for example, to common input from an unobserved population of neurons that is presynaptic to two or more cells in the observed population. We consider two models for the network firing-rates, one of which is computationally and analytically tractable but can lead to unrealistically high firing-rates, while the other with reasonable firing-rates imposes a greater computational burden. We develop an expectation-maximization algorithm for fitting the parameters of both the models. For the analytically tractable model the expectation step is based on a continuous-time implementation of the extended Kalman smoother, and the maximization step involves two concave maximization problems which may be solved in parallel. The other model that we consider necessitates the use of Monte Carlo methods for the expectation as well as maximization step. We discuss the trade-off involved in choosing between the two models and the associated methods. The techniques developed allow us to solve a variety of inference problems in a straightforward, computationally efficient fashion; for example, we may use the model to predict network activity given an arbitrary stimulus, infer a neuron's ring rate given the stimulus and the activity of the other observed neurons, and perform optimal stimulus decoding and prediction. We present several detailed simulation studies which explore the strengths and limitations of our approach.
Modeling Heterogeneity and Dependence for Analysis of Neuronal Data.

Xiaofeng Wang,Jiayang Sun,Kenneth J. Gustafson,Guang H. Yue

DOI: https://doi.org/10.1002/sim.2943

2007-01-01

Statistics in Medicine

Abstract:In this paper, we describe two types of neuroscience problems which challenge the typical statistical models assumed for analyzing neuronal data. This offers an opportunity for new modeling and statistical inference. In the first problem, the data are spatial neural counts which are often over-dispersed and spatially correlated so that a standard Poisson regression model is inadequate. In the second problem, the data are averaged electroencephalograph signals recorded during muscle fatigue, where a time series AR(1) regression model cannot fully capture all the variation and correlation structure in the data. It is shown that an additional parameter has to be included in the modeling of the correlation structure and that the role of the parameter differs from one channel to the other. We propose appropriate generalized models for these data, develop statistical procedures under the generalized models, and apply these procedures to the real data that motivated this paper. The effect of mis-specification of a correlation structure is also investigated.
Effects of correlated and synchronized stochastic inputs to leaky integrator neuronal model.

Jianfeng Feng

DOI: https://doi.org/10.1016/S0022-5193(03)00022-5

IF: 2.405

2003-01-01

Journal of Theoretical Biology

Abstract:We present an analysis of neuronal model behaviour with correlated synaptic inputs including the cases that correlated inputs are equivalent to exactly synchronized inputs and correlated inputs are not equivalent to exactly synchronized inputs.
A First-Order Non-Homogeneous Markov Model for the Response of Spiking Neurons Stimulated by Small Phase-Continuous Signals

J. Tapson,C. Jin,A. van Schaik,R. Etienne-Cummings

DOI: https://doi.org/10.48550/arXiv.0807.1513

2008-07-10

Abstract:We present a first-order non-homogeneous Markov model for the interspike-interval density of a continuously stimulated spiking neuron. The model allows the conditional interspike-interval density and the stationary interspike-interval density to be expressed as products of two separate functions, one of which describes only the neuron characteristics, and the other of which describes only the signal characteristics. This allows the use of this model to predict the response when the underlying neuron model is not known or well determined. The approximation shows particularly clearly that signal autocorrelations and cross-correlations arise as natural features of the interspike-interval density, and are particularly clear for small signals and moderate noise. We show that this model simplifies the design of spiking neuron cross-correlation systems, and describe a four-neuron mutual inhibition network that generates a cross-correlation output for two input signals.

Neurons and Cognition,Neural and Evolutionary Computing
Extraction Of Unique Independent Components For Nonlinear Mixture Of Sources

Pei Gao,Li Chin Khor,Wai Lok Woo,Satnam Singh Dlay

DOI: https://doi.org/10.4304/jcp.2.6.9-16

2007-01-01

Journal of Computers

Abstract:In this paper, a neural network solution to extract independent components from nonlinearly mixed signals is proposed. Firstly, a structurally constrained mixing model is introduced to extend the recently proposed mono-nonlinearity mixing model, allowing that different nonlinear distortion are applied to each source signal. Based on this nonlinear mixing model, a novel demixing system characterized by polynomial neural network is then proposed for recovering the original sources. The parameter learning algorithm is derived mathematically based on the minimum mutual information principle. It is shown that unique extraction of independent components can be achieved by optimizing the mutual information cost function under both model structure and signal constraints. In this framework, the theory of series reversion is developed with the aim to perform dual optimization on the polynomials of the proposed demixing system. Finally, simulation results are presented to verify the efficacy of the proposed approach.
Detectable and Undetectable Input Signals for the Integrate-and-fire Model

JF Feng,D Brown,G Wei,B Tirozzi

DOI: https://doi.org/10.1088/0305-4470/34/8/310

2001-01-01

Abstract:We consider the integrate-and-fire model with non-stationary, stochastic inputs and address-the following issue: what are the conditions on the input currents that make the input signal undetectable? A novel theoretical approach to tackle the problem for the model with non-stationary inputs is introduced. When the noise strength is independent of the deterministic component of the synaptic input, an expression for the critical input signal is given. If the input signal is weaker than the critical input signal, the neuron ultimately stops firing, i.e. is not able to detect the input signal; otherwise it fires with probability one. Similar results are established for Poisson type inputs where the strength of the noise is proportional to the deterministic component of the synaptic input.
Probabilistic Binary-Mask Cocktail-Party Source Separation in a Convolutional Deep Neural Network

Andrew J.R. Simpson

DOI: https://doi.org/10.48550/arXiv.1503.06962

2015-03-24

Abstract:Separation of competing speech is a key challenge in signal processing and a feat routinely performed by the human auditory brain. A long standing benchmark of the spectrogram approach to source separation is known as the ideal binary mask. Here, we train a convolutional deep neural network, on a two-speaker cocktail party problem, to make probabilistic predictions about binary masks. Our results approach ideal binary mask performance, illustrating that relatively simple deep neural networks are capable of robust binary mask prediction. We also illustrate the trade-off between prediction statistics and separation quality.

Sound,Machine Learning,Neural and Evolutionary Computing
Information processing in a neuron ensemble with the multiplicative correlation structure.

Si Wu,Shun-ichi Amari,Hiroyuki Nakahara

DOI: https://doi.org/10.1016/j.neunet.2003.10.003

IF: 7.8

2004-01-01

Neural Networks

Abstract:The present study investigates the performance of population codes when the fluctuations in neural activity have mutual correlation with strength being proportional to the neuronal firing rate (multiplicative noise). The neural field is used to calculate the Fisher information, which is decomposed in two parts, one due to the tuning function and spatial correlation, and the other due to the multiplicative structure. Their different characteristics are studied. The paper also investigates three types of maximum likelihood method, namely, decoding by using faithful and unfaithful models and the Center of Mass strategy, and compares their performances in terms of decoding accuracy and computational complexity.
Stimulus-dependent maximum entropy models of neural population codes

Einat Granot-Atedgi,Gašper Tkačik,Ronen Segev,Elad Schneidman

DOI: https://doi.org/10.1371/journal.pcbi.1002922

2012-05-30

Abstract:Neural populations encode information about their stimulus in a collective fashion, by joint activity patterns of spiking and silence. A full account of this mapping from stimulus to neural activity is given by the conditional probability distribution over neural codewords given the sensory input. To be able to infer a model for this distribution from large-scale neural recordings, we introduce a stimulus-dependent maximum entropy (SDME) model---a minimal extension of the canonical linear-nonlinear model of a single neuron, to a pairwise-coupled neural population. The model is able to capture the single-cell response properties as well as the correlations in neural spiking due to shared stimulus and due to effective neuron-to-neuron connections. Here we show that in a population of 100 retinal ganglion cells in the salamander retina responding to temporal white-noise stimuli, dependencies between cells play an important encoding role. As a result, the SDME model gives a more accurate account of single cell responses and in particular outperforms uncoupled models in reproducing the distributions of codewords emitted in response to a stimulus. We show how the SDME model, in conjunction with static maximum entropy models of population vocabulary, can be used to estimate information-theoretic quantities like surprise and information transmission in a neural population.

Neurons and Cognition,Biological Physics

Neuronal Models with Masked Signals

Correlated Neuronal Computation

Neuronal Discrimination Capacity

Stochastic Resonance Enhancing Detectability Of Weak Signal By Neuronal Networks Model For Receiver

Symmetrical uncertainty based neural selection in motor cortex brain-machine interfaces

Impact of Spatially Correlated Noise on Neuronal Firing

A modelling study on discrimination tasks.

Conditional Finite Mixtures of Poisson Distributions for Context-Dependent Neural Correlations

Some Fractional Stochastic Models for Neuronal Activity with Different Time-Scales and Correlated Inputs

Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons

Noise and signal: A model-based study of stochastic effects in neural systems

Estimating a Separably-Markov Random Field (SMuRF) from Binary Observations

Common-input models for multiple neural spike-train data

Modeling Heterogeneity and Dependence for Analysis of Neuronal Data.

Effects of correlated and synchronized stochastic inputs to leaky integrator neuronal model.

A First-Order Non-Homogeneous Markov Model for the Response of Spiking Neurons Stimulated by Small Phase-Continuous Signals

Extraction Of Unique Independent Components For Nonlinear Mixture Of Sources

Detectable and Undetectable Input Signals for the Integrate-and-fire Model

Probabilistic Binary-Mask Cocktail-Party Source Separation in a Convolutional Deep Neural Network

Information processing in a neuron ensemble with the multiplicative correlation structure.

Stimulus-dependent maximum entropy models of neural population codes