Abstract:Regression models are popular tools in empirical sciences to infer the influence of a set of variables onto a dependent variable given an experimental dataset. In neuroscience and cognitive psychology, Generalized Linear Models (GLMs) -including linear regression, logistic regression, and Poisson GLM- is the regression model of choice to study the factors that drive participant's choices, reaction times and neural activations. These methods are however limited as they only capture linear contributions of each regressors. Here, we introduce an extension of GLMs called Generalized Unrestricted Models (GUMs), which allows to infer a much richer set of contributions of the regressors to the dependent variable, including possible interactions between the regressors. In a GUM, each regressor is passed through a linear or nonlinear function, and the contribution of the different resulting transformed regressors can be summed or multiplied to generate a predictor for the dependent variable. We propose a Bayesian treatment of these models in which we endow functions with Gaussian Process priors, and we present two methods to compute a posterior over the functions given a dataset: the Laplace method and a sparse variational approach, which scales better for large dataset. For each method, we assess the quality of the model estimation and we detail how the hyperparameters (defining for example the expected smoothness of the function) can be fitted. Finally, we illustrate the power of the method on a behavioral dataset where subjects reported the average perceived orientation of a series of gratings. The method allows to recover the mapping of the grating angle onto perceptual evidence for each subject, as well as the impact of the grating based on its position. Overall, GUMs provides a very rich and flexible framework to run nonlinear regression analysis in neuroscience, psychology, and beyond.

VBA: a probabilistic treatment of nonlinear models for neurobiological and behavioural data

Practical Bayesian Inference in Neuroscience: Or How I Learned To Stop Worrying and Embrace the Distribution

Stochastic Variational Bayesian Inference for a Nonlinear Forward Model

Probabilistic Inference on Virtual Brain Models of Disorders

A Bayesian functional PCA model with multilevel partition priors for group studies in neuroscience

Exploration, inference and prediction in neuroscience and biomedicine

Bayesian Models of Functional Connectomics and Behavior

A Probabilistic Model of Functional Brain Connectivity Network for Discovering Novel Biomarkers.

Beyond t test and ANOVA: applications of mixed-effects models for more rigorous statistical analysis in neuroscience research

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

Incorporating structured assumptions with probabilistic graphical models in fMRI data analysis

Bayesian analysis of neuroimaging data in FSL

Dynamic Causal Modeling in Probabilistic Programming Languages

Modelling Alzheimer's Protein Dynamics: A Data-Driven Integration of Stochastic Methods, Machine Learning and Connectome Insights

Where is all the nonlinearity: flexible nonlinear modeling of behaviorally relevant neural dynamics using recurrent neural networks

Variational Bayes Neural Network: Posterior Consistency, Classification Accuracy and Computational Challenges

A Randomization-Based, Model-Free Approach to Functional Neuroimaging: A Proof of Concept

An amortized approach to non-linear mixed-effects modeling based on neural posterior estimation

Non-linear regression models for behavioral and neural data analysis

Efficient Amortised Bayesian Inference for Hierarchical and Nonlinear Dynamical Systems

Time Series Analysis of fMRI Data: Spatial Modelling and Bayesian Computation