Abstract:Astrocytes are a ubiquitous and enigmatic type of non-neuronal cell and are found in the brain of all vertebrates. While traditionally viewed as being supportive of neurons, it is increasingly recognized that astrocytes play a more direct and active role in brain function and neural computation. On account of their sensitivity to a host of physiological covariates and ability to modulate neuronal activity and connectivity on slower time scales, astrocytes may be particularly well poised to modulate the dynamics of neural circuits in functionally salient ways. In the current paper, we seek to capture these features via actionable abstractions within computational models of neuron-astrocyte interaction. Specifically, we engage how nested feedback loops of neuron-astrocyte interaction, acting over separated time-scales, may endow astrocytes with the capability to enable learning in context-dependent settings, where fluctuations in task parameters may occur much more slowly than within-task requirements. We pose a general model of neuron-synapse-astrocyte interaction and use formal analysis to characterize how astrocytic modulation may constitute a form of meta-plasticity, altering the ways in which synapses and neurons adapt as a function of time. We then embed this model in a bandit-based reinforcement learning task environment, and show how the presence of time-scale separated astrocytic modulation enables learning over multiple fluctuating contexts. Indeed, these networks learn far more reliably compared to dynamically homogeneous networks and conventional non-network-based bandit algorithms. Our results fuel the notion that neuron-astrocyte interactions in the brain benefit learning over different time-scales and the conveyance of task-relevant contextual information onto circuit dynamics. Astrocytes, a non-neuronal cell type, constitute a significant portion of all cells in the brain, yet our understanding of their involvement in neural computation remains limited. In this paper, we use computational modeling to examine how astrocytes may interact with neurons to expand the types of activity and, ultimately, computations that neurons can produce. Two features of astrocytes make them interesting in this context. First, a single astrocyte is able to modulate dozens of neurons and synaptic connections between them. Furthermore, this modulation occurs at slower temporal scales than the neural activity itself, thus meaning that astrocytes could have long-lasting effects on neural activity and connectivity. Our computational models capture both of these features. Using these models, we show that networks with astrocytes can more readily adapt to slowly varying task parameters versus those with neurons alone. We further analyze the models to understand, in mathematical terms, why such effects may arise. Our results shed light on the potential computational role of this common, but enigmatic type of brain cell.

Contextual guidance: An integrated theory for astrocytes function in brain circuits and behavior

Astrocytes as a mechanism for contextually-guided network dynamics and function

Astrocytes as a mechanism for meta-plasticity and contextually-guided network function

The role of astrocyte‐mediated plasticity in neural circuit development and function

A Neural-Astrocytic Network Architecture: Astrocytic calcium waves modulate synchronous neuronal activity

Computational models of astrocyte function at glutamatergic synapses

Neuron-Glial Interactions: Implications for Plasticity, Behavior, and Cognition

Understanding astrocyte differentiation: Clinical relevance, technical challenges, and new opportunities in the omics era

From Synapses to Circuits, Astrocytes Regulate Behavior

Astrocyte function from information processing to cognition and cognitive impairment

Network-level encoding of local neurotransmitters in cortical astrocytes

A perspective on astrocyte regulation of neural circuit function and animal behavior

Astrocytes are active: An information theoretic approach reveals differences in Ca2+ signaling patterns among distinct astrocyte subtypes

New Roles for Old Glue: Astrocyte Function in Synaptic Plasticity and Neurological Disorders

Computational Astrocyence: Astrocytes encode inhibitory activity into the frequency and spatial extent of their calcium elevations

Computational modeling of neuron–glia signaling interactions to unravel cellular and neural circuit functioning

Emerging roles of astrocytes as immune effectors in the central nervous system

A tale of two stories: astrocyte regulation of synaptic depression and facilitation

Astrocyte-mediated neuronal irregularities and dynamics: the complexity of the tripartite synapse

Deciphering the astrocytic contribution to learning and relearning

Diverse Calcium Signaling in Astrocytes: Insights from a Computational Model