Abstract:Abstract To navigate the world around us, neural circuits rapidly adapt to their environment learning generalizable strategies to decode information. When modeling these learning strategies, network models find the optimal solution to satisfy one task condition but fail when introduced to a novel task or even a different stimulus in the same space. In the experiments described in this letter, I investigate the role of lateral gap junctions in learning generalizable strategies to process information. Lateral gap junctions are formed by connexin proteins creating an open pore that allows for direct electrical signaling between two neurons. During neural development, the rate of gap junctions is high, and daughter cells that share similar tuning properties are more likely to be connected by these junctions. Gap junctions are highly plastic and get heavily pruned throughout development. I hypothesize that they mediate generalized learning by imprinting the weighting structure within a layer to avoid overfitting to one task condition. To test this hypothesis, I implemented a feedforward probabilistic neural network mimicking a cortical fast spiking neuron circuit that is heavily involved in movement. Many of these cells are tuned to speeds that I used as the input stimulus for the network to estimate. When training this network using a delta learning rule, both a laterally connected network and an unconnected network can estimate a single speed. However, when asking the network to estimate two or more speeds, alternated in training, an unconnected network either cannot learn speed or optimizes to a singular speed, while the laterally connected network learns the generalizable strategy and can estimate both speeds. These results suggest that lateral gap junctions between neurons enable generalized learning, which may help explain learning differences across life span.

Multilayer In-Place Learning Networks: Multitask Invariance And Adaptive Lateral Connections

The Multilayer In-Place Learning Network for the Development of General Invariances and Multi-Task Learning

A Multilayer In-Place Learning Network For Development Of General Invariances

TheMultilayer In-Place Learning NetworkfortheDevelopment of GeneralInvariances Andmulti-Task Learning

Cortex Inspired In-Place Learning Networks For General Invariance And Multi-Tasks

Multilayer In-Place Learning Networks for Modeling Functional Layers in the Laminar Cortex.

Multilayer In-Place Learning Networks with Adaptive Lateral Connections: Models and Simulations

Distributed Learning of Predictive Structures from Multiple Tasks over Networks

A Framework for Learning Invariant Physical Relations in Multimodal Sensory Processing

Learning Multiple Tasks with Multilinear Relationship Networks.

Multi-Task Structural Learning using Local Task Similarity induced Neuron Creation and Removal

Towards Understanding Multi-Task Learning (Generalization) of LLMs via Detecting and Exploring Task-Specific Neurons

Spatio–Temporal Multimodal Developmental Learning

Spatio-Temporal Adaptation in the Unsupervised Development of Networked Visual Neurons

Parallel Learning by Multitasking Neural Networks

Triple-Memory Networks: A Brain-Inspired Method for Continual Learning

Lateral Connections Improve Generalizability of Learning in a Simple Neural Network

SynapNet: A Complementary Learning System Inspired Algorithm With Real-Time Application in Multimodal Perception

Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments

Evolutionary Multitasking Multilayer Network Reconstruction

Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learning