Abstract:Why do biological and artificial neurons sometimes modularise, each encoding a single meaningful variable, and sometimes entangle their representation of many variables? In this work, we develop a theory of when biologically inspired representations -- those that are nonnegative and energy efficient -- modularise with respect to source variables (sources). We derive necessary and sufficient conditions on a sample of sources that determine whether the neurons in an optimal biologically-inspired linear autoencoder modularise. Our theory applies to any dataset, extending far beyond the case of statistical independence studied in previous work. Rather, we show that sources modularise if their support is "sufficiently spread". From this theory, we extract and validate predictions in a variety of empirical studies on how data distribution affects modularisation in nonlinear feedforward and recurrent neural networks trained on supervised and unsupervised tasks. Furthermore, we apply these ideas to neuroscience data. First, we explain why two studies that recorded prefrontal activity in working memory tasks conflict on whether memories are encoded in orthogonal subspaces: the support of the sources differed due to a critical discrepancy in experimental protocol. Second, we use similar arguments to understand why preparatory and potent subspaces in RNN models of motor cortex are only sometimes orthogonal. Third, we study spatial and reward information mixing in entorhinal recordings, and show our theory matches data better than previous work. And fourth, we suggest a suite of surprising settings in which neurons can be (or appear) mixed selective, without requiring complex nonlinear readouts as in traditional theories. In sum, our theory prescribes precise conditions on when neural activities modularise, providing tools for inducing and elucidating modular representations in brains and machines.

The Origin of Cognitive Modules for Face Processing: A Computational Evolutionary Perspective

Brain-like functional specialization emerges spontaneously in deep neural networks

Emergence and reconfiguration of modular structure for synaptic neural networks during continual familiarity detection

The Face Module Emerged in a Deep Convolutional Neural Network Selectively Deprived of Face Experience

Tracking the Development of Functional Connectomes for Face Processing

Emergence and reconfiguration of modular structure for artificial neural networks during continual familiarity detection

Understanding Human Cognition Through Computational Modeling

A Biologically Inspired Model Mimicking the Memory and Two Distinct Pathways of Face Perception

A critical period for developing face recognition

Don't Cut Corners: Exact Conditions for Modularity in Biologically Inspired Representations

Co-Evolutionary Modular Neural Networks for Automatic Problem Decomposition

Explaining the Neuroevolution of Fighting Creatures Through Virtual fMRI

Face processing emerges from object-trained convolutional neural networks

Matter & Mind Matter

Modular representations emerge in neural networks trained to perform context-dependent tasks

Evolving Modular Neural Networks Which Generalise Well

Evaluating the evolution and inter-individual variability of infant functional module development from 0 to 5 years old

Co-evolution of Functional Brain Network at Multiple Scales during Early Infancy

Explaining face representation in the primate brain using different computational models

Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learning

A specialized face-processing network consistent with the representational geometry of monkey face patches