Abstract:Striking progress has been made in understanding cognition by analyzing how the brain is engaged in different modes of information processing. For instance, so-called synergistic information (information encoded by a set of neurons but not by any subset) plays a key role in areas of the human brain linked with complex cognition. However, two questions remain unanswered: (a) how and why a cognitive system can become highly synergistic; and (b) how informational states map onto artificial neural networks in various learning modes. Here we employ an information-decomposition framework to investigate neural networks performing cognitive tasks. Our results show that synergy increases as networks learn multiple diverse tasks, and that in tasks requiring integration of multiple sources, performance critically relies on synergistic neurons. Overall, our results suggest that synergy is used to combine information from multiple modalities—and more generally for flexible and efficient learning. These findings reveal new ways of investigating how and why learning systems employ specific information-processing strategies, and support the principle that the capacity for general-purpose learning critically relies on the system's information dynamics. What is the informational basis of learning in humans, animals, or, indeed, artificial neural networks (ANN)? Furthermore, how can these systems learn to solve multiple tasks simultaneously? These fundamental questions are, surprisingly, still not fully understood. One advantage of studying ANNs is that we can precisely probe learning-related changes. Here we draw on a recent branch of information theory, partial information decomposition, to examine how different types of information support different learning goals, and where, in ANNs. We show that adding noise to an ANN encourages it to keep copies of information at multiple nodes, promoting robustness. In contrast, whenever flexible learning is required, for instance when facing varied stimulus types or diverse tasks, individual neurons work together to represent information more abstractly. This work sheds light on how systems encode information differently according to their learning pressures, which can help us better understand how and why the human brain uses particular forms of information processing.

A synergistic core for human brain evolution and cognition

A Synergistic Workspace for Human Consciousness Revealed by Integrated Information Decomposition

Emergence of a synergistic scaffold in the brains of human infants

Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks

Multivariate Information Theory Uncovers Synergistic Subsystems of the Human Cerebral Cortex

Competitive interactions shape brain dynamics and computation across species

Genetic and phylogenetic uncoupling of structure and function in human transmodal cortex

Analysis of the human connectome data supports the notion of a "Common Model of Cognition" for human and human-like intelligence across domains

A synergetic turn in cognitive neuroscience of brain diseases

Task-Based Core-Periphery Organisation of Human Brain Dynamics

Linking Brain Structure, Activity, and Cognitive Function through Computation

An energy costly architecture of neuromodulators for human brain evolution and cognition

A molecular and cellular perspective on human brain evolution and tempo

The morphospace of the brain-cognition organisation

MULTIMODAL GRADIENTS UNIFY LOCAL AND GLOBAL CORTICAL ORGANIZATION

Network modeling of dynamic brain interactions predicts emergence of neural information that supports human cognitive behavior

Time-varying synergy/redundancy dominance in the human cerebral cortex

Human Cognition and Language Processing with Neural-Lexicon Hypothesis

Information decomposition and the informational architecture of the brain

Overview of Social Neuroscience