Abstract:Is reduction always a good scientific strategy? Does it always lead to a gain in information? The very existence of the special sciences above and beyond physics seems to hint no. Previous research has shown that dimension reduction (macroscales) can increase the dependency between elements of a system (a phenomenon called "causal emergence"). However, this has been shown only for specific measures like effective information or integrated information. Here, we provide an umbrella mathematical framework for emergence based on information conversion. Specifically, we show evidence that a macroscale can have more of a certain type of information than its underlying microscale. This is because macroscales can convert information from one type to another. In such cases, reduction to a microscale means the loss of this type of information. We demonstrate this using the well-understood mutual information measure applied to Boolean networks. By using the partial information decomposition, the mutual information can be decomposed into redundant, unique, and synergistic information atoms. Then by introducing a novel measure of the synergy bias of a given decomposition, we are able to show that the synergy component of a Boolean network's mutual information can increase at macroscales. This can occur even when there is no difference in the total mutual information between a macroscale and its underlying microscale, proving information conversion. We relate this broad framework to previous work, compare it to other theories, and argue it complexifies any notion of universal reduction in the sciences, since such reduction would likely lead to a loss of synergistic information in scientific models.

Greater than the parts: A review of the information decomposition approach to causal emergence

Emergence and Causality in Complex Systems: A Survey of Causal Emergence and Related Quantitative Studies

Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studies

Quantify the Causes of Causal Emergence: Critical Conditions of Uncertainty and Asymmetry in Causal Structure

Finding emergence in data by maximizing effective information

Emergence as the conversion of information: A unifying theory

Dynamical Reversibility and A New Theory of Causal Emergence

Software in the natural world: A computational approach to hierarchical emergence

Information decomposition and the informational architecture of the brain

Cause of Causal Emergence: Redistribution of Uncertainty and Its Critical Condition

The Cause of Causal Emergence: Redistribution of Uncertainty

Causal emergence is widespread across measures of causation

Disentangled Representations for Causal Cognition

A Review and Roadmap of Deep Causal Model from Different Causal Structures and Representations

Neural Information Squeezer for Causal Emergence

Flickering Emergences: The Question of Locality in Information-Theoretic Approaches to Emergence

Decomposing causality into its synergistic, unique, and redundant components

Beyond integrated information: A taxonomy of information dynamics phenomena

Fundamental Properties of Causal Entropy and Information Gain

What Emergence Can Possibly Mean