Abstract:Information theory has explained the organization of many biological phenomena, from the physiology of sensory receptive fields to the variability of certain DNA sequence ensembles. Some scholars have proposed that information should provide the central explanatory principle in biology, in the sense that any behavioral strategy that is optimal for an organism's survival must necessarily involve efficient information processing. We challenge this view by providing a counterexample. We present an analytically tractable model for a particular instance of a perception-action loop: a creature searching for a food source confined to a one-dimensional ring world. The model incorporates the statistical structure of the creature's world, the effects of the creature's actions on that structure, and the creature's strategic decision process. The model takes the form of a Markov process on an infinite dimensional state space. To analyze it we construct an exact coarse graining that reduces the model to a Markov process on a finite number of "information states". This technique allows us to make quantitative comparisons between the performance of an information-theoretically optimal strategy with other candidate strategies on a food gathering task. We find that: 1. Information optimal search does not necessarily optimize utility (expected food gain). 2. The rank ordering of search strategies by information performance does not predict their ordering by expected food obtained. 3. The relative advantage of different strategies depends on the statistical structure of the environment, in particular the variability of motion of the source. We conclude that there is no simple relationship between information and utility. Behavioral optimality does not imply information efficiency, nor is there a simple tradeoff between gaining information about a food source versus obtaining the food itself.

How to select an objective function using information theory

How to Select an Objective Function Using Information Theory

Information Theory and its Relation to Machine Learning

Information Maximization Fails to Maximize Expected Utility in a Simple Foraging Model

Generalized Information Theory Meets Human Cognition: Introducing a Unified Framework to Model Uncertainty and Information Search

A theory of best choice selection through objective arguments grounded in Linear Response Theory concepts

A Unified Information Criterion For Evaluating Probe And Test Selection

Metrics for Bayesian Optimal Experiment Design under Model Misspecification

Information-Theoretic Analysis Of Human Performance For Command Selection

Information-Theoretic Foundations for Machine Learning

Information vs. Uncertainty as the Foundation for a Science of Environmental Modeling

Information theoretic approach to interactive learning

Model Selection for Explosive Models

Data Modeling in Machine Learning Based on Information-Theoretic Measures

On Statistical Efficiency in Learning

Information Theory and Statistics: an overview

Bayesian forecasting with information theory

Generalizing Information to the Evolution of Rational Belief

Learning to explain: An information-theoretic perspective on model interpretation

Select Objective Functions for Multiple Criteria Programming Classification.

KTO: Model Alignment as Prospect Theoretic Optimization