Abstract:Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables pure noise-to-data generation and modular reconstruction of, images or videos. Concurrently, evolutionary algorithms employ optimization methods inspired by biological principles to refine sets of numerical parameters encoding potential solutions to rugged objective functions. Our research reveals a fundamental connection between diffusion models and evolutionary algorithms through their shared underlying generative mechanisms: both methods generate high-quality samples via iterative refinement on random initial distributions. By employing deep learning-based diffusion models as generative models across diverse evolutionary tasks and iteratively refining diffusion models with heuristically acquired databases, we can iteratively sample potentially better-adapted offspring parameters, integrating them into successive generations of the diffusion model. This approach achieves efficient convergence toward high-fitness parameters while maintaining explorative diversity. Diffusion models introduce enhanced memory capabilities into evolutionary algorithms, retaining historical information across generations and leveraging subtle data correlations to generate refined samples. We elevate evolutionary algorithms from procedures with shallow heuristics to frameworks with deep memory. By deploying classifier-free guidance for conditional sampling at the parameter level, we achieve precise control over evolutionary search dynamics to further specific genotypical, phenotypical, or population-wide traits. Our framework marks a major heuristic and algorithmic transition, offering increased flexibility, precision, and control in evolutionary optimization processes.

From Bayes to Darwin: evolutionary search as an exaptation from sampling-based Bayesian inference

Dynamics of heuristics selection for cooperative behaviour

Evolutionary emergence of biological intelligence

Connections between sequential Bayesian inference and evolutionary dynamics

Diffusion Models are Evolutionary Algorithms

A variational synthesis of evolutionary and developmental dynamics

Biological arrow of time: Emergence of tangled information hierarchies and self-modelling dynamics

Individual-based probabilistic models of adaptive evolution and various scaling approximations

Evolutionary Computer Simulations

Biophysical Cybernetics of Directed Evolution and Eco-evolutionary Dynamics

Evolutionary game selection creates cooperative environments

Out of randomness: How evolution benefits from modularity

Heuristically Adaptive Diffusion-Model Evolutionary Strategy

Phenotypic Plasticity, the Baldwin Effect, and the Speeding up of Evolution: the Computational Roots of an Illusion

Dynamical transitions in the evolution of learning algorithms by selection

Evolutionary Automata and Deep Evolutionary Computation

Evaluating evolution as a learning algorithm

Selecting for Selection: Learning To Balance Adaptive and Diversifying Pressures in Evolutionary Search

Parallels and promising directions in the study of genetic, cultural, and moral evolution

Acceleration of Evolutionary Processes by Learning and Extended Fisher's Fundamental Theorem

Evolutionary Algorithms Simulating Molecular Evolution: A New Field Proposal