Abstract:Novelty search (NS) refers to a class of exploration algorithms that automatically uncover diverse system behaviors through simulations or experiments. Systematically obtaining diverse outcomes is a key component in many real-world design problems such as material and drug discovery, neural architecture search, reinforcement learning, and robot navigation. Since the relationship between the inputs and outputs (i.e., behaviors) of these complex systems is typically not available in closed form, NS requires a black-box perspective. Consequently, popular NS algorithms rely on evolutionary optimization and other meta-heuristics that require intensive sampling of the input space, which is impractical when the system is expensive to evaluate. We propose a Bayesian optimization inspired algorithm for sample-efficient NS that is specifically designed for such expensive black-box systems. Our approach models the input-to-behavior mapping with multi-output Gaussian processes (MOGP) and selects the next point to evaluate by maximizing a novelty metric that depends on a posterior sample drawn from the MOGP that promotes both exploration and exploitation. By leveraging advances in efficient posterior sampling and high-dimensional Gaussian process modeling, we discuss how our approach can be made scalable with respect to both amount of data and number of inputs. We test our approach on ten synthetic benchmark problems and eight real-world problems (with up to 2133 inputs) including new applications such as discovery of diverse metal organic frameworks for use in clean energy technology. We show that our approach greatly outperforms existing NS algorithms by finding substantially larger sets of diverse behaviors under limited sample budgets.

A Coupon-Collector Model of Machine-Aided Discovery

Quantifying the Ease of Scientific Discovery

The dynamics of correlated novelties

Dynamics on expanding spaces: modeling the emergence of novelties

The dynamics of higher-order novelties

A Compound Correlation Model for Disjoint Literature-Based Knowledge Discovery (vol 64, pg 423, 2012)

On a generalisation of the coupon collector problem

Coupon Advertising in Online Social Systems: Algorithms and Sampling Techniques

Time-Dependent Urn Models reproduce the full spectrum of novelties discovery

Dynamics of a birth-death process based on combinatorial innovation

Recent advances in accelerated discovery through machine learning and statistical inference

DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agents

Scientific discovery in a model-centric framework: Reproducibility, innovation, and epistemic diversity

Counterfactual Data Augmentation for Debiased Coupon Recommendations Based on Potential Knowledge

Towards an explanatory and computational theory of scientific discovery

DiscoveryBench: Towards Data-Driven Discovery with Large Language Models

Scalable Sparse Regression for Model Discovery: The Fast Lane to Insight

Uncovering the dynamics of citations of scientific papers

BEACON: A Bayesian Optimization Strategy for Novelty Search in Expensive Black-Box Systems

Deterministic Coupon Collection and Better Strong Dispersers.

A Survey on Causal Discovery: Theory and Practice