Abstract:Machine learning methods are increasingly employed to address challenges faced by biologists. One area that will greatly benefit from this cross-pollination is the problem of biological sequence design, which has massive potential for therapeutic applications. However, significant inefficiencies remain in communication between these fields which result in biologists finding the progress in machine learning inaccessible, and hinder machine learning scientists from contributing to impactful problems in bioengineering. Sequence design can be seen as a search process on a discrete, high-dimensional space, where each sequence is associated with a function. This sequence-to-function map is known as a "Fitness Landscape". Designing a sequence with a particular function is hence a matter of "discovering" such a (often rare) sequence within this space. Today we can build predictive models with good interpolation ability due to impressive progress in the synthesis and testing of biological sequences in large numbers, which enables model training and validation. However, it often remains a challenge to find useful sequences with the properties that we like using these models. In particular, in this primer we highlight that algorithms for experimental design, what we call "exploration strategies", are a related, yet distinct problem from building good models of sequence-to-function maps. We review advances and insights from current literature -- by no means a complete treatment -- while highlighting desirable features of optimal model-guided exploration, and cover potential pitfalls drawn from our own experience. This primer can serve as a starting point for researchers from different domains that are interested in the problem of searching a sequence space with a model, but are perhaps unaware of approaches that originate outside their field.

Sequence Evolution Under Constraints: Lessons Learned from Sudoku.

Variation and Evolution Analysis of SARS-CoV-2 Using Self-Game Sequence Optimization

Experimental Rugged Fitness Landscape in Protein Sequence Space.

Evolutionary Tinkering Enriches the Hierarchical and Nested Structures in Amino Acid Sequences

Problem Solving at the Edge of Chaos: Entropy, Puzzles and the Sudoku Freezing Transition

The Evolution of Protein Structures and Structural Ensembles Under Functional Constraint

Computational and Experimental Exploration of Protein Fitness Landscapes: Navigating Smooth and Rugged Terrains

Designing Biological Sequences Without Prior Knowledge Using Evolutionary Reinforcement Learning

Adaptation in protein fitness landscapes is facilitated by indirect paths

Brainstorming through the Sequence Universe: Theories on the Protein Problem

Exploring protein fitness landscapes by directed evolution

Predictability of evolutionary trajectories in fitness landscapes

How natural sequence variation modulates protein folding dynamics

Beyond Thermodynamic Constraints: Evolutionary Sampling Generates Realistic Protein Sequence Variation

Evolutionary accessibility of random and structured fitness landscapes

A primer on model-guided exploration of fitness landscapes for biological sequence design

Rare-Event Sampling Analysis Uncovers the Fitness Landscape of the Genetic Code

Stable DNA Sequence over Close-Ending and Pairing Sequences Constraint

Hierarchy and extremes in selections from pools of randomized proteins

Mathematical modeling of evolution. Solved and open problems

Funneled Energy Landscape Unifies Principles of Protein Binding and Evolution