Abstract:Bioinformatics has witnessed a paradigm shift with the increasing integration of artificial intelligence (AI), particularly through the adoption of foundation models (FMs). These AI techniques have rapidly advanced, addressing historical challenges in bioinformatics such as the scarcity of annotated data and the presence of data noise. FMs are particularly adept at handling large-scale, unlabeled data, a common scenario in biological contexts due to the time-consuming and costly nature of experimentally determining labeled data. This characteristic has allowed FMs to excel and achieve notable results in various downstream validation tasks, demonstrating their ability to represent diverse biological entities effectively. Undoubtedly, FMs have ushered in a new era in computational biology, especially in the realm of deep learning. The primary goal of this survey is to conduct a systematic investigation and summary of FMs in bioinformatics, tracing their evolution, current research status, and the methodologies employed. Central to our focus is the application of FMs to specific biological problems, aiming to guide the research community in choosing appropriate FMs for their research needs. We delve into the specifics of the problem at hand including sequence analysis, structure prediction, function annotation, and multimodal integration, comparing the structures and advancements against traditional methods. Furthermore, the review analyses challenges and limitations faced by FMs in biology, such as data noise, model explainability, and potential biases. Finally, we outline potential development paths and strategies for FMs in future biological research, setting the stage for continued innovation and application in this rapidly evolving field. This comprehensive review serves not only as an academic resource but also as a roadmap for future explorations and applications of FMs in biology.

The EM Algorithm and the Rise of Computational Biology

Computational Network Biology: Data, Models, and Applications

A special issue of Essays in Biochemistry on computational biology

Computational Discovery of Regulatory DNA Motifs Using Evolutionary Computation

Evolutionary Algorithms Simulating Molecular Evolution: A New Field Proposal

Computational Biology and Chemistry with AI and ML

Computational Models In Systems Biology

Sequence and Structure Analysis of Biological Molecules Based on Computational Methods

Computational intelligence approaches for pattern discovery in biological systems

Digital biology: an emerging and promising discipline

A field guide to cultivating computational biology

Computational Genome Analysis

A Survey on Evolutionary Algorithm Based Hybrid Intelligence in Bioinformatics

Computational Biology: Toward Deciphering Gene Regulatory Information in Mammalian Genomes

Recognition of Translation Initiation Sites of Eukaryotic Genes Based on an Em Algorithm

Machine learning tools advance biophysics

Evolutionary Algorithms: Concepts, Designs, and Applications in Bioinformatics: Evolutionary Algorithms for Bioinformatics

Progress and Opportunities of Foundation Models in Bioinformatics

From Structure to Function: Methods and Applications

Bringing computation to biology by bridging the last mile

From structure to function: methods and applications.