What is dynamic programming?

Sean R Eddy

DOI: https://doi.org/10.1038/nbt0704-909

IF: 46.9

2004-07-01

Nature Biotechnology

Abstract:Sequence alignment methods often use something called a 'dynamic programming' algorithm. What is dynamic programming and how does it work?

biotechnology & applied microbiology

What problem does this paper attempt to address?

Recursive dynamic programming for adaptive sequence and structure alignment

R Thiele,R Zimmer,T Lengauer

Abstract:We propose a new alignment procedure that is capable of aligning protein sequences and structures in a unified manner. Recursive dynamic programming (RDP) is a hierarchical method which, on each level of the hierarchy, identifies locally optimal solutions and assembles them into partial alignments of sequences and/or structures. In contrast to classical dynamic programming, RDP can also handle alignment problems that use objective functions not obeying the principle of prefix optimality, e.g. scoring schemes derived from energy potentials of mean force. For such alignment problems, RDP aims at computing solutions that are near-optimal with respect to the involved cost function and biologically meaningful at the same time. Towards this goal, RDP maintains a dynamic balance between different factors governing alignment fitness such as evolutionary relationships and structural preferences. As in the RDP method gaps are not scored explicitly, the problematic assignment of gap cost parameters is circumvented. In order to evaluate the RDP approach we analyse whether known and accepted multiple alignments based on structural information can be reproduced with the RDP method. For this purpose, we consider the family of ferredoxins as our prime example. Our experiments show that, if properly tuned, the RDP method can outperform methods based on classical sequence alignment algorithms as well as methods that take purely structural information into account.
Dynamic programming by polymorphic semiring algebraic shortcut fusion

Max A. Little,Xi He,Ugur Kayas

DOI: https://doi.org/10.1145/3664828

2024-01-04

Abstract:Dynamic programming (DP) is an algorithmic design paradigm for the efficient, exact solution of otherwise intractable, combinatorial problems. However, DP algorithm design is often presented in an ad-hoc manner. It is sometimes difficult to justify algorithm correctness. To address this issue, this paper presents a rigorous algebraic formalism for systematically deriving DP algorithms, based on semiring polymorphism. We start with a specification, construct an algorithm to compute the required solution which is self-evidently correct because it exhaustively generates and evaluates all possible solutions meeting the specification. We then derive, through the use of shortcut fusion, an implementation of this algorithm which is both efficient and correct. We also demonstrate how, with the use of semiring lifting, the specification can be augmented with combinatorial constraints, showing how these constraints can be fused with the algorithm. We furthermore demonstrate how existing DP algorithms for a given combinatorial problem can be abstracted from their original context and re-purposed. This approach can be applied to the full scope of combinatorial problems expressible in terms of semirings. This includes, for example: optimal probability and Viterbi decoding, probabilistic marginalization, logical inference, fuzzy sets, differentiable softmax, relational and provenance queries. The approach, building on ideas from the existing literature on constructive algorithmics, exploits generic properties of polymorphic functions, tupling and formal sums and algebraic simplifications arising from constraint algebras. We demonstrate the effectiveness of this formalism for some example applications arising in signal processing, bioinformatics and reliability engineering. Python software implementing these algorithms can be downloaded from: <a class="link-external link-http" href="http://www.maxlittle.net/software/dppolyalg.zip" rel="external noopener nofollow">this http URL</a>.

Data Structures and Algorithms,Machine Learning,Rings and Algebras
New Sequence Alignment Algorithm using AI Rules and Dynamic Seeds

Suchindra,Preetam Nagaraj

2023-05-26

Abstract:DNA sequence alignment is important today as it is usually the first step in finding gene mutation, evolutionary similarities, protein structure, drug development and cancer treatment. Covid-19 is one recent example. There are many sequencing algorithms developed over the past decades but the sequence alignment using expert systems is quite new. To find DNA sequence alignment, dynamic programming was used initially. Later faster algorithms used small DNA sequence length of fixed size to find regions of similarity, and then build the final alignment using these regions. Such systems were not sensitive but were fast. To improve the sensitivity, we propose a new algorithm which is based on finding maximal matches between two sequences, find seeds between them, employ rules to find more seeds of varying length, and then employ a new stitching algorithm, and weighted seeds to solve the problem

Genomics
A Greedy Algorithm for Aligning DNA Sequences

Zheng Zhang,Scott Schwartz,Lukas Wagner,Webb Miller

DOI: https://doi.org/10.1089/10665270050081478

IF: 1.549

2000-02-01

Journal of Computational Biology

Abstract:For aligning DNA sequences that differ only by sequencing errors, or by equivalent errors from other sources, a greedy algorithm can be much faster than traditional dynamic programming approaches and yet produce an alignment that is guaranteed to be theoretically optimal. We introduce a new greedy alignment algorithm with particularly good performance and show that it computes the same alignment as does a certain dynamic programming algorithm, while executing over 10 times faster on appropriate data. An implementation of this algorithm is currently used in a program that assembles the UniGene database at the National Center for Biotechnology Information.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology,computer science, interdisciplinary applications,statistics & probability
Novel Structure-Based Pairwise Sequence Alignment

SI Xiu-hua,CHEN Guo-liang

2006-01-01

Abstract:The classical dynamic programming algorithms for alignments are based on edition costs computed additionally position by position, according to a fixed substitution matrix. These methods find the global alignment with maximal score but in practice, we favor the information of the structure or the function of the sequences considered. In this paper, we present a method consisting in combining the techniques of dynamic programming and Variable Memory Markov, which reveals the structure or the function of the sequences.
Speed-Up in Dynamic-Programming

FF YAO

DOI: https://doi.org/10.1137/0603055

1982-01-01

SIAM Journal on Algebraic and Discrete Methods

Abstract:Dynamic programming is a general problem-solving method that has been used widely in many disciplines, including computer science. In this paper we present some recent results in the design of efficient dynamic programming algorithms. These results illustrate two approaches for achieving efficiency: the first by developing general techniques that are applicable to a broad class of problems, and the second by inventing clever algorithms that take advantage of individual situations.
A Parallel Dynamic Programming Algorithm on a Multi-Core Architecture

Guangming Tan,Ninghui Sun,Guang R. Gao

DOI: https://doi.org/10.1145/1248377.1248399

2007-01-01

Abstract:Dynamic programming is an efficient technique to solve combinatorial search and optimization problem. There have been many parallel dynamic programming algorithms. The purpose of this paper is to study a family of dynamic programming algorithm where data dependence appear between non-consecutive stages, in other words, the data dependence is non-uniform. This kind of dynnamic programming is typically called nonserial polyadic dynamic programming . Owing to the non-uniform data dependence, it is harder to optimize this problem for parallelism and locality on parallel architectures. In this paper, we address the chanllenge of exploiting fine grain parallelism and locality of nonserial polyadic dynamic programming on a multi-core architecture. We present a programming and execution model for multi-core architectures with memory hierarchy. In the framework of the new model, the parallelism and locality benifit from a data dependence transformation. We propose a parallel pipelined algorithm for filling the dynamic programming matrix by decomposing the computation operators. The new parallel algorithm tolerates the memory access latency using multi-thread and is easily improved with tile technique. We formulate and analytically solve the optimization problem determing the tile size that minimizes the total execution time. The experiments on a simulator give a validation of the proposed model and show that the fine grain parallel algorithm achieves sub-linear speedup and that a potential high scalability on multi-core arichitecture.
Parallel and (Nearly) Work-Efficient Dynamic Programming

Xiangyun Ding,Yan Gu,Yihan Sun

DOI: https://doi.org/10.1145/3626183.3659958

2024-05-22

Abstract:The idea of dynamic programming (DP), proposed by Bellman in the 1950s, is one of the most important algorithmic techniques. However, in parallel, many fundamental and sequentially simple problems become more challenging, and open to a (nearly) work-efficient solution (i.e., the work is off by at most a polylogarithmic factor over the best sequential solution). In fact, sequential DP algorithms employ many advanced optimizations such as decision monotonicity or special data structures, and achieve better work than straightforward solutions. Many such optimizations are inherently sequential, which creates extra challenges for a parallel algorithm to achieve the same work bound.

Data Structures and Algorithms,Distributed, Parallel, and Cluster Computing
Parallel linear space algorithm for large-scale sequence alignment

Eric Li,Cheng Xu,Tao Wang,Li Jin,Yimin Zhang

DOI: https://doi.org/10.1007/11549468_132

2005-01-01

Abstract:Aligning long DNA sequences is a fundamental and common task in molecular biology. Though dynamic programming algorithms have been developed to solve this problem, the space and time required by these algorithms are still a challenge. In this paper we present the Parallel Linear Space Alignment (PLSA) algorithm to compute the long sequence alignment to meet this challenge. Using this algorithm, the local start points and grid cache partition the whole sequence alignment problem into several smaller independent subproblems. A novel dynamic load balancing approach then efficiently solves these subproblems in parallel, which provides more parallelism in the trace-back phase. Furthermore, PLSA helps to find k near-optimal non-intersecting alignments. Our experiments show that this proposed algorithm scales well with the increasing number of processors, and it exhibits almost linear speedup for large-scale sequences.
Dynamic Programming Algorithms for Discovery of Antibiotic Resistance in Microbial Genomes

Manal Helal,Vitali Sintchenko

2023-11-29

Abstract:The translation of comparative genomics into clinical decision support tools often depends on the quality of sequence alignments. However, currently used methods of multiple sequence alignments suffer from significant biases and problems with aligning diverged sequences. The objective of this study was to develop and test a new multiple sequence alignment (MSA) algorithm suitable for the high-throughput comparative analysis of different microbial genomes. This algorithm employs an innovative tensor indexing method for partitioning the dynamic programming hyper-cube space for parallel processing. We have used the clinically relevant task of identifying regions that determine resistance to antibiotics to test the new algorithm and to compare its performance with existing MSA methods. The new method "mmDst" performed better than existing MSA algorithms for more divergent sequences because it employs a simultaneous alignment scoring recurrence, which effectively approximated the score for edge missing cell scores that fall outside the scoring region.

Genomics,Data Structures and Algorithms
Optimizing Operations Management and Business Analytics Strategies under Uncertainty: Dynamic Programming

Ran Yi

DOI: https://doi.org/10.54254/2754-1169/49/20230507

2023-12-01

Abstract:Dynamic programming is a method used in mathematics, management science, computer science, economics, and bioinformatics to solve complex problems by decomposing the original problem into relatively simple sub-problems. Dynamic programming is often applicable to problems with overlapping subproblems and optimal substructure properties. This paper employs a comprehensive research approach of literature review, as well as empirical analysis and case studies to investigate the topic and demonstrate the practicality and effectiveness of dynamic programming in solving complex decision-making problems. However, the curse of dimensionality poses challenges when dealing with high-dimensional decision spaces, requiring approximate dynamic programming methods, including reinforcement learning algorithms. Therefore, when dealing with more complex dynamic programming problems, it is also essential to use program construction tools such as Python to help design a program that can optimize the problem. Therefore, in the learning of dynamic programming, in addition to the correct understanding of basic concepts and methods, specific problems must be analyzed and dealt with in detail, models should be built with rich imagination, and solutions should be solved with creative skills.
Locality and Parallelism Optimization for Dynamic Programming Algorithm in Bioinformatics

Guangming Tan,Shengzhong Feng,Ninghui Sun

DOI: https://doi.org/10.1109/sc.2006.41

2006-01-01

Abstract:Dynamic programming has been one of the most efficient approaches to sequence analysis and structure prediction in biology. However, their performance is limited due to the drastic increase in both the number of biological data and variety of the computer architectures. With regard to such predicament, this paper creates excellent algorithms aimed at addressing the challenges of improving memory efficiency and network latency tolerance for nonserial polyadic dynamic programming where the dependences are nonuniform. By relaxing the nonuniform dependences, we proposed a new cache oblivious scheme to enhance its performance on memory hierarchy architectures. Moreover we develop and extend a tiling technique to parallelize this nonserial polyadic dynamic programming using an alternate block-cyclic mapping strategy for balancing the computational and memory load, where an analytical parameterized model is formulated to determine the tile volume size that minimizes the total execution time and an algorithmic transformation is used to schedule the tile to overlap communication with computation to further minimize communication overhead on parallel architectures. The numerical experiments were carried out on several high performance computer systems. The new cache-oblivious dynamic programming algorithm achieve 2-10 speedup and the parallel tiling algorithm with communication-computation overlapping shows a desired potential for fine-grained parallel computing on massively parallel computer systems
Using Dynamic Programming To Match Human Behavior Sequences

Yan Chen,Qiang Wu,Xiangjian He

DOI: https://doi.org/10.1109/ICARCV.2008.4795746

2008-01-01

Abstract:This paper proposed a new approach for recognition and matching the human behavior sequence. Each human behavior sequence is represented by its key postures to greatly reduce the computation time. Normalization is applied to all the behavior sequences key postures for matching. A dynamic time warping (DTW) algorithm is used to perform the alignment of two time series. Experiments are carried out on an open human behavior database and exciting results have been obtained.
Defining topological equivalences in protein structures by means of a dynamic programming algorithm.

Y Luo,L Lai,X Xu,Y Tang

DOI: https://doi.org/10.1093/protein/6.4.373

1993-01-01

Protein Engineering

Abstract:An automatic algorithm for defining topological equivalences in protein structures is presented. The algorithm is based on a dynamic programming technique and self-consistent scoring method. We have used it to align pairs of similar protein structures of several protein families and to identify recurrent structural domains in aspartic proteinase 2APR. Its ability to find suboptimal paths permits a thorough comparison of proteins at each level in the hierarchy of the protein structure: secondary structure, super-secondary structure, domain and entire globular structure. The algorithm has been extended to the structure alignment of ribonucleic acid and can be extended to the structure alignment of any linear polymer.
A Dynamic Programming Approach to De Novo Peptide Sequencing Via Tandem Mass Spectrometry

T Chen,MY Kao,M Tepel,J Rush,GM Church

DOI: https://doi.org/10.1089/10665270152530872

2001-01-01

Abstract:Tandem mass spectrometry fragments a large number of molecules of the same peptide sequence into charged molecules of prefix and suffix peptide subsequences and then measures mass/charge ratios of these ions. The de novo peptide sequencing problem is to reconstruct the peptide sequence from a given tandem mass spectral data of k ions. By implicitly transforming the spectral data into an NC-spectrum graph G (V, E) where /V/ = 2k + 2, we can solve this problem in O(/V//E/) time and O(/V/2) space using dynamic programming. For an ideal noise-free spectrum with only b- and y-ions, we improve the algorithm to O(/V/ + /E/) time and O(/V/) space. Our approach can be further used to discover a modified amino acid in O(/V//E/) time. The algorithms have been implemented and tested on experimental data.
A Dynamic Programming Approach for the Alignment of Molecules

Ryan A. Williams,David A. Liberles

DOI: https://doi.org/10.1101/2024.01.23.576849

2024-01-26

Abstract:There is a need for computational approaches to compare molecules based upon chemical similarity or for evaluating biochemical transformations. Here, a new approach to molecular alignment in the Simplified Molecular Input Line Entry System (SMILES) format is introduced. Leveraging dynamic programming and scoring alignments to minimize differences in a measure of electronegativity, the study addresses the challenge of comprehending structural transformations in reaction pathways, notably transitions from linear to cyclical structures. The method is built from the Needleman-Wunsch algorithm for sequence alignment, but with a modified scoring function for different input data. Validation against a benchmarked dataset from the Krebs cycle based upon known chemical mechanisms of molecular transformations confirmed the efficacy of the approach. The transformations of the Pentose Phosphate Pathway were quantified using this algorithm and was compared with Glycolysis. The study introduces an algorithm that quantifies molecular transformations in metabolic pathways, highlighting a midpoint dissimilarity peak in cyclical pathways and a progressive decrease in molecular similarity in linear pathways. The software is available at: .

Bioinformatics
Dynamic Programming Approaches for Resource Allocation in Project Scheduling: Maximizing Efficiency under Time and Budget Constraints

Dileep Reddy Goda,Vishal Reddy Vadiyala,Sridhar Reddy Yerram,Suman Reddy Mallipeddi

DOI: https://doi.org/10.18034/abcjar.v12i1.722

2023-02-14

ABC Journal of Advanced Research

Abstract:This study investigates dynamic programming methodologies for resource allocation in project scheduling, aiming to optimize efficiency while adhering to time and budget limitations. Exploring the theoretical underpinnings of dynamic programming, including time and budget restrictions into resource allocation models, and conducting case studies to assess actual applications are the primary goals of this project. This study utilized a thorough review process, including a synthesis of the relevant literature, an analysis of the case study, and policy implications. Among the most important discoveries are the following: the versatility of dynamic programming techniques in addressing resource allocation challenges across industries, the significance of incorporating time and budget constraints into decision-making processes, and the necessity of addressing limitations related to computational complexity, data requirements, and risk management. In the context of policy consequences, investments in computing infrastructure, data management techniques, and risk mitigation strategies are highlighted. In general, the findings of this study highlight the potential of dynamic programming methodologies to improve the efficiency and effectiveness of resource allocation within the context of a project that is affected by time and financial restrictions.
MM-align: a quick algorithm for aligning multiple-chain protein complex structures using iterative dynamic programming

Srayanta Mukherjee,Yang Zhang

DOI: https://doi.org/10.1093/nar/gkp318

IF: 14.9

2009-05-14

Nucleic Acids Research

Abstract:Structural comparison of multiple-chain protein complexes is essential in many studies of protein-protein interactions. We develop a new algorithm, MM-align, for sequence-independent alignment of protein complex structures. The algorithm is built on a heuristic iteration of a modified Needleman-Wunsch dynamic programming (DP) algorithm, with the alignment score specified by the inter-complex residue distances. The multiple chains in each complex are first joined, in every possible order, and then simultaneously aligned with cross-chain alignments prevented. The alignments of interface residues are enhanced by an interface-specific weighting factor. MM-align is tested on a large-scale benchmark set of 205 x 3897 non-homologous multiple-chain complex pairs. Compared with a naïve extension of the monomer alignment program of TM-align, the alignment accuracy of MM-align is significantly higher as judged by the average TM-score of the physically-aligned residues. MM-align is about two times faster than TM-align because of omitting the cross-alignment zone of the DP matrix. It also shows that the enhanced alignment of the interfaces helps in identifying biologically relevant protein complex pairs.

biochemistry & molecular biology
Dynamic Programming for Structured Continuous Markov Decision Problems

Zhengzhu Feng,Richard Dearden,Nicolas Meuleau,Richard Washington

DOI: https://doi.org/10.48550/arXiv.1207.4115

2012-07-11

Abstract:We describe an approach for exploiting structure in Markov Decision Processes with continuous state variables. At each step of the dynamic programming, the state space is dynamically partitioned into regions where the value function is the same throughout the region. We first describe the algorithm for piecewise constant representations. We then extend it to piecewise linear representations, using techniques from POMDPs to represent and reason about linear surfaces efficiently. We show that for complex, structured problems, our approach exploits the natural structure so that optimal solutions can be computed efficiently.

Artificial Intelligence
Aligning biological sequences by exploiting residue conservation and coevolution

Anna Paola Muntoni,Andrea Pagnani,Martin Weigt,Francesco Zamponi

DOI: https://doi.org/10.1103/PhysRevE.102.062409

2020-11-13

Abstract:Sequences of nucleotides (for DNA and RNA) or amino acids (for proteins) are central objects in biology. Among the most important computational problems is that of sequence alignment, i.e. arranging sequences from different organisms in such a way to identify similar regions, to detect evolutionary relationships between sequences, and to predict biomolecular structure and function. This is typically addressed through profile models, which capture position-specificities like conservation in sequences, but assume an independent evolution of different positions. Over the last years, it has been well established that coevolution of different amino-acid positions is essential for maintaining three-dimensional structure and function. Modeling approaches based on inverse statistical physics can catch the coevolution signal in sequence ensembles; and they are now widely used in predicting protein structure, protein-protein interactions, and mutational landscapes. Here, we present DCAlign, an efficient alignment algorithm based on an approximate message-passing strategy, which is able to overcome the limitations of profile models, to include coevolution among positions in a general way, and to be therefore universally applicable to protein- and RNA-sequence alignment without the need of using complementary structural information. The potential of DCAlign is carefully explored using well-controlled simulated data, as well as real protein and RNA sequences.

Quantitative Methods,Disordered Systems and Neural Networks,Biological Physics,Biomolecules

What is dynamic programming?

Recursive dynamic programming for adaptive sequence and structure alignment

Dynamic programming by polymorphic semiring algebraic shortcut fusion

New Sequence Alignment Algorithm using AI Rules and Dynamic Seeds

A Greedy Algorithm for Aligning DNA Sequences

Novel Structure-Based Pairwise Sequence Alignment

Speed-Up in Dynamic-Programming

A Parallel Dynamic Programming Algorithm on a Multi-Core Architecture

Parallel and (Nearly) Work-Efficient Dynamic Programming

Parallel linear space algorithm for large-scale sequence alignment

Dynamic Programming Algorithms for Discovery of Antibiotic Resistance in Microbial Genomes

Optimizing Operations Management and Business Analytics Strategies under Uncertainty: Dynamic Programming

Locality and Parallelism Optimization for Dynamic Programming Algorithm in Bioinformatics

Using Dynamic Programming To Match Human Behavior Sequences

Defining topological equivalences in protein structures by means of a dynamic programming algorithm.

A Dynamic Programming Approach to De Novo Peptide Sequencing Via Tandem Mass Spectrometry

A Dynamic Programming Approach for the Alignment of Molecules

Dynamic Programming Approaches for Resource Allocation in Project Scheduling: Maximizing Efficiency under Time and Budget Constraints

MM-align: a quick algorithm for aligning multiple-chain protein complex structures using iterative dynamic programming

Dynamic Programming for Structured Continuous Markov Decision Problems

Aligning biological sequences by exploiting residue conservation and coevolution