Adaptive Parallel Algorithms From Biology *

Lishan Kang,Zhengjun Pan,Yuping Chen,Yuanxiang LiYong Liu,Jun HeThe

2007-01-01

Abstract:Recently, new algorithms derived from biology become more and more popular, therefore, have received increasing attention. In this paper, we should introduce our researches on parallel problem solvers from biology devel

What problem does this paper attempt to address?

Some Massively Parallel Algorithms from Nature

Li Yan,Kang Li-shan,Chen Yu-ping,Liu Pu,Cao Hong-qing,Pan Zheng-jun

DOI: https://doi.org/10.1007/bf02830011

2002-01-01

Wuhan University Journal of Natural Sciences

Abstract:We introduced the work on parallel problem solvers from physics and biology being developed by the research team at the State Key Laboratory of Software Engineering, Wuhan University. Results on parallel solvers include the following areas: Evolutionary algorithms based on imitating the evolution processes of nature for parallel problem solving, especially for parallel optimization and model-building; Asynchronous parallel algorithms based on domain decomposition which are inspired by physical analogies such as elastic relaxation process and annealing process, for scientific computations, especially for solving nonlinear mathematical physics problems. All these algorithms have the following common characteristics: inherent parallelism, self-adaptation and self-organization, because the basic ideas of these solvers are from imitating the natural evolutionary processes.
Massively Parallel Algorithms from Physics and Biology

LS Kang,YX Li,ZJ Pan,J He,DJ Evans

DOI: https://doi.org/10.1080/00207160108805062

2001-01-01

Abstract:In this paper the recent developments of lattice kinetic models are discussed followed by the fundamental concepts of Evolutionary Algorithms and their application to optimization, machine learning, Neural networks and many other areas. Finally, the application of Evolutionary Algorithms to the biological eco-system is presented.
Heterogeneous computing and grid scheduling with parallel biologically inspired hybrid heuristics

Jinglian Wang,Bin Gong,Hong Liu,Shaohui Li,Juan Yi

DOI: https://doi.org/10.1177/0142331214522287

IF: 2.146

2014-01-01

Transactions of the Institute of Measurement and Control

Abstract:This work presents novel parallel biologically inspired hybrid heuristics for task scheduling in distributed heterogeneous computing and grid environments, and NP-hard problems with capital relevance in distributed computing. Firstly, sequential hybrid metaheuristics based on artificial immune systems (AIS) are developed to provide a good scheduler in reduced execution time and improved resource utilization. In the new AIS, affinities of the antibody's genes are also effectively evaluated and regarded as memes from population real-time evolution; self-organized gene-meme co-evolution is simulated to improve population convergence; and appropriate Lyapunov functions inspired by interactive activation and competition neural networks are constructed to balance exploration and exploitation. Secondly, parallelization of the AIS-based algorithm is hierarchically designed and integrates with the two traditional parallel models (master-slave models and island models). The method has been specifically implemented on the newly developed supercomputer platform of hybrid multi-core CPU + GPU using C-CUDA for solving large-sized realistic instances. Numerical experiments are performed on both well known problem instances and large instances that model medium-sized grid environments. The comparative study shows that the proposed parallel approach is able to achieve high solving efficacy, outperforming previous results reported in the related literature, and also showing good scalability behaviour when facing high-dimension problem instances.
Research on Grid Resources Schedule Based on an Adaptive Distribute Parallel Genetic Algorithm

Guangyuan Liu,Jingjun Zhang,Sen Su

DOI: https://doi.org/10.4304/jcp.6.11.2285-2294

2011-01-01

Journal of Computers

Abstract:In this paper an improved adaptive parallel genetic algorithm is proposed to solve problems of grid resources distribution and matching, comparing with the traditional genetic algorithms, a new adaptive selection operator is introduced, which can prevent the premature convergence of genetic algorithm efficiently. Besides, in this paper, the migration strategy of the parallel genetic algorithm can prevent the population trapped in the local extreme. And a pc-cluster containing eight computers is constructed to execute the coarse-grained parallel genetic algorithm and series genetic algorithm, and different scale resources and tasks are tested on the pc-cluster. Several examples are provided to be examined and the results illustrate that the proposed algorithm has higher global optimization capability, computational efficiency and stronger stability than the traditional genetic algorithm for the max time span. From these results, the parallel genetic algorithm reduced the searching time much more than series genetic algorithm for the same solutions. Moreover, compared with series genetic algorithm, the parallel genetic algorithm can get the more optimal solutions when the iteration is same.
Parallel Implementations of Local Sequence Alignment: Hardware and Software

Vipin Chaudhary,Feng Liu,Vijay Matta,Laurence T. Yang,Xiandong Meng,Anil Nambiar

DOI: https://doi.org/10.1002/0471756504.ch10

2005-01-01

Abstract:With the progress in computer science and raw computational power available today, human quest to learn and understand the complex relationships within the subsets of biology, e.g., biological response, biodiversity, genetics, medicine, etc. has got a new promise. Computational Biology represents the marriage of computer science and biology, and spans may disciplines, such as bioinformatics (genomics and post-genomics), clinical informatics, medical imaging, bioengineering, etc. It finds application in many areas of life science, e.g., the development of human therapeutics, diagnostics, pyrognostics and forensics, up through the simulation of large entities such as populations and ecosystems. Genomics is the determination of the entire DNA sequence of an organism. The goal of modern human genomics is preventive, predictive, and individualized medicine. In agriculture, the goal is the production of foods with improved production characteristics and, increasingly beneficial consumer traits. Post-genomics refers to the biological processes that follow from DNA sequence(e.g. transciptomics, proteomics, metabolomics, etc.).
Locality and Parallelism Optimization for Dynamic Programming Algorithm in Bioinformatics

Guangming Tan,Shengzhong Feng,Ninghui Sun

DOI: https://doi.org/10.1109/sc.2006.41

2006-01-01

Abstract:Dynamic programming has been one of the most efficient approaches to sequence analysis and structure prediction in biology. However, their performance is limited due to the drastic increase in both the number of biological data and variety of the computer architectures. With regard to such predicament, this paper creates excellent algorithms aimed at addressing the challenges of improving memory efficiency and network latency tolerance for nonserial polyadic dynamic programming where the dependences are nonuniform. By relaxing the nonuniform dependences, we proposed a new cache oblivious scheme to enhance its performance on memory hierarchy architectures. Moreover we develop and extend a tiling technique to parallelize this nonserial polyadic dynamic programming using an alternate block-cyclic mapping strategy for balancing the computational and memory load, where an analytical parameterized model is formulated to determine the tile volume size that minimizes the total execution time and an algorithmic transformation is used to schedule the tile to overlap communication with computation to further minimize communication overhead on parallel architectures. The numerical experiments were carried out on several high performance computer systems. The new cache-oblivious dynamic programming algorithm achieve 2-10 speedup and the parallel tiling algorithm with communication-computation overlapping shows a desired potential for fine-grained parallel computing on massively parallel computer systems
Parallel algorithms and domain decomposition

Li-shan Kang

DOI: https://doi.org/10.1007/BFb0078540

1987-01-01

Lecture notes in mathematics

Abstract:Without Abstract
A Generic Parallel Pattern-Based System for Bioinformatics

Wg Liu,B Schmidt

2004-01-01

Abstract:Parallel program design patterns provide users a new way to get parallel programs without much effort. However, it is always a serious limitation for most existing parallel pattern-based systems that there is no generic description for the structure and behavior of a pattern at application level. This limitation has so far greatly hindered the practical use of these systems. In this paper, we present a new parallel pattern-based system for bioinformatics. The underlying programming techniques are based on generic programming, a programming technique suited for the generic representation of abstract concepts. This allows the new system to be built in a generic way at application level. We show how this system efficiently addresses the shortcomings of existing systems and leads to significant runtime savings for some popular applications in bioinformatics on PC clusters.
Adaptive and Parallel Genetic Algorithm Based on Solving Premature Convergence

ZHOU Yuanhui,LU Yuchang,SHI Chunyi

DOI: https://doi.org/10.3321/j.issn:1000-0054.1998.03.022

1998-01-01

Abstract:Premature convergence is still the preeminent problem in genetic algorithms (GAs). Some excellent individuals or genes are lost due to premature convergence, which causes local optimum. This paper presents an improved genetic algorithm based on multiple populations evolution and adaptive parameter adjusting. Experimental results show that this method alleviates the problem of premature convergence and improves the efficiency of searching.
Parallel Transfer Evolution Algorithm.

Yuanjun Laili,Lin Zhang,Yun Li

DOI: https://doi.org/10.1016/j.asoc.2018.11.044

IF: 8.7

2018-01-01

Applied Soft Computing

Abstract:Parallelization of an evolutionary algorithm takes the advantage of modular population division and information exchange among multiple processors. However, existing parallel evolutionary algorithms are rather ad hoc and lack a capability of adapting to diverse problems. To accommodate a wider range of problems and to reduce algorithm design costs, this paper develops a parallel transfer evolution algorithm. It is based on the island-model of parallel evolutionary algorithm and, for improving performance, transfers both the connections and the evolutionary operators from one sub-population pair to another adaptively. Needing no extra upper selection strategy, each sub-population is able to select autonomously evolutionary operators and local search operators as subroutines according to both the sub-population’s own and the connected neighbor’s ranking boards. The parallel transfer evolution is tested on two typical combinatorial optimization problems in comparison with six existing ad-hoc evolutionary algorithms, and is also applied to a real-world case study in comparison with five typical parallel evolutionary algorithms. The tests show that the proposed scheme and the resultant PEA offer high flexibility in dealing with a wider range of combinatorial optimization problems without algorithmic modification or redesign. Both the topological transfer and the algorithmic transfer are seen applicable not only to combinatorial optimization problems, but also to non-permutated complex problems.
Study on Distributed Parallel Computing on Hybrid Genetic Algorithm

TANG Tianbing,WEI Lingyun,XIE Xianghong,YAN Yi

DOI: https://doi.org/10.3778/j.issn.1002-8331.2011.09.060

2011-01-01

Abstract:A parallel hybrid genetic algorithm framework is proposed aiming at improving the computing efficiency and the solution quality.This algorithm framework consists of three parts which are genetic algorithm,niche operation and simplex search.The first two parts,genetic algorithm and niche operation,are executed in serial way and the other is in distributed parallel way.The distributed parallel computing environment is constructed with four computers connected by a switch.A dynamic task scheduling solution is introduced into the proposed algorithm.The experimental result of a classical engineering example demonstrates the validity of the new algorithm and good speedup and computing efficiency in the distributed parallel computing environment.
Parallel Algorithm for Multiple Genome Alignment on the Grid Environment

Nova Ahmed,Yi Pan,Art Vandenberg,Yuzhong Sun

DOI: https://doi.org/10.1109/ipdps.2005.324

2005-01-01

Abstract:The multiple genome sequence alignment problem falls in the domain of problems that can be parallelized to address large sequence lengths. Although there is communication required for the computation of the aligned sequences, the proper distribution can reduce the overall problem to a set of tasks to be solved independently and then merged. A parallel algorithm for the alignment of multiple genome sequences is described. The algorithm is experimentally evaluated in a distributed Grid environment that provides very scalable and low cost computation performance. The Grid environment is evaluated with respect to a traditional cluster environment and results are compared to evaluate the effectiveness of a Grid environment for large computational biology.
Parallel Optimization of Variation Detection Algorithms for Large-Scale Genome Data

CUI Yingbo,HUANG Chun,TANG Tao,YANG Canqun,LIAO Xiangke,PENG Shaoliang

DOI: https://doi.org/10.11959/j.issn.2096-0271.2020041

IF: 3.3

2020-01-01

Big Data Research

Abstract:Sequence alignment and mutation detection are the basic steps of genomic data analysis.They are the premise of subsequent functional analysis,and the most time-consuming steps.In order to effectively deal with the massive genomic big data brought by high-throughput sequencing technology,MPI,OpenMP and other technologies to perform multi-level parallel optimization of sequence alignment algorithm and SNP detection algorithm were used.By testing on different data sets and parallel scales,the core algorithm reached more than 9x speedup,and the parallel efficiency remained above 60% in large-scale test.The improved algorithms obtain good parallel performance and scalability,that effectively improves the ability of genomic big data mutation detection.
Parallel Design Pattern for Computational Biology and Scientific Computing Applications

WG Liu,B Schmidt

DOI: https://doi.org/10.1109/clustr.2003.1253348

2003-01-01

Abstract:Dynamic programming is an important algorithm design technique in computational biology and scientific computing. Typical applications using this technique are very compute-intensive and suffer from long runtimes on sequential architectures. Parallel program design patterns provide a new tool to semiautomatically generate parallel programs. In this paper we present a new parallel programs called the "block-cyclic based wavefront" to parallelize typical biology and scientific computing. We show how this technique leads to significant runtime savings on PC clusters.
A High-Performance Parallel Algorithm For Gene Sequence Discovery

Jun Liu,Zhen-Zhou Ji,Yu Ning

2016-01-01

Abstract:This paper first and foremost illustrates the problem of gene sequence discovery and introduces the way to show gene sequence discovery mode, the scoring mode, the evaluation index as well as other contents about the method of calculation in gene sequence discovery. Meanwhile, this paper detailedly analyzes the primary thought and feature about the discovery, and then a further study is made to confirm the feasibility of parallelization. This paper takes branch bounding method and parallel algorithm to improve its running speed and algorithm performance. By analyzing experimental data, a conclusion is drawn that the parallel algorithm of gene sequence discovery could considerably improve its performance and guarantee its validity.
A Parallel Genetic Algorithm Based on Solution Space Division

Yong FENG,Jun GUO,Hongyan XU,Xiaoying FU

DOI: https://doi.org/10.3969/j.issn.1672-9722.2017.02.007

2017-01-01

Abstract:Genetic algorithm is a kind of the optimization method which is commonly used in NP problem for approximate optimal solution, and it has been widely used in national defense, scientific research, economic management, engineering construction, and other important fields.But some problems often appear during its solving process, such as premature convergence to local optimal solution and the high computational complexity.To solve these problems, first of all, this paper proposes a parallel processing mechanism based on the solution space division which implement parallel processing to solve the optimization problem by dividing the problem solution space.Then the mechanism is introduced into the genetic algorithm, and this paper proposes a parallel genetic algorithm based on the solution space division.Finally, the experimental comparison indicate that the proposed algorithm in parallel processing has a good linear speedup, at the same time overcoming the premature convergence to local optimal solution is better than the standard genetic algorithm and coarse-grained parallel genetic algorithm.
Parallel Algorithms for Solving Semi Linear Elliptic Equations

xu yan,song junqiang,sun anxiang

1999-01-01

Abstract:Three types of parallel algorithms for sloving semi linear elliptic equations are designed based on domain decomposition,multigrid,accelerated Schwarz,monotone(upper and lower solutions),nonlinear Jacobi iteration and Newton iteration.They are known as the parallel Newton multigrid method,the parallel nonlinear multigrid method and the parallel accelerated Schwarz convergence method.The numerical experiments show that parallel computing of the three algorithms are feasible.
Parallel SaNSDE for Many-Core Sunway Processor

KANG Shang,QIAN Xuezhong,GAN Lin

DOI: https://doi.org/10.3778/j.issn.1673-9418.2006059

2021-01-01

Abstract:Evolutionary algorithm is an important method for solving large-scale optimization problems, which is widely applied to machine learning, process control, engineering optimization, management science, and social sciences. However, when the traditional evolutionary algorithms are used to high-dimensional and computing-density task, the performance of corresponding applications is difficult to be satisfactory. Parallelization on supercomputer is a popular solution to solve this problem. This paper proposes a two-level parallel self-adaptive differential evolution algorithm with neighborhood search (SaNSDE) on the Sunway TaihuLight, which implements process-level and thread-level parallelism. In the process-level parallelism, the cooperative co-evolution model and pool model are implemented, which divide large-scale problems into multiple low-dimensional problems and distribute them in different processes. In the thread-level parallelism, fitness calculation is accelerated. Experimental results show that the algorithm using the cooperative co-evolution model and the pool model, compared with the traditional parallel algorithm, improves the convergence effect more obviously after multi-core expansion. Compared with the serial algorithm, the two-level parallel SaNSDE algorithm achieves the maximum speedup of 134.29, 186.05, 239.01 and 189.80 in the four benchmark functions, respectively.
Parallel Computing for Genome Sequence Processing

You Zou,Yuejie Zhu,Yaohang Li,Fang‐Xiang Wu,Jianxin Wang

DOI: https://doi.org/10.1093/bib/bbab070

IF: 9.5

2021-01-01

Briefings in Bioinformatics

Abstract:The rapid increase of genome data brought by gene sequencing technologies poses a massive challenge to data processing. To solve the problems caused by enormous data and complex computing requirements, researchers have proposed many methods and tools which can be divided into three types: big data storage, efficient algorithm design and parallel computing. The purpose of this review is to investigate popular parallel programming technologies for genome sequence processing. Three common parallel computing models are introduced according to their hardware architectures, and each of which is classified into two or three types and is further analyzed with their features. Then, the parallel computing for genome sequence processing is discussed with four common applications: genome sequence alignment, single nucleotide polymorphism calling, genome sequence preprocessing, and pattern detection and searching. For each kind of application, its background is firstly introduced, and then a list of tools or algorithms are summarized in the aspects of principle, hardware platform and computing efficiency. The programming model of each hardware and application provides a reference for researchers to choose high-performance computing tools. Finally, we discuss the limitations and future trends of parallel computing technologies.
Biology-Derived Algorithms in Engineering Optimization

Xin-She Yang

DOI: https://doi.org/10.48550/arXiv.1003.1888

2010-03-09

Abstract:Biology-derived algorithms are an important part of computational sciences, which are essential to many scientific disciplines and engineering applications. Many computational methods are derived from or based on the analogy to natural evolution and biological activities, and these biologically inspired computations include genetic algorithms, neural networks, cellular automata, and other algorithms.

Optimization and Control,Computational Engineering, Finance, and Science,Neural and Evolutionary Computing,Quantitative Methods

Adaptive Parallel Algorithms From Biology *

Some Massively Parallel Algorithms from Nature

Massively Parallel Algorithms from Physics and Biology

Heterogeneous computing and grid scheduling with parallel biologically inspired hybrid heuristics

Research on Grid Resources Schedule Based on an Adaptive Distribute Parallel Genetic Algorithm

Parallel Implementations of Local Sequence Alignment: Hardware and Software

Locality and Parallelism Optimization for Dynamic Programming Algorithm in Bioinformatics

Parallel algorithms and domain decomposition

A Generic Parallel Pattern-Based System for Bioinformatics

Adaptive and Parallel Genetic Algorithm Based on Solving Premature Convergence

Parallel Transfer Evolution Algorithm.

Study on Distributed Parallel Computing on Hybrid Genetic Algorithm

Parallel Algorithm for Multiple Genome Alignment on the Grid Environment

Parallel Optimization of Variation Detection Algorithms for Large-Scale Genome Data

Parallel Design Pattern for Computational Biology and Scientific Computing Applications

A High-Performance Parallel Algorithm For Gene Sequence Discovery

A Parallel Genetic Algorithm Based on Solution Space Division

Parallel Algorithms for Solving Semi Linear Elliptic Equations

Parallel SaNSDE for Many-Core Sunway Processor

Parallel Computing for Genome Sequence Processing

Biology-Derived Algorithms in Engineering Optimization