Multitask Evolution with Cartesian Genetic Programming

Eric O. Scott,Kenneth A. De Jong

DOI: https://doi.org/10.48550/arXiv.1702.02217

2017-04-25

Abstract:We introduce a genetic programming method for solving multiple Boolean circuit synthesis tasks simultaneously. This allows us to solve a set of elementary logic functions twice as easily as with a direct, single-task approach.

Neural and Evolutionary Computing

What problem does this paper attempt to address?

Gene Expression Programming with Multiple Chromosomes

Bo Wang,Min Yao,Rong Zhu

DOI: https://doi.org/10.1504/ijmic.2011.043145

2011-01-01

International Journal of Modelling, Identification and Control

Abstract:Gene expression programming (GEP) has been widely used in the areas of pattern recognition and knowledge discovery, however, when dealing with complicated problems, it is very time-consuming and the number of generations is large. In order to overcome these drawbacks, this paper proposes a multi-chromosomes GEP algorithm (MC-GEP). Firstly, the individual is composed of multiple chromosomes, each chromosome consists of one or more genes. Secondly, the expression of each chromosome or combinations of several chromosomes may be chosen to indicate the individual. Finally, chromosome recombination is changed and performed orderly like meiosis. Experimental results show that MC-GEP can reduce the running time and the number of generations with respect to the GEP.
Semantically-Oriented Mutation Operator in Cartesian Genetic Programming for Evolutionary Circuit Design

David Hodan,Vojtech Mrazek,Zdenek Vasicek

DOI: https://doi.org/10.1145/3377930.3390188

2020-04-23

Abstract:Despite many successful applications, Cartesian Genetic Programming (CGP) suffers from limited scalability, especially when used for evolutionary circuit design. Considering the multiplier design problem, for example, the 5x5-bit multiplier represents the most complex circuit evolved from a randomly generated initial population. The efficiency of CGP highly depends on the performance of the point mutation operator, however, this operator is purely stochastic. This contrasts with the recent developments in Genetic Programming (GP), where advanced informed approaches such as semantic-aware operators are incorporated to improve the search space exploration capability of GP. In this paper, we propose a semantically-oriented mutation operator (SOMO) suitable for the evolutionary design of combinational circuits. SOMO uses semantics to determine the best value for each mutated gene. Compared to the common CGP and its variants as well as the recent versions of Semantic GP, the proposed method converges on common Boolean benchmarks substantially faster while keeping the phenotype size relatively small. The successfully evolved instances presented in this paper include 10-bit parity, 10+10-bit adder and 5x5-bit multiplier. The most complex circuits were evolved in less than one hour with a single-thread implementation running on a common CPU.

Neural and Evolutionary Computing
A Co-evolutionary Cartesian Genetic Programming with Adaptive Knowledge Transfer

Jinghui Zhong,Linhao Li,Wei-Li Liu,Liang Feng,Xiao-Min Hu

DOI: https://doi.org/10.1109/cec.2019.8790352

2019-01-01

Abstract:Cartesian Genetic Programming (CGP) is a powerful and popular tool for automatic generation of computer programs to solve user defined tasks. This paper proposes a Co-evolutionary CGP (named Co-CGP) which can automatically gain high-order knowledge to accelerate the search. In the Co-CGP, two modules are working in cooperation to solve a given problem. One module focuses on solving a series of small scale problems of the same type to generate the building blocks. Simultaneously, the second module focuses on combing the available building blocks to construct the final solution. Besides, an adaptive control strategy is introduced to automatically evaluate the effectiveness of the building blocks and adjust the search behaviour adaptively so as to improve search efficiency. The proposed Co-CGP is tested on eight problems with different complexities. Experimental results show that the Co-CGP can significantly improve the performance of CGP, in terms of both search efficiency and accuracy.
Multi-task code reuse in genetic programming

Wojciech Jaskowski,Krzysztof Krawiec,Bartosz Wieloch

DOI: https://doi.org/10.1145/1388969.1389040

2008-01-01

Abstract:We propose a method of knowledge reuse between evolutionary processes that solve different optimization tasks. We define the method in the framework of tree-based genetic programming (GP) and implement it as code reuse between GP trees that evolve in parallel in separate populations delegated to particular tasks. The technical means of code reuse is a crossbreeding operator which works very similar to standard tree-swapping crossover. We consider two variants of this operator, which differ in the way they handle the incompatibility of terminals between the considered problems. In the experimental part we demonstrate that such code reuse is usually beneficial and leads to success rate improvements when solving the common boolean benchmarks.
Positional Cartesian Genetic Programming

DG Wilson,Julian F. Miller,Sylvain Cussat-Blanc,Hervé Luga

DOI: https://doi.org/10.48550/arXiv.1810.04119

2018-10-09

Neural and Evolutionary Computing

Abstract:Cartesian Genetic Programming (CGP) has many modifications across a variety of implementations, such as recursive connections and node weights. Alternative genetic operators have also been proposed for CGP, but have not been fully studied. In this work, we present a new form of genetic programming based on a floating point representation. In this new form of CGP, called Positional CGP, node positions are evolved. This allows for the evaluation of many different genetic operators while allowing for previous CGP improvements like recurrency. Using nine benchmark problems from three different classes, we evaluate the optimal parameters for CGP and PCGP, including novel genetic operators.
Multifactorial Genetic Programming for Symbolic Regression Problems

Jinghui Zhong,Liang Feng,Wentong Cai,Yew-Soon Ong

DOI: https://doi.org/10.1109/tsmc.2018.2853719

2020-01-01

IEEE Transactions on Systems Man and Cybernetics Systems

Abstract:Genetic programming (GP) is a powerful evolutionary algorithm that has been widely used for solving many real-world optimization problems. However, traditional GP can only solve a single task in one independent run, which is inefficient in cases where multiple tasks need to be solved at the same time. Recently, multifactorial optimization (MFO) has been proposed as a new evolutionary paradigm toward evolutionary multitasking. It intends to conduct evolutionary search on multiple tasks in one independent run. To enable multitasking GP, in this paper, we propose a novel multifactorial GP (MFGP) algorithm. To the best of our knowledge, this is the first attempt in the literature to conduct multitasking GP using a single population. The proposed MFGP consists of a novel scalable chromosome encoding scheme which is capable of representing multiple solutions simultaneously, and new evolutionary mechanisms for MFO based on self-learning gene expression programming. Further, comprehensive experimental studies are conducted on multitask scenarios consisting of commonly used GP benchmark problems and real world applications. The obtained empirical results confirmed the efficacy of the proposed MFGP.
On Heuristics for Seeding the Initial Population of Cartesian Genetic Programming Applied to Combinational Logic Circuits

Francisco A.L. Manfrini,Heder S. Bernardino,Helio J.C. Barbosa

DOI: https://doi.org/10.1145/2908961.2909031

2016-07-20

Abstract:The design of circuits is an important research field and the corresponding optimization problems are complex and computationally expensive. Here, a Cartesian Genetic Programming (CGP) technique was used to design combinational logic circuits. Several configurations were tested for seeding the initial population. First, the number of rows, columns, and levels-back were varied. In addition, the initial population was generated using only NAND gates. These configurations were compared with results from the literature in four benchmark circuits, where in all instances it was possible to find that some seeding configurations contributed beneficially to the evolutionary process, allowing CGP to find a solution employing a lower number of fitness evaluations. Finally, the variation of the number of nodes of the individuals during the search was also analyzed and the results showed that there is a correlation between the topology of the initial population and the region of the search space which is explored.
Code Building Genetic Programming

Edward Pantridge,Lee Spector

DOI: https://doi.org/10.1145/3377930.3390239

2020-08-09

Abstract:In recent years the field of genetic programming has made significant advances towards automatic programming. Research and development of contemporary program synthesis methods, such as PushGP and Grammar Guided Genetic Programming, can produce programs that solve problems typically assigned in introductory academic settings. These problems focus on a narrow, predetermined set of simple data structures, basic control flow patterns, and primitive, non-overlapping data types (without, for example, inheritance or composite types). Few, if any, genetic programming methods for program synthesis have convincingly demonstrated the capability of synthesizing programs that use arbitrary data types, data structures, and specifications that are drawn from existing codebases. In this paper, we introduce Code Building Genetic Programming (CBGP) as a framework within which this can be done, by leveraging programming language features such as reflection and first-class specifications. CBGP produces a computational graph that can be executed or translated into source code of a host language. To demonstrate the novel capabilities of CBGP, we present results on new benchmarks that use non-primitive, polymorphic data types as well as some standard program synthesis benchmarks.

Programming Languages,Neural and Evolutionary Computing,Software Engineering
Evolutionary Multitasking in Permutation-Based Combinatorial Optimization Problems: Realization with Tsp, Qap, Lop, and Jsp

Yuan,Yew-Soon Ong,Abhishek Gupta,Puay Siew Tan,Hua Xu

DOI: https://doi.org/10.1109/tencon.2016.7848632

2016-01-01

Abstract:Evolutionary computation (EC) has gained increasing popularity in dealing with permutation-based combinatorial optimization problems (PCOPs). Traditionally, EC focuses on solving a single optimization task at a time. However, in complex multi-echelon supply chain networks (SCNs), there usually exist various kinds of PCOPs at the same time, e.g., travel salesman problem (TSP), job-shop scheduling problem (JSP), etc. So, it is desirable to solve several PCOPs at once with both effectiveness and efficiency. Very recently, a new paradigm in EC, namely, multifactorial optimization (MFO) has been introduced to explore the potential of evolutionary multitasking, which can serve the purpose of simultaneously optimizing multiple PCOPs in SCNs. In this paper, the evolutionary multitasking of PCOPs is studied. In particular, based on a recently proposed multitasking engine known as the multifactorial evolutionary algorithm (MFEA), two novel mechanisms, namely, a new unified representation and a new survivor selection procedure, are introduced to better adapt to PCOPs. Experimental results obtained on well-known benchmark problems not only show the benefits of the two new mechanisms but also verify the promise of evolutionary multitasking for PCOPs. In addition, the results on a test case involving four optimization tasks demonstrate the potential scalability of evolutionary multitasking to many-task environments.
Imperative Genetic Programming

Iztok Fajfar,Žiga Rojec,Árpád Bűrmen,Matevž Kunaver,Tadej Tuma,Sašo Tomažič,Janez Puhan

DOI: https://doi.org/10.3390/sym16091146

2024-09-04

Symmetry

Abstract:Genetic programming (GP) has a long-standing tradition in the evolution of computer programs, predominantly utilizing tree and linear paradigms, each with distinct advantages and limitations. Despite the rapid growth of the GP field, there have been disproportionately few attempts to evolve 'real' Turing-like imperative programs (as contrasted with functional programming) from the ground up. Existing research focuses mainly on specific special cases where the structure of the solution is partly known. This paper explores the potential of integrating tree and linear GP paradigms to develop an encoding scheme that universally supports genetic operators without constraints and consistently generates syntactically correct Python programs from scratch. By blending the symmetrical structure of tree-based representations with the inherent asymmetry of linear sequences, we created a versatile environment for program evolution. Our approach was rigorously tested on 35 problems characterized by varying Halstead complexity metrics, to delineate the approach's boundaries. While expected brute-force program solutions were observed, our method yielded more sophisticated strategies, such as optimizing a program by restricting the division trials to the values up to the square root of the number when counting its proper divisors. Despite the recent groundbreaking advancements in large language models, we assert that the GP field warrants continued research. GP embodies a fundamentally different computational paradigm, crucial for advancing our understanding of natural evolutionary processes.

multidisciplinary sciences
Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization

Abhishek Gupta,Yew-Soon Ong

DOI: https://doi.org/10.48550/arXiv.1607.05390

2016-07-19

Abstract:Evolutionary multitasking has recently emerged as a novel paradigm that enables the similarities and/or latent complementarities (if present) between distinct optimization tasks to be exploited in an autonomous manner simply by solving them together with a unified solution representation scheme. An important matter underpinning future algorithmic advancements is to develop a better understanding of the driving force behind successful multitask problem-solving. In this regard, two (seemingly disparate) ideas have been put forward, namely, (a) implicit genetic transfer as the key ingredient facilitating the exchange of high-quality genetic material across tasks, and (b) population diversification resulting in effective global search of the unified search space encompassing all tasks. In this paper, we present some empirical results that provide a clearer picture of the relationship between the two aforementioned propositions. For the numerical experiments we make use of Sudoku puzzles as case studies, mainly because of their feature that outwardly unlike puzzle statements can often have nearly identical final solutions. The experiments reveal that while on many occasions genetic transfer and population diversity may be viewed as two sides of the same coin, the wider implication of genetic transfer, as shall be shown herein, captures the true essence of evolutionary multitasking to the fullest.

Neural and Evolutionary Computing
Optimization of Combinational Logic Circuits with Genetic Programming

S. Karakatic,V. Podgorelec,M. Hericko

DOI: https://doi.org/10.5755/j01.eee.19.7.5169

2013-09-11

Electronics and Electrical Engineering

Abstract:In this paper we research the possibility of automated combinational logic circuit (CLC) design using evolutionary computation. We propose and develop a genetic programming method which is able to construct a CLC based on the given truth tables, where the focus is to minimize the number of logic gates while accuracy is not compromised. We tested the proposed approach and compared the results both with MGA and NGA automatic methods as well as with the results obtained by human designers. Results show that our algorithm is superior to other methods as it can find correct circuits with fewer specified elements. The experiments performed on larger examples show good performance and scalability of the proposed evolutionary approach. DOI: http://dx.doi.org/10.5755/j01.eee.19.7.5169
Evolving Exact Integer Algorithms with Genetic Programming

Thomas Weise,Mingxu Wan,Ke Tang,Xin Yao

DOI: https://doi.org/10.1109/cec.2014.6900292

2014-01-01

Abstract:The synthesis of exact integer algorithms is a hard task for Genetic Programming (GP), as it exhibits epistasis and deceptiveness. Most existing studies in this domain only target few and simple problems or test a small set of different representations. In this paper, we present the (to the best of our knowledge) largest study on this domain to date. We first propose a novel benchmark suite of 20 non-trivial problems with a variety of different features. We then test two approaches to reduce the impact of the negative features: (a) a new nested form of Transactional Memory (TM) to reduce epistatic effects by allowing instructions in the program code to be permutated with less impact on the program behavior and (b) our recently published Frequency Fitness Assignment method (FFA) to reduce the chance of premature convergence on deceptive problems. In a full-factorial experiment with six different loop instructions, TM, and FFA, we find that GP is able to solve all benchmark problems, although not all of them with a high success rate. Several interesting algorithms are discovered. FFA has a tremendous positive impact while TM turns out not to be useful.
Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming

Thomas Helmuth,Edward Pantridge,James Gunder Frazier,Lee Spector

2024-08-08

Abstract:Counterexample-driven genetic programming (CDGP) uses specifications provided as formal constraints to generate the training cases used to evaluate evolving programs. It has also been extended to combine formal constraints and user-provided training data to solve symbolic regression problems. Here we show how the ideas underlying CDGP can also be applied using only user-provided training data, without formal specifications. We demonstrate the application of this method, called ``informal CDGP,'' to software synthesis problems. Our results show that informal CDGP finds solutions faster (i.e. with fewer program executions) than standard GP. Additionally, we propose two new variants to informal CDGP, and find that one produces significantly more successful runs on about half of the tested problems. Finally, we study whether the addition of counterexample training cases to the training set is useful by comparing informal CDGP to using a static subsample of the training set, and find that the addition of counterexamples significantly improves performance.

Neural and Evolutionary Computing,Artificial Intelligence,Software Engineering
Multitask Genetic Programming-Based Generative Hyperheuristics: A Case Study in Dynamic Scheduling

Fangfang Zhang,Yi Mei,Su Nguyen,Kay Chen Tan,Mengjie Zhang

DOI: https://doi.org/10.1109/TCYB.2021.3065340

Abstract:Evolutionary multitask learning has achieved great success due to its ability to handle multiple tasks simultaneously. However, it is rarely used in the hyperheuristic domain, which aims at generating a heuristic for a class of problems rather than solving one specific problem. The existing multitask hyperheuristic studies only focus on heuristic selection, which is not applicable to heuristic generation. To fill the gap, we propose a novel multitask generative hyperheuristic approach based on genetic programming (GP) in this article. Specifically, we introduce the idea in evolutionary multitask learning to GP hyperheuristics with a suitable evolutionary framework and individual selection pressure. In addition, an origin-based offspring reservation strategy is developed to maintain the quality of individuals for each task. To verify the effectiveness of the proposed approach, comprehensive empirical studies have been conducted on the homogeneous and heterogeneous multitask dynamic flexible job shop scheduling. The results show that the proposed algorithm can significantly improve the quality of scheduling heuristics for each task in all the examined scenarios. In addition, the evolved scheduling heuristics verify the mutual help among the tasks in a multitask scenario.
Constrained Multiobjective Optimization Via Multitasking and Knowledge Transfer

Fei Ming,Wenyin Gong,Ling Wang,Liang Gao

DOI: https://doi.org/10.1109/tevc.2022.3230822

IF: 16.497

2024-01-01

IEEE Transactions on Evolutionary Computation

Abstract:Solving constrained multiobjective optimization problems (CMOPs) with various features and challenges via evolutionary algorithms is very popular. Existing methods usually adopt an additional helper problem to simplify and solve them by divide and conquer. This article proposes a new multitasking framework for CMOPs, borrowing the idea of evolutionary multitasking optimization. The main contributions are: 1) a multitasking framework is proposed, where a CMOP is modeled as a multitasking optimization problem with three tasks. Then, it is solved by constraint-first, constraint-ignored, and constraint-relaxed multiobjective evolutionary algorithms; 2) a knowledge expression and a transfer strategy are devised to transfer the knowledge among the tasks; and 3) based on the proposed framework, a new two-stage algorithm is presented to solve CMOPs. The effectiveness of our approach is validated through experiments on four CMOP benchmark suites and 19 real-world CMOPs.
Evolutionary Design of Digital Circuits Using Genetic Programming

S.M. Ashik Eftekhar,Sk. Mahbub Habib,M.M.A. Hashem

DOI: https://doi.org/10.48550/arXiv.1304.2467

2013-04-09

Abstract:For simple digital circuits, conventional method of designing circuits can easily be applied. But for complex digital circuits, the conventional method of designing circuits is not fruitfully applicable because it is time-consuming. On the contrary, Genetic Programming is used mostly for automatic program generation. The modern approach for designing Arithmetic circuits, commonly digital circuits, is based on Graphs. This graph-based evolutionary design of arithmetic circuits is a method of optimized designing of arithmetic circuits. In this paper, a new technique for evolutionary design of digital circuits is proposed using Genetic Programming (GP) with Subtree Mutation in place of Graph-based design. The results obtained using this technique demonstrates the potential capability of genetic programming in digital circuit design with limited computer algorithms. The proposed technique, helps to simplify and speed up the process of designing digital circuits, discovers a variation in the field of digital circuit design where optimized digital circuits can be successfully and effectively designed.

Neural and Evolutionary Computing
Numerical circuit synthesis and compilation for multi-state preparation

Aaron Szasz,Ed Younis,Wibe de Jong

DOI: https://doi.org/10.1109/QCE57702.2023.00092

2023-09-20

Abstract:Near-term quantum computers have significant error rates and short coherence times, so compilation of circuits to be as short as possible is essential. Two types of compilation problems are typically considered: circuits to prepare a given state from a fixed input state, called "state preparation"; and circuits to implement a given unitary operation, for example by "unitary synthesis". In this paper we solve a more general problem: the transformation of a set of $m$ states to another set of $m$ states, which we call "multi-state preparation". State preparation and unitary synthesis are special cases; for state preparation, $m=1$, while for unitary synthesis, $m$ is the dimension of the full Hilbert space. We generate and optimize circuits for multi-state preparation numerically. In cases where a top-down approach based on matrix decompositions is also possible, our method finds circuits with substantially (up to 40%) fewer two-qubit gates. We discuss possible applications, including efficient preparation of macroscopic superposition ("cat") states and synthesis of quantum channels.

Quantum Physics,Emerging Technologies
Combining Genetic Programming and Model-Driven Development.

Thomas Weise,Michael Zapf,Mohammad Khan,Kurt Geihs

DOI: https://doi.org/10.1142/s1469026809002436

2009-01-01

International Journal of Computational Intelligence and Applications

Abstract:Genetic programming (GP) is known to provide good solutions for many problems like the evolution of network protocols and distributed algorithms. In most cases it is a hardwired module of a design framework assisting the engineer in optimizing specific aspects in system development. In this article, we show how the utility of GP can be increased remarkably by isolating it as a component and integrating it into the modeldriven software development process. Our GP framework produces XMI-encoded UML models that can easily be loaded into widely available modeling tools, which in turn offer code generation as well as additional analysis and test capabilities. We use the evolution of a distributed election algorithm as an example to illustrate how GP can be combined with model-driven development (MDD).
Constraint subsets-based evolutionary multitasking for constrained multiobjective optimization

Kunjie Yu,Lingjun Wang,Jing Liang,Heshan Wang,Kangjia Qiao,Tianye Liang

DOI: https://doi.org/10.1016/j.swevo.2024.101531

IF: 10.267

2024-03-24

Swarm and Evolutionary Computation

Abstract:Constrained multiobjective optimization problems (CMOPs) are challenging because they need to optimize multiple conflicting objectives and satisfy various constraints simultaneously. To solve CMOPs, various constrained multiobjective evolutionary algorithms have been proposed in recent years. However, most of them tackle constraints by considering all constraints or zero constraint scenarios, these extreme treatment methods may be unable to utilize the information of multiple constraint subsets composed of partial constraints to maintain more promising infeasible solutions. To remedy this issue, a constraint subsets-based evolutionary multitasking method is developed, where a CMOP is transformed into a multitasking optimization problem by creating multiple simple auxiliary CMOPs. Particularly, the original CMOP is the main task, while the newly created CMOPs with different constraint subsets are the auxiliary tasks. Each task will be evolved by one specific population, and the knowledge transfer is conducted among tasks to realize the collaborative search. Meanwhile, the updating of the auxiliary task involves two stages. In the first stage, each auxiliary population will evolve to approach the pareto front of the constraint subset (s-CPF), promoting crossing the infeasible regions. While in the second stage, a feasible region-based search mechanism is proposed to approach the pareto front of the main task from each s-CPF, by utilizing unique and promising infeasible solutions. In addition, systematic experiments are carried out on three benchmark test suites and four real-world CMOPs. The experimental results fully demonstrate that the proposed algorithm is highly competitive with other state-of-the-art constrained multiobjective evolutionary algorithms.

computer science, artificial intelligence, theory & methods

Multitask Evolution with Cartesian Genetic Programming

Gene Expression Programming with Multiple Chromosomes

Semantically-Oriented Mutation Operator in Cartesian Genetic Programming for Evolutionary Circuit Design

A Co-evolutionary Cartesian Genetic Programming with Adaptive Knowledge Transfer

Multi-task code reuse in genetic programming

Positional Cartesian Genetic Programming

Multifactorial Genetic Programming for Symbolic Regression Problems

On Heuristics for Seeding the Initial Population of Cartesian Genetic Programming Applied to Combinational Logic Circuits

Code Building Genetic Programming

Evolutionary Multitasking in Permutation-Based Combinatorial Optimization Problems: Realization with Tsp, Qap, Lop, and Jsp

Imperative Genetic Programming

Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization

Optimization of Combinational Logic Circuits with Genetic Programming

Evolving Exact Integer Algorithms with Genetic Programming

Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming

Multitask Genetic Programming-Based Generative Hyperheuristics: A Case Study in Dynamic Scheduling

Constrained Multiobjective Optimization Via Multitasking and Knowledge Transfer

Evolutionary Design of Digital Circuits Using Genetic Programming

Numerical circuit synthesis and compilation for multi-state preparation

Combining Genetic Programming and Model-Driven Development.

Constraint subsets-based evolutionary multitasking for constrained multiobjective optimization