Abstract:This paper analyses the competitive approach to the co-evolutionary training of multi-layer perceptron classifiers. Two algorithms were tested: the first opposes a population of classifiers to a population of training patterns; the second pits a population of classifiers against a population of subsets of training patterns. The classifiers are regarded as predators that need to ‘capture’ (correctly categorise) the prey (training patterns). Success for the predators is measured on their ability to capture prey. Success for the prey is measured on their ability to escape predation (be misclassified). The aim of the procedure is to create an evolutionary tug-of-war between the best classifiers and the most difficult data samples, increasing the efficiency and accuracy of the learning process. The two co-evolutionary algorithms were tested on a number of well-known benchmarks and on several artificial data sets modelling different kinds of common classification problems such as overlapping data categories, noisy training inputs, and unbalanced data classes. The performance of the co-evolutionary methods was compared with that of two traditional training techniques: the standard backpropagation rule and a conventional evolutionary algorithm. The co-evolutionary procedures achieved top accuracy in all classification problems. They particularly excelled on data sets containing noisy training inputs, where they outperformed the backpropagation rule, and on tasks involving unbalanced data classes, where they outperformed both backpropagation and the conventional evolutionary algorithm. Compared to the standard evolutionary algorithm, the co-evolutionary procedures were able to obtain similar or superior learning accuracies, whilst needing considerably less presentations of the training patterns. This economy in the use of training patterns translated into significant savings in computational overheads and algorithms running time.

Simultaneous Generation of Accurate and Interpretable Neural Network Classifiers

A Classification Surrogate Model based Evolutionary Algorithm for Neural Network Structure Learning

Evolutionary Multi-Objective Optimization for Simultaneous Generation of Signal-Type and Symbol-Type Representations

Neural Network Regularization and Ensembling Using Multi-Objective Evolutionary Algorithms

Generation of Consistent Sets of Multi-Label Classification Rules with a Multi-Objective Evolutionary Algorithm

Evolutionary Multi-Objective Optimization of Spiking Neural Networks

Multiobjective Evolution of the Explainable Fuzzy Rough Neural Network with Gene Expression Programming

Multi-Objective Evolutionary Optimization Of Exemplar-Based Classifiers: A Pnn Test Case

Multi-Objective Evolutionary Optimization of Probabilistic Neural Network

Learning Interpretable Models Through Multi-Objective Neural Architecture Search

Evolutionary convolutional neural network for image classification based on multi-objective genetic programming with leader–follower mechanism

Optimizing Multi-Instance Neural Networks Based on an Improved Genetic Algorithm

A Selective Ensemble Classifier Using Multiobjective Optimization Based Extreme Learning Machine Algorithm

Pareto Analysis of Evolutionary and Learning Systems

Evolutionary Multi-objective Optimisation in Neurotrajectory Prediction

Competitive co-evolution of multi-layer perceptron classifiers

Neural Optimizer Equation, Decay Function, and Learning Rate Schedule Joint Evolution

Optimizing Neural Networks with Gradient Lexicase Selection

Limited Evaluation Evolutionary Optimization of Large Neural Networks

Evolvability Degeneration in Multi-Objective Genetic Programming for Symbolic Regression

Evolving Quantized Neural Networks for Image Classification Using A Multi-Objective Genetic Algorithm