Abstract:The multi-class classification task is one of the most common tasks in machine learning. As a typical solution based on a partitioning strategy, Error-Correcting Output Codes (ECOC) can transform a multi-class classification problem into multiple binary classification problems. The key of ECOC is to construct an effective codematrix to represent a set of class decomposition schemes, which transforms a multiclass problem into a group of binary class problems. Consequently, the design of a fast and effective ECOC codematrix generation method is of great research significance and value for solving multi-class classification problems. In ECOC algorithms, the design of codematrix is treated as a combination problem between different code columns, in which the evolutionary algorithm shows a great advantage. Based on this consideration, the Gene Expression Programming (GEP) is applied to search for the codematrix with high performance because its expressive tree structure makes it well represent codematrcies for subsequent optimization operations. This paper proposes an adaptive ECOC algorithm based on Gene Expression Programming (GEP) and similarity measurement matrix, named GEP-ECOC. In our GEP, each individual represents a set of columns to form a random ECOC codematrix, which is optimized in the evolutionary process. Meanwhile, the crossover and mutation operations are modified to include a legality checking process to ensure that the generated codematrix satisfies the ECOC constraints. The GEP-based ECOC codematrix generation algorithm can quickly produce a codematrix with better performance, which ensures the efficiency of the algorithm to a certain extent. In addition, an adaptive algorithm based on a similarity measurement matrix is proposed to add new columns to the current codematrix, aiming to better handle hard classes. Our algorithm is compared with other algorithms on various data sets, and the experimental results confirm that our GEP-ECOC can balance the efficiency and performance of the algorithm and achieve higher performance.

Using Hybrid Hadamard Error Correcting Output Codes for Multi-class Problem Based on Support Vector Machines

Using Hadamard ECOC in Multi-Class Problems Based on SVM.

Application of Hadamard ECOC in Multi-Class Problems Based on SVM

On Hadamard-Type Output Coding in Multiclass Learning.

A Multi-Class Classification Method of Support Vector Machine Based on Error Correcting Output Codes

A Multiclass SVM Method Via Probabilistic Error-Correcting Output Codes

An Improved Error-Correcting Output Coding Framework with Kernel-Based Decoding

Adaptive Error-Correcting Output Codes

Distance Function Learning in Error-Correcting Output Coding Framework

Heuristic Ternary Error-Correcting Output Codes Via Weight Optimization and Layered Clustering-Based Approach

Spectral Error Correcting Output Codes for Efficient Multiclass Recognition

Joint learning of error-correcting output codes and dichotomizers from data

The Minimum Closed Sphere Model for Multi-Class Classifiers Using Error-Correcting Output Codes

A novel soft-coded error-correcting output codes algorithm

Speech Recognition Based on Support Vector Machine and Error Correcting Output Codes

Classification of Multi-Spectral/Hyperspectral Data Using Genetic Programming and Error-Correcting Output Codes

Robust Multi-View Face Detection Using Error Correcting Output Codes

Active Learning with Error-Correcting Output Codes

Constructing the shortest ECOC for fast multi-classification

Deep Error-Correcting Output Codes.

An Adaptive Error-Correcting Output Codes Algorithm Based on Gene Expression Programming and Similarity Measurement Matrix