Abstract:Existing neural classification networks predominately adopt one-hot encoding due to its simplicity in representing categorical data. However, the one-hot representation neglects inter-category correlations, which may result in poor generalization. Herein, we observe that a pre-trained baseline network has paid attention to the target image region even though it incorrectly predicts the image, revealing which categories confuse the baseline. This observation motivates us to consider inter-category correlations. Therefore, we propose a clonal network, named ClonalNet, which learns to discriminate between confusing categories derived from the pre-trained baseline. The ClonalNet architecture can be identical or smaller than the baseline architecture. When identical, ClonalNet is a clonal version of the baseline but does not share weights. When smaller, the training process of ClonalNet resembles that of the standard knowledge distillation. The difference from knowledge distillation is that we design a focusing-picking loss to optimize ClonalNet. This novel loss enforces ClonalNet to concentrate on confusing categories and make more confident predictions on ground-truth labels with the baseline reference. Experiments show that ClonalNet significantly ∗Corresponding author Email addresses: zxue2019@zju.edu.cn (Xue Zhang), shenhl@zju.edu.cn (Hui-Liang Shen) Preprint submitted to Pattern Recognition October 15, 2021 ar X iv :2 11 0. 07 30 7v 1 [ cs .C V ] 1 4 O ct 2 02 1 outperforms baseline networks and knowledge distillation.

Robust Classification Of Immunity Clonal Synergetic Network Inspired By Fuzzy Integral

Clonal selection algorithm based on feature antibodies for feature selection and parameter optimization of support vector machines

Kernel-based Immunity Synergetic Network for Image Classification

A Novel Immune Algorithm for Complex Optimization Problems

A novel pattern recognition algorithm: Combining ART network with SVM to reconstruct a multi-class classifier

Immunity clonal synergetic learning of unbalanced attention parameters in synergetic network

An Effective Learning Algorithm of Synergetic Neural Network

Reconstruction Of Order Parameters Based On Immunity Clonal Strategy For Image Classification

A Kernel-Based Intuitionistic Fuzzy C-Means Clustering Using Improved Multi-Objective Immune Algorithm

Manifold distance based artificial immune incremental data clustering algorithm

A multi-objective immune algorithm for intrusion feature selection

Immuno-mimetic Deep Neural Networks (Immuno-Net)

Immune cooperation mechanism based learning framework.

ClonalNet: Classifying Better by Focusing on Confusing Categories

Distribution Network Reconfiguration Based on Self-Adapting Immune Clone Selection Algorithm

A two-phase clustering algorithm based on artificial immune network

An Online Training RBF Network Based on Immune System

A General Fuzzy Cerebellar Model Neural Network Multidimensional Classifier Using Intuitionistic Fuzzy Sets for Medical Identification

Multi-robot cooperation using immune network with memory

Morphological classification of neurons based on Sugeno fuzzy integration and multi-classifier fusion

Immune Centroids Over-Sampling Method for Multi-Class Classification.