Abstract:This work aims to address the image classification problem under open-set protocol: classes in test set do not appear in the training set. Intuitively, convolutional Neural Network (CNN) with softmax loss is a straight-forward solution. However, the unknown class (is not predefined in the training set) makes the boundaries of intra-class and inter-class more blurred, which brings more challenges for image classification. Although some softmax variants, such as center loss, CosFace loss etc., focus on learning discriminative features by minimizing the intra-class distance, they do not explicitly maximize inter-class distance, which is more important for open-set problem verified by our experiments. Besides, even though deep metric learning, such as with the contrastive loss and the triplet loss, can learn discriminative features of intra-class and inter-class, it needs a time-consuming image sampling process during training. In this paper, we propose a novel normalized maximal margin (NMM) loss for open-set image classification, which not only explicitly minimizes intra-class distance and maximizes inter-class distance, but also defines their margins. Specially, after analyzing the advantage of angular space that the softmax loss normalized by the feature and weights through geometric interpretation, we make NMM work in angular space. Then, the validity of NMM for discriminative features learning is demonstrated from the view of geometric interpretation as well. After that, we innovatively determine the upper bound of inter-class margin by theoretical analysis. Finally, extensive experiments are conducted on popular datasets: CIFAR-100 (object recognition), ImageNet (image classification), LFW (face recognition) and MSMT17 (person re-identification) to verify the effectiveness of NMM. The experimental results show that NMM achieves very competitive performance.

Channel modulus normalization for CNN image classification

BCN: Batch Channel Normalization for Image Classification

Improving Classification Performance of Softmax Loss Function Based on Scalable Batch-Normalization

Normalized Convolutional Neural Network

Normalized Maximal Margin Loss for Open-Set Image Classification

Training Images Generation for CNN Based Automatic Modulation Classification

ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions

An Investigation of the Impact of Normalization Schemes on GCN Modelling

Normalized Activation Function: Toward Better Convergence

MINTIN: Maxout-Based and Input-Normalized Transformation Invariant Neural Network

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

Improving Network Slimming with Nonconvex Regularization

Modulated Convolutional Networks

Multi-scale Unified Network for Image Classification

Optimization of CNN through Novel Training Strategy for Visual Classification Problems

Enhanced Convolutional Neural Tangent Kernels

Patching Weak Convolutional Neural Network Models through Modularization and Composition

SlimConv: Reducing Channel Redundancy in Convolutional Neural Networks by Features Recombining

High-Performance Large-Scale Image Recognition Without Normalization

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Multiscale Conditional Regularization for Convolutional Neural Networks