Abstract:Computer vision tasks are traditionally defined and evaluated using semantic categories. However, it is known to the field that semantic classes do not necessarily correspond to a unique visual class (e.g. inside and outside of a car). Furthermore, many of the feasible learning techniques at hand cannot model a visual class which appears consistent to the human eye. These problems have motivated the use of 1) Unsupervised or supervised clustering as a preprocessing step to identify the visual subclasses to be used in a mixture-of-experts learning regime. 2) Felzenszwalb et al. part model and other works model mixture assignment with latent variables which is optimized during learning 3) Highly non-linear classifiers which are inherently capable of modelling multi-modal input space but are inefficient at the test time. In this work, we promote an incremental view over the recognition of semantic classes with varied appearances. We propose an optimization technique which incrementally finds maximal visual subclasses in a regularized risk minimization framework. Our proposed approach unifies the clustering and classification steps in a single algorithm. The importance of this approach is its compliance with the classification via the fact that it does not need to know about the number of clusters, the representation and similarity measures used in pre-processing clustering methods a priori. Following this approach we show both qualitatively and quantitatively significant results. We show that the visual subclasses demonstrate a long tail distribution. Finally, we show that state of the art object detection methods (e.g. DPM) are unable to use the tails of this distribution comprising 50\% of the training samples. In fact we show that DPM performance slightly increases on average by the removal of this half of the data.

An Unsupervised Learning Classifier with Competitive Error Performance

Nonparametric Unsupervised Classification

Mejigclu: more effective jigsaw clustering for unsupervised visual representation learning

With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations

Self-tuned Visual Subclass Learning with Shared Samples An Incremental Approach

Class-Incremental Learning: Survey and Performance Evaluation on Image Classification

Automated Classification of Model Errors on ImageNet

PCNN: Probable-Class Nearest-Neighbor Explanations Improve Fine-Grained Image Classification Accuracy for AIs and Humans

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Learning from Error: A Two-Level Combined Model for Image Classification

A novel semi-supervised hyperspectral image classification approach based on spatial neighborhood information and classifier combination

In defense of Nearest-Neighbor based image classification

Efficient Training of Colorectal Cancer Diagnosis Model through Unsupervised Learning Composite Network

USD: U ncertainty-based One-phase Learning to Enhance Pseudo-Label Reliability for S emi-Supervised Object D etection

Deep Unlearning: Fast and Efficient Gradient-free Approach to Class Forgetting

Nearest Neighbor Classifier Embedded Network for Active Learning

A Classifier-Free Incremental Learning Framework for Scalable Medical Image Segmentation

A Tailored Complex Medical Decision Analysis Model for Diabetic Retinopathy Classification Based on Optimized Un-Supervised Feature Learning Approach

On adversarial training and the 1 Nearest Neighbor classifier

Rethinking Nearest Neighbors for Visual Classification

Reinforcement Based Learning on Classification Task Could Yield Better Generalization and Adversarial Accuracy