Abstract:Open-set recognition (OSR) toward a practical open-world setting has attracted increasing research attention in recent years. However, existing OSR settings are either too idealized or focus on specific scenes such as long-tailed distribution and few-shot samples, which fail to capture the complexity of real-world scenarios. In this article, we propose a realistic OSR (ROSR) setting that covers a diverse range of challenging and real-world scenarios, including fine-grained cases with strong semantic correlation and a large number of species, few-shot samples, long-tailed sample distribution, dynamic inputs (e.g., images, spatio-temporal, and multimodal signals) and cross-domain adaptation. In particular, we rethink the simple and basic OpenMax for the ROSR setting and introduce a novel method, regularized discriminative OpenMax (RD-OpenMax), to handle the challenges in the ROSR setting. RD-OpenMax improves upon the basic OpenMax approach by introducing a covariance attention-based covariance pooling (CACP) module as a global aggregation step before the deep architecture's classifier. This module explores rich statistical information on features and provides discriminative distance scores for OpenMax. To address the instability of extreme value theory (EVT) estimation due to insufficient training samples under few-shot and long-tailed scenarios, we propose a regularized EVT (REVT) method based on Monte Carlo sampling to recalibrate the distribution of distance scores. As such, our RD-OpenMax performs a REVT model of distance scores generated by discriminative CACP representations to distinguish known classes and recognize unknown ones effectively and robustly. Extensive experiments are conducted on more than ten visual benchmarks across several scenarios, and the empirical comparisons show that the ROSR setting challenges existing state-of-the-art OSR approaches. Moreover, our RD-OpenMax clearly outperforms its counterparts under the ROSR setting while performing favorably against state-of-the-arts under the traditional OSR setting.

Effects of Common Regularization Techniques on Open-Set Recognition

Convolutional Prototype Network for Open Set Recognition

Continual Learning in Human Activity Recognition: an Empirical Analysis of Regularization

Understanding Open-Set Recognition by Jacobian Norm and Inter-Class Separation

Know Yourself Better: Diverse Discriminative Feature Learning Improves Open Set Recognition

Network as Regularization for Training Deep Neural Networks: Framework, Model and Performance

Contrastive Open Set Recognition

Open-Set Biometrics: Beyond Good Closed-Set Models

Class-Specific Semantic Reconstruction for Open Set Recognition

Measuring Human Perception to Improve Open Set Recognition

RD-OpenMax: Rethinking OpenMax for Robust Realistic Open-Set Recognition

Taking Class Imbalance Into Account in Open Set Recognition Evaluation

Impact of Regularization on Calibration and Robustness: from the Representation Space Perspective

The design of error-correcting output codes algorithm for the open-set recognition

OpenMix+: Revisiting Data Augmentation for Open Set Recognition

Open-set Label Noise Can Improve Robustness Against Inherent Label Noise

A Dual-threshold Based Evidential Openmax Approach for Open Set Recognition

Open Long-Tailed Recognition In A Dynamic World

P-ODN: Prototype based Open Deep Network for Open Set Recognition

Regularized Structured Perceptron: A Case Study on Chinese Word Segmentation, POS Tagging and Parsing.

OpenSlot: Mixed Open-set Recognition with Object-centric Learning