Abstract:PDF HTML XML Export Cite reminder Multi-granularity Inter-class Correlation Based Contrastive Learning for Open Set Recognition DOI: 10.21655/ijsi.1673-7288.00266 Author: Affiliation: Clc Number: Fund Project: Article | Figures | Metrics | Reference | Related | Cited by | Materials | Comments Abstract:In recent years, deep neural networks have continuously achieved breakthroughs in the classification task. However, they will mistakenly give a wrong known class prediction when faced with unknown samples in the testing phase. The open set recognition is a possible way to solve the problem, which requires the model to not only classify the known classes but also distinguish the unknown samples accurately. Most of the existing methods are designed heuristically on the basis of certain assumptions. Despite keeping the performance increasing, they have not analyzed the key factors that affect the task. In this paper, we analyze the commonalities of existing methods by designing a new decision variable experiment and find that the ability of the model to learn representations of known classes is an important factor. Then an open set recognition method is proposed based on the representation learning ability enhancement of the model. Firstly, due to the powerful representation learning capabilities demonstrated by the contrastive learning and the label information contained in the open set recognition task, supervised contrastive learning is introduced to improve the modeling ability of the model for known classes. Secondly, considering that the inter-class correlation is the representation learning at the class level, and the hierarchical structure relationship among the classes is often presented, a loss function of the multi-granularity inter-class correlation is designed. In the way of building the hierarchical structure in the label semantic space and measuring the multi-granularity inter-class correlation, the loss function of multi-granularity inter-class correlation constrains the model to learn the correlation among different known classes to further improve the representation learning ability of the model. Finally, experimental results on multiple standard datasets verify the effectiveness of the proposed method in open set recognition. Reference Related Cited by

Adaptive Open Set Recognition with Multi-modal Joint Metric Learning.

Convolutional Prototype Network for Open Set Recognition

Multi-view Discriminant Framework for Automatic Modulation Open Set Recognition

Logit prototype learning with active multimodal representation for robust open-set recognition

Exploring Diverse Representations for Open Set Recognition

OpenSlot: Mixed Open-set Recognition with Object-centric Learning

Synergetic proto-pull and reciprocal points for open set recognition

Towards Multimodal Open-Set Domain Generalization and Adaptation through Self-supervision

Adversarial Reciprocal Points Learning for Open Set Recognition

Understanding Open-Set Recognition by Jacobian Norm and Inter-Class Separation

Orientational Distribution Learning With Hierarchical Spatial Attention for Open Set Recognition

LMC: Large Model Collaboration with Cross-assessment for Training-Free Open-Set Object Recognition

OSMR: Open-Set Modulation Recognition Based on Information Enhancement

An Open-Set Modulation Recognition Scheme with Deep Representation Learning

A Dual-threshold Based Evidential Openmax Approach for Open Set Recognition

Multimodal Dual-Embedding Networks for Malware Open-Set Recognition

RD-OpenMax: Rethinking OpenMax for Robust Realistic Open-Set Recognition

Multi-granularity Inter-class Correlation Based Contrastive Learning for Open Set Recognition

Open set HRRP recognition with few samples based on multi-modality prototypical networks

Learning Multiple Gaussian Prototypes for Open-Set Recognition

CAMV: Class Activation Mapping Value Towards Open Set Fine-Grained Recognition