Abstract:In this paper, we study a practical yet challenging task, On-the-fly Category Discovery (OCD), aiming to online discover the newly-coming stream data that belong to both known and unknown classes, by leveraging only known category knowledge contained in labeled data. Previous OCD methods employ the hash-based technique to represent old/new categories by hash codes for instance-wise inference. However, directly mapping features into low-dimensional hash space not only inevitably damages the ability to distinguish classes and but also causes "high sensitivity" issue, especially for fine-grained classes, leading to inferior performance. To address these issues, we propose a novel Prototypical Hash Encoding (PHE) framework consisting of Category-aware Prototype Generation (CPG) and Discriminative Category Encoding (DCE) to mitigate the sensitivity of hash code while preserving rich discriminative information contained in high-dimension feature space, in a two-stage projection fashion. CPG enables the model to fully capture the intra-category diversity by representing each category with multiple prototypes. DCE boosts the discrimination ability of hash code with the guidance of the generated category prototypes and the constraint of minimum separation distance. By jointly optimizing CPG and DCE, we demonstrate that these two components are mutually beneficial towards an effective OCD. Extensive experiments show the significant superiority of our PHE over previous methods, e.g., obtaining an improvement of +5.3% in ALL ACC averaged on all datasets. Moreover, due to the nature of the interpretable prototypes, we visually analyze the underlying mechanism of how PHE helps group certain samples into either known or unknown categories. Code is available at <a class="link-external link-https" href="https://github.com/HaiyangZheng/PHE" rel="external noopener nofollow">this https URL</a>.

An attribute-weighted isometric embedding method for categorical encoding on mixed data

Multi-view Heterogeneous Fusion and Embedding for Categorical Attributes on Mixed Data.

Fine-Grained Attribute Weighted Inverted Specific-Class Distance Measure For Nominal Attributes

From Categorical to Numerical: Multiple Transitive Distance Learning and Embedding.

Hierarchical Feature Embedding for Attribute Recognition

Prototypical Hash Encoding for On-the-Fly Fine-Grained Category Discovery

Group Optimization for Multi-Attribute Visual Embedding

Alleviating the Attribute Conditional Independence and I.I.D. Assumptions of Averaged One-Dependence Estimator by Double Weighting

Attribute Importance Measurement Method Based on Data Coordination Degree

CAVIAR: Categorical-Variable Embeddings for Accurate and Robust Inference

Information-based Projection Method for Categorical Clustering and Outlier Detection

Encoding high-cardinality string categorical variables

Unsupervised Heterogeneous Coupling Learning for Categorical Representation

Addressing Dynamic and Sparse Qualitative Data: A Hilbert Space Embedding of Categorical Variables

Exploiting Category Information and Document Information to Improve Term Weighting for Text Categorization

Attribute-Aware Feature Encoding for Object Recognition and Segmentation

Improving Pairwise PEE Via Hybrid-Dimensional Histogram Generation and Adaptive Mapping Selection

A Cat Is A Cat (Not A Dog!): Unraveling Information Mix-ups in Text-to-Image Encoders through Causal Analysis and Embedding Optimization

Effective Methods of Categorical Data Encoding for Artificial Intelligence Algorithms

Adaptive Fusion Based Method for Imbalanced Data Classification

Fusing heterogeneous information for multi-modal attributed network embedding