Abstract:Identifying statistically significant anomalies in an unlabeled data set is of key importance in many applications such as financial security and remote sensing. Rare category detection (RCD) helps address this issue by passing candidate data examples to a labeling oracle (e.g., a human expert) for labeling. A challenging task in RCD is to discover all categories without any prior information about the given data set. A few approaches have been proposed to address this issue, which are on quadratic or cubic time complexities w.r.t. the data set size N and require considerable labeling queries involving time-consuming and expensive labeling effort of a human expert. In this paper, aiming at solutions with lower time complexity and less labeling queries, we propose two prior-free (i.e., without any prior information about a given data set) RCD algorithms, namely (1) iFRED which achieves linear time complexity w.r.t. N, and (2) vFRED which substantially reduces the number of labeling queries. This is done by tabulating each dimension of the data set into bins, followed by zooming out to shrink each bin down to a position and conducting wavelet analysis on the data density function to fast locate the position (i.e., a bin) of a rare category, and zooming in the located bin to select candidate data examples for labeling. Theoretical analysis guarantees the effectiveness of our algorithms, and comprehensive experiments on both synthetic and real data sets further verify the effectiveness and efficiency.

Rare Category Detection on O(dN) Time Complexity.

Prior-free Rare Category Detection: More Effective and Efficient Solutions

Rare Category Detection Forest.

Radar: Rare Category Detection Via Computation Of Boundary Degree

CLOVER: a faster prior-free approach to rare-category detection

Rare Category Detection Algorithm Based on Weighted Boundary Degree

Rare Category Exploration Via Wavelet Analysis: Theory and Applications

Rare Category Exploration On Linear Time Complexity

Semisupervised Prior Free Rare Category Detection with Mixed Criteria

Rare Category Exploration with Noisy Labels.

Rare Category Exploration

Fast Rare Category Detection Using Nearest Centroid Neighborhood

LERI: Local Exploration for Rare-Category Identification

Fast-RCM: Fast Tree-Based Unsupervised Rare-Class Mining

Ordinal Outlier Detection Based On Recursive Uniform Partitioning

COG: Local Decomposition for Rare Class Analysis

Density-driven Regularization for Out-of-distribution Detection

RODD: Robust Outlier Detection in Data Cubes

When and How Does In-Distribution Label Help Out-of-Distribution Detection?

Out-of-Distribution Detection with Class Ratio Estimation

Test-Time Linear Out-of-Distribution Detection