Abstract:Existing unsupervised outlier detection (OD) solutions face a grave challenge with surging visual data like images. Although deep neural networks (DNNs) prove successful for visual data, deep OD remains difficult due to OD's unsupervised nature. This paper proposes a novel framework named E 3Outlier that can perform effective and end-to-end deep outlier removal. Its core idea is to introduce self-supervision into deep OD. Specifically, our major solution is to adopt a discriminative learning paradigm that creates multiple pseudo classes from given unlabeled data by various data operations, which enables us to apply prevalent discriminative DNNs (e.g., ResNet) to the unsupervised OD problem. Then, with theoretical and empirical demonstration, we argue that inlier priority, a property that encourages DNN to prioritize inliers during self-supervised learning, makes it possible to perform end-to-end OD. Meanwhile, unlike frequently-used outlierness measures (e.g., density, proximity) in previous OD methods, we explore network uncertainty and validate it as a highly effective outlierness measure, while two practical score refinement strategies are also designed to improve OD performance. Finally, in addition to the discriminative learning paradigm above, we also explore the solutions that exploit other learning paradigms (i.e., generative learning and contrastive learning) to introduce self-supervision for E 3Outlier. Such extendibility not only brings further performance gain on relatively difficult datasets, but also enables E 3Outlier to be applied to other OD applications like video abnormal event detection. Extensive experiments demonstrate that E 3Outlier can considerably outperform state-of-the-art counterparts by 10%-30% AUROC. Demo codes are available at https://github.com/demonzyj56/E3Outlier.

OUTLIER MANAGEMENT OF INTELLIGENT DATA ANALYSIS

Research Progress on Outlier Mining

Outliers Learning And Its Applications

Intelligent Identification and Order-Sensitive Correction Method of Outliers from Multi-Data Source Based on Historical Data Mining

Outlier detection for incomplete real-valued data via information entropy and class-consistent technology

Outlier Detection and Spatial Analysis Algorithms

On Saving Outliers for Better Clustering over Noisy Data.

Outlier detection using conditional information entropy and rough set theory

Human-in-the-loop Outlier Detection.

Outlier Detection using AI: A Survey

Comparison of Data Visualization, Outlier Detection and Data Dimensionality Reduction Methods

A critical overview of outlier detection methods

Comparative Analysis of three outlier detection methods in univariate data sets

Outlier Detection Method Based on Compressed Time Series and Voronoi Diagram for Power Data

Detecting outliers by clustering algorithms

Sample Weighting: an Inherent Approach for Outlier Suppressing Discriminant Analysis

E 3 Outlier : A Self-Supervised Framework for Unsupervised Deep Outlier Detection

A Fast Outlier Detection Method for Big Data.

A novel outlier detection method for monitoring data in dam engineering

Outlier Classification for Microbiological Open Set Recognition

Homophily Outlier Detection in Non-IID Categorical Data