Abstract:Novelty detection in discrete sequences is a challenging task, since deviations from the process generating the normal data are often small or intentionally hidden. Novelties can be detected by modeling normal sequences and measuring the deviations of a new sequence from the model predictions. However, in many applications data is generated by several distinct processes so that models trained on all the data tend to over-generalize and novelties remain undetected. We propose to approach this challenge through decomposition: by clustering the data we break down the problem, obtaining simpler modeling task in each cluster which can be modeled more accurately. However, this comes at a trade-off, since the amount of training data per cluster is reduced. This is a particular problem for discrete sequences where state-of-the-art models are data-hungry. The success of this approach thus depends on the quality of the clustering, i.e., whether the individual learning problems are sufficiently simpler than the joint problem. While clustering discrete sequences automatically is a challenging and domain-specific task, it is often easy for human domain experts, given the right tools. In this paper, we adapt a state-of-the-art visual analytics tool for discrete sequence clustering to obtain informed clusters from domain experts and use LSTMs to model each cluster individually. Our extensive empirical evaluation indicates that this informed clustering outperforms automatic ones and that our approach outperforms state-of-the-art novelty detection methods for discrete sequences in three real-world application scenarios. In particular, decomposition outperforms a global model despite less training data on each individual cluster.

L1 norm based KPCA for novelty detection

Model Selection of Gaussian Kernel PCA for Novelty Detection

Privacy preserving and fast decision for novelty detection using support vector data description

Incremental Kernel Null Space Discriminant Analysis for Novelty Detection

Adversarially Robust One-class Novelty Detection

Adversarially Learned One-Class Classifier for Novelty Detection

PCA-L1 Algorithm Based on Kernel Function

A Robust Likelihood Model for Novelty Detection

A Novel Kernel-Based Maximum a Posteriori Classification Method

Point Cloud Novelty Detection Based on Latent Representations of a General Feature Extractor

Text Classification with Novelty Detection

Non-Adversarial Novelty Detection with Generative Latent Nearest Neighbors

Novelty Detection via Non-Adversarial Generative Network

AutoMS: Automatic Model Selection for Novelty Detection with Error Rate Control

Robust and Sparse Kernel PCA and Its Outlier Map

Selective Feature Bagging of one-class classifiers for novelty detection in high-dimensional data

Kernel PCA for Out-of-Distribution Detection

Novelty Detection in Sequential Data by Informed Clustering and Modeling

One-Class Support Vector Machine for Functional Data Novelty Detection

Robust Principal Component Analysis via Joint l(2,1)-Norms Minimization

Beyond the Known: Adversarial Autoencoders in Novelty Detection