Abstract:Anomaly detection (AD) in images, identifying significant deviations from normality, is a critical issue in computer vision. This paper introduces a novel approach to dimensionality reduction for AD using pre-trained convolutional neural network (CNN) that incorporate EfficientNet models. We investigate the importance of component selection and propose two types of tree search approaches, both employing a greedy strategy, for optimal eigencomponent selection. Our study conducts three main experiments to evaluate the effectiveness of our approach. The first experiment explores the influence of test set performance on component choice, the second experiment examines the performance when we train on one anomaly type and evaluate on all other types, and the third experiment investigates the impact of using a minimum number of images for training and selecting them based on anomaly types. Our approach aims to find the optimal subset of components that deliver the highest performance score, instead of focusing solely on the proportion of variance explained by each component and also understand the components behaviour in different settings. Our results indicate that the proposed method surpasses both Principal Component Analysis (PCA) and Negated Principal Component Analysis (NPCA) in terms of detection accuracy, even when using fewer components. Thus, our approach provides a promising alternative to conventional dimensionality reduction techniques in AD, and holds potential to enhance the efficiency and effectiveness of AD systems.

Model Selection of Gaussian Kernel PCA for Novelty Detection

The Optimization for Parameter of Kernel Function with GA

L1 norm based KPCA for novelty detection

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Adaptive Kpca Modeling of Nonlinear Systems

Moving window kernel PCA for adaptive monitoring of nonlinear processes

Multimode Process Monitoring with PCA Mixture Model

Gaussian Image Anomaly Detection with Greedy Eigencomponent Selection

Efficient Model Selection for Support Vector Machine with Gaussian Kernel Function

Multi-kernel PCA based high-dimensional images feature reduction

Incremental Kernel Null Space Discriminant Analysis for Novelty Detection

Learning a Data-Dependent Kernel Function for KPCA-based Nonlinear Process Monitoring

Adaptive kernel subspace method for speeding up feature extraction

Parameter selection of Gaussian kernel for one-class SVM.

Heuristic Hyperparameter Choice for Image Anomaly Detection

Kernel PCA for Out-of-Distribution Detection

KPCA Based on Feature Samples for Fault Detection

Two Methods of Selecting Gaussian Kernel Parameters for One-Class Svm and Their Application to Fault Detection

Robust and Sparse Kernel PCA and Its Outlier Map

AutoMS: Automatic Model Selection for Novelty Detection with Error Rate Control

A Selective KPCA Algorithm Based on High-Order Statistics for Anomaly Detection in Hyperspectral Imagery