Abstract:Lately, the enormous generation of databases in almost every aspect of life has created a great demand for new powerful tools for turning data into useful information. Therefore, researchers were encouraged to explore and develop new machine learning ideas and methods. Mixture models are one of the machine learning techniques receiving considerable attention due to their ability to handle efficiently and effectively multidimensional data. In this paper, we represent a solution for two challenging issues: modeling non-Gaussian data and determining the set of relevant features in the data. The problem of modeling non-Gaussian data largely present in several computer vision, image processing, medical, and Bioinformatics applications is accomplished by the development of a generative infinite Gamma mixture model. The Gamma is chosen for its ability to handle long-tailed distributions, which allows it to have a good approximation to data with outliers. The proposed model, which can be viewed as a Dirichlet process mixture of Gamma distributions, takes into account the feature selection problem by determining a set of relevant features for each data cluster which provides better interpretability and generalization capabilities. We propose then an efficient algorithm to learn this infinite model’s parameters by estimating all its posterior quantities of interest using Markov Chain Monte Carlo (MCMC) simulations. Thus, our algorithm is able to perform model selection, parameter learning, and feature selection simultaneously in a single step for the Gamma Mixture model. Furthermore, we show how the model can be used, while comparing it with other popular models in the literature, in two challenging applications namely medical images and gene expressions classification.

Application of SsVGMM to Medical Data - Classification with Novelty Detection.

Privacy preserving and fast decision for novelty detection using support vector data description

Novelty detection for long-term diagnostic data with Gaussian and non-Gaussian disturbances using a support vector machine

Margin-Aware Intra-Class Novelty Identification for Medical Images

A hierarchical nonparametric Bayesian approach for medical images and gene expressions classification

A versatile anomaly detection method for medical images with a flow-based generative model in semi-supervision setting

Generative Models for Novelty Detection: Applications in abnormal event and situational change detection from data series

Fine-Grained Out-of-Distribution Detection of Medical Images Using Combination of Feature Uncertainty and Mahalanobis Distance.

Variational Inference for Semiparametric Bayesian Novelty Detection in Large Datasets

A Novel Pre-processing Method for Classification Problems in Medical Intelligent Tasks

Novelty and Similarity: Detection Using Data‐Driven Soft Independent Modeling of Class Analogy

Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image

A novel application of finite Gaussian mixture model (GMM) using real and simulated biomarkers of cardiovascular disease to distinguish adolescents with and without obesity

Image Recognition with Missing-Features Based on Gaussian Mixture Model and Graph Constrained Nonnegative Matrix Factorization

One-Class Support Vector Machine for Functional Data Novelty Detection

Semi-Supervised Disease Classification based on Limited Medical Image Data

Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images

A General Fuzzy Cerebellar Model Neural Network Multidimensional Classifier Using Intuitionistic Fuzzy Sets for Medical Identification

Probabilistic Modeling for Novelty Detection with Applications to Fraud Identification

A Competitive Generalized Gamma Mixture Model for Medical Image Diagnosis

Novel Class Discovery in Chest X-rays Via Paired Images and Text