Abstract:Anomalies and outliers are common in real-world data, and they can arise from many sources, such as sensor faults. Accordingly, anomaly detection is important both for analyzing the anomalies themselves and for cleaning the data for further analysis of its ambient structure. Nonetheless, a precise definition of anomalies is important for automated detection and herein we approach such problems from the perspective of detecting sparse latent effects embedded in large collections of noisy data. Standard Graphical Lasso-based techniques can identify the conditional dependency structure of a collection of random variables based on their sample covariance matrix. However, classic Graphical Lasso is sensitive to outliers in the sample covariance matrix. In particular, several outliers in a sample covariance matrix can destroy the sparsity of its inverse. Accordingly, we propose a novel optimization problem that is similar in spirit to Robust Principal Component Analysis (RPCA) and splits the sample covariance matrix $M$ into two parts, $M=F+S$, where $F$ is the cleaned sample covariance whose inverse is sparse and computable by Graphical Lasso, and $S$ contains the outliers in $M$. We accomplish this decomposition by adding an additional $ \ell_1$ penalty to classic Graphical Lasso, and name it "Robust Graphical Lasso (Rglasso)". Moreover, we propose an Alternating Direction Method of Multipliers (ADMM) solution to the optimization problem which scales to large numbers of unknowns. We evaluate our algorithm on both real and synthetic datasets, obtaining interpretable results and outperforming the standard robust Minimum Covariance Determinant (MCD) method and Robust Principal Component Analysis (RPCA) regarding both accuracy and speed.

LAD Regression and Nonparametric Methods for Detecting Outliers and Leverage Points

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

Residuals and Regression Diagnostics: Focusing on Logistic Regression

LAD-LASSO: SIMULATION STUDY OF ROBUST REGRESSION IN HIGH DIMENSIONAL DATA

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

COMPARISONS BETWEEN ROBUST REGRESSION APPROACHES IN THE PRESENCE OF OUTLIERS AND HIGH LEVERAGE POINTS

Weighted LAD-LASSO method for robust parameter estimation and variable selection in regression

Outlier detection using distributionally robust optimization under the Wasserstein metric

A descent algorithm for constrained LAD-Lasso estimation with applications in portfolio selection

Robust Variable Selection Based on Relaxed Lad Lasso

A Non-Greedy Algorithm Based L1-Norm LDA Method for Fault Detection

LAD in finance: accounting analytics and fraud detection

Anomaly Detection via Graphical Lasso

A New Outlier Detection Method Considering Outliers As Model Errors

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

DETECTION OF MULTIPLE OUTLIERS BY RANDOM ROBUST TESTING

Influence diagnostics in Birnbaum-Saunders nonlinear regression models

Detection and inference of changes in high-dimensional linear regression with non-sparse structures

Uniform Post Selection Inference for LAD Regression and Other Z-estimation problems

Reducing bias and mitigating the influence of excess of zeros in regression covariates with multi-outcome adaptive LAD-lasso