Abstract:Distributional data analysis, concerned with statistical analysis and modeling for data objects consisting of random probability density functions (PDFs) in the framework of functional data analysis (FDA), has received considerable interest in recent years. However, many important aspects remain unexplored, such as outlier detection and robustness. Existing functional outlier detection methods are mainly used for ordinary functional data and usually perform poorly when applied to PDFs. To fill this gap, this study focuses on PDF-valued outlier detection, as well as its application in robust distributional regression. Similar to ordinary functional data, detecting the shape outlier masked by the “curve net’’ formed by the bulk of the PDFs is the major challenge in PDF-outlier detection. To this end, we propose a tree-structured transformation system for feature extraction as well as converting the shape outliers to easily detectable magnitude outliers, relevant outlier detectors are designed for the specific transformed data. A multiple detection strategy is also proposed to account for detection uncertainties and to combine different detectors to form a more reliable detection tool. Moreover, we propose a distributional-regression-based approach for detecting the abnormal associations of PDF-valued two-tuples. As a specific application, the proposed outlier detection methods are applied to robustify a distribution-to-distribution regression method, and we develop a robust estimator for the regression operator by downweighting the detected outliers. The proposed methods are validated and evaluated by extensive simulation studies or real data applications. Relevant comparative studies demonstrate the superiority of the developed outlier detection method with other competitors in distributional outlier detection.

Outliers Detection Based on Modified Robust-mahalanobis-distance and Chi-squared Distribution and Its Application

Outliers Detection Based on Modified MCD and Its Performance

The Outlier Detection Algorithm and Its Application in the Statistical Monitoring Model Based on Modified Scaling

Multivariate outlier detection based on a robust Mahalanobis distance with shrinkage estimators

Modified Minimum Covariance Determinant Estimator and Its Application to Outlier Detection of Chemical Process Data

A Centroid-Based Outlier Detection Method

A robust distance-based approach for detecting multidimensional outliers

Functional Outlier Detection for Density-Valued Data with Application to Robustify Distribution-to-Distribution Regression.

An Outlier Detection Method Based on Mahalanobis Distance for Source Localization

Study and Application of Method of Extracting Outliers in Statistical Monitoring Model Based on Robust Scaling

Detecting outliers by clustering algorithms

An Outlier Detection Technique Based on Spectral Clustering

MSD-Kmeans: A Novel Algorithm for Efficient Detection of Global and Local Outliers

Outlier detection using conditional information entropy and rough set theory

An Outlier Mining Algorithm Based on Dissimilarity

SVM-OD: SVM Method to Detect Outliers

Outlier Detection with Cluster Catch Digraphs

A Parametric and Non-Parametric Approach for High-Accurate Outlier Detection.

A Spectral Clustering Based Outlier Detection Technique.

A neighborhood weighted-based method for the detection of outliers

MSD-Kmeans: A Hybrid Algorithm for Efficient Detection of Global and Local Outliers