Abstract:The issue of outliers has been a research focus in the field of geodesy. Based on a statistical testing method known as the w -test, data snooping along with its iterative form, iterative data snooping (IDS), is commonly used to diagnose outliers in linear models. However, in the case of multiple outliers, it may suffer from the masking and swamping effects, thereby limiting the detection and identification capabilities. This contribution is to investigate the cause of masking and swamping effects and propose a new method to mitigate these phenomena. First, based on the data division, an extended form of the w -test with its reliability measure is presented, and a theoretical reinterpretation of data snooping and IDS is provided. Then, to alleviate the effects of masking and swamping, a new outlier diagnostic method and its iterative form are proposed, namely data refining and iterative data refining (IDR). In general, if the total observations are initially divided into an inlying set and an outlying set, data snooping can be considered a process of selecting outliers from the inlying set to the outlying set. Conversely, data refining is then a reverse process to transfer inliers from the outlying set to the inlying one. Both theoretical analysis and practical examples show that IDR would keep stronger robustness than IDS due to the alleviation of masking and swamping effect, although it may pose a higher risk of precision loss when dealing with insufficient data.

Outlier Removal Method for the Refinement of Optically Measured Displacement Field Based on Critical Factor Least Squares and Subdomain Division

Distortion Correction in Surface Defects Evaluating System of Large Fine Optics

Type-based Outlier Removal Framework for Point Clouds

Outlier Removal Based on Chauvenet's Criterion and Dense Disparity Refinement Using Least Square Support Vector Machine.

A Novel Image Registration Method Based on Geometrical Outlier Removal

Out-of-core Outlier Removal for Large-Scale Indoor Point Clouds

Outlier detection and disparity refinement in stereo matching

Suppression for Phase Error of Fringe Projection Profilometry Using Outlier-Detection Model: Development of an Easy and Accurate Method for Measurement

Displacement fields denoising and strains extraction by finite element method

Robust moving total least squares: A technique for the reconstruction of measurement data in the presence of multiple outliers

Outlier Detection of GPS Monitoring Data Using Relational Analysis and Negative Selection Algorithm

A Two-Step Outlier Removal Procedure for Surface Reconstruction

Efficient Algorithms for Global Outlier Removal in Large-scale Structure-from-Motion

Outliers handling in the structure-from-motion algorithm

An extended w-test for outlier diagnostics in linear models

A Geometrical-Statistical approach to outlier removal for TDOA measuments

Outlier detection in spatial error models using modified thresholding-based iterative procedure for outlier detection approach

Point Clouds Outlier Removal Method Based on Improved Mahalanobis and Completion

Automatic Identification and Removal of Outliers for High-Speed Fringe Projection Profilometry

Accurate Defect Detection in Thin-Wall Structures with Transducer Networks Via Outlier Elimination

Comparative Analysis of three outlier detection methods in univariate data sets