Separation of the Linear and Nonlinear Covariates in the Sparse Semi-Parametric Regression Model in the Presence of Outliers

Morteza Amini,Mahdi Roozbeh,Nur Anisah Mohamed

DOI: https://doi.org/10.3390/math12020172

IF: 2.4

2024-01-06

Mathematics

Abstract:Determining the predictor variables that have a non-linear effect as well as those that have a linear effect on the response variable is crucial in additive semi-parametric models. This issue has been extensively investigated by many researchers in the area of semi-parametric linear additive models, and various separation methods are proposed by the authors. A popular issue that might affect both estimation and separation results is the existence of outliers among the observations. In order to address this lack of sensitivity towards extreme observations, robust estimating approaches are frequently applied. We propose a robust method for simultaneously identifying the linear and nonlinear components of a semi-parametric linear additive model, even in the presence of outliers in the observations. Additionally, this model is sparse in that it may be used to determine which explanatory variables are ineffective by giving accurate zero estimates for their coefficients. To assess the effectiveness of the proposed method, a comprehensive Monte Carlo simulation study is conducted along with an application to investigate the dataset, which includes Boston property prices dataset.

mathematics

What problem does this paper attempt to address?

The paper attempts to address the problem of separating and estimating linear and nonlinear covariates in a semi-parametric linear additive model (SLA model) in the presence of outliers. Specifically: - **Research Background**: In semi-parametric linear additive models, it is crucial to identify which predictor variables have a linear effect on the response variable and which have a nonlinear effect. This issue has been widely discussed in the study of semi-parametric linear additive models, and various separation methods have been proposed. - **Existing Challenges**: The presence of outliers can affect the estimation results and the accuracy of the separation. To address this challenge, robust regression methods are usually employed to reduce the impact of outliers. - **Contribution of the Paper**: The authors propose a new robust method that can simultaneously identify the linear and nonlinear parts in a semi-parametric linear additive model in the presence of outliers. Additionally, the model is sparse, capable of determining which explanatory variables are invalid by providing exact zero estimates. - **Validation Method**: To evaluate the effectiveness of the proposed method, a series of Monte Carlo simulation studies were conducted, and an empirical analysis was applied to the Boston housing price dataset.

Separation of the Linear and Nonlinear Covariates in the Sparse Semi-Parametric Regression Model in the Presence of Outliers

Robust variable selection for partially linear additive models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Sparse and Robust Linear Regression: An Optimization Algorithm and Its Statistical Properties

Variable selection for both outcomes and predictors: sparse multivariate principal covariates regression

Non-separable Models with High-dimensional Data

Ultra high-dimensional semiparametric longitudinal data analysis

Robust Variable Selection Via Nonconcave Penalties with an Upgraded Parsimonious Dynamic Covariance Modeling

A One-Covariate-at-a-Time Method for Nonparametric Additive Models

Group Selection and Shrinkage: Structured Sparsity for Semiparametric Additive Models

Robust function-on-function interaction regression

Covariate-adjusted nonlinear regression

Robust Bayesian nonparametric variable selection for linear regression

Nonlinear Multivariate Function-on-function Regression with Variable Selection

Robust estimation in linear regression models for longitudinal data with covariate measurement errors and outliers

Locally Sparse Function on function Regression

Outlier Robust and Sparse Estimation of Linear Regression Coefficients

Detecting potential outliers in longitudinal data with time-dependent covariates

A High-dimensional M-estimator Framework for Bi-level Variable Selection

Variable projection algorithms with sparse constraint for separable nonlinear models