A Relative Efficiency in Linear Weighted Regression

夏蕾,田保光,王楠楠,许丽娟

DOI: https://doi.org/10.3969/j.issn.1671-1815.2009.20.042

2009-01-01

Abstract:A new relative efficiencies in linear model in reference is instructed it into the linear weighted regression.It's lower bounds and the relation between some generalized coefficients are also proposed.

What problem does this paper attempt to address?

A Relative Feasibility Degree Based Approach for Constrained Optimization Problems.

Cheng-gang Cui,Yan-jun Li,Tie-jun Wu

DOI: https://doi.org/10.1631/jzus.c0910072

2010-01-01

Abstract:Based on the ratio of the size of the feasible region of constraints to the size of the feasible region of a constrained optimization problem, we propose a new constraint handling approach to improve the efficiency of heuristic search methods in solving the constrained optimization problems. In the traditional classification of a solution candidate, it is either a feasible or an infeasible solution. To refine this classification, a new concept about the relative feasibility degree of a solution candidate is proposed to represent the amount by which the ‘feasibility’ of the solution candidate exceeds that of another candidate. Relative feasibility degree based selection rules are also proposed to enable evolutionary computation techniques to accelerate the search process of reaching a feasible region. In addition, a relative feasibility degree based differential evolution algorithm is derived to solve constraint optimization problems. The proposed approach is tested with nine benchmark problems. Results indicate that our approach is very competitive compared with four existing state-of-the-art techniques, though still sensitive to the intervals of control parameters of the differential evolution.
A Relative Error Estimation Approach for Multiplicative Single Index Model

Zhanfeng Wang,Zimu Chen,Yaohua Wu

DOI: https://doi.org/10.1007/s11424-017-5309-3

2017-01-01

Journal of Systems Science and Complexity

Abstract:As an alternative to absolute error methods, such as the least square and least absolute deviation estimations, a product relative error estimation is proposed for a multiplicative single index regression model. Regression coefficients in the model are estimated via a two-stage procedure and their statistical properties such as consistency and normality are studied. Numerical studies including simulation and a body fat example show that the proposed method performs well.
A compromise criterion for weighted least squares estimates

Jordan Bryan,Haibo Zhou,Didong Li

2024-10-29

Abstract:In the heteroscedastic linear model, the weighted least squares estimate of the model coefficients is more efficient than the ordinary least squares estimate. However, the practical application of weighted least squares is challenging because it requires knowledge of the error variances. Feasible weighted least squares estimates, which use approximations of the variances when they are unknown, may either be more or less efficient than the ordinary least squares estimate depending on the quality of the approximation. A direct comparison between feasible and ordinary least squares has significant implications for the application of regression analysis in varied fields, yet such a comparison remains an unresolved challenge. In this study, we address this challenge by identifying the conditions under which feasible weighted least squares estimates using fixed weights demonstrate greater efficiency than the ordinary least squares estimate. These conditions provide guidance for the design of feasible estimates using random weights. They also shed light on how certain robust regression estimates behave with respect to the linear model with normal errors of unequal variance.

Statistics Theory,Methodology
Small-sample Properties for Generalized Ridge Estimator of Regression Coefficients in Linear Regression Model

WEI Jian,MIAO Bai-qi

DOI: https://doi.org/10.3969/j.issn.0253-2778.2006.09.006

2006-01-01

Journal of University of Science and Technology of China

Abstract:Under the mean square error matrix(MSEM) criterion and Pitman closeness(PC) criterion,the superiorities of the generalized ridge estimator over the least square estimator was studied,and the boundaries of their relative efficiencies for the linear regression model were presented.
A Relative Error-Based Estimation with an Increasing Number of Parameters

Hao Ding,Zhanfeng Wang,Yaohua Wu

DOI: https://doi.org/10.1080/03610926.2017.1301474

2017-01-01

Communication in Statistics- Theory and Methods

Abstract:The least product relative error (LPRE) estimator and test statistic to test linear hypotheses of regression parameters in the multiplicative regression model are studied when the number of covariate variables increases with the sample size. Some properties of the LPRE estimator and test statistic are obtained such as consistency, Bahadur presentation, and asymptotic distributions. Furthermore, we extend the LPRE to a more general relative error criterion and provide their statistical properties. Numerical studies including simulations and two real examples show that the proposed estimation performs well.
Least Product Relative Error Estimation

Kani Chen,Yuanyuan Lin,Zhanfeng Wang,Zhiliang Ying

DOI: https://doi.org/10.1016/j.jmva.2015.10.017

2016-01-01

Abstract:A least product relative error criterion is proposed for multiplicative regression models. It is invariant under scale transformation of the outcome and covariates. In addition, the objective function is smooth and convex, resulting in a simple and uniquely defined estimator of the regression parameter. It is shown that the estimator is asymptotically normal and that the simple plug-in variance estimation is valid. Simulation results confirm that the proposed method performs well. An application to body fat calculation is presented to illustrate the new method.
A New Class of Estimators Based on a General Relative Loss Function

Tao Hu,Baosheng Liang

DOI: https://doi.org/10.3390/math9101138

IF: 2.4

2021-01-01

Mathematics

Abstract:Motivated by the relative loss estimator of the median, we propose a new class of estimators for linear quantile models using a general relative loss function defined by the Box–Cox transformation function. The proposed method is very flexible. It includes a traditional quantile regression and median regression under the relative loss as special cases. Compared to the traditional linear quantile estimator, the proposed estimator has smaller variance and hence is more efficient in making statistical inferences. We show that, in theory, the proposed estimator is consistent and asymptotically normal under appropriate conditions. Extensive simulation studies were conducted, demonstrating good performance of the proposed method. An application of the proposed method in a prostate cancer study is provided.
On the relative and multiplicative model reductions

Xiang Chen,Kemin Zhou

DOI: https://doi.org/10.1109/ssst.1995.390617

1995-01-01

Abstract:A new relative error model reduction method is proposed using frequency weighted balanced realization and inner-outer factorizations. Explicit L/sub /spl infin// norm error bounds are also derived for the relative error and multiplicative error. A computer example is also given in the paper showing that the improved error bounds by Wang and Safonov (1990, 1992) are in fact wrong. We consider the problem of reducing the order of a linear multivariable dynamical system.
The Estimate Of The Rank For Regression Coefficient Matrix In A Median Regression-Model

Bq Miao

1992-01-01

Chinese Annals of Mathematics Series B

Abstract:It is discussed to infer the rank of regression coefficient matrix in a multivariate linear regression model. If the zero median vector is unique and the design matrices satisfy some weaker conditions, it is derived that the estimators of the rank of regression coefficient matrix under the minimum distance criterion by using model selection method is strongly consistent.
Varying-Coefficient Logistic Model Estimation and Its Application

花俊洲,吴冲锋

DOI: https://doi.org/10.3321/j.issn:1006-2467.2004.08.049

2004-01-01

Abstract:Based on linear Logistic model and by assuming the coefficients of the regressors to be arbitrary functions of the points in some metric space, a new type of regression model, called varying-coefficient Logistic model, was proposed. The local maximum likelihood approach was suggested to fit the model and the related issues such as determination of the local weights and the smoothing parameter were studied. At last, the model was applied for distinguishing analysis. The proposed model has higher flexibility and adaptability.
The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

LIU Xiejin,MIAO Baiqi

DOI: https://doi.org/10.19603/j.cnki.1000-1190.2013.05.003

2013-01-01

Abstract:The superiority of Bayes linear unbiased minimum variance(BLUMV) estimator with respect to least square(LS) estimator of unknown parameters was studied in terms of the mean square error matrix criterion,and the bounds of three relative efficiencies were obtained respectively.The superiority of the BLUMV estimator over LS estimator was studied in terms of the predictive Pitman closeness(PRPC) criterion.
Weighted Quantile Regression in Varying-Coefficient Model with Longitudinal Data

Fangzheng Lin,Yanlin Tang,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.csda.2020.106915

IF: 2.035

2020-01-01

Computational Statistics & Data Analysis

Abstract:A weighted approach is developed to improve estimation efficiency in varying-coefficient quantile regression model, with longitudinal data. The weights are obtained from empirical likelihood of varying-coefficient mean model, where the nonparametric functions are approximated by basis splines, and the matrix expansion idea in quadratic inference function method is used, to model the inverse of conditional correlation matrix within subject. Theoretical results show that, the weighted estimators of the varying coefficients in quantile regression, can achieve higher efficiency than conventional estimators without weighting scheme. Simulation studies are used to assess the finite sample performance and a real data analysis is also conducted.
Least Absolute Relative Error Estimation

Kani Chen,Shaojun Guo,Yuanyuan Lin,Zhiliang Ying

DOI: https://doi.org/10.1198/jasa.2010.tm09307

IF: 4.369

2010-01-01

Journal of the American Statistical Association

Abstract:Multiplicative regression model or accelerated failure time model, which becomes linear regression model after logarithmic transformation, is useful in analyzing data with positive responses, such as stock prices or life times, that are particularly common in economic/financial or biomedical studies. Least squares or least absolute deviation are among the most widely used criterions in statistical estimation for linear regression model. However, in many practical applications, especially in treating, for example, stock price data, the size of relative error, rather than that of error itself, is the central concern of the practitioners. This paper offers an alternative to the traditional estimation methods by considering minimizing the least absolute relative errors for multiplicative regression models. We prove consistency and asymptotic normality and provide an inference approach via random weighting. We also specify the error distribution, with which the proposed least absolute relative errors estimation is efficient. Supportive evidence is shown in simulation studies. Application is illustrated in an analysis of stock returns in Hong Kong Stock Exchange.
A New Estimator for Efficient Dimension Reduction in Regression.

Wei Luo,Xizhen Cai

DOI: https://doi.org/10.1016/j.jmva.2015.12.014

IF: 1.387

2016-01-01

Journal of Multivariate Analysis

Abstract:In this paper we propose a new estimator for efficient dimension reduction in regression, based on the work in Luo et al. (2014). Previous efficient estimators have been proposed by multiple authors, however under additional restrictive assumptions on the conditional variance of the response variable given the predictor vector. These assumptions also complicate the implementation. In contrast, the new estimator employs no such assumptions, and thus is far more applicable and more convenient to use. By an extended double-robustness property, it reaches asymptotic efficiency under fairly general conditions. Its finite-sample effectiveness is further illustrated by simulation studies and a real data example.
A New Recursive Bounded GM Estimator for Regression

Li-hua CHENG,Jun-min ZHANG

DOI: https://doi.org/10.11830/ISSN.1000-5013.2015.03.0359

2015-01-01

Abstract:A new recursive bounded GM estimator for regression is proposed.Unlike other GM estimators,the new esti-mator is based on one more general framework and uses a cost function with bounded M-estimate function.The new esti-mator,in effect,is a recursive one-step iteration solution of the"normal equations"corresponding to the cost function.In the new estimator,a weight function is designed to reject or to reduce the influence of the outliers.Furthermore,by in-troducing an augment variable,the proposed estimator is modified to a very adaptive version for the estimation of autore-gressive parameters.The simulation results show that both the proposed estimator and its modification are more effective than other related estimators in suppressing the adverse influence of outliers;the proposed estimator,with the same set-tings,can keep a high accuracy and stable convergence performance in a variety of non-stationary environments.
Weighted expectile average estimation of linear models with missing covariates

Qiang Zhao,Zhaodi Wang,Jingjing Wu,Xiuli Wang

DOI: https://doi.org/10.1080/03610918.2024.2405566

2024-09-25

Communications in Statistics - Simulation and Computation

Abstract:In this article, we proposed a weighted expectile average estimator for linear models with missing covariates. The asymptotic normality of the proposed estimator was established in theory. Further, we derived the explicit optimal weight and thus obtained the resulted optimal weighted expectile estimator. In order to examine the finite-sample performance of the proposed estimator, simulation studies and a real data analysis were conducted and the results were compared with other existing competitors in the literature.

statistics & probability
Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Xiang Li,Yu-Ning Li,Li-Xin Zhang,Jun Zhao

DOI: https://doi.org/10.1016/j.csda.2024.107997

IF: 2.035

2024-01-01

Computational Statistics & Data Analysis

Abstract:The methodology for the inference problem in high-dimensional linear expectile regression is developed. By transforming the expectile loss into a weighted-least-squares form and applying a de-biasing strategy, Wald-type tests for multiple constraints within a regularized framework are established. An estimator for the pseudo-inverse of the generalized Hessian matrix in high dimension is constructed using general amenable regularizers, including Lasso and SCAD, with its consistency demonstrated through a novel proof technique. Simulation studies and real data applications demonstrate the efficacy of the proposed test statistic in both homoscedastic and heteroscedastic scenarios.
A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Zhenzhi Qin,Liping Zhang

2021-01-01

Pacific journal of optimization

Abstract:The high dimensional sparse linear regression problem has many important applications in electronic engineering, statistics, and compressed sensing. In this paper, we introduce a new penalized least absolute deviation (LAD) model for the high dimensional sparse linear regression problem. First, we adopt the LAD model because it is suitable for data in the presence of outliers and provides a powerful technique for outlier robustness. Second, we adopt a reweighted difference of l(1) and l(2) norms as a nonconvex regularized term which enables one to reconstruct the sparse signal of interest from substantially fewer measurements. We propose a rule for setting the penalty level and show that the new model can provide a surprisingly good estimation error without any assumptions on the moments of the noise even for Cauchy noise. We present an efficient sequential linear programming algorithm for solving the new model and prove that the generated sequence converges to a stationary point satisfying the first-order optimality condition. Numerical results are also presented to indicate the efficiency of the proposed algorithm.
A REPRESENTATION FOR THE REGRESSION COEFFICIENTS IN WEIGHTED LEAST SQUARES

Donald B. Rubin

DOI: https://doi.org/10.1002/j.2333-8504.1978.tb01148.x

1978-01-01

Research Bulletin

Abstract:ABSTRACTA representation is given for the regression coefficients in weighted least squares fits. The result has application in proving the convergence of certain reweighted least squares algorithms designed to give robust fits, and in characterizing the region of regression coefficients that can be obtained by weighted least squares given fixed data.
Statistical Inference of Seemingly Unrelated Partially Linear Additive Regression Models

徐群芳,徐勤丰

2013-01-01

Chinese Annals of Mathematics

Abstract:Motivated by an application and in order to reduce the modeling bias,the authors propose a class of semiparametric seemingly unrelated partially linear additive regression models,in which the relationship between the response and some covariates is linear,the relationship between the response and other covariates is allowed to be unknown and have an additive structure,and the errors are correlated across the equations.By combining the series/sieve approximation,least squares and estimating the contemporaneous correlation,the authors present a class of weighted semiparametric least squares estimators(WSLSEs for short) for the parametric components and a class of weighted series/sieve estimators(WSEs for short) for the nonparametric components.It is shown that these weighted estimators are asymptotically more efficient than the unweighted ones.Their asymptotic normalities are established.In addition,using these asymptotic properties to make statistical inference for the parametric and nonparametric components is also considered.The proposed methods are evaluated by wide simulation studies and applied to a national longitudinal surveys(NLS for short) data set about the wage of women in the United States.

A Relative Efficiency in Linear Weighted Regression

A Relative Feasibility Degree Based Approach for Constrained Optimization Problems.

A Relative Error Estimation Approach for Multiplicative Single Index Model

A compromise criterion for weighted least squares estimates

Small-sample Properties for Generalized Ridge Estimator of Regression Coefficients in Linear Regression Model

A Relative Error-Based Estimation with an Increasing Number of Parameters

Least Product Relative Error Estimation

A New Class of Estimators Based on a General Relative Loss Function

On the relative and multiplicative model reductions

The Estimate Of The Rank For Regression Coefficient Matrix In A Median Regression-Model

Varying-Coefficient Logistic Model Estimation and Its Application

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

Weighted Quantile Regression in Varying-Coefficient Model with Longitudinal Data

Least Absolute Relative Error Estimation

A New Estimator for Efficient Dimension Reduction in Regression.

A New Recursive Bounded GM Estimator for Regression

Weighted expectile average estimation of linear models with missing covariates

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

A REPRESENTATION FOR THE REGRESSION COEFFICIENTS IN WEIGHTED LEAST SQUARES

Statistical Inference of Seemingly Unrelated Partially Linear Additive Regression Models