Robust estimating equations and bias correction of correlation parameters for longitudinal data

QinGuo You,ZhuZhong Yi,K FungWing

IF: 2.035

2008-01-01

Computational Statistics & Data Analysis

Abstract:The estimation of correlation parameters has received attention for both its own interest and improvement of the estimation efficiency of mean parameters by the generalized estimating equations (GE...

What problem does this paper attempt to address?

Robust Estimating Equations and Bias Correction of Correlation Parameters for Longitudinal Data

Guo You Qin,Zhong Yi Zhu,Wing K. Fung

DOI: https://doi.org/10.1016/j.csda.2008.03.019

IF: 2.035

2008-01-01

Computational Statistics & Data Analysis

Abstract:The estimation of correlation parameters has received attention for both its own interest and improvement of the estimation efficiency of mean parameters by the generalized estimating equations (GEE) approach. Many of the well-established methods for the estimation of correlation parameters can be constructed under the GEE framework which is, however, sensitive to outliers. In this paper, we consider two ways of constructing robust estimating equations for achieving robust estimation of the correlation parameters. Furthermore, the estimators of the correlation parameters from the robustified GEE may be still biased as the expectation of the estimating equation is biased from zero when the underlying distribution is not symmetric. Therefore, bias-corrected robust estimators of correlation parameters are proposed. The performance of the proposed methods are investigated by simulation. The results show that the proposed robust and bias-corrected robust estimators can reduce the bias successfully. Two real data sets are analyzed for illustration.
The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Tao ZHANG,Yi ZHANG

DOI: https://doi.org/10.16357/j.cnki.issn1000-5862.2015.04.06

2015-01-01

Abstract:A linear model for longitudinal data with continuous responses and error-prone covariates via quadratic in-ference functions methods is considered. Asymptotic normality of the parameter estimators is established by quadratic inference functions. In order to testing interested parameter,the statistic that proposed asymptotically follows a chi-squared distribution. The finite-sample properties of the procedures are studied through Monte Carlo simulations. At last,an application to a longitudinal study is used to illustrate the procedure developed here.
Robust estimation of covariance parameters in partial linear model for longitudinal data☆

G QIN,Z ZHU,W FUNG

DOI: https://doi.org/10.1016/j.jspi.2008.03.042

IF: 1.095

2009-01-01

Journal of Statistical Planning and Inference

Abstract:For longitudinal data, the within-subject dependence structure and covariance parameters may be of practical and theoretical interests. The estimation of covariance parameters has received much attention and been studied mainly in the framework of generalized estimating equations (GEEs). The GEEs method, however, is sensitive to outliers. In this paper, an alternative set of robust generalized estimating equations for both the mean and covariance parameters are proposed in the partial linear model for longitudinal data. The asymptotic properties of the proposed estimators of regression parameters, non-parametric function and covariance parameters are obtained. Simulation studies are conducted to evaluate the performance of the proposed estimators under different contaminations. The proposed method is illustrated with a real data analysis.
Robust estimation in joint mean–covariance regression model for longitudinal data

Xueying Zheng,Wing Kam Fung,Zhongyi Zhu

DOI: https://doi.org/10.1007/s10463-012-0383-8

2012-01-01

Annals of the Institute of Statistical Mathematics

Abstract:In this paper, we develop robust estimation for the mean and covariance jointly for the regression model of longitudinal data within the framework of generalized estimating equations (GEE). The proposed approach integrates the robust method and joint mean–covariance regression modeling. Robust generalized estimating equations using bounded scores and leverage-based weights are employed for the mean and covariance to achieve robustness against outliers. The resulting estimators are shown to be consistent and asymptotically normally distributed. Simulation studies are conducted to investigate the effectiveness of the proposed method. As expected, the robust method outperforms its non-robust version under contaminations. Finally, we illustrate by analyzing a hormone data set. By downweighing the potential outliers, the proposed method not only shifts the estimation in the mean model, but also shrinks the range of the innovation variance, leading to a more reliable estimation in the covariance matrix.
Robust Estimating Functions and Bias Correction for Longitudinal Data Analysis

YG Wang,X Lin,M Zhu

DOI: https://doi.org/10.1111/j.1541-0420.2005.00354.x

IF: 1.701

2005-01-01

Biometrics

Abstract:Summary Robust methods are useful in making reliable statistical inferences when there are small deviations from the model assumptions. The widely used method of the generalized estimating equations can be “robustified” by replacing the standardized residuals with the M‐residuals. If the Pearson residuals are assumed to be unbiased from zero, parameter estimators from the robust approach are asymptotically biased when error distributions are not symmetric. We propose a distribution‐free method for correcting this bias. Our extensive numerical studies show that the proposed method can reduce the bias substantially. Examples are given for illustration.
Robust estimation in linear regression models for longitudinal data with covariate measurement errors and outliers

Yuexia Zhang,Guoyou Qin,Zhongyi Zhu,Jiajia Zhang

DOI: https://doi.org/10.1016/j.jmva.2018.07.015

IF: 1.387

2018-01-01

Journal of Multivariate Analysis

Abstract:Measurement errors and outliers commonly arise during the process of longitudinal data collection and ignoring them in data analysis can lead to large deviations in estimates. Therefore, it is important to take into account the effect of measurement errors and outliers in longitudinal data analysis. In this paper, a robust estimating equation method for analyzing longitudinal data with covariate measurement errors and outliers is proposed. Specifically, the biases caused by measurement errors are reduced via using the independence between replicate measurements and the biases caused by outliers are corrected via centralizing the observed covariate matrix. The proposed method does not require specifying the distributions of the true covariates, response and measurement errors. In practice, it can be easily implemented via the standard generalized estimating equations algorithms. The asymptotic normality of the proposed estimator is established under regularity conditions. Extensive simulation studies show that the proposed method performs better in handling measurement errors and outliers than several existing methods. For illustration, the proposed method is applied to a data set from the Lifestyle Education for Activity and Nutrition (LEAN) study.
Robust Estimation in Partial Linear Mixed Model for Longitudinal Data

Qin Guoyou,Zhu Zhongyi

DOI: https://doi.org/10.1016/s0252-9602(08)60035-1

2008-01-01

Acta Mathematica Scientia

Abstract:In this article, robust generalized estimating equation for the analysis of partial linear mixed model for longitudinal data is used. The authors approximate the nonparametric function by a regression spline. Under some regular conditions, the asymptotic properties of the estimators are obtained. To avoid the computation of high-dimensional integral, a robust Monte Carlo Newton-Raphson algorithm is used. Some simulations are carried out to study the performance of the proposed robust estimators. In addition, the authors also study the robustness and the efficiency of the proposed estimators by simulation. Finally, two real longitudinal data sets are analyzed.
Robust estimation of mean and covariance for longitudinal data with dropouts

qin guoyou,zhu zhongyi

DOI: https://doi.org/10.1080/02664763.2014.999033

IF: 1.416

2015-01-01

Journal of Applied Statistics

Abstract:In this paper, we study estimation of linear models in the framework of longitudinal data with dropouts. Under the assumptions that random errors follow an elliptical distribution and all the subjects share the same within-subject covariance matrix which does not depend on covariates, we develop a robust method for simultaneous estimation of mean and covariance. The proposed method is robust against outliers, and does not require to model the covariance and missing data process. Theoretical properties of the proposed estimator are established and simulation studies show its good performance. In the end, the proposed method is applied to a real data analysis for illustration.
Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Xueying Zheng,Wing Kam Fung,Zhongyi Zhu

DOI: https://doi.org/10.5705/ss.2011.251

IF: 1.4

2014-01-01

Statistica Sinica

Abstract:In longitudinal data analysis, a correct specification of the within-subject covariance matrix cultivates an efficient estimation for mean regression coefficients. In this article, we consider robust variable selection method in a joint mean and covariance model. We propose a set of penalized robust generalized estimating equations to simultaneously estimate the mean regression coefficients, the generalized autoregressive coefficients, and innovation variances introduced by the modified Cholesky decomposition. The set of estimating equations select important covariate variables in both mean and covariance models together with the estimating procedure. Under some regularity conditions, we develop the oracle property of the proposed robust variable selection method. Finally, a simulation study and a detailed data analysis are carried out to assess and illustrate the small sample performance; they show that the proposed method performs favorably by combining the robustifying and penalized estimating techniques together in the joint mean and covariance model.
Analysis of Longitudinal Data with Covariate Measurement Error and Missing Responses: an Improved Unbiased Estimating Equation.

Huiming Lin,Guoyou Qin,Jiajia Zhang,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.csda.2017.11.010

IF: 2.035

2017-01-01

Computational Statistics & Data Analysis

Abstract:Because of the data collection process, measurement error and missing responses are common in longitudinal data, and correctly addressing these scenarios becomes one of main challenges in longitudinal data analysis. First, an unbiased estimating equation is proposed to improve the efficiency of parameter estimations for the marginal mean model for longitudinal data with covariate measurement error. The proposed unbiased estimating equation is asymptotically more efficient than the method in Qin et al. (2016a). Second, the proposed method can be extended to handle more complicated scenarios. Specifically, robust estimation for partially linear models with missing responses and covariate measurement error is considered. The proposed robust estimation does not require specifying the distribution of the covariate or the measurement error and is computationally easy to implement. Simulation studies are conducted to evaluate the improvement of the proposed method over existing methods (Qin et al., 2016b), and a sketch of the proof of its asymptotic property is provided. Finally, the proposed method is applied to the data from the Lifestyle Education for Activity and Nutrition (LEAN) study. (C) 2017 Elsevier B.V. All rights reserved.
Bayesian estimation for longitudinal data in a joint model with HPCs

Shuli Geng,Lixin Zhang

DOI: https://doi.org/10.1080/02331888.2023.2185243

IF: 2.346

2023-01-01

Statistics

Abstract:In longitudinal data analysis, linear models are typically utilized. However, deriving the Bayesian estimation with respect to the misspecification of the correlation structure is a challenging task. In this article, we construct a joint mean-covariance model with angles or hyperspherical coordinates (HPCs) for which we then present a Bayesian framework. Based on the connection with the semipartial correlations (SPCs), we focus on the selection (sparsity) priors on these angles. An efficient Markov chain Monte Carlo (MCMC) algorithm is developed for the proposed model, and the positive definiteness of the correlation matrix in posterior computation is automatically guaranteed by our method. Ultimately, we compare the performance of our joint model with some recent methods focusing only on the correlation matrix by using simulations and clinical trial data on smoking.
Orthogonality-based bias-corrected empirical likelihood inference for partial linear varying coefficient EV models with longitudinal data

Yan Zhou,Ruoxi Mei,Yichuan Zhao,Zongliang Hu,Mingtao Zhao

DOI: https://doi.org/10.1016/j.cam.2023.115751

IF: 2.872

2024-01-07

Journal of Computational and Applied Mathematics

Abstract:In this paper, we study the model estimation for the partial linear varying coefficient errors-in-variables (EV) models with longitudinal data. Based on the empirical likelihood and quadratic inference functions (QIF), we propose an orthogonality-based bias-corrected empirical likelihood estimation method using the orthogonal decomposition (QR) method of matrix. The proposed method can handle the measurement errors of covariates and unknown within-subject correlation simultaneously, estimate the parametric and nonparametric components separately. Under some regularity conditions, the resulting estimator of the parametric component is asymptotic normal and the estimators of the nonparametric varying coefficients achieve the optimal convergence rate. Furthermore, we conduct simulation studies and a real data analysis to compare the performance of the proposed method and existing methods in finite samples. The results show that the feasibility of the proposed method is obvious.

mathematics, applied
Robust empirical likelihood inference for generalized partial linear models with longitudinal data

Guoyou Qin,Yang Bai,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2011.08.003

IF: 1.387

2012-01-01

Journal of Multivariate Analysis

Abstract:In this paper, we propose a robust empirical likelihood (REL) inference for the parametric component in a generalized partial linear model (GPLM) with longitudinal data. We make use of bounded scores and leverage-based weights in the auxiliary random vectors to achieve robustness against outliers in both the response and covariates. Simulation studies demonstrate the good performance of our proposed REL method, which is more accurate and efficient than the robust generalized estimating equation (GEE) method (X. He, W.K. Fung, Z.Y. Zhu, Robust estimation in generalized partial linear models for clustered data, Journal of the American Statistical Association 100 (2005) 1176–1184). The proposed robust method is also illustrated by analyzing a real data set.
Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Shuli Geng,Lixin Zhang

DOI: https://doi.org/10.1016/j.spl.2024.110135

IF: 0.718

2024-01-01

Statistics & Probability Letters

Abstract:This paper focuses on decorrelated empirical likelihood-based inference for longitudinal data with ultrahigh-dimensional covariates. The primary issues we aim to address involve parameter estimation and hypothesis testing for a low-dimensional parameter of interest. Under the framework of the generalized linear model, we initially consider the within-subject correlation by linearizing the precision matrix with certain known matrices, which retains optimality even if the working correlated structure is misspecified. Coupled with the decorrelated matrix, we then eliminate the influence of nuisance parameters on the estimation procedure. The proposed approach not only yields more efficient estimators compared to generalized decorrelated estimating equations but also shares the same asymptotic variance as quadratic decorrelated inference function based methods. Furthermore, we define the decorrelated empirical log-likelihood ratio test statistic to assess the significance of regression coefficients. Finally, to evaluate the performance of the proposed procedure, we conduct simulation studies and apply it to a real data example.
Variable Selection in Robust Regression Models for Longitudinal Data

Yali Fan,Guoyou Qin,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2012.03.007

IF: 1.387

2012-01-01

Journal of Multivariate Analysis

Abstract:In this article, we consider variable selection in robust regression models for longitudinal data. We propose a penalized robust estimating equation to estimate the regression parameters and to select the important covariate variables simultaneously. Under some regularity conditions, we show the oracle properties of the proposed robust variable selection methods. A simulation study shows the robustness of the proposed methods against outliers. Moreover, it is found by the simulation study that incorporating the correlation structure into the procedure of variable selection will lead to better performance than ignoring the correlation structure for longitudinal data. In the end, the proposed methods are illustrated in the analysis of a real data set.
The effect of the working correlation on fitting models to longitudinal data

Samuel Muller,Suojin Wang,A. H. Welsh

DOI: https://doi.org/10.1111/sjos.12704

2024-01-03

Scandinavian Journal of Statistics

Abstract:We present a detailed discussion of the theoretical properties of quadratic inference function estimators of the parameters in marginal linear regression models. We consider the effect of the choice of working correlation on fundamental questions including the existence of quadratic inference function estimators, their relationship with generalized estimating equations estimators, and the robustness and asymptotic relative efficiency of quadratic inference function and generalized estimating equations estimators. We show that the quadratic inference function estimators do not always exist and propose a way to handle this. We then show that they have unbounded influence functions and can be more or less asymptotically efficient than generalized estimating equations estimators. We also present empirical evidence to demonstrate these results. We conclude that the choice of working correlation can have surprisingly large effects.

statistics & probability
Robust empirical likelihood inference for longitudinal data

Guoyou Qin,Yang Bai,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.spl.2009.07.005

IF: 0.718

2009-01-01

Statistics & Probability Letters

Abstract:This paper introduces the robust empirical likelihood (REL) inference for the longitudinal data. We propose the REL method by constructing robust auxiliary random vectors, and employ bounded scores and leverage-based weights in the auxiliary random vectors to achieve robustness against outliers in both the response and covariates. Simulation studies are conducted to demonstrate the good performance of our proposed REL method in terms of both robustness and efficiency improvement. The proposed method is also illustrated by analyzing a real data set from epileptic seizure study.
Joint Mean–covariance Model in Generalized Partially Linear Varying Coefficient Models for Longitudinal Data

Guoyou Qin,Jie Mao,Zhongyi Zhu

DOI: https://doi.org/10.1080/00949655.2015.1057731

2015-01-01

Abstract:In longitudinal data analysis, efficient estimation of regression coefficients requires a correct specification of certain covariance structure, and efficient estimation of covariance matrix requires a correct specification of mean regression model. In this article, we propose a general semiparametric model for the mean and the covariance simultaneously using the modified Cholesky decomposition. A regression spline-based approach within the framework of generalized estimating equations is proposed to estimate the parameters in the mean and the covariance. Under regularity conditions, asymptotic properties of the resulting estimators are established. Extensive simulation is conducted to investigate the performance of the proposed estimator and in the end a real data set is analysed using the proposed approach.
Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data

Guoyou Qin,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2007.01.006

IF: 1.387

2007-01-01

Journal of Multivariate Analysis

Abstract:In this paper, we consider robust generalized estimating equations for the analysis of semiparametric generalized partial linear mixed models (GPLMMs) for longitudinal data. We approximate the non-parametric function in the GPLMM by a regression spline, and make use of bounded scores and leverage-based weights in the estimating equation to achieve robustness against outliers and influential data points, respectively. Under some regularity conditions, the asymptotic properties of the robust estimators are investigated. To avoid the computational problems involving high-dimensional integrals in our estimators, we adopt a robust Monte Carlo Newton–Raphson (RMCNR) algorithm for fitting GPLMMs. Small simulations are carried out to study the behavior of the robust estimates in the presence of outliers, and these estimates are also compared to their corresponding non-robust estimates. The proposed robust method is illustrated in the analysis of two real data sets.
Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data

Yi Li,Yaning Yang,Xu Steven Xu,Min Yuan

DOI: https://doi.org/10.1016/j.compbiolchem.2022.107697

IF: 3.737

2022-08-01

Computational Biology and Chemistry

Abstract:The naïve empirical Bayes method has been widely used as an ad hoc tool in fitting linear mixed-effect models, which is much computationally efficient than the maximum likelihood estimation method. However, the shrinkage effect of the empirical Bayes method causes bias in the estimates of the fixed effects. Bias-correction has been proposed for the mixed-effects model when only one covariate is present. In this paper, we derive the shrinkage factor of the empirical Bayes predictors of the random effects and the variance-covariance matrix of the corrected estimates when the model has more than one covariate. The empirical Bayes estimates and test statistics are then corrected using the derived factor. Theoretical derivations, simulation studies and a real data application demonstrate the validity of the proposed method in that the corrected estimates are unbiased and the corrected tests have correct p-values.

biology,computer science, interdisciplinary applications

Robust estimating equations and bias correction of correlation parameters for longitudinal data

Robust Estimating Equations and Bias Correction of Correlation Parameters for Longitudinal Data

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Robust estimation of covariance parameters in partial linear model for longitudinal data☆

Robust estimation in joint mean–covariance regression model for longitudinal data

Robust Estimating Functions and Bias Correction for Longitudinal Data Analysis

Robust estimation in linear regression models for longitudinal data with covariate measurement errors and outliers

Robust Estimation in Partial Linear Mixed Model for Longitudinal Data

Robust estimation of mean and covariance for longitudinal data with dropouts

Variable Selection in Robust Joint Mean and Covariance Model for Longitudinal Data Analysis

Analysis of Longitudinal Data with Covariate Measurement Error and Missing Responses: an Improved Unbiased Estimating Equation.

Bayesian estimation for longitudinal data in a joint model with HPCs

Orthogonality-based bias-corrected empirical likelihood inference for partial linear varying coefficient EV models with longitudinal data

Robust empirical likelihood inference for generalized partial linear models with longitudinal data

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Variable Selection in Robust Regression Models for Longitudinal Data

The effect of the working correlation on fitting models to longitudinal data

Robust empirical likelihood inference for longitudinal data

Joint Mean–covariance Model in Generalized Partially Linear Varying Coefficient Models for Longitudinal Data

Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data

Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data