A semiparametric Bayesian approach to generalized partial linear mixed models for longitudinal data

TangNian-Sheng,DuanXing-De

IF: 2.035

2012-01-01

Computational Statistics & Data Analysis

Abstract:A generalized partial linear mixed model (GPLMM) is a natural extension of generalized linear mixed models (GLMMs) and partial linear models (PLMs). Almost all existing methods for analyzing GPLMMs...

What problem does this paper attempt to address?

A Unified Bayesian Inference Framework for Generalized Linear Models

Xiangming Meng,Sheng Wu,Jiang Zhu

DOI: https://doi.org/10.1109/lsp.2017.2789163

2018-01-01

IEEE Signal Processing Letters

Abstract:In this letter, we present a unified Bayesian inference framework for generalized linear models (GLM), which iteratively reduces the GLM problem to a sequence of standard linear model (SLM) problems. This framework provides new perspectives on some established GLM algorithms derived from SLM ones and also suggests novel extensions for some other SLM algorithms. Specific instances elucidated under such framework are the GLM versions of approximate message passing (AMP), vector AMP, and sparse Bayesian learning. It is proved that the resultant GLM version of AMP is equivalent to the well-known generalized approximate message passing. Numerical results for one-bit quantized compressed sensing demonstrate the effectiveness of this unified framework.
Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data

Guoyou Qin,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2007.01.006

IF: 1.387

2007-01-01

Journal of Multivariate Analysis

Abstract:In this paper, we consider robust generalized estimating equations for the analysis of semiparametric generalized partial linear mixed models (GPLMMs) for longitudinal data. We approximate the non-parametric function in the GPLMM by a regression spline, and make use of bounded scores and leverage-based weights in the estimating equation to achieve robustness against outliers and influential data points, respectively. Under some regularity conditions, the asymptotic properties of the robust estimators are investigated. To avoid the computational problems involving high-dimensional integrals in our estimators, we adopt a robust Monte Carlo Newton–Raphson (RMCNR) algorithm for fitting GPLMMs. Small simulations are carried out to study the behavior of the robust estimates in the presence of outliers, and these estimates are also compared to their corresponding non-robust estimates. The proposed robust method is illustrated in the analysis of two real data sets.
Longitudinal Data Analysis Based on Generalized Linear Partially Varying-Coefficient Models

Yaohua Rong,Manlai Tang,Maozai Tian

DOI: https://doi.org/10.1080/03610926.2015.1032421

2016-01-01

Abstract:In this article, we consider a generalized linear partially varying-coefficient model for longitudinal data analysis. A local quasi-likelihood method is proposed to estimate the constant-coefficient and varying-coefficient functions simultaneously based on the local polynomial kernel regression. The corresponding standard error estimates are derived. Large sample properties are investigated. The proposed methodologies are demonstrated by extensive simulation studies and a real example.
Asymptotic Properties of Estimation in Generalized Partial Linear Mixed Models

Zhang Hao,Zhu Zhongyi

DOI: https://doi.org/10.3969/j.issn.1001-4268.2009.02.007

2009-01-01

Abstract:Semiparametric models are useful in psychological, biological and medical application. Zhang (1998) used maximum penalized likelihood estimation (MPLE) to estimate both of the parametric and nonpara-metric parameters. Unfortunately, MPLE proposed by Zhang (1998) can only be applied to the Gaussian Models. In general, in order to estimate the parametric and nonparametric part in generalized partial linear mixed models, we choose to treat the random effects as the missing data and construct a Monte Carlo version of the EM algorithm. Based on the MCNR algorithm proposed by McCulloch (1997), we, in this paper, extend the algorithm to the generalized partial linear mixed models (GPLMM) so that it may estimate both of the parameters and nonparameters simultaneously. In the new algorithm, we approximate the nonparametric function in GPLMM by P-spline and use GCV to choose the smoothing parameter. Meanwhile, we also give the proofs and the asymptotic properties of the estimators. Finally, in order to test the reliability of the method, the proposed algorithm is illustrated in the simulation analysis and one real data set.
General Design Bayesian Generalized Linear Mixed Models

Y. Zhao,J. Staudenmayer,B. A. Coull,M. P. Wand

DOI: https://doi.org/10.1214/088342306000000015

2006-06-20

Abstract:Linear mixed models are able to handle an extraordinary range of complications in regression-type analyses. Their most common use is to account for within-subject correlation in longitudinal data analysis. They are also the standard vehicle for smoothing spatial count data. However, when treated in full generality, mixed models can also handle spline-type smoothing and closely approximate kriging. This allows for nonparametric regression models (e.g., additive models and varying coefficient models) to be handled within the mixed model framework. The key is to allow the random effects design matrix to have general structure; hence our label general design. For continuous response data, particularly when Gaussianity of the response is reasonably assumed, computation is now quite mature and supported by the R, SAS and S-PLUS packages. Such is not the case for binary and count responses, where generalized linear mixed models (GLMMs) are required, but are hindered by the presence of intractable multivariate integrals. Software known to us supports special cases of the GLMM (e.g., PROC NLMIXED in SAS or glmmML in R) or relies on the sometimes crude Laplace-type approximation of integrals (e.g., the SAS macro glimmix or glmmPQL in R). This paper describes the fitting of general design generalized linear mixed models. A Bayesian approach is taken and Markov chain Monte Carlo (MCMC) is used for estimation and inference. In this generalized setting, MCMC requires sampling from nonstandard distributions. In this article, we demonstrate that the MCMC package WinBUGS facilitates sound fitting of general design Bayesian generalized linear mixed models in practice.

Statistics Theory
Semiparametric Bayesian Analysis for Longitudinal Mixed Effects Models with Non-Normal AR(1) Errors

Junshan Shen,Hanjun Yu,Jin Yang,Chunling Liu

DOI: https://doi.org/10.1007/s11222-018-9824-4

IF: 2.3241

2018-01-01

Statistics and Computing

Abstract:This paper studies Bayesian inference on longitudinal mixed effects models with non-normal AR(1) errors. We model the nonparametric zero-mean noise in the autoregression residual with a Dirichlet process (DP) mixture model. Applying the empirical likelihood tool, an adjusted sampler based on the Pólya urn representation of DP is proposed to incorporate information of the moment constraints of the mixing distribution. A Gibbs sampling algorithm based on the adjusted sampler is proposed to approximate the posterior distributions under DP priors. The proposed method can easily be extended to address other moment constraints owing to the wide application background of the empirical likelihood. Simulation studies are used to evaluate the performance of the proposed method. Our method is illustrated via the analysis of a longitudinal dataset from a psychiatric study.
Partial Linear Models for Longitudinal Data Based on Quadratic Inference Functions

YANG BAI,ZHONGYI ZHU,WING K. FUNG

DOI: https://doi.org/10.1111/j.1467-9469.2007.00578.x

2008-01-01

Scandinavian Journal of Statistics

Abstract:In this paper, we consider improved estimating equations for semiparametric partial linear models (PLM) for longitudinal data, or clustered data in general. We approximate the non-parametric function in the PLM by a regression spline, and utilize quadratic inference functions (QIF) in the estimating equations to achieve a more efficient estimation of the parametric part in the model, even when the correlation structure is misspecified. Moreover, we construct a test which is an analogue to the likelihood ratio inference function for inferring the parametric component in the model. The proposed methods perform well in simulation studies and real data analysis conducted in this paper.
Robust empirical likelihood inference for generalized partial linear models with longitudinal data

Guoyou Qin,Yang Bai,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2011.08.003

IF: 1.387

2012-01-01

Journal of Multivariate Analysis

Abstract:In this paper, we propose a robust empirical likelihood (REL) inference for the parametric component in a generalized partial linear model (GPLM) with longitudinal data. We make use of bounded scores and leverage-based weights in the auxiliary random vectors to achieve robustness against outliers in both the response and covariates. Simulation studies demonstrate the good performance of our proposed REL method, which is more accurate and efficient than the robust generalized estimating equation (GEE) method (X. He, W.K. Fung, Z.Y. Zhu, Robust estimation in generalized partial linear models for clustered data, Journal of the American Statistical Association 100 (2005) 1176–1184). The proposed robust method is also illustrated by analyzing a real data set.
Robust Estimation in Partial Linear Mixed Model for Longitudinal Data

Qin Guoyou,Zhu Zhongyi

DOI: https://doi.org/10.1016/s0252-9602(08)60035-1

2008-01-01

Acta Mathematica Scientia

Abstract:In this article, robust generalized estimating equation for the analysis of partial linear mixed model for longitudinal data is used. The authors approximate the nonparametric function by a regression spline. Under some regular conditions, the asymptotic properties of the estimators are obtained. To avoid the computation of high-dimensional integral, a robust Monte Carlo Newton-Raphson algorithm is used. Some simulations are carried out to study the performance of the proposed robust estimators. In addition, the authors also study the robustness and the efficiency of the proposed estimators by simulation. Finally, two real longitudinal data sets are analyzed.
Bayesian estimation for longitudinal data in a joint model with HPCs

Shuli Geng,Lixin Zhang

DOI: https://doi.org/10.1080/02331888.2023.2185243

IF: 2.346

2023-01-01

Statistics

Abstract:In longitudinal data analysis, linear models are typically utilized. However, deriving the Bayesian estimation with respect to the misspecification of the correlation structure is a challenging task. In this article, we construct a joint mean-covariance model with angles or hyperspherical coordinates (HPCs) for which we then present a Bayesian framework. Based on the connection with the semipartial correlations (SPCs), we focus on the selection (sparsity) priors on these angles. An efficient Markov chain Monte Carlo (MCMC) algorithm is developed for the proposed model, and the positive definiteness of the correlation matrix in posterior computation is automatically guaranteed by our method. Ultimately, we compare the performance of our joint model with some recent methods focusing only on the correlation matrix by using simulations and clinical trial data on smoking.
Bayesian Latent-Class Mixed-Effect Hybrid Models for Dyadic Longitudinal Data with Non-Ignorable Dropouts.

Jaeil Ahn,Suyu Liu,Wenyi Wang,Ying Yuan

DOI: https://doi.org/10.1111/biom.12100

IF: 1.701

2013-01-01

Biometrics

Abstract:The analysis of longitudinal dyadic data is challenging due to the complicated correlations within and between dyads, as well as possibly non-ignorable dropouts. Based on a mixed-effects hybrid model, we propose an approach to analyze longitudinal dyadic data with non-ignorable dropouts. We factorize the joint distribution of the measurement and dropout processes into three components: the marginal distribution of random effects, the conditional distribution of the dropout process given the random effects, and the conditional distribution of the measurement process given the random effects and missing data patterns. We model the conditional dropout process using a discrete survival model, and the conditional measurement process using a latent-class pattern-mixture model. These models account for the dyadic interdependence using the "actor" and "partner" effects and dyad-specific random effects. We use the latent-dropout-class approach to address the problem of a large number of missing data patterns caused by the dyadic data structure. We evaluate the performance of the proposed method using a simulation study, and apply our method to a longitudinal dyadic data set that arose from a prostate cancer trial.
SEMIPARAMETRIC LATENT-CLASS MODELS FOR MULTIVARIATE LONGITUDINAL AND SURVIVAL DATA

Kin Yau Wong,Donglin Zeng,D Y Lin

DOI: https://doi.org/10.1214/21-aos2117

Abstract:In long-term follow-up studies, data are often collected on repeated measures of multivariate response variables as well as on time to the occurrence of a certain event. To jointly analyze such longitudinal data and survival time, we propose a general class of semiparametric latent-class models that accommodates a heterogeneous study population with flexible dependence structures between the longitudinal and survival outcomes. We combine nonparametric maximum likelihood estimation with sieve estimation and devise an efficient EM algorithm to implement the proposed approach. We establish the asymptotic properties of the proposed estimators through novel use of modern empirical process theory, sieve estimation theory, and semiparametric efficiency theory. Finally, we demonstrate the advantages of the proposed methods through extensive simulation studies and provide an application to the Atherosclerosis Risk in Communities study.
Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

Peirong Xu,Jun Zhang,Xingfang Huang,Tao Wang

DOI: https://doi.org/10.1007/s11749-015-0462-2

2015-01-01

Test

Abstract:We consider marginal generalized partially linear single-index models for longitudinal data. A profile generalized estimating equations (GEE)-based approach is proposed to estimate unknown regression parameters. Within a wide range of bandwidths for estimating the nonparametric function, our profile GEE estimator is consistent and asymptotically normal even if the covariance structure is misspecified. Moreover, if the covariance structure is correctly specified, the semiparametric efficiency can be achieved under heteroscedasticity and without distributional assumptions on the covariates. Simulation studies are conducted to evaluate the finite sample performance of the proposed procedure. The proposed methodology is further illustrated through a data analysis.
On Fitting Generalized Linear Mixed-Effects Models for Binary Responses Using Different Statistical Packages.

Hui Zhang,Naiji Lu,Changyong Feng,Sally W. Thurston,Yinglin Xia,Liang Zhu,Xin M. Tu

DOI: https://doi.org/10.1002/sim.4265

2011-01-01

Statistics in Medicine

Abstract:The generalized linear mixed-effects model (GLMM) is a popular paradigm to extend models for cross-sectional data to a longitudinal setting. When applied to modeling binary responses, different software packages and even different procedures within a package may give quite different results. In this report, we describe the statistical approaches that underlie these different procedures and discuss their strengths and weaknesses when applied to fit correlated binary responses. We then illustrate these considerations by applying these procedures implemented in some popular software packages to simulated and real study data. Our simulation results indicate a lack of reliability for most of the procedures considered, which carries significant implications for applying such popular software packages in practice.
Robustified Maximum Likelihood Estimation in Generalized Partial Linear Mixed Model for Longitudinal Data

Guo You Qin,Zhong Yi Zhu

DOI: https://doi.org/10.1111/j.1541-0420.2008.01050.x

IF: 1.701

2009-01-01

Biometrics

Abstract:In this article, we study the robust estimation of both mean and variance components in generalized partial linear mixed models based on the construction of robustified likelihood function. Under some regularity conditions, the asymptotic properties of the proposed robust estimators are shown. Some simulations are carried out to investigate the performance of the proposed robust estimators. Just as expected, the proposed robust estimators perform better than those resulting from robust estimating equations involving conditional expectation like Sinha (2004, Journal of the American Statistical Association 99, 451-460) and Qin and Zhu (2007, Journal of Multivariate Analysis 98, 1658-1683). In the end, the proposed robust method is illustrated by the analysis of a real data set.
Marginally Interpretable Generalized Linear Mixed Models

Jeffrey J. Gory,Peter F. Craigmile,Steven N. MacEachern

DOI: https://doi.org/10.48550/arXiv.1610.01526

2016-10-05

Methodology

Abstract:Two popular approaches for relating correlated measurements of a non-Gaussian response variable to a set of predictors are to fit a marginal model using generalized estimating equations and to fit a generalized linear mixed model by introducing latent random variables. The first approach is effective for parameter estimation, but leaves one without a formal model for the data with which to assess quality of fit or make predictions for future observations. The second approach overcomes the deficiencies of the first, but leads to parameter estimates that must be interpreted conditional on the latent variables. Further complicating matters, obtaining marginal summaries from a generalized linear mixed model often requires evaluation of an analytically intractable integral or use of attenuation factors that are not exact. We define a class of marginally interpretable generalized linear mixed models that lead to parameter estimates with a marginal interpretation while maintaining the desirable statistical properties of a conditionally-specified model. We discuss the form of these models under various common link functions and also address computational issues associated with these models. For logistic mixed effects models, we introduce an accurate and efficient method for evaluating the logistic-normal integral.
Bayesian estimation in generalized linear models for longitudinal data with hyperspherical coordinates

Shuli Geng,Lixin Zhang

DOI: https://doi.org/10.1080/02331888.2024.2332711

IF: 2.346

2024-03-27

Statistics

Abstract:Under the framework of generalized linear models (GLM), the generalized estimating equation (GEE) method is typically applied for longitudinal data analysis. However, there are a series of problems due to the misspecification of the within-subject correlation structure, especially in Bayesian estimation. To handle these difficulties, in this paper, we construct a class of generalized estimating equations for longitudinal data with hyperspherical coordinates (HPC) and propose a Bayesian approach established through empirical likelihood (EL). Additionally, an efficient Markov chain Monte Carlo (MCMC) procedure is developed for the required computation of the posterior distribution. As proved by the simulation studies and an application to a real longitudinal data set, our method not only performs better than traditional empirical likelihood estimation and Bayesian estimation with partial autocorrelations (PAC) but also is suitable for non-Gaussian data.

statistics & probability
Modelling Sparse Generalized Longitudinal Observations with Latent Gaussian Processes

Peter Hall,Hans-Georg Mueller,Fang Yao

DOI: https://doi.org/10.1111/j.1467-9868.2008.00656.x

2008-01-01

Abstract:SummaryIn longitudinal data analysis one frequently encounters non-Gaussian data that are repeatedly collected for a sample of individuals over time. The repeated observations could be binomial, Poisson or of another discrete type or could be continuous. The timings of the repeated measurements are often sparse and irregular. We introduce a latent Gaussian process model for such data, establishing a connection to functional data analysis. The functional methods proposed are non-parametric and computationally straightforward as they do not involve a likelihood. We develop functional principal components analysis for this situation and demonstrate the prediction of individual trajectories from sparse observations. This method can handle missing data and leads to predictions of the functional principal component scores which serve as random effects in this model. These scores can then be used for further statistical analysis, such as inference, regression, discriminant analysis or clustering. We illustrate these non-parametric methods with longitudinal data on primary biliary cirrhosis and show in simulations that they are competitive in comparisons with generalized estimating equations and generalized linear mixed models.
Partial Linear Models for Longitudinal Data Based on Penalized General Method of Moments

Ni Yanfeng,Zhu Zhongyi

DOI: https://doi.org/10.3969/j.issn.1001-4268.2012.03.007

2012-01-01

Abstract:For the analysis of partial linear model with longitudinal data,the general procedure is to fit the nonparametric part with kernel or spline estimation,followed by generalized linear model estimating frame.In this paper,we fit the nonparametric part with P-spline,and estimate the parametrical and nonparametric part with different Generalized method of moments estimation for different moment conditions,implemented by the proof of the asymptotical properties for the estimator,which is also been proved by simulation and illustrative example,from which we can also find out that different penalized general method of moments estimations for different moment conditions perform more efficiently.
Partial least square based approaches for high-dimensional linear mixed models

DOI: https://doi.org/10.1007/s10260-023-00685-2

2023-02-02

Abstract:To deal with repeated data or longitudinal data, linear mixed effects models are commonly used. A classical parameter estimation method is the Expectation–Maximization (EM) algorithm. In this paper, we propose three new Partial Least Square (PLS) based approaches using the EM-algorithm to reduce the high-dimensional data to a lower one for fixed effects in linear mixed models. Unlike the Principal Component Regression approach, the PLS method allows to take into account the link between the outcome and the independent variables. We compare these approaches from a simulation study and a yeast cell-cycle gene expression data set. We demonstrate the performance of two of them and we recommend their use to conduct future analyses for high dimensional data in linear mixed effect models context.

statistics & probability

A semiparametric Bayesian approach to generalized partial linear mixed models for longitudinal data

A Unified Bayesian Inference Framework for Generalized Linear Models

Robust Estimation in Generalized Semiparametric Mixed Models for Longitudinal Data

Longitudinal Data Analysis Based on Generalized Linear Partially Varying-Coefficient Models

Asymptotic Properties of Estimation in Generalized Partial Linear Mixed Models

General Design Bayesian Generalized Linear Mixed Models

Semiparametric Bayesian Analysis for Longitudinal Mixed Effects Models with Non-Normal AR(1) Errors

Partial Linear Models for Longitudinal Data Based on Quadratic Inference Functions

Robust empirical likelihood inference for generalized partial linear models with longitudinal data

Robust Estimation in Partial Linear Mixed Model for Longitudinal Data

Bayesian estimation for longitudinal data in a joint model with HPCs

Bayesian Latent-Class Mixed-Effect Hybrid Models for Dyadic Longitudinal Data with Non-Ignorable Dropouts.

SEMIPARAMETRIC LATENT-CLASS MODELS FOR MULTIVARIATE LONGITUDINAL AND SURVIVAL DATA

Efficient Estimation for Marginal Generalized Partially Linear Single-Index Models with Longitudinal Data

On Fitting Generalized Linear Mixed-Effects Models for Binary Responses Using Different Statistical Packages.

Robustified Maximum Likelihood Estimation in Generalized Partial Linear Mixed Model for Longitudinal Data

Marginally Interpretable Generalized Linear Mixed Models

Bayesian estimation in generalized linear models for longitudinal data with hyperspherical coordinates

Modelling Sparse Generalized Longitudinal Observations with Latent Gaussian Processes

Partial Linear Models for Longitudinal Data Based on Penalized General Method of Moments

Partial least square based approaches for high-dimensional linear mixed models