Influence Diagnostics of Poisson Models Base on Score Test Statistics

Jin‐Guan Lin

2008-01-01

Abstract:Based on longitudinal count data in the area of finance and medical treatment,a new method for outlier data diagnostics is given.Through kinds of perturb models,influence measurement function is gained and one numerical example is given to illustrate our results.

What problem does this paper attempt to address?

Influence Analysis on Semiparametric Generalized Linear Mixed Model

Zeng Linrui,Zhu Zhongyi

2007-01-01

Acta Mathematica Scientia

Abstract:In this paper,the authors present a unified diagnostic method for semiparametric generalized linear mixed model.The equivalency of case deletion model and mean shift outlier model is investigated and the diagnostic statistics such as cook distance,score test statistic for outlier tests are derived.Secondly,the local influence for the models is investigated and the counting formulas of influence matrices for case weights perturbation model and mean shift perturbation model are obtained.Finally,numerical example illustrates that the method is effective.
Influence analysis and outlier tests for semiparametric generalized linear model

曾林蕊,朱仲义,茆诗松

DOI: https://doi.org/10.3969/j.issn.1000-4424.2004.03.011

2004-01-01

Abstract:Diagnostic is used in the whole process of statistical inferences for solving problems.Influence analysis is a very important branch.The paper showed that the case deletion model is equivalent to the mean shift outlier model for semiparametric generalized linear models.The diagnostic statistics such as Cook's distance,score test statistic for outlier tests are derived.Finally,the numerical example illustrates that the method is available.
Simulation Study on Local Influence Diagnosis for Poisson Mixed-Effect Linear Model

N.Zhang

DOI: https://doi.org/10.48550/arXiv.1805.02898

2018-05-08

Abstract:Given that hierarchical count data in many fields are not Normally-distributed and include random effects, this paper extends the Generalized Linear Mixed Models (GLMMs) into Poisson Mixed-Effect Linear Model (PMELM) and do numerical simulation experiments to verify the approach proposed by Rakhmawati et al. (2016) in detecting outliers. This paper produces random data based on epilepsy longitudinal data in Thall and Vail (1990), use six ways to contaminate it and try to use code mentioned in supplementary materials in previous research to detect the man-made outlier. Output shows that this method is effective sometimes but does not always work, this is probably because of the limitation of coding or some other reasons. Even though the data set and local influence method has been researched and analyzed extensively in previous papers, this paper makes contributions in data visualization. Figures in this paper show the effect of each influencial component, which are clearer than the original output in R and SAS.

Methodology
On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

Fei Jiang,Yeqing Zhou,Jianxuan Liu,Yanyuan Ma

DOI: https://doi.org/10.48550/arXiv.2301.00139

2022-12-31

Abstract:We study estimation and testing in the Poisson regression model with noisy high dimensional covariates, which has wide applications in analyzing noisy big data. Correcting for the estimation bias due to the covariate noise leads to a non-convex target function to minimize. Treating the high dimensional issue further leads us to augment an amenable penalty term to the target function. We propose to estimate the regression parameter through minimizing the penalized target function. We derive the L1 and L2 convergence rates of the estimator and prove the variable selection consistency. We further establish the asymptotic normality of any subset of the parameters, where the subset can have infinitely many components as long as its cardinality grows sufficiently slow. We develop Wald and score tests based on the asymptotic normality of the estimator, which permits testing of linear functions of the members if the subset. We examine the finite sample performance of the proposed tests by extensive simulation. Finally, the proposed method is successfully applied to the Alzheimer's Disease Neuroimaging Initiative study, which motivated this work initially.

Statistics Theory,Machine Learning
Semiparametric analysis of longitudinal zero-inflated count data

Jiarui Feng,Zhongyi Zhu

DOI: https://doi.org/10.1016/j.jmva.2010.08.001

IF: 1.387

2011-01-01

Journal of Multivariate Analysis

Abstract:In this article, we consider a semiparametric zero-inflated Poisson mixed model that postulates a possible nonlinear relationship between the natural logarithm of the mean of the counts and a particular covariate in the longitudinal studies. A penalized log-likelihood function is proposed and Monte Carlo expectation-maximization algorithm is used to derive the estimates. Under some mild conditions, we establish the consistency and asymptotic normality of the resulting estimators. Simulation studies are carried out to investigate the finite sample performance of the proposed method. For illustration purposes, the method is applied to a data set from a pharmaceutical company where the variable of interest is the number of episodes of side effects after the patient has taken the treatments.
Mixed Model Approaches for Detecting Influential Observations in Genetic Data Analysis

Yousaf Hayat,Jian Yang,Jun Zhu

2015-01-01

Abstract:Influence diagnostics for detection of influential data points are widely used in statistical modeling to gauge out their impact on various aspect of the analysis. We proposed a method for detection of influential observations in mixed linear model using MINQUE (1) for estimation of variance components and linear unbiased prediction (LUP) for prediction of random effects. The method is based on the analogue of the Cook distance statistics for detection of influential observations affecting both the fixed and random components of a mixed linear model. The method is illustrated with both simulated and the real data sets based on an experimental model for genetic analysis.
A comparison of statistical methods for modeling count data with an application to hospital length of stay

Gustavo A Fernandez,Kristina P Vatcheva

DOI: https://doi.org/10.1186/s12874-022-01685-8

2022-08-04

Abstract:Background: Hospital length of stay (LOS) is a key indicator of hospital care management efficiency, cost of care, and hospital planning. Hospital LOS is often used as a measure of a post-medical procedure outcome, as a guide to the benefit of a treatment of interest, or as an important risk factor for adverse events. Therefore, understanding hospital LOS variability is always an important healthcare focus. Hospital LOS data can be treated as count data, with discrete and non-negative values, typically right skewed, and often exhibiting excessive zeros. In this study, we compared the performance of the Poisson, negative binomial (NB), zero-inflated Poisson (ZIP), and zero-inflated negative binomial (ZINB) regression models using simulated and empirical data. Methods: Data were generated under different simulation scenarios with varying sample sizes, proportions of zeros, and levels of overdispersion. Analysis of hospital LOS was conducted using empirical data from the Medical Information Mart for Intensive Care database. Results: Results showed that Poisson and ZIP models performed poorly in overdispersed data. ZIP outperformed the rest of the regression models when the overdispersion is due to zero-inflation only. NB and ZINB regression models faced substantial convergence issues when incorrectly used to model equidispersed data. NB model provided the best fit in overdispersed data and outperformed the ZINB model in many simulation scenarios with combinations of zero-inflation and overdispersion, regardless of the sample size. In the empirical data analysis, we demonstrated that fitting incorrect models to overdispersed data leaded to incorrect regression coefficients estimates and overstated significance of some of the predictors. Conclusions: Based on this study, we recommend to the researchers that they consider the ZIP models for count data with zero-inflation only and NB models for overdispersed data or data with combinations of zero-inflation and overdispersion. If the researcher believes there are two different data generating mechanisms producing zeros, then the ZINB regression model may provide greater flexibility when modeling the zero-inflation and overdispersion.
A case of unilateral renal cystic disease

Sik Lee,Sung-Kwang Park,S. Kang,W. Kim

DOI: https://doi.org/10.1111/j.1440-1797.2003.00222.x

2004-02-01

Nephrology

Abstract:SUMMARY: Unilateral renal cystic disease (URCD) is a distinct entity that is one of the renal cystic diseases. The clinical importance of URCD is to make a differential diagnosis from autosomal dominant polycystic kidney disease (ADPKD), multicystic dysplastic kidney, multilocular cystic renal neoplasm, and simple cysts. To confirm the diagnosis and to rule out asynchronous ADPKD requires long‐term follow up, especially in younger patients.
The Testing of Random Effect in Mixed Generalized Single Index Models

Chen Congjie,Zhu Zhongyi

DOI: https://doi.org/10.3969/j.issn.1001-4268.2011.01.004

2011-01-01

Abstract:In the regression analysis,it is common to assume the independence and homogeneous of the observation responses.In generalized parametric and nonparametric models,there does not exist the homoscedasticity of the model.However,in many exponential models,random effect is another main cause for over or under-dispersion of variance.So in this paper,the testing of random effect in discrete generalized single index model with random effects for longitudinal data is studied.Simulation for the Score testing statistics is also illustrated.
Modeling Time-Dependent Overdispersion in Longitudinal Count Data

Fei Ye,Yue Chen,Ying Yang

DOI: https://doi.org/10.1016/j.csda.2012.08.009

IF: 2.035

2013-01-01

Computational Statistics & Data Analysis

Abstract:Poisson regression is important in the analysis of longitudinal count data. However, the variance of responses is often much greater than the sample mean in practice, contradicting the Poisson model. To solve this overdispersion problem, negative binomial regression model was introduced by earlier researchers by adding another error term to the Poisson model. By default, the parameter of the additional error term, called the overdispersion parameter, is constant during the study period, but we find that it may fail in the research of epilepsy. Thus a formal likelihood ratio test is proposed and the test conforms that a time-dependent overdispersion phenomenon does exist. Then a mixed effect negative binomial model is proposed to take into account the time-dependent overdispersion, producing significantly better regression results compared with most earlier models. The proposed test and regression approach can easily be done by SAS PROC NLMIXED. The extensive simulation studies are conducted to evaluate the performance of the methods proposed.
A simulation study of the performance of statistical models for count outcomes with excessive zeros

Zhengyang Zhou,Dateng Li,David Huh,Minge Xie,Eun‐Young Mun

DOI: https://doi.org/10.1002/sim.10198

2024-08-31

Statistics in Medicine

Abstract:Background: Outcome measures that are count variables with excessive zeros are common in health behaviors research. Examples include the number of standard drinks consumed or alcohol‐related problems experienced over time. There is a lack of empirical data about the relative performance of prevailing statistical models for assessing the efficacy of interventions when outcomes are zero‐inflated, particularly compared with recently developed marginalized count regression approaches for such data. Methods: The current simulation study examined five commonly used approaches for analyzing count outcomes, including two linear models (with outcomes on raw and log‐transformed scales, respectively) and three prevailing count distribution‐based models (ie, Poisson, negative binomial, and zero‐inflated Poisson (ZIP) models). We also considered the marginalized zero‐inflated Poisson (MZIP) model, a novel alternative that estimates the overall effects on the population mean while adjusting for zero‐inflation. Motivated by alcohol misuse prevention trials, extensive simulations were conducted to evaluate and compare the statistical power and Type I error rate of the statistical models and approaches across data conditions that varied in sample size (N=100 to 500), zero rate (0.2 to 0.8), and intervention effect sizes. Results: Under zero‐inflation, the Poisson model failed to control the Type I error rate, resulting in higher than expected false positive results. When the intervention effects on the zero (vs. non‐zero) and count parts were in the same direction, the MZIP model had the highest statistical power, followed by the linear model with outcomes on the raw scale, negative binomial model, and ZIP model. The performance of the linear model with a log‐transformed outcome variable was unsatisfactory. Conclusions: The MZIP model demonstrated better statistical properties in detecting true intervention effects and controlling false positive results for zero‐inflated count outcomes. This MZIP model may serve as an appealing analytical approach to evaluating overall intervention effects in studies with count outcomes marked by excessive zeros.

public, environmental & occupational health,medicine, research & experimental,medical informatics,mathematical & computational biology,statistics & probability
A New Regression Model for the Analysis of Overdispersed and Zero-Modified Count Data

Wesley Bertoli,Katiane S. Conceição,Marinho G. Andrade,Francisco Louzada

DOI: https://doi.org/10.3390/e23060646

IF: 2.738

2021-05-21

Entropy

Abstract:Count datasets are traditionally analyzed using the ordinary Poisson distribution. However, said model has its applicability limited, as it can be somewhat restrictive to handling specific data structures. In this case, the need arises for obtaining alternative models that accommodate, for example, overdispersion and zero modification (inflation/deflation at the frequency of zeros). In practical terms, these are the most prevalent structures ruling the nature of discrete phenomena nowadays. Hence, this paper’s primary goal was to jointly address these issues by deriving a fixed-effects regression model based on the hurdle version of the Poisson–Sujatha distribution. In this framework, the zero modification is incorporated by considering that a binary probability model determines which outcomes are zero-valued, and a zero-truncated process is responsible for generating positive observations. Posterior inferences for the model parameters were obtained from a fully Bayesian approach based on the g-prior method. Intensive Monte Carlo simulation studies were performed to assess the Bayesian estimators’ empirical properties, and the obtained results have been discussed. The proposed model was considered for analyzing a real dataset, and its competitiveness regarding some well-established fixed-effects models for count data was evaluated. A sensitivity analysis to detect observations that may impact parameter estimates was performed based on standard divergence measures. The Bayesian p-value and the randomized quantile residuals were considered for the task of model validation.

physics, multidisciplinary
Sample size calculation based on discrete Weibull and zero-inflated discrete Weibull regression models

Hanna Yoo,Jae Won Lee

DOI: https://doi.org/10.1080/03610918.2020.1827264

2020-10-21

Abstract:In this paper, we present a sample size determination for count data based on discrete Weibull and zero-inflated discrete Weibull regression models. The discrete Weibull regression can be used under various dispersion of count data, but its attractive feature is not sufficiently revealed. Discrete Weibull regression has a desirable feature in that it can be used for both over and under dispersed data, and thus a researcher can use a unified model with having low risk of failing to cope with the dispersion type of the data. Although the sample size calculation for Poisson, negative binomial regression has been previously introduced in many papers, there is no study that deals with discrete Weibull or zero-inflated discrete Weibull regression. We modified the method by Channouf, Fredette, and MacGibbon (<a href="#">2014</a> Channouf, N. , M.Fredette, and B.MacGibbon . 2014. Power and sample size calculations for poisson and zero-inflated poisson regression models. Computational Statistics & Data Analysis 72:241–51. doi:10.1016/j.csda.2013.09.029.<a href="/servlet/linkout?suffix=CIT0004&dbid=16&doi=10.1080%2F03610918.2020.1827264&key=10.1016%2Fj.csda.2013.09.029">[Crossref]</a>, <a href="/servlet/linkout?suffix=CIT0004&dbid=128&doi=10.1080%2F03610918.2020.1827264&key=000330147000017">[Web of Science ®]</a> , <a class="google-scholar" href="http://scholar.google.com/scholar_lookup?hl=en&volume=72&publication_year=2014&pages=241-51&author=N.+Channouf&author=M.+Fredette&author=B.+MacGibbon&title=Power+and+sample+size+calculations+for+poisson+and+zero-inflated+poisson+regression+models&doi=10.1016%2Fj.csda.2013.09.029">[Google Scholar]</a>) to calculate the required sample size for the two models. By using these two models, one can incorporate the effect of skewness, dispersion type and zero-inflated structure of the data when calculating the required sample size. Through the simulation studies, it was shown that our proposed sample size calculation method gives accurate results and also sample size is affected by the skewness of the distribution, covariance structure of covariates and amount of zeros. For illustration of our methods, the hospital length of stay study was used.
Statistical model for overdispersed count outcome with many zeros: an approach for direct marginal inference

Samuel Iddi,Kwabena Doku-Amponsah

DOI: https://doi.org/10.48550/arXiv.1504.00071

2015-04-01

Abstract:Marginalized models are in great demand by most researchers in the life sciences particularly in clinical trials, epidemiology, health-economics, surveys and many others since they allow generalization of inference to the entire population under study. For count data, standard procedures such as the Poisson regression and negative binomial model provide population average inference for model parameters. However, occurrence of excess zero counts and lack of independence in empirical data have necessitated their extension to accommodate these phenomena. These extensions, though useful, complicates interpretations of effects. For example, the zero-inflated Poisson model accounts for the presence of excess zeros but the parameter estimates do not have a direct marginal inferential ability as its base model, the Poisson model. Marginalizations due to the presence of excess zeros are underdeveloped though demand for such is interestingly high. The aim of this paper is to develop a marginalized model for zero-inflated univariate count outcome in the presence of overdispersion. Emphasis is placed on methodological development, efficient estimation of model parameters, implementation and application to two empirical studies. A simulation study is performed to assess the performance of the model. Results from the analysis of two case studies indicated that the refined procedure performs significantly better than models which do not simultaneously correct for overdispersion and presence of excess zero counts in terms of likelihood comparisons and AIC values. The simulation studies also supported these findings. In addition, the proposed technique yielded small biases and mean square errors for model parameters. To ensure that the proposed method enjoys widespread use, it is implemented using the SAS NLMIXED procedure with minimal coding efforts.

Methodology
Application of Beta-Distribution and Combined Uniform and Binomial Methods in Longitudinal Modeling of Bounded Outcome Score Data

Chuanpu Hu,Honghui Zhou,Amarnath Sharma

DOI: https://doi.org/10.1208/s12248-020-00478-5

2020-07-21

The AAPS Journal

Abstract:Disease status is often measured with bounded outcome scores (BOS) which takes a discrete set of values on a finite range. The distribution of such data is often skewed, rendering the standard analysis methods assuming normal distribution inappropriate. Among the methods used for BOS analyses, two of them have the ability to predict the data within its natural range and accommodate data skewness: (1) a recently proposed beta-distribution based approach and (2) a mixture model known as CUB (combined uniform and binomial). This manuscript compares the two approaches, using an established mechanism-based longitudinal exposure-response model to analyze data from a phase 2 clinical trial in psoriatic patients. The beta-distribution–based approach was confirmed to perform well, and CUB also showed potential. A separate issue of modeling clinical trial data is that the collected baseline disease score range may be more limited than that of post-treatment disease score due to clinical trial inclusion criteria, a fact that is typically ignored in longitudinal modeling. The effect of baseline disease status restriction should in principle be adjusted for in longitudinal modeling.
Risk factor selection in rate making: EM adaptive LASSO for zero-inflated poisson regression models.

Yanlin Tang,Liya Xiang,Zhongyi Zhu

DOI: https://doi.org/10.1111/risa.12162

2014-01-01

Risk Analysis

Abstract:Risk factor selection is very important in the insurance industry, which helps precise rate making and studying the features of high-quality insureds. Zero-inflated data are common in insurance, such as the claim frequency data, and zero-inflation makes the selection of risk factors quite difficult. In this article, we propose a new risk factor selection approach, EM adaptive LASSO, for a zero-inflated Poisson regression model, which combines the EM algorithm and adaptive LASSO penalty. Under some regularity conditions, we show that, with probability approaching 1, important factors are selected and the redundant factors are excluded. We investigate the finite sample performance of the proposed method through a simulation study and the analysis of car insurance data from SAS Enterprise Miner database.
Variable selection approach for zero-inflated count data via adaptive lasso

Ping Zeng,Yongyue Wei,Yang Zhao,Jin Liu,Liya Liu,Ruyang Zhang,Jianwei Gou,Shuiping Huang,Feng Chen

DOI: https://doi.org/10.1080/02664763.2013.858672

IF: 1.416

2014-01-01

Journal of Applied Statistics

Abstract:This article proposes a variable selection approach for zero-inflated count data analysis based on the adaptive lasso technique. Two models including the zero-inflated Poisson and the zero-inflated negative binomial are investigated. An efficient algorithm is used to minimize the penalized log-likelihood function in an approximate manner. Both the generalized cross-validation and Bayesian information criterion procedures are employed to determine the optimal tuning parameter, and a consistent sandwich formula of standard errors for nonzero estimates is given based on local quadratic approximation. We evaluate the performance of the proposed adaptive lasso approach through extensive simulation studies, and apply it to analyze real-life data about doctor visits.
A Comparative Study of Several Models for Zero Inflation Counting Data

吴学福,刘振球,吴明山,方绮雯,袁黄波,张铁军

2020-01-01

Abstract:Objective To explore the comparison and application of several models to deal with zero inflation counting data.Methods Poisson,negative binomial,zero-inflated Poisson,zero-inflated negative binomial,Poisson hurdle,and negative binomial hurdle models were applied to fit the data in R program.While the likelihood ratio tests,Vuong statistics(for non-nested models),Akaike′s information criterion(AIC)and bayesian information criterion(BIC)were used to evaluate the goodness of fit.Results The zero-inflated negative binomial and the negative binomial hurdle models are better than other models,the negative binomial hurdle model fits the data more accurate.The fitting results showed that the longer stays in the hospital,more chronical conditions,higher education level and have private insurance means physician visit more frequently.Those who with good self-assessment and the male often have fewer visits to physician,which means fewer healthcare demand.Conclusion The zero-inflated negative binomial and negative binomial hurdle models are better in handling over-dispersion and zero-inflation.While in the case of relatively few zero observations,the negative binomial hurdle model may be more suitable.
Influence diagnostics in Birnbaum-Saunders nonlinear regression models

Artur J. Lemonte

DOI: https://doi.org/10.1080/02664761003692357

2009-04-27

Abstract:We consider the issue of assessing influence of observations in the class of Birnbaum-Saunders nonlinear regression models, which is useful in lifetime data analysis. Our results generalize those in Galea et al. [2004, Influence diagnostics in log-Birnbaum-Saunders regression models. Journal of Applied Statistics, 31, 1049-1064] which are confined to Birnbaum-Saunders linear regression models. Some influence methods, such as the local influence, total local influence of an individual and generalized leverage are discussed. Additionally, the normal curvatures of local influence are derived under various perturbation schemes.

Methodology
Intervention analysis for integer-valued autoregressive models

Xanthi Pedeli,Roland Fried

DOI: https://doi.org/10.48550/arXiv.2303.07933

2023-03-14

Abstract:We study the problem of intervention effects generating various types of outliers in an integer-valued autoregressive model with Poisson innovations. We concentrate on outliers which enter the dynamics and can be seen as effects of extraordinary events. We consider three different scenarios, namely the detection of an intervention effect of a known type at a known time, the detection of an intervention effect of unknown type at a known time and the detection of an intervention effect when both the type and the time are unknown. We develop F-tests and score tests for the first scenario. For the second and third scenarios we rely on the maximum of the different F-type or score statistics. The usefulness of the proposed approach is illustrated using monthly data on human brucellosis infections in Greece.

Methodology

Influence Diagnostics of Poisson Models Base on Score Test Statistics

Influence Analysis on Semiparametric Generalized Linear Mixed Model

Influence analysis and outlier tests for semiparametric generalized linear model

Simulation Study on Local Influence Diagnosis for Poisson Mixed-Effect Linear Model

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

Semiparametric analysis of longitudinal zero-inflated count data

Mixed Model Approaches for Detecting Influential Observations in Genetic Data Analysis

A comparison of statistical methods for modeling count data with an application to hospital length of stay

A case of unilateral renal cystic disease

The Testing of Random Effect in Mixed Generalized Single Index Models

Modeling Time-Dependent Overdispersion in Longitudinal Count Data

A simulation study of the performance of statistical models for count outcomes with excessive zeros

A New Regression Model for the Analysis of Overdispersed and Zero-Modified Count Data

Sample size calculation based on discrete Weibull and zero-inflated discrete Weibull regression models

Statistical model for overdispersed count outcome with many zeros: an approach for direct marginal inference

Application of Beta-Distribution and Combined Uniform and Binomial Methods in Longitudinal Modeling of Bounded Outcome Score Data

Risk factor selection in rate making: EM adaptive LASSO for zero-inflated poisson regression models.

Variable selection approach for zero-inflated count data via adaptive lasso

A Comparative Study of Several Models for Zero Inflation Counting Data

Influence diagnostics in Birnbaum-Saunders nonlinear regression models

Intervention analysis for integer-valued autoregressive models