Biases in dynamic models with fixed effects

John J. Beggs,Marc Nerlove

DOI: https://doi.org/10.1016/0165-1765(88)90046-8

IF: 1.469

1988-01-01

Economics Letters

Abstract:This paper examines bias in dynamic models with fixed effects where both the number of time series observations and the number of cross-sectional replications are small. The formula bias estimate is in line with that in published Monte Carlo studies.

economics

What problem does this paper attempt to address?

A note on the estimation problem of dynamic binary panel data model with fixed effects

Yu Gang,Gao Wei,Shi Ning-zhong

2012-01-01

Abstract:This paper considers the estimation of dynamic binary panel data model with fixed effects. A bias correction estimator which is the bias correction of maximum likelihood estimator is proposed, and we show that it is asymptotically unbiased and consistent. Monte Carlo simulations are presented to illustrate the bias correction estimator obtained.
Bias Correction Estimator for A Dynamic Panel Data Model with Fixed Effects Using an Iterated Bootstrap

Gang Yu,Wei Gao,Ning-Zhong Shi

2011-01-01

Hacettepe Journal of Mathematics and Statistics

Abstract:A bias correction estimator (BCE) for a dynamic panel data model with fixed effects is given, based on the alternating iterative maximum likelihood estimator (AIMLE). The new estimator is asymptotically unbiased and consistent. Monte Carlo studies are conducted to evaluate the finite sample properties of the MLE, AIMLE and BCE. It is shown that the BCE based on AIMLE appears to dominate the AIMLE approach both in terms of the median bias (Bias) and median absolute error (MAE) of the estimators.
Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data

Yi Li,Yaning Yang,Xu Steven Xu,Min Yuan

DOI: https://doi.org/10.1016/j.compbiolchem.2022.107697

IF: 3.737

2022-08-01

Computational Biology and Chemistry

Abstract:The naïve empirical Bayes method has been widely used as an ad hoc tool in fitting linear mixed-effect models, which is much computationally efficient than the maximum likelihood estimation method. However, the shrinkage effect of the empirical Bayes method causes bias in the estimates of the fixed effects. Bias-correction has been proposed for the mixed-effects model when only one covariate is present. In this paper, we derive the shrinkage factor of the empirical Bayes predictors of the random effects and the variance-covariance matrix of the corrected estimates when the model has more than one covariate. The empirical Bayes estimates and test statistics are then corrected using the derived factor. Theoretical derivations, simulation studies and a real data application demonstrate the validity of the proposed method in that the corrected estimates are unbiased and the corrected tests have correct p-values.

biology,computer science, interdisciplinary applications
Dealing with dynamic endogeneity in international business research

Jiatao Li,Haoyuan Ding,Yichuan Hu,Guoguang Wan

DOI: https://doi.org/10.1057/s41267-020-00398-8

IF: 11.6

2021-01-04

Journal of International Business Studies

Abstract:Dynamic endogeneity occurs when the current values of a study's independent variables are affected by the past values of the dependent variables, which can lead to biased estimates. Our analysis of 80 empirical papers published in the <i>Journal of International Business Studies</i> uncovers cases of inappropriate treatment of dynamic endogeneity. Our simulations reveal factors that lead to bias in a fixed effects estimator and highlight the advantages and disadvantages of the system generalized method of moments estimator. We demonstrate our points with an empirical study of the impact of the international experience of managers and board members on firm internationalization. We show how using a fixed effects estimator rather than a generalized method of moments estimator can lead to differences in regression results. We also show the proper use of a generalized method of moments estimator.

management,business
Neglected dynamics and spatial dependence on panel data: consequences for convergence of the usual static model estimators

Alain Pirotte,Jesús Mur

DOI: https://doi.org/10.1080/17421772.2016.1232839

2016-11-03

Spatial Economic Analysis

Abstract:Neglected dynamics and spatial dependence on panel data: consequences for convergence of the usual static model estimators. Spatial Economic Analysis. This article assumes that the estimated model is static, whereas the true model is an autoregressive distributed lag error components model including spatial dependence on the disturbances. We derive the probability limits of the ordinary least squares (OLS), Between and Within estimators of a static model on panel data. The results show that asymptotic biases of these estimators vary mainly according to the degree of spatial autocorrelation, the unobservable individual heterogeneity and the data generating process (DGP) of the explanatory variable. The probability limit of the Between estimator converges to the long-run effects, particularly when the individual unobserved heterogeneity is large, when compared with the idiosyncratic error term, and/or there is a strong time dynamic in the regressors. The interpretation is more contrasted for the OLS and Within estimators. The former can be associated under very restrictive conditions with the long-run effects; the latter with the short-run effects.

economics
Dynamic treatment effects: high-dimensional inference under model misspecification

Yuqian Zhang,Weijie Ji,Jelena Bradic

2023-06-16

Abstract:Estimating dynamic treatment effects is essential across various disciplines, offering nuanced insights into the time-dependent causal impact of interventions. However, this estimation presents challenges due to the "curse of dimensionality" and time-varying confounding, which can lead to biased estimates. Additionally, correctly specifying the growing number of treatment assignments and outcome models with multiple exposures seems overly complex. Given these challenges, the concept of double robustness, where model misspecification is permitted, is extremely valuable, yet unachieved in practical applications. This paper introduces a new approach by proposing novel, robust estimators for both treatment assignments and outcome models. We present a "sequential model double robust" solution, demonstrating that double robustness over multiple time points can be achieved when each time exposure is doubly robust. This approach improves the robustness and reliability of dynamic treatment effects estimation, addressing a significant gap in this field.

Methodology,Machine Learning,Econometrics,Statistics Theory
Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator

Joseph Cummins,Douglas L. Miller,Brock Smith,David Simon

DOI: https://doi.org/10.1515/jem-2021-0019

2023-10-28

Journal of Econometric Methods

Abstract:We investigate the properties of a systematic bias that arises in the synthetic control estimator in panel data settings with finite pre-treatment periods, offering intuition and guidance to practitioners. The bias comes from matching to idiosyncratic error terms (noise) in the treated unit and the donor units' pre-treatment outcome values. This in turn leads to a biased counterfactual for the post-treatment periods. We use Monte Carlo simulations to evaluate the determinants of the bias in terms of error term variance, sample characteristics and DGP complexity, providing guidance as to which situations are likely to yield more bias. We also offer a procedure to reduce the bias using a direct computational bias-correction procedure based on re-sampling from a pilot model that can reduce the bias in empirically feasible implementations. As a final potential solution, we compare the performance of our corrections to that of an Interactive Fixed Effects model. An empirical application focused on trade liberalization indicates that the magnitude of the bias may be economically meaningful in a real world setting.
Simple Models and Biased Forecasts

Pooya Molavi

DOI: https://doi.org/10.48550/arXiv.2202.06921

2024-10-09

Abstract:This paper proposes a framework in which agents are constrained to use simple models to forecast economic variables and characterizes the resulting biases. It considers agents who can only entertain state-space models with no more than $d$ states, where $d$ measures the intertemporal complexity of a model. Agents are boundedly rational in that they can only consider models that are too simple to nest the true process, yet they use the best model among those considered. I show that using simple models adds persistence to forward-looking decisions and increases the comovement among them. I then explain how this insight can bring the predictions of three workhorse macroeconomic models closer to data. In the new-Keynesian model, forward guidance becomes less powerful. In the real business cycle model, consumption responds more sluggishly to productivity shocks. The Diamond--Mortensen--Pissarides model exhibits more internal propagation and more realistic comovement in response to productivity and separation shocks.

Theoretical Economics
Artificial neural networks to solve dynamic programming problems: A bias-corrected Monte Carlo operator

Julien Pascal

DOI: https://doi.org/10.1016/j.jedc.2024.104853

IF: 1.62

2024-03-30

Journal of Economic Dynamics and Control

Abstract:Artificial Neural Networks (ANNs) are powerful tools that can solve dynamic programming problems arising in economics. In this context, estimating ANN parameters involves minimizing a loss function based on the model's stochastic functional equations. In general, the expectations appearing in the loss function admit no closed-form solution, so numerical approximation techniques must be used. In this paper, I analyze a bias-corrected Monte Carlo operator (bc-MC) that approximates expectations by Monte Carlo. I show that the bc-MC operator is a generalization of the all-in-one expectation operator, already proposed in the literature. I demonstrate that, under some conditions on the primitives of the economic model, the bc-MC operator is the unbiased estimator of the loss function with the minimum variance. I propose a method to optimally set the hyperparameters defining the bc-MC operator, and illustrate the findings numerically with well-known economic models. I also demonstrate that the bc-MC operator can scale to high-dimensional models. With just approximately a minute of computing time, I find a global solution to an economic model with a kink in the decision function and more than 100 dimensions.

economics
Nonparametric Dynamic Panel Data Models with Interactive Fixed Effects: Sieve Estimation and Specification Testing ∗

Liangjun Su,Yonghui Zhang

2013-01-01

Abstract:In this paper we analyze nonparametric dynamic panel data models with interactive fixed effects, where the predetermined regressors enter the models nonparametrically and the common factors enter the models linearly but with individual specific factor loadings. We consider the issues of estimation and specification testing when both the cross-sectional dimension  and the time dimension  are large. We propose sieve estimation for the nonparametric function by extending Bai’s (2009) principal component analysis (PCA) to our nonparametric framework. Based on the asymptotic expansion of the Gaussian quasi-log-likelihood function, we deriv et he convergence rate for the sieve estimator and establish its asymptotic normality. The sources of asymptotic biases are discussed and a bias-corrected estimator is provided. We also propose a consistent specification test for the linearity of the functional form by comparing the linear and sieve estimators. We establish the asymptotic distributions of the test statistic under both the null hypothesis and a sequence of Pitman local alternatives. A bootstrap procedure is proposed to obtain the bootstrap -values and its asymptotic validity is justified. Monte Carlo simulations are conducted to investigate the finite sample performance of our estimator and test. We apply our method to an economic growth data set to study the relationship between capital accumulation and real GDP growth rate.
Semiparametric Estimation Of Dynamic Binary Choice Panel Data Models

Fu Ouyang,Thomas Tao Yang

DOI: https://doi.org/10.1017/s0266466624000057

IF: 1.968

2024-03-12

Econometric Theory

Abstract:We propose a new approach to the semiparametric analysis of panel data binary choice models with fixed effects and dynamics (lagged dependent variables). The model under consideration has the same random utility framework as in Honoré and Kyriazidou (2000, Econometrica 68, 839–874). We demonstrate that, with additional serial dependence conditions on the process of deterministic utility and tail restrictions on the error distribution, the (point) identification of the model can proceed in two steps, and requires matching only the value of an index function of explanatory variables over time, rather than the value of each explanatory variable. Our identification method motivates an easily implementable, two-step maximum score (2SMS) procedure – producing estimators whose rates of convergence, in contrast to Honoré and Kyriazidou's (2000, Econometrica 68, 839–874) methods, are independent of the model dimension. We then analyze the asymptotic properties of the 2SMS procedure and propose bootstrap-based distributional approximations for inference. Evidence from Monte Carlo simulations indicates that our procedure performs satisfactorily in finite samples.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Dynamic Selection in Algorithmic Decision-making

Jin Li,Ye Luo,Xiaowei Zhang

2023-09-28

Abstract:This paper identifies and addresses dynamic selection problems in online learning algorithms with endogenous data. In a contextual multi-armed bandit model, a novel bias (self-fulfilling bias) arises because the endogeneity of the data influences the choices of decisions, affecting the distribution of future data to be collected and analyzed. We propose an instrumental-variable-based algorithm to correct for the bias. It obtains true parameter values and attains low (logarithmic-like) regret levels. We also prove a central limit theorem for statistical inference. To establish the theoretical properties, we develop a general technique that untangles the interdependence between data and actions.

Econometrics,Machine Learning,Optimization and Control,Methodology
Improved inference for interactive fixed effects model under cross-sectional dependence

Zhenhao Gong,Min Seong Kim,Kim, Min Seong

DOI: https://doi.org/10.1007/s00181-024-02569-0

IF: 3.2

2024-03-03

Empirical Economics

Abstract:This paper proposes an inference procedure for the interactive fixed effects model that is valid in the presence of cross-sectional dependence. When the error terms are cross-sectionally dependent, the least square (LS) estimator of this model is asymptotically biased and therefore the associated confidence interval tends to have a large coverage error. To address this, we propose a bias correction of the LS estimator and a cross-sectional dependence robust variance estimator to construct associated test statistics. The paper also discusses practical issues in implementing the proposed method, including the construction of distance that reflects the decaying pattern of cross-sectional dependence and the selection of the bandwidth parameters. Monte Carlo simulations show our procedure works well in finite samples. As empirical illustrations, we apply our procedure to study the effect of divorce law reforms on divorce rates and the impact of clean water and sewerage interventions on child mortality.

economics,social sciences, mathematical methods
Correction of overfitting bias in regression models

Emanuele Massa,Marianne Jonker,Kit Roes,Anthony Coolen

2023-09-04

Abstract:Regression analysis based on many covariates is becoming increasingly common. However, when the number of covariates $p$ is of the same order as the number of observations $n$, maximum likelihood regression becomes unreliable due to overfitting. This typically leads to systematic estimation biases and increased estimator variances. It is crucial for inference and prediction to quantify these effects correctly. Several methods have been proposed in literature to overcome overfitting bias or adjust estimates. The vast majority of these focus on the regression parameters. But failure to estimate correctly also the nuisance parameters may lead to significant errors in confidence statements and outcome prediction. In this paper we present a jacknife method for deriving a compact set of non-linear equations which describe the statistical properties of the ML estimator in the regime where $p=O(n)$ and under the hypothesis of normally distributed covariates. These equations enable one to compute the overfitting bias of maximum likelihood (ML) estimators in parametric regression models as functions of $\zeta = p/n$. We then use these equations to compute shrinkage factors in order to remove the overfitting bias of maximum likelihood (ML) estimators. This new derivation offers various benefits over the replica approach in terms of increased transparency and reduced assumptions. To illustrate the theory we performed simulation studies for multiple regression models. In all cases we find excellent agreement between theory and simulations.

Methodology,Statistics Theory,Data Analysis, Statistics and Probability
Efficient Algorithms for Covariate Analysis with Dynamic Data Using Nonlinear Mixed-Effects Model.

Min Yuan,Zhi Zhu,Yaning Yang,Minghua Zhao,Kate Sasser,Hisham Hamadeh,Jose Pinheiro,Xu Steven Xu

DOI: https://doi.org/10.1177/0962280220949898

IF: 2.494

2020-01-01

Statistical Methods in Medical Research

Abstract:Nonlinear mixed-effects modeling is one of the most popular tools for analyzing repeated measurement data, particularly for applications in the biomedical fields. Multiple integration and nonlinear optimization are the two major challenges for likelihood-based methods in nonlinear mixed-effects modeling. To solve these problems, approaches based on empirical Bayesian estimates have been proposed by breaking the problem into a nonlinear mixed-effects model with no covariates and a linear regression model without random effect. This approach is time-efficient as it involves no covariates in the nonlinear optimization. However, covariate effects based on empirical Bayesian estimates are underestimated and the bias depends on the extent of shrinkage. Marginal correction method has been proposed to correct the bias caused by shrinkage to some extent. However, the marginal approach appears to be suboptimal when testing covariate effects on multiple model parameters, a situation that is often encountered in real-world data analysis. In addition, the marginal approach cannot correct the inaccuracy in the associated p-values. In this paper, we proposed a simultaneous correction method (nSCEBE), which can handle the situation where covariate analysis is performed on multiple model parameters. Simulation studies and real data analysis showed that nSCEBE is accurate and efficient for both effect-size estimation and p-value calculation compared with the existing methods. Importantly, nSCEBE can be >2000 times faster than the standard mixed-effects models, potentially allowing utilization for high-dimension covariate analysis for longitudinal or repeated measured outcomes.
Bias Correction and Robust Inference in Semiparametric Models

Jungjun Choi,Xiye Yang

DOI: https://doi.org/10.48550/arXiv.1908.00414

2020-10-14

Abstract:This paper analyzes several different biases that emerge from the (possibly) low-precision nonparametric ingredient in a semiparametric model. We show that both the variance part and the bias part of the nonparametric ingredient can lead to some biases in the semiparametric estimator, under conditions weaker than typically required in the literature. We then propose two bias-robust inference procedures, based on multi-scale jackknife and analytical bias correction, respectively. We also extend our framework to the case where the semiparametric estimator is constructed by some discontinuous functionals of the nonparametric ingredient. Simulation study shows that both bias-correction methods have good finite-sample performance.

Statistics Theory
To Adjust or Not to Adjust? Sensitivity Analysis of M-Bias and Butterfly-Bias

Peng Ding,Luke Miratrix

DOI: https://doi.org/10.48550/arXiv.1408.0324

2014-08-02

Abstract:"M-Bias," as it is called in the epidemiologic literature, is the bias introduced by conditioning on a pretreatment covariate due to a particular "M-Structure" between two latent factors, an observed treatment, an outcome, and a "collider." This potential source of bias, which can occur even when the treatment and the outcome are not confounded, has been a source of considerable controversy. We here present formulae for identifying under which circumstances biases are inflated or reduced. In particular, we show that the magnitude of M-Bias in linear structural equation models tends to be relatively small compared to confounding bias, suggesting that it is generally not a serious concern in many applied settings. These theoretical results are consistent with recent empirical findings from simulation studies. We also generalize the M-Bias setting (1) to allow for the correlation between the latent factors to be nonzero, and (2) to allow for the collider to be a confounder between the treatment and the outcome. These results demonstrate that mild deviations from the M-Structure tend to increase confounding bias more rapidly than M-Bias, suggesting that choosing to condition on any given covariate is generally the superior choice. As an application, we re-examine a controversial example between Professors Donald Rubin and Judea Pearl.

Statistics Theory
Approximation-Robust Inference in Dynamic Discrete Choice

Ben Deaner

DOI: https://doi.org/10.48550/arXiv.2010.11482

2020-10-22

Abstract:Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results in invalid confidence sets. We present a method for set estimation and inference that explicitly accounts for the use of approximation and is thus valid regardless of the approximation error. We show how one can account for the error from approximation at low computational cost. Our methodology allows researchers to assess the estimation error due to the use of approximation and thus more effectively manage the trade-off between bias and computational expedience. We provide simulation evidence to demonstrate the practicality of our approach.

Econometrics
Semiparametric Estimation of Dynamic Discrete Choice Models

Nicholas Buchholz,Matthew Shum,Haiqing Xu

DOI: https://doi.org/10.2139/ssrn.3378724

2019-01-01

SSRN Electronic Journal

Abstract:<p>We consider the estimation of dynamic binary choice models in a semiparametric setting, in which the per-period utility functions are known up to a finite number of parameters, but the distribution of utility shocks is left unspecified. This semiparametric setup differs from most of the existing identification and estimation literature for dynamic discrete choice models. To show identification we derive and exploit a new recursive representation for the unknown quantile function of the utility shocks. Our estimators are straightforward to compute, and resemble classic closed-form estimators from the literature on semiparametric regression and average derivative estimation. Monte Carlo simulations demonstrate that our estimator performs well in small samples.</p>
Bootstrap Inference for Fixed‐Effect Models

Ayden Higgins,Koen Jochmans

DOI: https://doi.org/10.3982/ecta20712

IF: 6.1

2024-03-20

Econometrica

Abstract:The maximum‐likelihood estimator of nonlinear panel data models with fixed effects is asymptotically biased under rectangular‐array asymptotics. The literature has devoted substantial effort to devising methods that correct for this bias as a means to salvage standard inferential procedures. The chief purpose of this paper is to show that the (recursive, parametric) bootstrap replicates the asymptotic distribution of the (uncorrected) maximum‐likelihood estimator and of the likelihood‐ratio statistic. This justifies the use of confidence sets and decision rules for hypothesis testing constructed via conventional bootstrap methods. No modification for the presence of bias needs to be made.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability

Biases in dynamic models with fixed effects

A note on the estimation problem of dynamic binary panel data model with fixed effects

Bias Correction Estimator for A Dynamic Panel Data Model with Fixed Effects Using an Iterated Bootstrap

Bias correction for multiple covariate analysis using empirical bayesian estimation in mixed-effects models for longitudinal data

Dealing with dynamic endogeneity in international business research

Neglected dynamics and spatial dependence on panel data: consequences for convergence of the usual static model estimators

Dynamic treatment effects: high-dimensional inference under model misspecification

Matching on Noise: Finite Sample Bias in the Synthetic Control Estimator

Simple Models and Biased Forecasts

Artificial neural networks to solve dynamic programming problems: A bias-corrected Monte Carlo operator

Nonparametric Dynamic Panel Data Models with Interactive Fixed Effects: Sieve Estimation and Specification Testing ∗

Semiparametric Estimation Of Dynamic Binary Choice Panel Data Models

Dynamic Selection in Algorithmic Decision-making

Improved inference for interactive fixed effects model under cross-sectional dependence

Correction of overfitting bias in regression models

Efficient Algorithms for Covariate Analysis with Dynamic Data Using Nonlinear Mixed-Effects Model.

Bias Correction and Robust Inference in Semiparametric Models

To Adjust or Not to Adjust? Sensitivity Analysis of M-Bias and Butterfly-Bias

Approximation-Robust Inference in Dynamic Discrete Choice

Semiparametric Estimation of Dynamic Discrete Choice Models

Bootstrap Inference for Fixed‐Effect Models