The Weighted Method of Moments Approach for Moment Condition Models

Zhiguo Xiao

DOI: https://doi.org/10.1016/j.econlet.2010.01.019

IF: 1.469

2010-01-01

Economics Letters

Abstract:This paper proposes weighted method of moments for estimating over-identified moment condition models. Weighted method of moments is asymptotically equivalent to, but may have better finite sample properties than generalized method of moments and empirical likelihood.

What problem does this paper attempt to address?

Adaptive Shrinkage Estimation of High Dimensional Moment Condition Model with Smooth Structural Changes

Xingyi Chen,Yongmiao Hong,Haiqi Li

DOI: https://doi.org/10.2139/ssrn.3792704

2021-01-01

SSRN Electronic Journal

Abstract:Structural change is a long-standing problem in time series econometrics and macroeconomics, and financial time series are likely to be affected by structural instability due to changes in preferences, technologies, policies, etc. Most of the existing literature on moment condition models assumed that structural parameters were fixed over the entire sample period. To allow for time-varying structural parameters in the high dimensional moment condition models, this paper proposes a shrinkage local generalized method of moment (SLGMM) which simultaneously achieves parameter estimation and moment selection. We show that our method consistently selects the correct moment conditions and the SLGMM estimator possesses the oracle property, that is, it is as efficient as the time-varying GMM estimator based on all valid moment conditions. Moreover, we establish the consistency and asymptotic normality of the SLGMM estimator. A Monte Carlo simulation and an empirical application on asset pricing are conducted to show the merits of the newly proposed method.
Efficient Estimation of Moment Condition Models with Heterogenous Populations

Zhiguo Xiao

2011-01-01

Annals of economics and finance

Abstract:A wide range of econometric and statistical models are specified through moment conditions. Efficient estimation of such models essentially employs two distinct ideas: optimally combining estimation equations (e.g., the optimal estimating equations of Codambe (1976), the generalized method of moments of Hansen (1982) and the empirical likelihood of Qin and Lawless (1994)), and optimally combining estimators (e.g., the weighted method of moments of Xiao (2010)). This paper extends these methods to moment condition models with heterogeneous populations. Comparison of the finite sample performance of the proposed estimators is conducted through Monte Carlo simulations.
Stochastic Generalized Method of Moments.

Guosheng Yin,Yanyuan Ma,Faming Liang,Ying Yuan

DOI: https://doi.org/10.1198/jcgs.2011.09210

2011-01-01

Journal of Computational and Graphical Statistics

Abstract:The generalized method of moments (GMM) is a very popular estimation and inference procedure based on moment conditions. When likelihood-based methods are difficult to implement, one can often derive various moment conditions and construct the GMM objective function. However, minimization of the objective function in the GMM may be challenging, especially over a large parameter space. Due to the special structure of the GMM, we propose a new sampling-based algorithm, the stochastic GMM sampler, which replaces the multivariate minimization problem by a series of conditional sampling procedures. We develop the theoretical properties of the proposed iterative Monte Carlo method, and demonstrate its superior performance over other GMM estimation procedures in simulation studies. As an illustration, we apply the stochastic GMM sampler to a Medfly life longevity study. Supplemental materials for the article are available online.
Estimating and Testing for Smooth Structural Changes in Moment Condition Models

Haiqi Li,Jin Zhou,Yongmiao Hong

DOI: https://doi.org/10.2139/ssrn.3792747

IF: 3.363

2024-01-01

Journal of Econometrics

Abstract:Numerous studies have been devoted to estimating and testing for moment condition models.Most of the existing studies assume that structural parameters are either fixed or changed abruptlyover time. This study considers estimation of and testing for smooth structural changes in momentcondition models where the data generating process is assumed to be locally stationary. A novellocal generalized method of moment estimator and its boundary-corrected counterpart are proposed to estimate the smoothly changing structural parameters. Consistency and asymptotic normality are established, and an optimal weighting matrix and its consistent estimator are obtained. In particular, a consistent nonparametric test is proposed to check both smooth changes and abrupt breaks in structural parameters. The test is asymptotically pivotal and does not require prior information about the alternative. A Monte Carlo study is performed to illustrate the merits ofthe proposed test. In an empirical application, we document the time-varying features of the riskaversion parameter in an asset pricing model, which are consistent with business cycles and financial crisis.
An approximated exponentially tilted empirical likelihood estimator of moment condition models

Fei Jin,Yuqin Wang

DOI: https://doi.org/10.1080/07474938.2024.2339146

IF: 1.2

2024-05-10

Econometric Reviews

Abstract:This study proposes an approximated estimator for moment condition models. Our estimator approximates the exponentially tilted empirical likelihood (ETEL) estimator in Schennach (2007) by using a second-order approximation of implied probabilities (IPs) for the exponential tilting (ET). The resulting approximated ETEL estimator generates positive IPs. As the nested optimization of ETEL and EL is avoided, it is computationally simple. It is second-order asymptotically equivalent to the EL estimator. In particular, it has the same O ( n −1 ) bias as EL. It also has the same O ( n −2 ) variance as EL. Like ET and ETEL estimators, it is n convergent under model misspecification, while the EL estimator may not be.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Efficient GMM Estimation with Singular System of Moment Conditions

Zhiguo Xiao

DOI: https://doi.org/10.1080/24754269.2019.1653159

2020-01-01

Statistical Theory and Related Fields

Abstract:Standard generalised method of moments (GMM) estimation was developed for nonsingular system of moment conditions. However, many important economic models are characterised by singular system of moment conditions. This paper shows that efficient GMM estimation of such models can be achieved by using the reflexive generalised inverses, in particular the Moore–Penrose generalised inverse, of the variance matrix of the sample moment conditions as the weighting matrix. We provide a consistent estimator of the optimal weighting matrix and establish its consistency. Potential issues of using generalised inverse and some remedies are also discussed.
Estimation Beyond Data Reweighting: Kernel Method of Moments

Heiner Kremer,Yassine Nemmour,Bernhard Schölkopf,Jia-Jie Zhu

2023-06-13

Abstract:Moment restrictions and their conditional counterparts emerge in many areas of machine learning and statistics ranging from causal inference to reinforcement learning. Estimators for these tasks, generally called methods of moments, include the prominent generalized method of moments (GMM) which has recently gained attention in causal inference. GMM is a special case of the broader family of empirical likelihood estimators which are based on approximating a population distribution by means of minimizing a $\varphi$-divergence to an empirical distribution. However, the use of $\varphi$-divergences effectively limits the candidate distributions to reweightings of the data samples. We lift this long-standing limitation and provide a method of moments that goes beyond data reweighting. This is achieved by defining an empirical likelihood estimator based on maximum mean discrepancy which we term the kernel method of moments (KMM). We provide a variant of our estimator for conditional moment restrictions and show that it is asymptotically first-order optimal for such problems. Finally, we show that our method achieves competitive performance on several conditional moment restriction tasks.

Machine Learning
Method of Moments Estimation for Affine Stochastic Volatility Models

Yan-Feng Wu,Xiangyu Yang,Jian-Qiang Hu

2024-08-17

Abstract:We develop moment estimators for the parameters of affine stochastic volatility models. We first address the challenge of calculating moments for the models by introducing a recursive equation for deriving closed-form expressions for moments of any order. Consequently, we propose our moment estimators. We then establish a central limit theorem for our estimators and derive the explicit formulas for the asymptotic covariance matrix. Finally, we provide numerical results to validate our method.

Statistical Finance,Econometrics
Robust parameter estimation of regression models under weakened moment assumptions

Kangqiang Li,Songqiao Tang,Lixin Zhang

DOI: https://doi.org/10.1016/j.spl.2022.109678

IF: 0.718

2022-01-01

Statistics & Probability Letters

Abstract:This paper provides some extended results on estimating parameter matrix of several regression models when the covariate or response possesses weaker moment condition. We study the M-estimator of Fan et al. (2021) for matrix completion model with (1+ϵ)-th moment noise. The corresponding phase transition phenomenon is observed. When 1>ϵ>0, the robust estimator possesses a slower convergence rate compared with previous literature. For high dimensional multiple index coefficient model, we propose an improved estimator via applying the element-wise truncation method to handle heavy-tailed data with finite fourth moment. The extensive simulation study validates our theoretical results.
Estimation for conditional moment models based on martingale difference divergence

Kunyang Song,Feiyu Jiang,Ke Zhu

DOI: https://doi.org/10.1111/jtsa.12788

2024-10-28

Journal of Time Series Analysis

Abstract:We provide a new estimation method for conditional moment models via the martingale difference divergence (MDD). Our MDD‐based estimation method is formed in the framework of a continuum of unconditional moment restrictions. Unlike the existing estimation methods in this framework, the MDD‐based estimation method adopts a non‐integrable weighting function, which could capture more information from unconditional moment restrictions than the integrable weighting function to enhance the estimation efficiency. Due to the nature of shift‐invariance in MDD, our MDD‐based estimation method can not identify the intercept parameters. To overcome this identification issue, we further provide a two‐step estimation procedure for the model with intercept parameters. Under regularity conditions, we establish the asymptotics of the proposed estimators, which are not only easy‐to‐implement with expectation‐based asymptotic variances, but also applicable to time series data with an unspecified form of conditional heteroskedasticity. Finally, we illustrate the usefulness of the proposed estimators by simulations and two real examples.

statistics & probability,mathematics, interdisciplinary applications
Bayesian estimation and comparison of conditional moment models

Siddhartha Chib,Minchul Shin,Anna Simoni

DOI: https://doi.org/10.1111/rssb.12484

2021-12-16

Abstract:Abstract We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The non-parametric exponentially tilted empirical likelihood function is constructed to satisfy a sequence of unconditional moments based on an increasing (in sample size) vector of approximating functions (such as tensor splines based on the splines of each conditioning variable). For any given sample size, results are robust to the number of expanded moments. We derive Bernstein–von Mises theorems for the behaviour of the posterior distribution under both correct and incorrect specification of the conditional moments, subject to growth rate conditions (slower under misspecification) on the number of approximating functions. A large-sample theory for comparing different conditional moment models is also developed. The central result is that the marginal likelihood criterion selects the model that is less misspecified. We also introduce sparsity-based model search for high-dimensional conditioning variables, and provide efficient Markov chain Monte Carlo computations for high-dimensional parameters. Along with clarifying examples, the framework is illustrated with real data applications to risk-factor determination in finance, and causal inference under conditional ignorability.

statistics & probability
Robust parameter estimation of regression model with weaker moment∗

Kangqiang Li,Songqiao Tang,Lixin Zhang

2021-01-01

Abstract:This paper provides some extended results on estimating the parameter matrix of high-dimensional regression model when the covariate or response possess weaker moment condition. We investigate the M -estimator of Fan et al. (Ann Stat 49(3):1239–1266, 2021) for matrix completion model with (1 + ǫ)-th moments. The corresponding phase transition phenomenon is observed. When ǫ ≥ 1, the robust estimator possesses the same convergence rate as previous literature. While 1 > ǫ > 0, the rate will be slower. For high dimensional multiple index coefficient model, we also apply the element-wise truncation method to construct a robust estimator which handle missing and heavy-tailed data with finite fourth moment.
Efficiency bounds for moment condition models with mixed identification strength

Prosper Dovonon,Yves F. Atchadé,Firmin Doko Tchatoka

DOI: https://doi.org/10.1016/j.jeconom.2024.105723

IF: 3.363

2024-03-14

Journal of Econometrics

Abstract:Moment condition models with mixed identification strength are models that are point identified but with estimating moment functions that are allowed to drift to 0 uniformly over the parameter space. Even though identification fails in the limit, depending on how slow the moment functions vanish, consistent estimation is possible. Existing estimators such as the generalized method of moment (GMM) estimator exhibit a pattern of nonstandard or even heterogeneous rate of convergence that materializes by some parameter directions being estimated at a slower rate than others. This paper derives asymptotic semiparametric efficiency bounds for regular estimators of parameters of these models. We show that GMM estimators are regular and that the so-called two-step GMM estimator – using the inverse of estimating function's variance as weighting matrix – is semiparametrically efficient as it reaches the minimum variance attainable by regular estimators. This estimator is also asymptotically minimax efficient with respect to a large family of loss functions. Monte Carlo simulations are provided that confirm these results.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications
On the Asymptotic Approximation of Inverse Moment under Sub-Linear Expectations

Yi Wu,Xuejun Wang,Lixin Zhang

DOI: https://doi.org/10.1016/j.jmaa.2018.08.010

IF: 1.417

2018-01-01

Journal of Mathematical Analysis and Applications

Abstract:In this paper, we will investigate the approximations of inverse moments for double-indexed weighted sums of random variables under sub-linear expectations. The asymptotic approximations of inverse moments and the convergence rate of approximations are established under the meaning of upper expectation Eˆ and the lower expectation εˆ, respectively. Moreover, we carry out some simulations to verify the validity of our theoretical results. The results obtained in the paper improve and extend the corresponding ones of Yang et al. [24] from independent random variables in the classical probability space to END random variables in sub-linear expectation space.
Modified generalized method of moments for a robust estimation of polytomous logistic model

Xiaoshan Wang

DOI: https://doi.org/10.7717/peerj.467

IF: 3.061

2014-07-01

PeerJ

Abstract:The maximum likelihood estimation (MLE) method, typically used for polytomous logistic regression, is prone to bias due to both misclassification in outcome and contamination in the design matrix. Hence, robust estimators are needed. In this study, we propose such a method for nominal response data with continuous covariates. A generalized method of weighted moments (GMWM) approach is developed for dealing with contaminated polytomous response data. In this approach, distances are calculated based on individual sample moments. And Huber weights are applied to those observations with large distances. Mellow-type weights are also used to downplay leverage points. We describe theoretical properties of the proposed approach. Simulations suggest that the GMWM performs very well in correcting contamination-caused biases. An empirical application of the GMWM estimator on data from a survey demonstrates its usefulness.

multidisciplinary sciences
METHOD OF MOMENTS ESTIMATION FOR LÉVY-DRIVEN ORNSTEIN–UHLENBECK STOCHASTIC VOLATILITY MODELS

Xiangyu Yang,Yanfeng Wu,Zeyu Zheng,Jian-Qiang Hu

DOI: https://doi.org/10.1017/s0269964820000315

2021-01-01

Probability in the Engineering and Informational Sciences

Abstract:This paper studies the parameter estimation for Ornstein–Uhlenbeck stochastic volatility models driven by Lévy processes. We propose computationally efficient estimators based on the method of moments that are robust to model misspecification. We develop an analytical framework that enables closed-form representation of model parameters in terms of the moments and autocorrelations of observed underlying processes. Under moderate assumptions, which are typically much weaker than those for likelihood methods, we prove large-sample behaviors for our proposed estimators, including strong consistency and asymptotic normality. Our estimators obtain the canonical square-root convergence rate and are shown through numerical experiments to outperform likelihood-based methods.
Separating common and idiosyncratic components without moment condition and on the weighted $L_1$ minimization path.

Yong He,Xin-Bing Kong,Lei Yu,Xinsheng Zhang

2020-01-01

Abstract:In large-dimensional factor analysis, existing methods, such as principal component analysis (PCA), assumed finite fourth moment of the idiosyncratic components, in order to derive the convergence rates of the estimated factor loadings and scores. However, in many areas, such as finance and macroeconomics, many variables are heavy-tailed. In this case, PCA-based estimators and their variations are not theoretically underpinned. In this paper, we investigate into the weighted $L_1$ minimization on the factor loadings and scores, which amounts to assuming a temporal and cross-sectional quantile structure for panel observations instead of the mean pattern in $L_2$ minimization. Without any moment constraint on the idiosyncratic errors, we correctly identify the common and idiosyncratic components for each variable. We obtained the convergence rates of a computationally feasible weighted $L_1$ minimization estimators via iteratively alternating the quantile regression cross-sectionally and serially. Bahardur representations for the estimated factor loadings and scores are provided under some mild conditions. In addition, a robust method is proposed to estimate the number of factors consistently. Simulation experiments checked the validity of the theory. Our analysis on a financial data set shows the superiority of the proposed method over other state-of-the-art methods.
Partial Linear Models for Longitudinal Data Based on Penalized General Method of Moments

Ni Yanfeng,Zhu Zhongyi

DOI: https://doi.org/10.3969/j.issn.1001-4268.2012.03.007

2012-01-01

Abstract:For the analysis of partial linear model with longitudinal data,the general procedure is to fit the nonparametric part with kernel or spline estimation,followed by generalized linear model estimating frame.In this paper,we fit the nonparametric part with P-spline,and estimate the parametrical and nonparametric part with different Generalized method of moments estimation for different moment conditions,implemented by the proof of the asymptotical properties for the estimator,which is also been proved by simulation and illustrative example,from which we can also find out that different penalized general method of moments estimations for different moment conditions perform more efficiently.
On Gmm Inference: Partial Identification, Identification Strength, And Nonstandard Asymptotics

Donald S. Poskitt

DOI: https://doi.org/10.1017/s0266466623000221

IF: 1.968

2023-09-19

Econometric Theory

Abstract:This paper analyses aspects of generalized method of moments (GMM) inference in moment equality models in settings where standard regularity conditions may break down. Explicit analytic formulations for the asymptotic distributions of estimable functions of the GMM estimator and statistics based on the GMM criterion function are derived under relatively mild assumptions. The moment Jacobian is allowed to be rank deficient, so first order identification may fail, the values of the Jacobian singular values are not constrained, thereby allowing for varying levels of identification strength, the long-run variance of the moment conditions can be singular, and the GMM criterion function weighting matrix may also be chosen sub-optimally. The large-sample properties are derived without imposing a specific structure on the functional form of the moment conditions. Closed-form expressions for the distributions are presented that can be evaluated using standard software without recourse to bootstrap or simulation methods. The practical operation of the results is illustrated via examples involving instrumental variables estimation of a structural equation with endogenous regressors and a common CH features model.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Robust inference for moment condition models without rational expectations

Xiaohong Chen,Lars Peter Hansen,Peter G. Hansen

DOI: https://doi.org/10.1016/j.jeconom.2023.105653

IF: 3.363

2024-01-27

Journal of Econometrics

Abstract:Applied researchers using structural models under rational expectations (RE) often confront empirical evidence of misspecification. In this paper we consider a generic dynamic model that is posed as a vector of unconditional moment restrictions. We suppose that the model is globally misspecified under RE, and thus empirically flawed in a way that is not econometrically subtle. We relax the RE restriction by allowing subjective beliefs to differ from the data-generating probability (DGP) model while still maintaining that the moment conditions are satisfied under the subjective beliefs of economic agents. We use statistical measures of divergence relative to RE to bound the set of subjective probabilities. This form of misspecification alters econometric identification and inferences in a substantial way, leading us to construct robust confidence sets for various set identified functionals.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications

The Weighted Method of Moments Approach for Moment Condition Models

Adaptive Shrinkage Estimation of High Dimensional Moment Condition Model with Smooth Structural Changes

Efficient Estimation of Moment Condition Models with Heterogenous Populations

Stochastic Generalized Method of Moments.

Estimating and Testing for Smooth Structural Changes in Moment Condition Models

An approximated exponentially tilted empirical likelihood estimator of moment condition models

Efficient GMM Estimation with Singular System of Moment Conditions

Estimation Beyond Data Reweighting: Kernel Method of Moments

Method of Moments Estimation for Affine Stochastic Volatility Models

Robust parameter estimation of regression models under weakened moment assumptions

Estimation for conditional moment models based on martingale difference divergence

Bayesian estimation and comparison of conditional moment models

Robust parameter estimation of regression model with weaker moment∗

Efficiency bounds for moment condition models with mixed identification strength

On the Asymptotic Approximation of Inverse Moment under Sub-Linear Expectations

Modified generalized method of moments for a robust estimation of polytomous logistic model

METHOD OF MOMENTS ESTIMATION FOR LÉVY-DRIVEN ORNSTEIN–UHLENBECK STOCHASTIC VOLATILITY MODELS

Separating common and idiosyncratic components without moment condition and on the weighted $L_1$ minimization path.

Partial Linear Models for Longitudinal Data Based on Penalized General Method of Moments

On Gmm Inference: Partial Identification, Identification Strength, And Nonstandard Asymptotics

Robust inference for moment condition models without rational expectations