Abstract:This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is renowned for its strong consistency and optimality generally credited to Cramer. These properties, however, falter when the model is not regular or not completely accurate. In addition, their applicability is limited to local maxima close to the unknown true parameter value. One must therefore ascertain that the global maximum of the likelihood is strongly consistent under generic conditions (Wald, 1949). Global consistency is also a vital research problem in the context of empirical likelihood (Owen, 2001). The EL is a ground-breaking platform for nonparametric statistical inference. A subsequent milestone is achieved by placing estimating functions under the EL umbrella (Qin and Lawless, 1994). The resulting profile EL function possesses many nice properties of parametric likelihood but also shares the same shortcomings. These properties cannot be utilized unless we know the local maximum at hand is close to the unknown true parameter value. To overcome this obstacle, we first put forward a clean set of conditions under which the global maximum is consistent. We then develop a global maximum test to ascertain if the local maximum at hand is in fact a global maximum. Furthermore, we invent a global maximum remedy to ensure global consistency by expanding the set of estimating functions under EL. Our simulation experiments on many examples from the literature firmly establish that the proposed approaches work as predicted. Our approaches also provide superior solutions to problems of their parametric counterparts investigated by DeHaan (1981), Veall (1991), and Gan and Jiang (1999).

Maximum Ideal Likelihood Estimator: An New Estimation and Inference Framework for Latent Variable Models

Maximum Approximated Likelihood Estimation

On the maximum likelihood estimation in general log-linear models

Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimation

Near Universal Consistency of the Maximum Pseudolikelihood Estimator for Discrete Models

Development of Integrated Choice and Latent Variable (ICLV) Models Using Matrix-Based Analytic Approximation and Automatic Differentiation Methods on TensorFlow Platform

A Multiscale Perspective on Maximum Marginal Likelihood Estimation

Targeted Maximum Likelihood Estimation using Exponential Families

Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Momentum Particle Maximum Likelihood

Statistical Inference for Generative Models with Maximum Mean Discrepancy

Dimension-reduced Empirical Likelihood Estimation and Inference for M-estimators with Nonignorable Nonresponse

On Fenchel Mini-Max Learning.

Quasi Maximum Likelihood Estimation for Large-Dimensional Matrix Factor Models

Inference for High-Dimensional Linear Mixed-Effects Models: A Quasi-Likelihood Approach

Maximum Likelihood Estimation under the Emax Model: Existence, Geometry and Efficiency

Global Consistency of Empirical Likelihood

Maximum Reconstruction Estimation for Generative Latent-Variable Models.

On the correspondence of deviances and maximum likelihood and interval estimates from log-linear to logistic regression modelling

Maximum Marginal Likelihood Estimation of a Monotonic Polynomial Generalized Partial Credit Model with Applications to Multiple Group Analysis