Abstract:This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is renowned for its strong consistency and optimality generally credited to Cramer. These properties, however, falter when the model is not regular or not completely accurate. In addition, their applicability is limited to local maxima close to the unknown true parameter value. One must therefore ascertain that the global maximum of the likelihood is strongly consistent under generic conditions (Wald, 1949). Global consistency is also a vital research problem in the context of empirical likelihood (Owen, 2001). The EL is a ground-breaking platform for nonparametric statistical inference. A subsequent milestone is achieved by placing estimating functions under the EL umbrella (Qin and Lawless, 1994). The resulting profile EL function possesses many nice properties of parametric likelihood but also shares the same shortcomings. These properties cannot be utilized unless we know the local maximum at hand is close to the unknown true parameter value. To overcome this obstacle, we first put forward a clean set of conditions under which the global maximum is consistent. We then develop a global maximum test to ascertain if the local maximum at hand is in fact a global maximum. Furthermore, we invent a global maximum remedy to ensure global consistency by expanding the set of estimating functions under EL. Our simulation experiments on many examples from the literature firmly establish that the proposed approaches work as predicted. Our approaches also provide superior solutions to problems of their parametric counterparts investigated by DeHaan (1981), Veall (1991), and Gan and Jiang (1999).

Maximum leave-one-out likelihood estimation for location parameter of unbounded densities

On improved estimation of the larger location parameter

Penalized Maximum Likelihood Estimator for Mixture of von Mises-Fisher Distributions

Maximum-Likelihood-Estimation of Parameters under A Spatial Sampling Scheme

Robust explicit estimation of the log-logistic distribution with applications

Maximum Likelihood from Incomplete Data Via the EM Algorithm

Maximum Likelihood Inference in Robust Linear Mixed-Effects Models Using Multivariate T Distributions

Estimating location parameters of two exponential distributions with ordered scale parameters

Maximum Entropy Estimator for Hidden Markov Models: Reduction to Dimension 2

A location Invariant Statistic-Based Consistent Estimation Method for Three-Parameter Generalized Exponential Distribution

Quasi-maximum likelihood estimation and penalized estimation under non-standard conditions

On Weight Design of Maximum Weighted Likelihood and an Extended EM Algorithm

Near Universal Consistency of the Maximum Pseudolikelihood Estimator for Discrete Models

Tilting maximum Lq-Likelihood estimation for extreme values drawing on block maxima

Global Consistency of Empirical Likelihood

Multivariate, Heteroscedastic Empirical Bayes via Nonparametric Maximum Likelihood

Maximum likelihood estimation for left-truncated log-logistic distributions with a given truncation point

On the tails of log-concave density estimators

Maximum likelihood estimation for a special exponential family under random double-truncation

Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimation

Model-free Estimation of Latent Structure via Multiscale Nonparametric Maximum Likelihood