Abstract:This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is renowned for its strong consistency and optimality generally credited to Cramer. These properties, however, falter when the model is not regular or not completely accurate. In addition, their applicability is limited to local maxima close to the unknown true parameter value. One must therefore ascertain that the global maximum of the likelihood is strongly consistent under generic conditions (Wald, 1949). Global consistency is also a vital research problem in the context of empirical likelihood (Owen, 2001). The EL is a ground-breaking platform for nonparametric statistical inference. A subsequent milestone is achieved by placing estimating functions under the EL umbrella (Qin and Lawless, 1994). The resulting profile EL function possesses many nice properties of parametric likelihood but also shares the same shortcomings. These properties cannot be utilized unless we know the local maximum at hand is close to the unknown true parameter value. To overcome this obstacle, we first put forward a clean set of conditions under which the global maximum is consistent. We then develop a global maximum test to ascertain if the local maximum at hand is in fact a global maximum. Furthermore, we invent a global maximum remedy to ensure global consistency by expanding the set of estimating functions under EL. Our simulation experiments on many examples from the literature firmly establish that the proposed approaches work as predicted. Our approaches also provide superior solutions to problems of their parametric counterparts investigated by DeHaan (1981), Veall (1991), and Gan and Jiang (1999).

Parsimonious and Efficient Likelihood Composition by Gibbs Sampling

Universal inference with composite likelihoods

Parsimonious and powerful composite likelihood testing for group difference and genotype-phenotype association

When Composite Likelihood Meets Stochastic Approximation

Insufficient Gibbs sampling

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

Interacting Particle Langevin Algorithm for Maximum Marginal Likelihood Estimation

A smoothed semiparametric likelihood for estimation of nonparametric finite mixture models with a copula-based dependence structure

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Robustness properties of marginal composite likelihood estimators

Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

Composite likelihood and maximum likelihood methods for joint latent class modeling of disease prevalence and high-dimensional semicontinuous biomarker data

Metropolized Randomized Maximum Likelihood for sampling from multimodal distributions

Global Consistency of Empirical Likelihood

Model selection in finite mixture of regression models: a Bayesian approach with innovative weighted g priors and reversible jump Markov chain Monte Carlo implementation (vol 85, pg 2456, 2015)

Combined and Least Squares Empirical Likelihood

Model robust hybrid likelihood

High-dimensional empirical likelihood inference

Near Universal Consistency of the Maximum Pseudolikelihood Estimator for Discrete Models

A Multiscale Perspective on Maximum Marginal Likelihood Estimation

Sampling hyperparameters in hierarchical models: improving on Gibbs for high-dimensional latent fields and large data sets