Abstract:<span>We propose a framework for inference based on an "iterative likelihood function," which provides a unified representation for a number of iterative approaches, including the EM algorithm and the generalized estimating equations (GEEs). The parameters are decoupled to facilitate construction of the inference vehicle, to simplify computation, or to ensure robustness to model misspecification and then recoupled to retain their original interpretations. For simplicity, throughout the paper, we will refer to the log-likelihood as the "likelihood." We define the global, local, and stationary estimates of an iterative likelihood and, correspondingly, the global, local, and stationary attraction points of the expected iterative likelihood. Asymptotic properties of the global, local, and stationary estimates are derived under certain assumptions. An iterative likelihood is usually constructed such that the true value of the parameter is a point of attraction of the expected log-likelihood. Often, one can only verify that the true value of the parameter is a local or stationary attraction, but not a global attraction. We show that when the true value of the parameter is a global attraction, any global estimate is consistent and asymptotically normal; when the true value is a local or stationary attraction, there exists a local or stationary estimate that is consistent and asymptotically normal, with a probability tending to 1. The behavior of the estimates under a misspecified model is also discussed. Our methodology is illustrated with three examples: (i) estimation of the treatment group difference in the level of censored HIV RNA viral load from an AIDS clinical trial; (ii) analysis of the relationship between forced expiratory volume and height in girls from a longitudinal pulmonary function study; and (iii) investigation of the impact of smoking on lung cancer in the presence of DNA adducts. Two additional examples are in the <a class="ext-link" href="https://doi.org/10.1080/10618600.2021.1904961">supplementary materials</a>, GEEs with missing covariates and an unweighted estimator for big data with subsampling. Supplementary files for this article are available online.</span>

Likelihood inference for exponential-trawl processes

Likelihood-based inference and forecasting for trawl processes: a stochastic optimization approach

Discrete-time trawl processes with long memory

Nonparametric estimation of trawl processes: Theory and Applications

Spectral estimation for non-linear long range dependent discrete time trawl processes

A latent trawl process model for extreme values

Limit theorems for integrated trawl processes with symmetric Lévy bases

Limit Theorems for Trawl Processes

Simulation methods and error analysis for trawl processes and ambit fields

Intermittency of trawl processes

Asymptotic Theory for Explosive Fractional Ornstein-Uhlenbeck Processes

Likelihood inference of the non-stationary Hawkes process with non-exponential kernel

Likelihood free inference for Markov processes: a comparison

Iterative Likelihood: A Unified Inference Tool

Likelihood-based inference, identifiability and prediction using count data from lattice-based random walk models

The Pearson Diffusions: A Class of Statistically Tractable Diffusion Processes

Maximum likelihood estimation for a special exponential family under random double-truncation

Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

Amortized Simulation-Based Frequentist Inference for Tractable and Intractable Likelihoods

Information divergences and likelihood ratios of Poisson processes and point patterns

Neural Likelihood Approximation for Integer Valued Time Series Data