Abstract:In capture–recapture experiments, the presence of overdispersion and heterogeneity necessitates the use of the negative binomial regression model for inferring population sizes. However, within this model, existing methods based on likelihood and ratio regression for estimating the dispersion parameter often face boundary and nonidentifiability issues. These problems can result in nonsensically large point estimates and unbounded upper limits of confidence intervals for the population size. We present a penalized empirical likelihood technique for solving these two problems by imposing a half-normal prior on the population size. Based on the proposed approach, a maximum penalized empirical likelihood estimator with asymptotic normality and a penalized empirical likelihood ratio statistic with asymptotic chi-square distribution are derived. To improve numerical performance, we present an effective expectation-maximization (EM) algorithm. In the M-step, optimization for the model parameters could be achieved by fitting a standard negative binomial regression model via the R basic function glm.nb(). This approach ensures the convergence and reliability of the numerical algorithm. Using simulations, we analyze several synthetic datasets to illustrate three advantages of our methods in finite-sample cases: complete mitigation of the boundary problem, more efficient maximum penalized empirical likelihood estimates, and more precise penalized empirical likelihood ratio interval estimates compared to the estimates obtained without penalty. These advantages are further demonstrated in a case study estimating the abundance of black bears (Ursus americanus) at the U.S. Army's Fort Drum Military Installation in northern New York.

Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signals Detection

ELASTIC-NET REGULARIZED HIGH-DIMENSIONAL NEGATIVE BINOMIAL REGRESSION: CONSISTENCY AND WEAK SIGNAL DETECTION

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Consistency of $\ell _{1}$ Penalized Negative Binomial Regressions

Stability of the Elastic Net Estimator

Nonnegative Elastic Net and application in index tracking

A Naïve Bayes Regularized Logistic Regression Estimator for Low-dimensional Classification

On Estimation Error Bounds of the Elastic Net when P ≫ N

Accurate inference in negative binomial regression

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Efficient Tuning-Free $\ell_1$-Regression of Nonnegative Compressible Signals

Iterative Reweighted Framework Based Algorithms for Sparse Linear Regression with Generalized Elastic Net Penalty

Enmsp: an elastic-net multi-step screening procedure for high-dimensional regression

Robust Negative Binomial Regression via the Kibria–Lukman Strategy: Methodology and Application

Robust Elastic Net Regression

A Penalized Empirical Likelihood Approach for Estimating Population Sizes under the Negative Binomial Regression Model

Sparse-penalized deep neural networks estimator under weak dependence

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

High-dimensional variable selection with heterogeneous signals: A precise asymptotic perspective

Weighted Lasso Estimates for Sparse Logistic Regression: Non-Asymptotic Properties with Measurement Errors

Non-Asymptotic Guarantees for Robust Statistical Learning under Infinite Variance Assumption