MINIMAX INVARIANT ESTIMATOR OF CONTINUOUS DISTRIBUTION FUNCTION UNDER

Jianhui Ning,Mei Xie

2007-01-01

Abstract:In this paper we consider the problem of estimation of a continuous distribution function under the LINEX loss function. The best invariant estimator is obtained, and proved to be minimax for any sample size n ‚ 1.

What problem does this paper attempt to address?

On continuous distribution functions, minimax and best invariant estimators, and integrated balanced loss functions

Mohammad Jafari Jozani,Alexandre Leblanc,Eric Marchand

DOI: https://doi.org/10.48550/arXiv.1308.1815

2013-08-08

Abstract:We consider the problem of estimating a continuous distribution function $F$, as well as meaningful functions $\tau(F)$ under a large class of loss functions. We obtain best invariant estimators and establish their minimaxity for Hölder continuous $\tau$'s and strict bowl-shaped losses with a bounded derivative. We also introduce and motivate the use of integrated balanced loss functions which combine the criteria of an integrated distance between a decision $d$ and $F$, with the proximity of $d$ with a target estimator $d_0$. Moreover, we show how the risk analysis of procedures under such an integrated balanced loss relates to a dual risk analysis under an "unbalanced" loss, and we derive best invariant estimators, minimax estimators, risk comparisons, dominance and inadmissibility results. Finally, we expand on various illustrations and applications relative to maxima-nomination sampling, median-nomination sampling, and a case study related to bilirubin levels in the blood of babies suffering from jaundice.

Statistics Theory
Rate Of Convergence For The Maximum Likelihood Estimator In Fractional Ornstein-Uhlenbeck Processes

Lin Sun,Youzhu Liu,Weijun Xu,Weilin Xiao

2012-01-01

Abstract:This paper studies the rate of convergence of the maximum likelihood estimator of drift parameter appearing fractional Ornstein-Uhlenbeck processes when Hurst parameter is greater than 1/2. The Laplace transform computations and the Holder's inequality are used to obtain the asymptotic convergence rate .
Limit theorems for kernel density estimators under dependent samples

yuexu zhao,zhengyan lin

2013-01-01

Abstract: In this paper, we construct a moment inequality for mixing dependent random variables, it is of independent interest. As applications, the consistency of the kernel density estimation is investigated. Several limit theorems are established: First, the central limit theorems for the kernel density estimator $f_{n,K}(x)$ and its distribution function are constructed. Also, the convergence rates of $\|f_{n,K}(x)-Ef_{n,K}(x)\|_{p}$ in sup-norm loss and integral $L^{p}$-norm loss are proved. Moreover, the a.s. convergence rates of the supremum of $|f_{n,K}(x)-Ef_{n,K}(x)|$ over a compact set and the whole real line are obtained. It is showed, under suitable conditions on the mixing rates, the kernel function and the bandwidths, that the optimal rates for i.i.d. random variables are also optimal for dependent ones.
Quantile Inference for Moderate Deviations from a Unit Root Model with Infinite Variance

Zhou Zhiyong,Lin Zhengyan

DOI: https://doi.org/10.1016/j.jkss.2014.09.004

2015-01-01

Abstract:The limit distribution of the quantile estimate for the moderate deviations from a unit root model with possibly infinite variance errors is derived. Both the mildly integrated case and the mildly explosive case are investigated. Quicker convergence rates than the ordinary least squares estimation are gained. Numerical simulations are conducted to illustrate the performance of our estimation procedure.
The functional central limit theorem for linear processes with strong near-epoch dependent innovations

Jin Qiu,Zhengyan Lin

DOI: https://doi.org/10.1016/j.jmaa.2010.10.078

IF: 1.417

2011-01-01

Journal of Mathematical Analysis and Applications

Abstract:This paper discusses linear processes with innovations exhibiting asymptotic weak dependence by being strong near-epoch dependent functions of mixing processes. The functional central limit theorem for the normalized partial sum process is established. The conditions given essentially improve on existing results in the literature in terms of the “size” requirement for the amount of dependence. It is also shown that two important econometric models, ARMA and GARCH models, are strong near-epoch dependent sequences.
The Functional Central Limit Theorem for Strong Near-Epoch Dependent Random Variables *

Zy Lin,J Qiu

DOI: https://doi.org/10.1080/10020070412331343061

2004-01-01

Chinese Annals of Mathematics Series B

Abstract:In this paper, a central limit theorem for strong near-epoch dependent sequences of random variables introduced in [9] is showed. Under the same moments condition, the authors essentially weaken the "size" requirement mentioned in other papers about near epoch dependence.
ADMISSIBILITY OF THE BEST INVARIANT ESTIMATOR OF A DISCRETE DISTRIBUTION FUNCTION

Anchi Yu,Qiqing

2003-01-01

Abstract:We consider the problem of invariant estimation of a discrete distribution function F under the Cramer-von Mises loss. It is proved that the best invariant estimator is admissible. This extends a result of Brown (1988) and settles an open question (Brown (1988)). The idea used in the proof of admissibility is a new refinement of the standard Bayes argument, which is different from the step-wise Bayes approach and Blyth’s (1951) Lemma.
Minimax rates of convergence for nonparametric location-scale models

Bingxin Zhao,Yuhong Yang

2023-07-04

Abstract:This paper studies minimax rates of convergence for nonparametric location-scale models, which include mean, quantile and expectile regression settings. Under Hellinger differentiability on the error distribution and other mild conditions, we show that the minimax rate of convergence for estimating the regression function under the squared $L_2$ loss is determined by the metric entropy of the nonparametric function class. Different error distributions, including asymmetric Laplace distribution, asymmetric connected double truncated gamma distribution, connected normal-Laplace distribution, Cauchy distribution and asymmetric normal distribution are studied as examples. Applications on low order interaction models and multiple index models are also given.

Statistics Theory
Distribution Estimation under the Infinity Norm

Aryeh Kontorovich,Amichai Painsky

2024-02-13

Abstract:We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees for the maximum likelihood estimator significantly improve upon the currently known results. A variety of techniques are utilized and innovated upon, including Chernoff-type inequalities and empirical Bernstein bounds. We illustrate our results in synthetic and real-world experiments. Finally, we apply our proposed framework to a basic selective inference problem, where we estimate the most frequent probabilities in a sample.

Statistics Theory,Machine Learning
Asymptotic Approximation of Inverse Moments of Nonnegative Random Variables

Tiee-Jian Wu,Xiaoping Shi,Baiqi Miao

DOI: https://doi.org/10.1016/j.spl.2009.02.010

IF: 0.718

2009-01-01

Statistics & Probability Letters

Abstract:Let {Zn,n≥1} be a sequence of independent nonnegative r.v.’s (random variables) with finite second moments. It is shown that under a Lindeberg-type condition, the αth inverse moment E{a+Xn}−α can be asymptotically approximated by the inverse of the αth moment {a+EXn}−α where a>0,α>0, and {Xn} are the naturally-scaled partial sums. Furthermore, it is shown that, when {Zn} only possess finite rth moments, 1≤r<2, the preceding asymptotic approximation can still be valid by using different norming constants which are the standard deviations of partial sums of suitably truncated {Zn}.
THE EB ESTIMATION OF PARAMETER IN TRUNCATED FAMILY WITH LINEX LOSS USING NA SAMPLES

许勇,师小琳,师义民

DOI: https://doi.org/10.3969/j.issn.0255-7797.2004.02.002

2004-01-01

Journal of Mathematics

Abstract:Under Linex loss we construct the EB estimation for the parameter of the two-sided truncated distribution families using negatively associated (NA) samples. The convergence rate of the proposed EB estimation is obtained and the rate can approach to 1 arbitrarily. Finally, an example has been given that satisfies the conditions of the main result.
SELF-NORMALIZED CENTRAL LIMIT THEOREM AND ESTIMATION OF VARIANCE OF PARTIAL SUMS FOR NEGATIVE DEPENDENT RANDOM VARIABLES

Zhang Lixin,Shi Strongway

DOI: https://doi.org/10.1007/s11766-002-0012-z

2002-01-01

Abstract:Let { X n , n≥1} be a stationary LNQD or NA sequence satisfying EX 1 = μ, EX 1 2 <∞ and (Var S n )/ n →σ 2 as n →∞. In this paper a class of self-normalized central limit theorems and estimators of Var S n are studied. The weak and strong consistency of the estimators of Var S n are presented.
Characterizing the minimax rate of nonparametric regression under bounded convex constraints

Akshay Prasadan,Matey Neykov

2024-03-10

Abstract:We quantify the minimax rate for a nonparametric regression model over a convex function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where \[\varepsilon^{\ast} =\sup\{\varepsilon>0:n\varepsilon^2 \le \log M_{\mathcal{F}}^{\operatorname{loc}}(\varepsilon,c)\},\] where $M_{\mathcal{F}}^{\operatorname{loc}}(\cdot, c)$ is the local metric entropy of $\mathcal{F}$ and our loss function is the squared population $L_2$ distance over our input space $\mathcal{X}$. In contrast to classical works on the topic [cf. Yang and Barron, 1999], our results do not require functions in $\mathcal{F}$ to be uniformly bounded in sup-norm. In addition, we prove that our estimator is adaptive to the true point, and to the best of our knowledge this is the first such estimator in this general setting. This work builds on the Gaussian sequence framework of Neykov [2022] using a similar algorithmic scheme to achieve the minimax rate. Our algorithmic rate also applies with sub-Gaussian noise. We illustrate the utility of this theory with examples including multivariate monotone functions, linear functionals over ellipsoids, and Lipschitz classes.

Statistics Theory
Mini-Max-Risk and Mini-Mean-Risk Inferences for A Partially Piecewise Regression

Lu Lin,Yongxin Liu,Chen Lin

DOI: https://doi.org/10.1080/02331888.2016.1274312

IF: 2.346

2017-01-01

Statistics

Abstract:We consider a partially piecewise regression in which the main regression coefficients are constant in all subdomains, but the extraessential regression function is variable in different pieces and is difficult to be estimated. Under this situation, two new regression methodologies are proposed under the criteria of mini-max-risk and mini-mean-risk. The resulting models can describe the regression relations in maximum-risk and mean-risk environments, respectively. A two-stage estimation procedure, together with a composite method, is introduced. The asymptotic normality of the estimators is established, the standard convergence rate and efficiency are achieved. Some unusual features of the new estimators and predictions, and the related variable selection are discussed for a comprehensive comparison. Simulation studies and a real-financial example are given to illustrate the new methodologies.
A Central Limit Theorem in Non‐parametric Regression with Truncated, Censored and Dependent Data

hanying liang,jacobo de unaalvarez,maria del carmen iglesiasperez

DOI: https://doi.org/10.1111/sjos.12105

2015-01-01

Scandinavian Journal of Statistics

Abstract:On the basis of the idea of the Nadaraya-Watson (NW) kernel smoother and the technique of the local linear (LL) smoother, we construct the NW and LL estimators of conditional mean functions and their derivatives for a left-truncated and right-censored model. The target function includes the regression function, the conditional moment and the conditional distribution function as special cases. It is assumed that the lifetime observations with covariates form a stationary -mixing sequence. Asymptotic normality of the estimators is established. Finite sample behaviour of the estimators is investigated via simulations. A real data illustration is included too.
Adaptive minimax estimation for discretely observed Lévy processes

Céline Duval,Taher Jalal,Ester Mariucci

2024-11-01

Abstract:In this paper, we study the nonparametric estimation of the density $f_\Delta$ of an increment of a Lévy process $X$ based on $n$ observations with a sampling rate $\Delta$. The class of Lévy processes considered is broad, including both processes with a Gaussian component and pure jump processes. A key focus is on processes where $f_\Delta$ is smooth for all $\Delta$. We introduce a spectral estimator of $f_\Delta$ and derive both upper and lower bounds, showing that the estimator is minimax optimal in both low- and high-frequency regimes. Our results differ from existing work by offering weaker, easily verifiable assumptions and providing non-asymptotic results that explicitly depend on $\Delta$. In low-frequency settings, we recover parametric convergence rates, while in high-frequency settings, we identify two regimes based on whether the Gaussian or jump components dominate. The rates of convergence are closely tied to the jump activity, with continuity between the Gaussian case and more general jump processes. Additionally, we propose a fully data-driven estimator with proven simplicity and rapid implementation, supported by numerical experiments.

Statistics Theory,Probability
CONFIDENCE INTERVALS FOR HIGH-DIMENSIONAL LINEAR REGRESSION: MINIMAX RATES AND ADAPTIVITY

T. Tony Cai,zijian guo

DOI: https://doi.org/10.1214/16-AOS1461

2017-01-01

Abstract:Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high-dimensional linear regression with random design. We first establish the convergence rates of the minimax expected length for confidence intervals in the oracle setting where the sparsity parameter is given. The focus is then on the problem of adaptation to sparsity for the construction of confidence intervals. Ideally, an adaptive confidence interval should have its length automatically adjusted to the sparsity of the unknown regression vector, while maintaining a pre-specified coverage probability. It is shown that such a goal is in general not attainable, except when the sparsity parameter is restricted to a small region over which the confidence intervals have the optimal length of the usual parametric rate. It is further demonstrated that the lack of adaptivity is not due to the conservativeness of the minimax framework, but is fundamentally caused by the difficulty of learning the bias accurately.
A nonparametric maximum likelihood estimation for biased-sampling data with zero-inflated truncation

Feipeng Zhang,Jiejing Yang,Min Ye

DOI: https://doi.org/10.1016/j.econlet.2020.109399

IF: 1.469

2020-01-01

Economics Letters

Abstract:This paper considers biased-sampling data with zero-inflated truncation, where the survival times are left truncated by zero-inflated distributed truncation times. We develop a nonparametric estimator of survival function for biased-sampling data with zero-inflated truncation via a new expectation–maximization algorithm. We demonstrate the good performance of the proposed estimator through numerical simulation studies. An empirical application of employment data is conducted to illustrate the method.
Quasi-minimax Estimation in the General Linear Regression Model

Hu Yang,Litong Wang,Lijuan Song

DOI: https://doi.org/10.1016/j.jspi.2008.09.016

IF: 1.095

2008-01-01

Journal of Statistical Planning and Inference

Abstract:This paper is mainly concerned with minimax estimation in the general linear regression model y=Xβ+ε under ellipsoidal restrictions on the parameter space and quadratic loss function. We confine ourselves to estimators that are linear in the response vector y. The minimax estimators of the regression coefficient β are derived under homogeneous condition and heterogeneous condition, respectively. Furthermore, these obtained estimators are the ridge-type estimators and mean dispersion error (MDE) superior to the best linear unbiased estimator b=(X′W-1X)-1X′W-1y under some conditions.
Limiting Distributions for the Minimum-Maximum Models

Ling Peng,Lei Gao

DOI: https://doi.org/10.3390/math7080719

IF: 2.4

2019-01-01

Mathematics

Abstract:We consider the extreme value problem of the minimum-maximum models for the independent and identically distributed random sequence and stationary random sequence, respectively. By invoking some probability formulas and Taylor’s expansions of the distribution functions, the limiting distributions for these two kinds of sequences are obtained. Moreover, convergence analysis is carried out for those extreme value distributions. Several numerical experiments are conducted to validate our theoretical results.

MINIMAX INVARIANT ESTIMATOR OF CONTINUOUS DISTRIBUTION FUNCTION UNDER

On continuous distribution functions, minimax and best invariant estimators, and integrated balanced loss functions

Rate Of Convergence For The Maximum Likelihood Estimator In Fractional Ornstein-Uhlenbeck Processes

Limit theorems for kernel density estimators under dependent samples

Quantile Inference for Moderate Deviations from a Unit Root Model with Infinite Variance

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

The Functional Central Limit Theorem for Strong Near-Epoch Dependent Random Variables *

ADMISSIBILITY OF THE BEST INVARIANT ESTIMATOR OF A DISCRETE DISTRIBUTION FUNCTION

Minimax rates of convergence for nonparametric location-scale models

Distribution Estimation under the Infinity Norm

Asymptotic Approximation of Inverse Moments of Nonnegative Random Variables

THE EB ESTIMATION OF PARAMETER IN TRUNCATED FAMILY WITH LINEX LOSS USING NA SAMPLES

SELF-NORMALIZED CENTRAL LIMIT THEOREM AND ESTIMATION OF VARIANCE OF PARTIAL SUMS FOR NEGATIVE DEPENDENT RANDOM VARIABLES

Characterizing the minimax rate of nonparametric regression under bounded convex constraints

Mini-Max-Risk and Mini-Mean-Risk Inferences for A Partially Piecewise Regression

A Central Limit Theorem in Non‐parametric Regression with Truncated, Censored and Dependent Data

Adaptive minimax estimation for discretely observed Lévy processes

CONFIDENCE INTERVALS FOR HIGH-DIMENSIONAL LINEAR REGRESSION: MINIMAX RATES AND ADAPTIVITY

A nonparametric maximum likelihood estimation for biased-sampling data with zero-inflated truncation

Quasi-minimax Estimation in the General Linear Regression Model

Limiting Distributions for the Minimum-Maximum Models