Post-traumatic osteochondroma.

R. T. Greyson-Fleg,J. Reichmister,E. McCarthy,M. Freedman

DOI: https://doi.org/10.1007/springerreference_39488

Abstract:

What problem does this paper attempt to address?

Bayesian Non-parametric Quantile Process Regression and Estimation of Marginal Quantile Effects

Steven G. Xu,Brian J. Reich

DOI: https://doi.org/10.48550/arXiv.2102.11309

2021-02-22

Methodology

Abstract:Flexible estimation of multiple conditional quantiles is of interest in numerous applications, such as studying the effect of pregnancy-related factors on low and high birth weight. We propose a Bayesian non-parametric method to simultaneously estimate non-crossing, non-linear quantile curves. We expand the conditional distribution function of the response in I-spline basis functions where the covariate-dependent coefficients are modeled using neural networks. By leveraging the approximation power of splines and neural networks, our model can approximate any continuous quantile function. Compared to existing models, our model estimates all rather than a finite subset of quantiles, scales well to high dimensions, and accounts for estimation uncertainty. While the model is arbitrarily flexible, interpretable marginal quantile effects are estimated using accumulative local effect plots and variable importance measures. A simulation study shows that our model can better recover quantiles of the response distribution when the data is sparse, and an analysis of birth weight data is presented.
Multivariate Density Estimation by Bayesian Sequential Partitioning

Luo Lu,Hui Jiang,Wing H. Wong

DOI: https://doi.org/10.1080/01621459.2013.813389

IF: 4.369

2013-01-01

Journal of the American Statistical Association

Abstract:Consider a class of densities that are piecewise constant functions over partitions of the sample space defined by sequential coordinate partitioning. We introduce a prior distribution for a density in this function class and derive in closed form the marginal posterior distribution of the corresponding partition. A computationally efficient method, based on sequential importance sampling, is presented for the inference of the partition from this posterior distribution. Compared to traditional approaches such as the kernel method or the histogram, the Bayesian sequential partitioning (BSP) method proposed here is capable of providing much more accurate estimates when the sample space is of moderate to high dimension. We illustrate this by simulated as well as real data examples. The examples also demonstrate how BSP can be used to design new classification methods competitive with the state of the art.
Bayesian nonparametric quantile process regression and estimation of marginal quantile effects

Steven G. Xu,Brian J. Reich

DOI: https://doi.org/10.1111/biom.13576

IF: 1.701

2021-11-10

Biometrics

Abstract:Flexible estimation of multiple conditional quantiles is of interest in numerous applications, such as studying the effect of pregnancy-related factors on low and high birth weight. We propose a Bayesian non-parametric method to simultaneously estimate non-crossing, non-linear quantile curves. We expand the conditional distribution function of the response in I-spline basis functions where the covariate-dependent coefficients are modeled using neural networks. By leveraging the approximation power of splines and neural networks, our model can approximate any continuous quantile function. Compared to existing models, our model estimates all rather than a finite subset of quantiles, scales well to high dimensions, and accounts for estimation uncertainty. While the model is arbitrarily flexible, interpretable marginal quantile effects are estimated using accumulative local effect plots and variable importance measures. A simulation study shows that our model can better recover quantiles of the response distribution when the data is sparse, and an analysis of birth weight data is presented.

statistics & probability,mathematical & computational biology,biology
Parametric and nonparametric probability distribution estimators of sample maximum

Taku Moriyama

2024-07-18

Abstract:Extreme value theory has constructed asymptotic properties of the sample maximum. This study concerns probability distribution estimation of the sample maximum. The traditional approach is parametric fitting to the limiting distribution -- the generalized extreme value distribution; however, the model in non-limiting cases is misspecified to a certain extent. We propose a plug-in type of nonparametric estimator that does not need model specification. Asymptotic properties of the distribution estimator are derived. The simulation study numerically investigates the relative performance in finite-sample cases. This study assumes that the underlying distribution of the original sample belongs to one of the Hall class, the Weibull class or the bounded class, whose types of the limiting distributions are all different: the Frechet, Gumbel or Weibull. It is proven that the convergence rate of the parametric fitting estimator depends on both the extreme value index and the second-order parameter and gets slower as the extreme value index tends to zero. On the other hand, the rate of the nonparametric estimator is proven to be independent of the extreme value index under certain conditions. The numerical performances of the parametric fitting estimator and the nonparametric estimator are compared, which shows that the nonparametric estimator performs better, especially for the extreme value index close to zero. Finally, we report two real case studies: the Potomac River peak stream flow (cfs) data and the Danish Fire Insurance data.

Statistics Theory
Adaptive Nonparametric Density Estimation with B-Spline Bases

Yanchun Zhao,Mengzhu Zhang,Qian Ni,Xuhui Wang

DOI: https://doi.org/10.3390/math11020291

IF: 2.4

2023-01-06

Mathematics

Abstract:Learning density estimation is important in probabilistic modeling and reasoning with uncertainty. Since B-spline basis functions are piecewise polynomials with local support, density estimation with B-splines shows its advantages when intensive numerical computations are involved in the subsequent applications. To obtain an optimal local density estimation with B-splines, we need to select the bandwidth (i.e., the distance of two adjacent knots) for uniform B-splines. However, the selection of bandwidth is challenging, and the computation is costly. On the other hand, nonuniform B-splines can improve on the approximation capability of uniform B-splines. Based on this observation, we perform density estimation with nonuniform B-splines. By introducing the error indicator attached to each interval, we propose an adaptive strategy to generate the nonuniform knot vector. The error indicator is an approximation of the information entropy locally, which is closely related to the number of kernels when we construct the nonuniform estimator. The numerical experiments show that, compared with the uniform B-spline, the local density estimation with nonuniform B-splines not only achieves better estimation results but also effectively alleviates the overfitting phenomenon caused by the uniform B-splines. The comparison with the existing estimation procedures, including the state-of-the-art kernel estimators, demonstrates the accuracy of our new method.

mathematics
A New Maximum Entropy Method for Estimation of Multimodal Probability Density Function

G. Li,Y. X. Wang,Y. Zeng,W. X. He

DOI: https://doi.org/10.1016/j.apm.2021.09.029

IF: 5.336

2021-01-01

Applied Mathematical Modelling

Abstract:The high-precision estimation of a multimodal probability density function is a difficult problem in many engineering fields. We propose a new method to improve the estimation accuracy based on the fractional moment-based maximum entropy method with a nonlinear transformation and a multi-peak recognition method. For the translation parameters in the nonlinear transformation, three approaches, such as sample-based least square polynomial fitting technique, sample-based kernel density estimation and classical maximum entropy method, are presented to determine the parameters. By adjusting the translation parameter, the valley of the probability density function curve can be translated to the position with a larger slope, and the distance between adjacent peaks is enlarged to avoid the wrong fitting form of the probability density function curve with multiple peaks. After the parameters of the transformation are obtained, the fractional moment-based maximum entropy method is applied to predict the probability density function of the transformed performance function. Two numerical examples are used to verify the accuracy and stability of the proposed method. Two engineering examples are introduced to illustrate the applicability and efficiency of the proposed method in the real-life engineering setting. It is concluded that the proposed method uses fewer moments with less additional calculation costs, and has good computational efficiency and applicability for the modeling of multi modal probability density functions, compared with the classical fractional moment-based maximum entropy method. (c) 2021 Elsevier Inc. All rights reserved.
Uncertain Maximum Likelihood Estimation with Application to Uncertain Regression Analysis

Waichon Lio,Baoding Liu

DOI: https://doi.org/10.1007/s00500-020-04951-3

IF: 3.732

2020-01-01

Soft Computing

Abstract:Regression analysis is a mathematical tool to estimate the relationship between explanatory variables and response variable. This paper defines a likelihood function in the sense of uncertain measure to represent the likelihood of unknown parameters. Furthermore, the method of maximum likelihood estimation is used for the parameter estimation of uncertain regression models, and the uncertainty distribution of the disturbance term is simultaneously calculated. Finally, some numerical examples are documented to illustrate the proposed method.
Empirical Density Estimation based on Spline Quasi-Interpolation with applications to Copulas clustering modeling

Cristiano Tamborrino,Antonella Falini,Francesca Mazzia

2024-02-18

Abstract:Density estimation is a fundamental technique employed in various fields to model and to understand the underlying distribution of data. The primary objective of density estimation is to estimate the probability density function of a random variable. This process is particularly valuable when dealing with univariate or multivariate data and is essential for tasks such as clustering, anomaly detection, and generative modeling. In this paper we propose the mono-variate approximation of the density using spline quasi interpolation and we applied it in the context of clustering modeling. The clustering technique used is based on the construction of suitable multivariate distributions which rely on the estimation of the monovariate empirical densities (marginals). Such an approximation is achieved by using the proposed spline quasi-interpolation, while the joint distributions to model the sought clustering partition is constructed with the use of copulas functions. In particular, since copulas can capture the dependence between the features of the data independently from the marginal distributions, a finite mixture copula model is proposed. The presented algorithm is validated on artificial and real datasets.

Machine Learning,Numerical Analysis
A hybrid nonparametric multivariate density estimator with applications to risk management

Juan LinXiming Wua Department of Finance,School of Economics,Wang Yanan Institute for Studies in Economics,Xiamen University,Xiamen,Chinab Department of Agricultural Economics,Texas A&M University,College Station,Texas,USA

DOI: https://doi.org/10.1080/07474938.2024.2334119

IF: 1.2

2024-04-18

Econometric Reviews

Abstract:Multivariate density estimation is plagued by the curse of dimensionality in theory and practice. We propose a hybrid density estimator of a multivariate density f that combines the strengths of the kernel estimator and the exponential series estimator. This estimator refines a preliminary kernel estimate f̂0 with a multiplicative correction that estimates the ratio r=f/f̂0 with an exponential series estimator. Thanks to the consistency of the pilot estimate, the coefficients of the series expansion tend to approach zero asymptotically. Accordingly, we design a thresholding method for basis function selection. A major obstacle of multivariate exponential series estimator is the calculation of its normalization factor. We resolve this difficulty with Monte Carlo integration, using the pilot kernel estimate as the trial density for importance sampling. This approach greatly enhances the practicality of the hybrid estimator. Numerical simulations demonstrate the good finite sample performance of the hybrid estimator. We present one empirical application in financial risk management.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Bivariate Distribution Regression with Application to Insurance Data

Yunyun Wang,Tatsushi Oka,Dan Zhu

2023-09-03

Abstract:Understanding variable dependence, particularly eliciting their statistical properties given a set of covariates, provides the mathematical foundation in practical operations management such as risk analysis and decision-making given observed circumstances. This article presents an estimation method for modeling the conditional joint distribution of bivariate outcomes based on the distribution regression and factorization methods. This method is considered semiparametric in that it allows for flexible modeling of both the marginal and joint distributions conditional on covariates without imposing global parametric assumptions across the entire distribution. In contrast to existing parametric approaches, our method can accommodate discrete, continuous, or mixed variables, and provides a simple yet effective way to capture distributional dependence structures between bivariate outcomes and covariates. Various simulation results confirm that our method can perform similarly or better in finite samples compared to the alternative methods. In an application to the study of a motor third-party liability insurance portfolio, the proposed method effectively estimates risk measures such as the conditional Value-at-Risk and Expected Shortfall. This result suggests that this semiparametric approach can serve as an alternative in insurance risk management.

Methodology,Econometrics,Risk Management,Applications
The Unit Folded Normal Distribution: A New Unit Probability Distribution with the Estimation Procedures, Quantile Regression Modeling and Educational Attainment Applications

Mustafa Ç. Korkmaz,Christophe Chesneau,Zehra Sedef Korkmaz

DOI: https://doi.org/10.13052/jrss0974-8024.15111

2022-04-26

Journal of Reliability and Statistical Studies

Abstract:In this paper, we develop a continuous distribution on the unit interval characterized by the distribution of the absolute hyperbolic tangent transformation of a random variable following the normal distribution. The lack of research on the prospect of hyperbolic transformations providing flexible distributions on the unit interval is a motivation for the study. First, we study it theoretically and discuss its properties of interest from a modeling point of view. In particular, it is shown that the proposed distribution accommodates various levels of skewness and kurtosis. Then, some statistical work is performed. We investigate diverse estimation methods for the involved parameters and evaluate their performance through two simulation studies. Subsequently, the quantile regression model derived from the proposed distribution is developed. Two real-world data applications of interest are provided. The first application is about the univariate modeling of the percentage of the educational attainment of some countries, which is one indicator of the education topic of the Better Life Index (BLI) of the Organization for Economic Co-operation and Development (OECD) countries. The second application is to explain the relationship between the percentage of educational attainment of some countries with one indicator of the work-life balance, safety, and health topics of BLI via median quantile regression modeling. For the considered data sets, the proposed distribution and quantile regression models show that they have better modeling abilities than competitive models under some comparison criteria. The results also indicate that covariates are (statistically) significant at any ordinary level of significance for the median response.

English Else
Maximum Entropy Discrimination Poisson Regression for Software Reliability Modeling

Sotirios P Chatzis,Andreas S Andreou

DOI: https://doi.org/10.1109/TNNLS.2015.2391171

Abstract:Reliably predicting software defects is one of the most significant tasks in software engineering. Two of the major components of modern software reliability modeling approaches are: 1) extraction of salient features for software system representation, based on appropriately designed software metrics and 2) development of intricate regression models for count data, to allow effective software reliability data modeling and prediction. Surprisingly, research in the latter frontier of count data regression modeling has been rather limited. More specifically, a lack of simple and efficient algorithms for posterior computation has made the Bayesian approaches appear unattractive, and thus underdeveloped in the context of software reliability modeling. In this paper, we try to address these issues by introducing a novel Bayesian regression model for count data, based on the concept of max-margin data modeling, effected in the context of a fully Bayesian model treatment with simple and efficient posterior distribution updates. Our novel approach yields a more discriminative learning technique, making more effective use of our training data during model inference. In addition, it allows of better handling uncertainty in the modeled data, which can be a significant problem when the training data are limited. We derive elegant inference algorithms for our model under the mean-field paradigm and exhibit its effectiveness using the publicly available benchmark data sets.
Pathology of the pleura: What the pulmonologists need to know

P. Cagle,T. Allen

DOI: https://doi.org/10.1111/j.1440-1843.2011.01957.x

2011-04-01

Abstract:Primary and metastatic pleural neoplasms, and non‐neoplastic pleural diseases, can have similar clinical, radiographic and gross features. However, treatments and prognoses of these diverse pleural conditions vary greatly. Accurate diagnosis of pleural disease is therefore extremely important, and histological interpretation of pleural biopsies is vital to rendering an accurate diagnosis. Smaller biopsies contribute to the difficulties in accurately characterizing pleural lesions, and immunostains are frequently employed in their assessment. Diffuse malignant mesothelioma, the most common primary pulmonary neoplasm, is rare; however, other less common primary pleural neoplasms, including solitary fibrous tumour, the most common benign primary pleural neoplasm, occur. These neoplasms are discussed. Also, non‐neoplastic pleural diseases, including granulomatous pleuritis, eosinophilic pleuritis and fibrous and fibrinous pleuritis, among other diseases, are discussed.
Multivariate Density Estimation via Adaptive Partitioning (I): Sieve MLE

Linxi Liu,Wing Hung Wong

DOI: https://doi.org/10.48550/arXiv.1401.2597

2015-08-20

Abstract:We study a non-parametric approach to multivariate density estimation. The estimators are piecewise constant density functions supported by binary partitions. The partition of the sample space is learned by maximizing the likelihood of the corresponding histogram on that partition. We analyze the convergence rate of the sieve maximum likelihood estimator, and reach a conclusion that for a relatively rich class of density functions the rate does not directly depend on the dimension. This suggests that, under certain conditions, this method is immune to the curse of dimensionality, in the sense that it is possible to get close to the parametric rate even in high dimensions. We also apply this method to several special cases, and calculate the explicit convergence rates respectively.

Statistics Theory,Methodology
Density Estimation by Monte Carlo and Quasi-Monte Carlo

Pierre L'Ecuyer,Florian Puchhammer

DOI: https://doi.org/10.48550/arXiv.2103.15976

2021-09-08

Abstract:Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods include histograms and kernel density estimators. In this review paper, we are interested instead in the situation where the observations are generated by Monte Carlo simulation from a model. Then, one can take advantage of variance reduction methods such as stratification, conditional Monte Carlo, and randomized quasi-Monte Carlo (RQMC), and obtain a more accurate density estimator than with standard Monte Carlo for a given computing budget. We discuss several ways of doing this, proposed in recent papers, with a focus on methods that exploit RQMC. A first idea is to directly combine RQMC with a standard kernel density estimator. Another one is to adapt a simulation-based derivative estimation method such as smoothed perturbation analysis or the likelihood ratio method to obtain a continuous estimator of the cdf, whose derivative is an unbiased estimator of the density. This can then be combined with RQMC. We summarize recent theoretical results with these approaches and give numerical illustrations of how they improve the convergence of the mean square integrated error.

Computation
Nonparametric forecasting of multivariate probability density functions

Dominque Guégan,Matteo Iacopini

DOI: https://doi.org/10.48550/arXiv.1803.06823

2018-03-19

Abstract:The study of dependence between random variables is the core of theoretical and applied statistics. Static and dynamic copula models are useful for describing the dependence structure, which is fully encrypted in the copula probability density function. However, these models are not always able to describe the temporal change of the dependence patterns, which is a key characteristic of financial data. We propose a novel nonparametric framework for modelling a time series of copula probability density functions, which allows to forecast the entire function without the need of post-processing procedures to grant positiveness and unit integral. We exploit a suitable isometry that allows to transfer the analysis in a subset of the space of square integrable functions, where we build on nonparametric functional data analysis techniques to perform the analysis. The framework does not assume the densities to belong to any parametric family and it can be successfully applied also to general multivariate probability density functions with bounded or unbounded support. Finally, a noteworthy field of application pertains the study of time varying networks represented through vine copula models. We apply the proposed methodology for estimating and forecasting the time varying dependence structure between the S\&P500 and NASDAQ indices.

Methodology
Bayesian Inference for Multivariate Monotone Densities

Kang Wang,Subhashis Ghosal

2023-06-08

Abstract:We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction, we put a prior on the step heights through binning and a Dirichlet distribution. An arbitrary piece-wise constant probability density is converted to a monotone one by a projection map, taking its $\mathbb{L}_1$-projection onto the space of monotone functions, which is subsequently normalized to integrate to one. We construct consistent Bayesian tests to test multivariate monotonicity of a probability density based on the $\mathbb{L}_1$-distance to the class of monotone functions. The test is shown to have a size going to zero and high power against alternatives sufficiently separated from the null hypothesis. To obtain a Bayesian credible interval for the value of the density function at an interior point with guaranteed asymptotic frequentist coverage, we consider a posterior quantile interval of an induced map transforming the function value to its value optimized over certain blocks. The limiting coverage is explicitly calculated and is seen to be higher than the credibility level used in the construction. By exploring the asymptotic relationship between the coverage and the credibility, we show that a desired asymptomatic coverage can be obtained exactly by starting with an appropriate credibility level.

Statistics Theory,Methodology
Conditional Density Estimation via Weighted Logistic Regressions

Yiping Guo,Howard D. Bondell

DOI: https://doi.org/10.48550/arXiv.2010.10896

2020-10-21

Abstract:Compared to the conditional mean as a simple point estimator, the conditional density function is more informative to describe the distributions with multi-modality, asymmetry or heteroskedasticity. In this paper, we propose a novel parametric conditional density estimation method by showing the connection between the general density and the likelihood function of inhomogeneous Poisson process models. The maximum likelihood estimates can be obtained via weighted logistic regressions, and the computation can be significantly relaxed by combining a block-wise alternating maximization scheme and local case-control sampling. We also provide simulation studies for illustration.

Methodology,Machine Learning
A branch cut approach to the probability density and distribution functions of a linear combination of central and non-central Chi-square random variables

Alfred Kume,Tomonari Sei,Andrew T. A. Wood

DOI: https://doi.org/10.48550/arXiv.2305.07434

2023-05-12

Abstract:The paper considers the distribution of a general linear combination of central and non-central chi-square random variables by exploring the branch cut regions that appear in the standard Laplace inversion process. Due to the original interest from the directional statistics, the focus of this paper is on the density function of such distributions and not on their cumulative distribution function. In fact, our results confirm that the latter is a special case of the former. Our approach provides new insight by generating alternative characterizations of the probability density function in terms of a finite number of feasible univariate integrals. In particular, the central cases seem to allow an interesting representation in terms of the branch cuts, while general degrees of freedom and non-centrality can be easily adopted using recursive differentiation. Numerical results confirm that the proposed approach works well while more transparency and therefore easier control in the accuracy is ensured.

Computation,Probability
Estimation of the area under a curve via several B-spline-based regression methods and applications

Mingmei Tian,Jihnhee Yu,Joonyeong Kim

DOI: https://doi.org/10.1080/10543406.2020.1730871

2020-07-03

Abstract:Estimating the area under a curve (AUC) is an important subject in many fields of medicine and science. The regression model using B-spline functions provides flexibility in curve fitting, making it suitable for AUC estimation with various types of nonlinear trends. Despite the versatility of the B-spline approach, comprehensive discussions regarding relevant AUC estimation techniques using B-spline functions and their comparison with existing methods cannot be found in extant literature. In this paper, we investigate AUC estimation using B-spline regression and B-spline regression with several penalties, as well as discuss corresponding inferences. We carry out an extensive Monte Carlo study to evaluate the performance of the proposed methods in various realistic pharmacokinetics and analytical chemistry data settings. We show that the proposed methods provide robust and reliable AUC estimation regardless of different types of nonlinear models from scientific and medical research areas. Our proposed method is appropriate for general AUC estimation since it does not require nonlinear model specifications and inference techniques corresponding to the specified model.

Post-traumatic osteochondroma.

Bayesian Non-parametric Quantile Process Regression and Estimation of Marginal Quantile Effects

Multivariate Density Estimation by Bayesian Sequential Partitioning

Bayesian nonparametric quantile process regression and estimation of marginal quantile effects

Parametric and nonparametric probability distribution estimators of sample maximum

Adaptive Nonparametric Density Estimation with B-Spline Bases

A New Maximum Entropy Method for Estimation of Multimodal Probability Density Function

Uncertain Maximum Likelihood Estimation with Application to Uncertain Regression Analysis

Empirical Density Estimation based on Spline Quasi-Interpolation with applications to Copulas clustering modeling

A hybrid nonparametric multivariate density estimator with applications to risk management

Bivariate Distribution Regression with Application to Insurance Data

The Unit Folded Normal Distribution: A New Unit Probability Distribution with the Estimation Procedures, Quantile Regression Modeling and Educational Attainment Applications

Maximum Entropy Discrimination Poisson Regression for Software Reliability Modeling

Pathology of the pleura: What the pulmonologists need to know

Multivariate Density Estimation via Adaptive Partitioning (I): Sieve MLE

Density Estimation by Monte Carlo and Quasi-Monte Carlo

Nonparametric forecasting of multivariate probability density functions

Bayesian Inference for Multivariate Monotone Densities

Conditional Density Estimation via Weighted Logistic Regressions

A branch cut approach to the probability density and distribution functions of a linear combination of central and non-central Chi-square random variables

Estimation of the area under a curve via several B-spline-based regression methods and applications