Simultaneous estimation and variable selection for a non-crossing multiple quantile regression using deep neural networks

Jungmin Shin,Seunghyun Gwak,Seung Jun Shin,Sungwan Bang
DOI: https://doi.org/10.1007/s11222-024-10418-4
IF: 2.3241
2024-03-23
Statistics and Computing
Abstract:In this paper, we present the DNN-NMQR estimator, an approach that utilizes a deep neural network structure to solve multiple quantile regression problems. When estimating multiple quantiles, our approach leverages the structural characteristics of DNN to enhance estimation results by encouraging shared learning across different quantiles through DNN-NMQR. Also, this method effectively addresses quantile crossing issues through the penalization method. To refine our methodology, we introduce a convolution-type quadratic smoothing function, ensuring that the objective function remains differentiable throughout. Furthermore, we provide a brief discussion on the convergence analysis of DNN-NMQR, drawing on the concept of the neural tangent kernel. For a high-dimensional case, we propose the (A)GDNN-NMQR estimator, which applies group-wise -type regularization methods and enjoys the advantages of quantile estimation and variable selection simultaneously. We extensively validate all of our proposed methods through numerical experiments and real data analysis.
statistics & probability,computer science, theory & methods
What problem does this paper attempt to address?