An Efficient Multi Quantile Regression Network with Ad Hoc Prevention of Quantile Crossing

Jens Decke,Arne Jenß,Bernhard Sick,Christian Gruhl
2024-05-31
Abstract:This article presents the Sorting Composite Quantile Regression Neural Network (SCQRNN), an advanced quantile regression model designed to prevent quantile crossing and enhance computational efficiency. Integrating ad hoc sorting in training, the SCQRNN ensures non-intersecting quantiles, boosting model reliability and interpretability. We demonstrate that the SCQRNN not only prevents quantile crossing and reduces computational complexity but also achieves faster convergence than traditional models. This advancement meets the requirements of high-performance computing for sustainable, accurate computation. In organic computing, the SCQRNN enhances self-aware systems with predictive uncertainties, enriching applications across finance, meteorology, climate science, and engineering.
Machine Learning
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the phenomenon of **quantile crossing** in quantile regression. Specifically: 1. **Quantile Crossing Problem**: In traditional quantile regression models, the predicted quantiles may cross each other, which violates the basic principle that high - quantiles must be greater than or equal to low - quantiles. This phenomenon not only affects the interpretability of the model but also weakens the reliability of inferences drawn from the model. 2. **Computational Efficiency Problem**: Existing methods to prevent quantile crossing are often accompanied by high computational costs or rely on post - processing steps. These methods are especially impractical in scenarios of handling large - scale data sets or requiring real - time analysis, and the complexity may become an obstacle to practical applications. 3. **Environmental Sustainability Problem**: In the field of high - performance computing (HPC), the intersection of computational efficiency and sustainable computing is becoming increasingly important. Especially in neural network quantile regression, traditional processing methods usually lead to significant energy consumption, raising concerns about ecological impacts. To address these problems, the paper proposes a new method - **Sorted Composite Quantile Regression Neural Network (SCQRNN)**. SCQRNN ensures that quantiles do not cross by integrating sorting operations during the training process, while improving computational efficiency and model reliability. Specific contributions include: - Developing a more efficient non - crossing quantile regression model. - Conducting a theoretical complexity analysis of the proposed algorithm. - Performing a comparative analysis of the proposed method with the existing state - of - the - art models using nine data sets, evaluating the root - mean - square error (RMSE) and overall reliability. - Studying the convergence speed and comparing it with a reasonable baseline model on practical problems. Through these improvements, SCQRNN not only solves the quantile - crossing problem but also significantly reduces the computational time and resource requirements, maintaining the accuracy and robustness of the model.