Abstract:Evidential Deep Learning (EDL) is an emerging method for uncertainty estimation that provides reliable predictive uncertainty in a single forward pass, attracting significant attention. Grounded in subjective logic, EDL derives Dirichlet concentration parameters from neural networks to construct a Dirichlet probability density function (PDF), modeling the distribution of class probabilities. Despite its success, EDL incorporates several nonessential settings: In model construction, (1) a commonly ignored prior weight parameter is fixed to the number of classes, while its value actually impacts the balance between the proportion of evidence and its magnitude in deriving predictive scores. In model optimization, (2) the empirical risk features a variance-minimizing optimization term that biases the PDF towards a Dirac delta function, potentially exacerbating overconfidence. (3) Additionally, the structural risk typically includes a KL-divergence-minimizing regularization, whose optimization direction extends beyond the intended purpose and contradicts common sense, diminishing the information carried by the evidence magnitude. Therefore, we propose Re-EDL, a simplified yet more effective variant of EDL, by relaxing the nonessential settings and retaining the essential one, namely, the adoption of projected probability from subjective logic. Specifically, Re-EDL treats the prior weight as an adjustable hyperparameter rather than a fixed scalar, and directly optimizes the expectation of the Dirichlet PDF provided by deprecating both the variance-minimizing optimization term and the divergence regularization term. Extensive experiments and state-of-the-art performance validate the effectiveness of our method. The source code is available at <a class="link-external link-https" href="https://github.com/MengyuanChen21/Re-EDL" rel="external noopener nofollow">this https URL</a>.

Evidential Regression by Synthesizing Feature Selection and Parameters Learning

An Interactive Nonparametric Evidential Regression Algorithm with Instance Selection

A Data-Driven Evidential Regression Model for Building Hourly Energy Consumption Prediction with Feature Selection and Parameters Learning

Uncertainty Regularized Evidential Regression

Minimizing neighborhood evidential decision error for feature evaluation and selection based on evidence theory

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Revisiting Essential and Nonessential Settings of Evidential Deep Learning

Ensemble with Divisive Bagging for Feature Selection in Big Data

A semi-parametric approach to feature selection in high-dimensional linear regression models

Joint Optimization of Feature Selection and Parameters for Support Vector Regression

Regression Analysis of Belief Functions on Interval-Valued Variables: Comparative Studies

Symbolic Regression as Feature Engineering Method for Machine and Deep Learning Regression Tasks

Parameters learning in evidential network deducing using unite-believe value

Empirical Likelihood-based Inference for Single-index EV Models with Validation Data

Feature Selection Via Joint Embedding Learning and Sparse Regression

The Evidence Contraction Issue in Deep Evidential Regression: Discussion and Solution

A novel relational regularization feature selection method for joint regression and classification in AD diagnosis

Regression-test model for high dimensional feature selection

KERNEL ENTROPY-BASED UNSUPERVISED SPECTRAL FEATURE SELECTION

ELBD: Efficient score algorithm for feature selection on latent variables of VAE