Abstract:Deep neural networks (DNNs) have received tremendous attention and achieved great success in various applications, such as image and video analysis, natural language processing, recommendation systems, and drug discovery. However, inherent uncertainties derived from different root causes have been realized as serious hurdles for DNNs to find robust and trustworthy solutions for real-world problems. A lack of consideration of such uncertainties may lead to unnecessary risk. For example, a self-driving autonomous car can misdetect a human on the road. A deep learning-based medical assistant may misdiagnose cancer as a benign tumor. In this work, we study how to measure different uncertainty causes for DNNs and use them to solve diverse decision-making problems more effectively. In the first part of this thesis, we develop a general learning framework to quantify multiple types of uncertainties caused by different root causes, such as vacuity (i.e., uncertainty due to a lack of evidence) and dissonance (i.e., uncertainty due to conflicting evidence), for graph neural networks. We provide a theoretical analysis of the relationships between different uncertainty types. We further demonstrate that dissonance is most effective for misclassification detection and vacuity is most effective for Out-of-Distribution (OOD) detection. In the second part of the thesis, we study the significant impact of OOD objects on semi-supervised learning (SSL) for DNNs and develop a novel framework to improve the robustness of existing SSL algorithms against OODs. In the last part of the thesis, we create a general learning framework to quantity multiple uncertainty types for multi-label temporal neural networks. We further develop novel uncertainty fusion operators to quantify the fused uncertainty of a subsequence for early event detection.

Lightweight Approaches to DNN Regression Error Reduction: an Uncertainty Alignment Perspective.

Dynamically Weighted Ensemble Neural Networks for Regression Problems

A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

Wordreg: Mitigating the Gap Between Training and Inference with Worst-Case Drop Regularization

Improving Fault Tolerance for Reliable DNN Using Boundary-Aware Activation

Likelihood Annealing: Fast Calibrated Uncertainty for Regression

Uncertainty Quantification Metrics for Deep Regression

Multi-Loss Sub-Ensembles for Accurate Classification with Uncertainty Estimation

A Novel Regression Loss for Non-Parametric Uncertainty Optimization

Towards reliable uncertainty quantification via deep ensemble in multi-output regression task

Towards Reliable Uncertainty Quantification via Deep Ensembles in Multi-output Regression Task

Addressing Deep Learning Model Calibration Using Evidential Neural Networks And Uncertainty-Aware Training

Multidimensional Uncertainty Quantification for Deep Neural Networks

Reliability Assurance for Deep Neural Network Architectures Against Numerical Defects

Risk-Controlled Selective Prediction For Regression Deep Neural Network Models

DropConnect Is Effective in Modeling Uncertainty of Bayesian Deep Networks

Accurate Uncertainties for Deep Learning Using Calibrated Regression

Scalable and Efficient Methods for Uncertainty Estimation and Reduction in Deep Learning

Deep Neural Network Confidence Calibration from Stochastic Weight Averaging

Towards Regression-Free Neural Networks for Diverse Compute Platforms

SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates