Abstract:The ability to evaluate uncertainties in evolving data streams has become equally, if not more, crucial than building a static predictor. For instance, during the pandemic, a model should consider possible uncertainties such as governmental policies, meteorological features, and vaccination schedules. Neural process families (NPFs) have recently shone a light on predicting such uncertainties by bridging Gaussian processes (GPs) and neural networks (NNs). Their abilities to output average predictions and the acceptable variances, i.e., uncertainties, made them suitable for predictions with insufficient data, such as meta-learning or few-shot learning. However, existing models have not addressed continual learning which imposes a stricter constraint on the data access. Regarding this, we introduce a member meta-continual learning with neural process (MCLNP) for uncertainty estimation. We enable two levels of uncertainty estimations: the local uncertainty on certain points and the global uncertainty p(z) that represents the function evolution in dynamic environments. To facilitate continual learning, we hypothesize that the previous knowledge can be applied to the current task, hence adopt a coreset as a memory buffer to alleviate catastrophic forgetting. The relationships between the degree of global uncertainties with the intratask diversity and model complexity are discussed. We have estimated prediction uncertainties with multiple evolving types including abrupt/gradual/recurrent shifts. The applications encompass meta-continual learning in the 1-D, 2-D datasets, and a novel spatial-temporal COVID dataset. The results show that our method outperforms the baselines on the likelihood and can rebound quickly even for heavily evolved data streams.

Dynamic ensemble of regression neural networks based on predictive uncertainty

Dynamically Weighted Ensemble Neural Networks with Generalized Regression Neural Network for Solving Regression Problems

Dynamically Weighted Ensemble Neural Networks for Regression Problems

A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

Uncertainty Estimation With Neural Processes for Meta-Continual Learning

Why have a Unified Predictive Uncertainty? Disentangling it using Deep Split Ensembles

Divergent Ensemble Networks: Enhancing Uncertainty Estimation with Shared Representations and Independent Branching

Dynamic Post-Hoc Neural Ensemblers

Dynamic ensemble selection based on Deep Neural Network Uncertainty Estimation for Adversarial Robustness

A Graph Neural Network Based Decentralized Learning Scheme

Sequential Bayesian Neural Subnetwork Ensembles

Confidence-Nets: A Step Towards better Prediction Intervals for regression Neural Networks on small datasets

Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning

Human Uncertainty Inference via Deterministic Ensemble Neural Networks

Adaptive Neural Network Ensemble Using Frequency Distribution

Multi-Loss Sub-Ensembles for Accurate Classification with Uncertainty Estimation

Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts

DropConnect Is Effective in Modeling Uncertainty of Bayesian Deep Networks

Uncertainty propagation for dropout-based Bayesian neural networks

RNEP: Random Node Entropy Pairing for Efficient Decentralized Training with Non-IID Local Data

Towards Reliable Uncertainty Quantification via Deep Ensembles in Multi-output Regression Task