Abstract:Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it is well-known that deep models trained via maximum likelihood estimation tend to be overconfident and give poorly-calibrated predictions. Bayesian deep learning attempts to address this by placing priors on the model parameters, which are then combined with a likelihood to perform posterior inference. Unfortunately, for deep models, the true posterior is intractable, forcing the user to resort to approximations. In this thesis, we explore the use of variational inference (VI) as an approximation, as it is unique in simultaneously approximating the posterior and providing a lower bound to the marginal likelihood. If tight enough, this lower bound can be used to optimize hyperparameters and to facilitate model selection. However, this capacity has rarely been used to its full extent for Bayesian neural networks, likely because the approximate posteriors typically used in practice can lack the flexibility to effectively bound the marginal likelihood. We therefore explore three aspects of Bayesian learning for deep models: 1) we ask whether it is necessary to perform inference over as many parameters as possible, or whether it is reasonable to treat many of them as optimizable hyperparameters; 2) we propose a variational posterior that provides a unified view of inference in Bayesian neural networks and deep Gaussian processes; 3) we demonstrate how VI can be improved in certain deep Gaussian process models by analytically removing symmetries from the posterior, and performing inference on Gram matrices instead of features. We hope that our contributions will provide a stepping stone to fully realize the promises of VI in the future.

Exploring Variational Deep Q Networks

Amortized Variational Deep Q Network.

Towards Improved Variational Inference for Deep Bayesian Models

Variational Quantum Circuits for Deep Reinforcement Learning

Deterministic Variational Inference for Robust Bayesian Neural Networks

Curiosity-Driven Variational Autoencoder for Deep Q Network

Enhancing Variational Quantum Circuit Training: An Improved Neural Network Approach for Barren Plateau Mitigation

Variational Optimization for Quantum Problems using Deep Generative Networks

Optimizing Variational Quantum Neural Networks Based on Collective Intelligence

SVQN: Sequential Variational Soft Q-Learning Networks

Variational learning for quantum artificial neural networks

Variational Neural-Network Ansatz for Continuum Quantum Field Theory

Variational Adaptive-Newton Method for Explorative Learning

Leveraging Pre-Trained Neural Networks to Enhance Machine Learning with Variational Quantum Circuits

Neural Variational Inference and Learning in Belief Networks

Variational Learning of Bayesian Neural Networks Via Bayesian Dark Knowledge

Variational Probability Flow for Biologically Plausible Training of Deep Neural Networks.

Toward Neural Network Simulation of Variational Quantum Algorithms

Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors

QNEAT: Natural Evolution of Variational Quantum Circuit Architecture

Variational Stochastic Gradient Descent for Deep Neural Networks