Abstract:Deep neural networks (DNNs) have achieved unprecedented success across many scientific and engineering fields in the last decades. Despite its empirical success, unfortunately, recent studies have shown that there are various failure modes and blindspots in DNN models which may result in unexpected serious failures and potential harms, e.g. the existence of adversarial examples and small perturbations. This is not acceptable especially for safety critical and high stakes applications in the real-world, including healthcare, self-driving cars, aircraft control systems, hiring and malware detection protocols. Moreover, it has been challenging to understand why and when DNNs will fail due to their complicated structures and black-box behaviors. Lacking interpretability is one critical issue that may seriously hinder the deployment of DNNs in high-stake applications, which need interpretability to trust the prediction, to understand potential failures, and to be able to mitigate harms and eliminate biases in the model. To make DNNs trustworthy and reliable for deployment, it is necessary and urgent to develop methods and tools that can (i) quantify and improve their robustness against adversarial and natural perturbations, and (ii) understand their underlying behaviors and further correct errors to prevent injuries and damages. These are the important first steps to enable Trustworthy AI and Trustworthy Machine Learning. In this talk, I will survey a series of research efforts in my lab contributed to tackling the grand challenges in (i) and (ii). In the first part of my talk, I will overview our research effort in Robust Machine Learning since 2017, where we have proposed the first attack-agnostic robustness evaluation metric, the first efficient robustness certification algorithms for various types of perturbations, and efficient robust learning algorithms across supervised learning to deep reinforcement learning. In the second part of my talk, I will survey a series of exciting results in my lab on accelerating interpretable machine learning and explainable AI. Specifically, I will show how we could bring interpretability into deep learning by leveraging recent advances in multi-modal models. I'll present recent works in our group on automatically dissecting neural networks with open vocabulary concepts, designing interpretable neural networks without concept labels, and briefly overview our recent efforts on demystifying black-box DNN training process, automated neuron explanations for Large Language Models and the first robustness evaluation of a family of neuron-level interpretation techniques.

AAAI New Faculty Highlights: General and Scalable Optimization for Robust AI

Beyond NaN: Resiliency of Optimization Layers in The Face of Infeasibility

Optimization and Optimizers for Adversarial Robustness

When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks

RobArch: Designing Robust Architectures against Adversarial Attacks

Adversarial robustness improvement for deep neural networks

Exploiting the Potential of Datasets: A Data-Centric Approach for Model Robustness

Optimism in the Face of Adversity: Understanding and Improving Deep Learning Through Adversarial Robustness

$A^{3}D$: A Platform of Searching for Robust Neural Architectures and Efficient Adversarial Attacks

Opportunities and Challenges in Deep Learning Adversarial Robustness: A Survey

Wasserstein distributional robustness of neural networks

Multi-objective Search of Robust Neural Architectures Against Multiple Types of Adversarial Attacks

Data-driven stochastic robust optimization: General computational framework and algorithm leveraging machine learning for optimization under uncertainty in the big data era

Towards Trustworthy Deep Learning

SoK: Certified Robustness for Deep Neural Networks

An ADMM-Based Universal Framework for Adversarial Attacks on Deep Neural Networks

SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms

Computational issues in Optimization for Deep networks

A constrained optimization approach to improve robustness of neural networks

A Direct Approach to Robust Deep Learning Using Adversarial Networks