Abstract:The trustworthiness of machine learning has emerged as a critical topic in the field, encompassing various applications and research areas such as robustness, security, interpretability, and fairness. The last decade saw the development of numerous methods addressing these challenges. In this survey, we systematically review these advancements from a data-centric perspective, highlighting the shortcomings of traditional empirical risk minimization (ERM) training in handling challenges posed by the data. Interestingly, we observe a convergence of these methods, despite being developed independently across trustworthy machine learning subfields. Pearl's hierarchy of causality offers a unifying framework for these techniques. Accordingly, this survey presents the background of trustworthy machine learning development using a unified set of concepts, connects this language to Pearl's causal hierarchy, and finally discusses methods explicitly inspired by causality literature. We provide a unified language with mathematical vocabulary to link these methods across robustness, adversarial robustness, interpretability, and fairness, fostering a more cohesive understanding of the field. Further, we explore the trustworthiness of large pretrained models. After summarizing dominant techniques like fine-tuning, parameter-efficient fine-tuning, prompting, and reinforcement learning with human feedback, we draw connections between them and the standard ERM. This connection allows us to build upon the principled understanding of trustworthy methods, extending it to these new techniques in large pretrained models, paving the way for future methods. Existing methods under this perspective are also reviewed. Lastly, we offer a brief summary of the applications of these methods and discuss potential future aspects related to our survey. For more information, please visit <a class="link-external link-http" href="http://trustai.one" rel="external noopener nofollow">this http URL</a>.

Stable learning establishes some common ground between causal inference and machine learning

Towards Understanding How Machines Can Learn Causal Overhypotheses

When causal inference meets deep learning

From Dependence to Causation

Causal Inference Meets Machine Learning

Promises and Challenges of Causality for Ethical Machine Learning

Can predictive models be used for causal inference?

Deep Causal Learning: Representation, Discovery and Inference

Causality Learning: A New Perspective for Interpretable Machine Learning

Causal Inference and Counterfactual Prediction in Machine Learning for Actionable Healthcare

Toward Causal Representation Learning

Causal Inference Meets Deep Learning: A Comprehensive Survey

Causal inference in AI education: A primer

Explaining the Behavior of Black-Box Prediction Algorithms with Causal Learning

Causal Machine Learning: A Survey and Open Problems

Active and Passive Causal Inference Learning

Recent Developments in Causal Inference and Machine Learning

Stable Learning via Causality-based Feature Rectification

Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives

The Causal-Neural Connection: Expressiveness, Learnability, and Inference

Alleviating Privacy Attacks via Causal Learning