Abstract:There has been a surge of recent interest in sociocultural diversity in machine learning (ML) research, with researchers (i) examining the benefits of diversity as an organizational solution for alleviating problems with algorithmic bias, and (ii) proposing measures and methods for implementing diversity as a design desideratum in the construction of predictive algorithms. Currently, however, there is a gap between discussions of measures and benefits of diversity in ML, on the one hand, and the broader research on the underlying concepts of diversity and the precise mechanisms of its functional benefits, on the other. This gap is problematic because diversity is not a monolithic concept. Rather, different concepts of diversity are based on distinct rationales that should inform how we measure diversity in a given context. Similarly, the lack of specificity about the precise mechanisms underpinning diversity's potential benefits can result in uninformative generalities, invalid experimental designs, and illicit interpretations of findings. In this work, we draw on research in philosophy, psychology, and social and organizational sciences to make three contributions: First, we introduce a taxonomy of different diversity concepts from philosophy of science, and explicate the distinct epistemic and political rationales underlying these concepts. Second, we provide an overview of mechanisms by which diversity can benefit group performance. Third, we situate these taxonomies--of concepts and mechanisms--in the lifecycle of sociotechnical ML systems and make a case for their usefulness in fair and accountable ML. We do so by illustrating how they clarify the discourse around diversity in the context of ML systems, promote the formulation of more precise research questions about diversity's impact, and provide conceptual tools to further advance research and practice.

Diversity in Machine Learning

Diversity in Sociotechnical Machine Learning Systems

On Diversity in Discriminative Neural Networks

Position: Measure Dataset Diversity, Don't Just Claim It

Addressing Complexities of Machine Learning in Big Data: Principles, Trends and Challenges from Systematical Perspectives

Diversity from Human Feedback

On the Diversity of Synthetic Data and its Impact on Training Large Language Models

Diversification on Big Data in Query Processing

Diversity Analysis on Imbalanced Data Sets by Using Ensemble Models

Feature diversity in self-supervised learning

Recent Advances in Diversified Recommendation

Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data

Diversity Learning: Introducing the Space-time Scheme to Ensemble Learning

Diversify and Conquer: Diversity-Centric Data Selection with Iterative Refinement

Diversity Measurement and Subset Selection for Instruction Tuning Datasets

Diversity Boosted Learning for Domain Generalization with Large Number of Domains

D3: Data Diversity Design for Systematic Generalization in Visual Question Answering

An Analysis of Diversity Measures

Exploiting Sample Diversity in Distributed Machine Learning Systems.

Neural diversity is key to collective artificial learning