Abstract:Fairness in machine learning (ML) applications is an important practice for developers in research and industry. In ML applications, unfairness is triggered due to bias in the data, curation process, erroneous assumptions, and implicit bias rendered within the algorithmic development process. As ML applications come into broader use developing fair ML applications is critical. Literature suggests multiple views on how fairness in ML is described from the users perspective and students as future developers. In particular, ML developers have not been the focus of research relating to perceived fairness. This paper reports on a pilot investigation of ML developers perception of fairness. In describing the perception of fairness, the paper performs an exploratory pilot study to assess the attributes of this construct using a systematic focus group of developers. In the focus group, we asked participants to discuss three questions- 1) What are the characteristics of fairness in ML? 2) What factors influence developers belief about the fairness of ML? and 3) What practices and tools are utilized for fairness in ML development? The findings of this exploratory work from the focus group show that to assess fairness developers generally focus on the overall ML application design and development, i.e., business-specific requirements, data collection, pre-processing, in-processing, and post-processing. Thus, we conclude that the procedural aspects of organizational justice theory can explain developers perception of fairness. The findings of this study can be utilized further to assist development teams in integrating fairness in the ML application development lifecycle. It will also motivate ML developers and organizations to develop best practices for assessing the fairness of ML-based applications.

It is Giving Major Satisfaction: Why Fairness Matters for Developers

Understanding Fairness in Software Engineering: Insights from Stack Exchange

Assessing Perceived Fairness from Machine Learning Developer's Perspective

Software Fairness Debt

How fair are we? From conceptualization to automated assessment of fairness definitions

"It's the most fair thing to do but it doesn't make any sense": Perceptions of Mathematical Fairness Notions by Hiring Professionals

Navigating Fairness: Practitioners' Understanding, Challenges, and Strategies in AI/ML Development

Assessing the Fairness of AI Systems: AI Practitioners' Processes, Challenges, and Needs for Support

Fairness Perceptions of Artificial Intelligence: A Review and Path Forward

Understanding Relations Between Perception of Fairness and Trust in Algorithmic Decision Making

Improving fairness in machine learning systems: What do industry practitioners need?

Fairness testing: testing software for discrimination

Fairness Preferences, Actual and Hypothetical: A Study of Crowdworker Incentives

Data-Driven Analysis of Gender Fairness in the Software Engineering Academic Landscape

From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits?

From Literature to Practice: Exploring Fairness Testing Tools for the Software Industry Adoption

Preliminary Insights on Industry Practices for Addressing Fairness Debt

Perception of fairness in algorithmic decisions: Future developers' perspective

Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey

The Pursuit of Fairness in Artificial Intelligence Models: A Survey

The fairness of human resource management practices: an assessment by the justice sensitive