Abstract:Performance reviews are intended to be objective, but all humans experience bias. While many companies opt for group reviews as a way to de-bias and challenge the status quo, what is being said in those meetings, how those comments are said and the context for those remarks are just as important. At the same time, most people’s attention span is of shorter duration than a review and being promoted depends on what bosses remember about their direct reports, their subjective measure of employee success, and their ability to convince others that employee accomplishments are deserving of a reward. As a result of these compounding factors, meta-bias patterns emerge in company culture. Combine those limitations with the fact that reviews are often a breeding ground for subtle — and not-so-subtle — bias, and it begs the question: Why are we not using technology to help? With developments in natural language processing (NLP) and conversational AI (CAI), computers can identify biased phrases in real time. Although these technologies have a long way to go to match human nuance, we can at least flag problematic phrases during something as significant as performance reviews. And with the right inputs rooted in social science and normalised based on geography, contextual relationships and culture, we could be surfacing insidious bias throughout organisations. This paper examines how a future CAI tool could reduce bias and, eventually, teach people to re-evaluate and reframe their thinking. In a performance review setting, the system would flag problematic phrases as they are said, and committee heads would stop the conversation. The committee would then evaluate the comment, ask the presenter for further information, and only continue once there is sufficient clarity. Once the discussion concludes, the review cycle would continue until another phrase is identified. The system serves to be persistently aware throughout all conversations and highlight potential bias for everyone to learn from. Beyond pointing out biased phrases during a performance review, a combination of NLP and CAI can serve as a foundation for company-wide analytics. Organisations can track who is speaking in a majority of meetings, what was said, who challenges biased phrases, whether or not certain types of people are misrepresented in reviews more or less frequently, and so on. All this information gives a fundamentally new picture of what is happening inside a company, laying the groundwork for human resource (HR)-related metrics that individuals (and the company as a whole) can improve over time.

Using AI to minimise bias in an employee performance review

AI-ENABLED INTERVIEW ANALYSIS: UNVEILING INSIGHTS AND ENHANCING DECISION-MAKING IN HUMAN RESOURCE MANAGEMENT

Saving face: Leveraging artificial intelligence‐based negative feedback to enhance employee job performance

A Comprehensive Review of AI Techniques for Addressing Algorithmic Bias in Job Hiring

Does AI Debias Recruitment? Race, Gender, and AI's "Eradication of Difference"

AI-Powered Employee Performance Evaluation Systems in HR Management

Navigating the Manager-AI Divide

Engineering Equity: How AI Can Help Reduce the Harm of Implicit Bias

A survey of recent methods for addressing AI fairness and bias in biomedicine

Hey ASR System! Why Aren't You More Inclusive? Automatic Speech Recognition Systems' Bias and Proposed Bias Mitigation Techniques. A Literature Review

Michael is better than Mehmet: exploring the perils of algorithmic biases and selective adherence to advice from automated decision support systems in hiring

AI for hiring in context: a perspective on overcoming the unique challenges of employment research to mitigate disparate impact

AI-Based Human Resource Management Tools and Techniques; A Systematic Literature Review

Fairness in AI-Driven Recruitment: Challenges, Metrics, Methods, and Future Directions

From Bias to Fairness: A Review of Ethical Considerations and Mitigation Strategies in Artificial Intelligence

Human-in-the-Loop AI Reviewing: Feasibility, Opportunities, and Risks

Can AI Algorithmic Decision-making Improve Employees’ Perception of Procedural Fairness?

Bias, Fairness and Accountability with Artificial Intelligence and Machine Learning Algorithms

Rolling in the deep of cognitive and AI biases

Human Bias in the Face of AI: The Role of Human Judgement in AI Generated Text Evaluation

AI-assisted peer review